Sep 10 20:54:58.423282 ip-10-0-129-100 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 10 20:54:58.423293 ip-10-0-129-100 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 10 20:54:58.423300 ip-10-0-129-100 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 10 20:54:58.423453 ip-10-0-129-100 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 10 20:55:08.534196 ip-10-0-129-100 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 10 20:55:08.534213 ip-10-0-129-100 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 54e910f7f36a48b88d6858312a959757 --
Sep 10 20:56:57.979548 ip-10-0-129-100 systemd[1]: Starting Kubernetes Kubelet...
Sep 10 20:56:58.345302 ip-10-0-129-100 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 20:56:58.345302 ip-10-0-129-100 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 10 20:56:58.345302 ip-10-0-129-100 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 20:56:58.345302 ip-10-0-129-100 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 10 20:56:58.345302 ip-10-0-129-100 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 20:56:58.347147 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.347061    2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 10 20:56:58.352841 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.352826    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 20:56:58.352841 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.352840    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 20:56:58.352903 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.352846    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 20:56:58.352903 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.352850    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 20:56:58.352903 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.352854    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 20:56:58.352903 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.352857    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 20:56:58.352903 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.352860    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 20:56:58.352903 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.352863    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 20:56:58.352903 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.352866    2564 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 20:56:58.352903 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.352869    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 20:56:58.352903 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.352872    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 20:56:58.352903 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.352875    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 20:56:58.352903 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.352878    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 20:56:58.352903 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.352881    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 20:56:58.352903 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.352883    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 20:56:58.352903 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.352886    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 20:56:58.352903 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.352888    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 20:56:58.352903 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.352891    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 20:56:58.352903 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.352894    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 20:56:58.352903 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.352896    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 20:56:58.352903 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.352899    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 20:56:58.352903 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.352902    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 20:56:58.353388 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.352904    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 20:56:58.353388 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.352907    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 20:56:58.353388 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.352910    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 20:56:58.353388 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.352913    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 20:56:58.353388 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.352915    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 20:56:58.353388 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.352918    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 20:56:58.353388 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.352921    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 20:56:58.353388 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.352923    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 20:56:58.353388 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.352926    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 20:56:58.353388 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.352928    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 20:56:58.353388 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.352932    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 20:56:58.353388 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.352936    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 20:56:58.353388 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.352939    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 20:56:58.353388 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.352942    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 20:56:58.353388 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.352945    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 20:56:58.353388 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.352947    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 20:56:58.353388 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.352950    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 20:56:58.353388 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.352954    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 20:56:58.353388 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.352956    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 20:56:58.353891 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.352958    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 20:56:58.353891 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.352961    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 20:56:58.353891 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.352964    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 20:56:58.353891 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.352966    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 20:56:58.353891 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.352969    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 20:56:58.353891 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.352971    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 20:56:58.353891 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.352974    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 20:56:58.353891 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.352976    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 20:56:58.353891 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.352979    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 20:56:58.353891 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.352988    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 20:56:58.353891 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.352992    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 20:56:58.353891 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.352995    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 20:56:58.353891 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.352997    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 20:56:58.353891 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353000    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 20:56:58.353891 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353003    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 20:56:58.353891 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353006    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 20:56:58.353891 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353009    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 20:56:58.353891 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353012    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 20:56:58.353891 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353014    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 20:56:58.353891 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353017    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 20:56:58.354400 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353020    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 20:56:58.354400 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353022    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 20:56:58.354400 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353025    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 20:56:58.354400 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353028    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 20:56:58.354400 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353030    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 20:56:58.354400 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353033    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 20:56:58.354400 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353035    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 20:56:58.354400 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353038    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 20:56:58.354400 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353040    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 20:56:58.354400 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353043    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 20:56:58.354400 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353046    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 20:56:58.354400 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353049    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 20:56:58.354400 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353052    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 20:56:58.354400 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353054    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 20:56:58.354400 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353057    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 20:56:58.354400 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353059    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 20:56:58.354400 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353062    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 20:56:58.354400 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353065    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 20:56:58.354400 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353067    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 20:56:58.354400 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353070    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 20:56:58.354884 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353072    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 20:56:58.354884 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353075    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 20:56:58.354884 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353077    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 20:56:58.354884 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353081    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 20:56:58.354884 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353084    2564 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 20:56:58.354884 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353087    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 20:56:58.354884 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353091    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 20:56:58.354884 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353094    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 20:56:58.354884 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353097    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 20:56:58.354884 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353100    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 20:56:58.354884 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353103    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 20:56:58.354884 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353106    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 20:56:58.354884 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353109    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 20:56:58.354884 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353112    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 20:56:58.354884 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353114    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 20:56:58.354884 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353117    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 20:56:58.354884 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353120    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 20:56:58.354884 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353123    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 20:56:58.354884 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353807    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 20:56:58.355345 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353814    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 20:56:58.355345 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353818    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 20:56:58.355345 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353821    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 20:56:58.355345 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353824    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 20:56:58.355345 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353828    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 20:56:58.355345 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353831    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 20:56:58.355345 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353834    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 20:56:58.355345 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353837    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 20:56:58.355345 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353840    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 20:56:58.355345 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353842    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 20:56:58.355345 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353845    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 20:56:58.355345 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353849    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 20:56:58.355345 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353853    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 20:56:58.355345 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353856    2564 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 20:56:58.355345 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353858    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 20:56:58.355345 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353861    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 20:56:58.355345 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353864    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 20:56:58.355345 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353866    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 20:56:58.355345 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353869    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 20:56:58.355345 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353873    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 20:56:58.355840 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353876    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 20:56:58.355840 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353878    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 20:56:58.355840 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353882    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 20:56:58.355840 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353884    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 20:56:58.355840 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353887    2564 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 20:56:58.355840 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353889    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 20:56:58.355840 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353892    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 20:56:58.355840 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353895    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 20:56:58.355840 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353898    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 20:56:58.355840 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353900    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 20:56:58.355840 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353903    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 20:56:58.355840 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353906    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 20:56:58.355840 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353908    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 20:56:58.355840 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353911    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 20:56:58.355840 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353913    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 20:56:58.355840 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353916    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 20:56:58.355840 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353918    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 20:56:58.355840 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353921    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 20:56:58.355840 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353925    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 20:56:58.355840 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353929    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 20:56:58.356334 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353932    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 20:56:58.356334 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353934    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 20:56:58.356334 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353937    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 20:56:58.356334 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353940    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 20:56:58.356334 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353943    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 20:56:58.356334 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353946    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 20:56:58.356334 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353948    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 20:56:58.356334 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353951    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 20:56:58.356334 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353954    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 20:56:58.356334 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353956    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 20:56:58.356334 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353959    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 20:56:58.356334 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353962    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 20:56:58.356334 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353965    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 20:56:58.356334 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353967    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 20:56:58.356334 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353970    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 20:56:58.356334 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353972    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 20:56:58.356334 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353976    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 20:56:58.356334 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353979    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 20:56:58.356334 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353981    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 20:56:58.356334 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353984    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 20:56:58.356840 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353986    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 20:56:58.356840 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353989    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 20:56:58.356840 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353991    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 20:56:58.356840 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353994    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 20:56:58.356840 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353996    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 20:56:58.356840 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.353999    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 20:56:58.356840 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354001    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 20:56:58.356840 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354004    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 20:56:58.356840 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354006    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 20:56:58.356840 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354009    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 20:56:58.356840 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354012    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 20:56:58.356840 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354014    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 20:56:58.356840 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354017    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 20:56:58.356840 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354019    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 20:56:58.356840 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354022    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 20:56:58.356840 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354024    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 20:56:58.356840 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354027    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 20:56:58.356840 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354029    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 20:56:58.356840 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354032    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 20:56:58.357407 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354035    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 20:56:58.357407 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354037    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 20:56:58.357407 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354040    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 20:56:58.357407 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354042    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 20:56:58.357407 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354048    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 20:56:58.357407 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354050    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 20:56:58.357407 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354053    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 20:56:58.357407 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354056    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 20:56:58.357407 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354058    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 20:56:58.357407 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354061    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 20:56:58.357407 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354064    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 20:56:58.357407 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354066    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 20:56:58.357407 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354069    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 20:56:58.357407 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354071    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 20:56:58.357407 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354075    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 20:56:58.357407 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354079    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 20:56:58.357407 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354082    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 20:56:58.357407 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354085    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 20:56:58.357407 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354088    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 20:56:58.357407 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354456    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 20:56:58.357912 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354462    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 20:56:58.357912 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354465    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 20:56:58.357912 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354468    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 20:56:58.357912 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354471    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 20:56:58.357912 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354474    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 20:56:58.357912 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354477    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 20:56:58.357912 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354481    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 20:56:58.357912 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354484    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 20:56:58.357912 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354487    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 20:56:58.357912 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354490    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 20:56:58.357912 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354493    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 20:56:58.357912 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354495    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 20:56:58.357912 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354498    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 20:56:58.357912 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354501    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 20:56:58.357912 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354504    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 20:56:58.357912 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354506    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 20:56:58.357912 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354509    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 20:56:58.357912 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354512    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 20:56:58.357912 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354515    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 20:56:58.357912 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354517    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 20:56:58.358403 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354520    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 20:56:58.358403 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354523    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 20:56:58.358403 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354525    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 20:56:58.358403 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354528    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 20:56:58.358403 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354530    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 20:56:58.358403 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354533    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 20:56:58.358403 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354536    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 20:56:58.358403 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354538    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 20:56:58.358403 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354540    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 20:56:58.358403 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354543    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 20:56:58.358403 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354545    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 20:56:58.358403 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354548    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 20:56:58.358403 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354550    2564 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 20:56:58.358403 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354553    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 20:56:58.358403 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354556    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 20:56:58.358403 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354558    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 20:56:58.358403 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354562    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 20:56:58.358403 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354564    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 20:56:58.358403 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354567    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 20:56:58.358403 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354570    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 20:56:58.358895 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354572    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 20:56:58.358895 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354575    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 20:56:58.358895 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354577    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 20:56:58.358895 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354580    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 20:56:58.358895 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354582    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 20:56:58.358895 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354585    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 20:56:58.358895 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354587    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 20:56:58.358895 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354590    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 20:56:58.358895 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354593    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 20:56:58.358895 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354595    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 20:56:58.358895 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354598    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 20:56:58.358895 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354601    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 20:56:58.358895 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354604    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 20:56:58.358895 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354606    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 20:56:58.358895 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354609    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 20:56:58.358895 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354611    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 20:56:58.358895 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354614    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 20:56:58.358895 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354616    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 20:56:58.358895 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354619    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 20:56:58.359381 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354621    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 20:56:58.359381 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354624    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 20:56:58.359381 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354626    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 20:56:58.359381 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354629    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 20:56:58.359381 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354632    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 20:56:58.359381 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354634    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 20:56:58.359381 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354641    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 20:56:58.359381 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354644    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 20:56:58.359381 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354647    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 20:56:58.359381 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354649    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 20:56:58.359381 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354652    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 20:56:58.359381 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354655    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 20:56:58.359381 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354657    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 20:56:58.359381 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354660    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 20:56:58.359381 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354662    2564 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 20:56:58.359381 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354665    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 20:56:58.359381 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354667    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 20:56:58.359381 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354670    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 20:56:58.359381 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354674    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 20:56:58.359381 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354677    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 20:56:58.359862 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354680    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 20:56:58.359862 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354683    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 20:56:58.359862 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354686    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 20:56:58.359862 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354688    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 20:56:58.359862 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354691    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 20:56:58.359862 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354694    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 20:56:58.359862 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354696    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 20:56:58.359862 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354699    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 20:56:58.359862 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354702    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 20:56:58.359862 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354704    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 20:56:58.359862 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354708    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 20:56:58.359862 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354710    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 20:56:58.359862 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354714    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 20:56:58.359862 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354717    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 20:56:58.359862 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354720    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 20:56:58.359862 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354723    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 20:56:58.359862 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354725    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 20:56:58.359862 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354728    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 20:56:58.359862 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.354731    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 20:56:58.359862 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.354804    2564 flags.go:64] FLAG: --address="0.0.0.0"
Sep 10 20:56:58.360357 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.354837    2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 10 20:56:58.360357 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.354852    2564 flags.go:64] FLAG: --anonymous-auth="true"
Sep 10 20:56:58.360357 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.354856    2564 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 10 20:56:58.360357 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.354860    2564 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 10 20:56:58.360357 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.354863    2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 10 20:56:58.360357 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.354867    2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 10 20:56:58.360357 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.354871    2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 10 20:56:58.360357 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.354874    2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 10 20:56:58.360357 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.354877    2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 10 20:56:58.360357 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.354881    2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 10 20:56:58.360357 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.354884    2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 10 20:56:58.360357 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.354888    2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 10 20:56:58.360357 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.354891    2564 flags.go:64] FLAG: --cgroup-root=""
Sep 10 20:56:58.360357 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.354895    2564 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 10 20:56:58.360357 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.354898    2564 flags.go:64] FLAG: --client-ca-file=""
Sep 10 20:56:58.360357 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.354901    2564 flags.go:64] FLAG: --cloud-provider="external"
Sep 10 20:56:58.360357 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.354904    2564 flags.go:64] FLAG: --cluster-dns="[]"
Sep 10 20:56:58.360357 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.354908    2564 flags.go:64] FLAG: --cluster-domain=""
Sep 10 20:56:58.360357 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.354911    2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 10 20:56:58.360357 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.354914    2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 10 20:56:58.360357 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.354917    2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 10 20:56:58.360357 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.354920    2564 flags.go:64] FLAG: --container-log-max-files="5"
Sep 10 20:56:58.360357 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.354924    2564 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 10 20:56:58.360357 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.354927    2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 10 20:56:58.360932 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.354930    2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 10 20:56:58.360932 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.354933    2564 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 10 20:56:58.360932 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.354936    2564 flags.go:64] FLAG: --contention-profiling="false"
Sep 10 20:56:58.360932 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.354939    2564 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 10 20:56:58.360932 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.354942    2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 10 20:56:58.360932 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.354945    2564 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 10 20:56:58.360932 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.354949    2564 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 10 20:56:58.360932 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.354953    2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 10 20:56:58.360932 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.354956    2564 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 10 20:56:58.360932 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.354959    2564 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 10 20:56:58.360932 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.354962    2564 flags.go:64] FLAG: --enable-load-reader="false"
Sep 10 20:56:58.360932 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.354965    2564 flags.go:64] FLAG: --enable-server="true"
Sep 10 20:56:58.360932 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.354969    2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 10 20:56:58.360932 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.354973    2564 flags.go:64] FLAG: --event-burst="100"
Sep 10 20:56:58.360932 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.354976    2564 flags.go:64] FLAG: --event-qps="50"
Sep 10 20:56:58.360932 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.354979    2564 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 10 20:56:58.360932 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.354982    2564 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 10 20:56:58.360932 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.354985    2564 flags.go:64] FLAG: --eviction-hard=""
Sep 10 20:56:58.360932 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.354989    2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 10 20:56:58.360932 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.354992    2564 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 10 20:56:58.360932 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.354995    2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 10 20:56:58.360932 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.354998    2564 flags.go:64] FLAG: --eviction-soft=""
Sep 10 20:56:58.360932 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355001    2564 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 10 20:56:58.360932 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355004    2564 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 10 20:56:58.360932 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355007    2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 10 20:56:58.361604 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355010    2564 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 10 20:56:58.361604 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355013    2564 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 10 20:56:58.361604 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355016    2564 flags.go:64] FLAG: --fail-swap-on="true"
Sep 10 20:56:58.361604 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355018    2564 flags.go:64] FLAG: --feature-gates=""
Sep 10 20:56:58.361604 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355022    2564 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 10 20:56:58.361604 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355025    2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 10 20:56:58.361604 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355028    2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 10 20:56:58.361604 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355031    2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 10 20:56:58.361604 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355034    2564 flags.go:64] FLAG: --healthz-port="10248"
Sep 10 20:56:58.361604 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355037    2564 flags.go:64] FLAG: --help="false"
Sep 10 20:56:58.361604 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355040    2564 flags.go:64] FLAG: --hostname-override="ip-10-0-129-100.ec2.internal"
Sep 10 20:56:58.361604 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355043    2564 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 10 20:56:58.361604 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355046    2564 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 10 20:56:58.361604 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355051    2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 10 20:56:58.361604 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355054    2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 10 20:56:58.361604 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355057    2564 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 10 20:56:58.361604 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355060    2564 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 10 20:56:58.361604 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355063    2564 flags.go:64] FLAG: --image-service-endpoint=""
Sep 10 20:56:58.361604 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355066    2564 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 10 20:56:58.361604 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355069    2564 flags.go:64] FLAG: --kube-api-burst="100"
Sep 10 20:56:58.361604 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355072    2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 10 20:56:58.361604 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355076    2564 flags.go:64] FLAG: --kube-api-qps="50"
Sep 10 20:56:58.361604 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355078    2564 flags.go:64] FLAG: --kube-reserved=""
Sep 10 20:56:58.361604 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355081    2564 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 10 20:56:58.362221 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355084    2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 10 20:56:58.362221 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355087    2564 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 10 20:56:58.362221 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355090    2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 10 20:56:58.362221 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355093    2564 flags.go:64] FLAG: --lock-file=""
Sep 10 20:56:58.362221 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355096    2564 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 10 20:56:58.362221 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355099    2564 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 10 20:56:58.362221 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355102    2564 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 10 20:56:58.362221 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355107    2564 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 10 20:56:58.362221 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355109    2564 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 10 20:56:58.362221 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355112    2564 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 10 20:56:58.362221 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355115    2564 flags.go:64] FLAG: --logging-format="text"
Sep 10 20:56:58.362221 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355118    2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 10 20:56:58.362221 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355121    2564 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 10 20:56:58.362221 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355124    2564 flags.go:64] FLAG: --manifest-url=""
Sep 10 20:56:58.362221 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355127    2564 flags.go:64] FLAG: --manifest-url-header=""
Sep 10 20:56:58.362221 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355133    2564 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 10 20:56:58.362221 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355136    2564 flags.go:64] FLAG: --max-open-files="1000000"
Sep 10 20:56:58.362221 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355140    2564 flags.go:64] FLAG: --max-pods="110"
Sep 10 20:56:58.362221 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355143    2564 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 10 20:56:58.362221 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355146    2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 10 20:56:58.362221 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355149    2564 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 10 20:56:58.362221 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355153    2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 10 20:56:58.362221 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355156    2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 10 20:56:58.362221 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355159    2564 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 10 20:56:58.362221 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355162    2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 10 20:56:58.362868 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355169    2564 flags.go:64] FLAG: --node-status-max-images="50"
Sep 10 20:56:58.362868 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355172    2564 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 10 20:56:58.362868 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355175    2564 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 10 20:56:58.362868 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355178    2564 flags.go:64] FLAG: --pod-cidr=""
Sep 10 20:56:58.362868 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355181    2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 10 20:56:58.362868 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355186    2564 flags.go:64] FLAG: --pod-manifest-path=""
Sep 10 20:56:58.362868 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355189    2564 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 10 20:56:58.362868 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355193    2564 flags.go:64] FLAG: --pods-per-core="0"
Sep 10 20:56:58.362868 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355196    2564 flags.go:64] FLAG: --port="10250"
Sep 10 20:56:58.362868 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355199    2564 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 10 20:56:58.362868 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355202    2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0052dde6f415132c6"
Sep 10 20:56:58.362868 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355204    2564 flags.go:64] FLAG: --qos-reserved=""
Sep 10 20:56:58.362868 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355207    2564 flags.go:64] FLAG: --read-only-port="10255"
Sep 10 20:56:58.362868 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355210    2564 flags.go:64] FLAG: --register-node="true"
Sep 10 20:56:58.362868 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355213    2564 flags.go:64] FLAG: --register-with-taints=""
Sep 10 20:56:58.362868 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355217    2564 flags.go:64] FLAG: --registry-burst="10"
Sep 10 20:56:58.362868 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355219    2564 flags.go:64] FLAG: --registry-qps="5"
Sep 10 20:56:58.362868 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355222    2564 flags.go:64] FLAG: --reserved-cpus=""
Sep 10 20:56:58.362868 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355225    2564 flags.go:64] FLAG: --reserved-memory=""
Sep 10 20:56:58.362868 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355228    2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 10 20:56:58.362868 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355231    2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 10 20:56:58.362868 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355234    2564 flags.go:64] FLAG: --rotate-certificates="false"
Sep 10 20:56:58.362868 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355239    2564 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 10 20:56:58.362868 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355242    2564 flags.go:64] FLAG: --runonce="false"
Sep 10 20:56:58.362868 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355245    2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 10 20:56:58.363484 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355247    2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 10 20:56:58.363484 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355250    2564 flags.go:64] FLAG: --seccomp-default="false"
Sep 10 20:56:58.363484 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355253    2564 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 10 20:56:58.363484 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355256    2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 10 20:56:58.363484 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355260    2564 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 10 20:56:58.363484 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355263    2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 10 20:56:58.363484 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355266    2564 flags.go:64] FLAG: --storage-driver-password="root"
Sep 10 20:56:58.363484 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355269    2564 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 10 20:56:58.363484 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355272    2564 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 10 20:56:58.363484 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355275    2564 flags.go:64] FLAG: --storage-driver-user="root"
Sep 10 20:56:58.363484 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355278    2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 10 20:56:58.363484 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355293    2564 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 10 20:56:58.363484 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355297    2564 flags.go:64] FLAG: --system-cgroups=""
Sep 10 20:56:58.363484 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355300    2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 10 20:56:58.363484 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355305    2564 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 10 20:56:58.363484 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355308    2564 flags.go:64] FLAG: --tls-cert-file=""
Sep 10 20:56:58.363484 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355311    2564 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 10 20:56:58.363484 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355315    2564 flags.go:64] FLAG: --tls-min-version=""
Sep 10 20:56:58.363484 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355318    2564 flags.go:64] FLAG: --tls-private-key-file=""
Sep 10 20:56:58.363484 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355321    2564 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 10 20:56:58.363484 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355324    2564 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 10 20:56:58.363484 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355327    2564 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 10 20:56:58.363484 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355330    2564 flags.go:64] FLAG: --v="2"
Sep 10 20:56:58.363484 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355334    2564 flags.go:64] FLAG: --version="false"
Sep 10 20:56:58.363484 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355338    2564 flags.go:64] FLAG: --vmodule=""
Sep 10 20:56:58.364073 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355341    2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 10 20:56:58.364073 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.355344    2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 10 20:56:58.364073 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355448    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 20:56:58.364073 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355451    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 20:56:58.364073 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355456    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 20:56:58.364073 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355459    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 20:56:58.364073 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355462    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 20:56:58.364073 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355465    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 20:56:58.364073 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355467    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 20:56:58.364073 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355470    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 20:56:58.364073 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355472    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 20:56:58.364073 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355476    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 20:56:58.364073 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355479    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 20:56:58.364073 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355482    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 20:56:58.364073 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355485    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 20:56:58.364073 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355487    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 20:56:58.364073 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355490    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 20:56:58.364073 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355492    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 20:56:58.364073 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355495    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 20:56:58.364073 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355498    2564 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 20:56:58.364571 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355501    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 20:56:58.364571 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355503    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 20:56:58.364571 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355506    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 20:56:58.364571 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355508    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 20:56:58.364571 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355511    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 20:56:58.364571 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355514    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 20:56:58.364571 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355516    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 20:56:58.364571 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355519    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 20:56:58.364571 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355521    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 20:56:58.364571 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355524    2564 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 20:56:58.364571 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355527    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 20:56:58.364571 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355530    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 20:56:58.364571 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355532    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 20:56:58.364571 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355535    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 20:56:58.364571 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355537    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 20:56:58.364571 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355542    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 20:56:58.364571 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355546    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 20:56:58.364571 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355550    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 20:56:58.364571 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355552    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 20:56:58.365034 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355555    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 20:56:58.365034 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355558    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 20:56:58.365034 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355560    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 20:56:58.365034 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355563    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 20:56:58.365034 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355567    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 20:56:58.365034 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355569    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 20:56:58.365034 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355572    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 20:56:58.365034 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355574    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 20:56:58.365034 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355577    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 20:56:58.365034 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355580    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 20:56:58.365034 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355582    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 20:56:58.365034 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355585    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 20:56:58.365034 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355587    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 20:56:58.365034 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355590    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 20:56:58.365034 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355593    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 20:56:58.365034 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355596    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 20:56:58.365034 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355598    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 20:56:58.365034 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355601    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 20:56:58.365034 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355603    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 20:56:58.365034 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355606    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 20:56:58.365578 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355608    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 20:56:58.365578 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355611    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 20:56:58.365578 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355613    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 20:56:58.365578 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355616    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 20:56:58.365578 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355619    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 20:56:58.365578 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355621    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 20:56:58.365578 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355624    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 20:56:58.365578 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355626    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 20:56:58.365578 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355629    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 20:56:58.365578 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355633    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 20:56:58.365578 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355636    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 20:56:58.365578 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355638    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 20:56:58.365578 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355641    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 20:56:58.365578 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355643    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 20:56:58.365578 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355646    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 20:56:58.365578 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355648    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 20:56:58.365578 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355652    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 20:56:58.365578 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355655    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 20:56:58.365578 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355657    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 20:56:58.366058 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355660    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 20:56:58.366058 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355663    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 20:56:58.366058 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355665    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 20:56:58.366058 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355668    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 20:56:58.366058 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355671    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 20:56:58.366058 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355673    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 20:56:58.366058 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355676    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 20:56:58.366058 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355678    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 20:56:58.366058 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355681    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 20:56:58.366058 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355684    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 20:56:58.366058 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355686    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 20:56:58.366058 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355689    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 20:56:58.366058 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355691    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 20:56:58.366058 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355694    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 20:56:58.366058 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355696    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 20:56:58.366058 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355699    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 20:56:58.366058 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355702    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 20:56:58.366058 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355704    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 20:56:58.366058 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355706    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 20:56:58.366058 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355709    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 20:56:58.366554 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355714    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 20:56:58.366554 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355717    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 20:56:58.366554 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.355722    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 20:56:58.366554 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.356477    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 20:56:58.366554 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.364271    2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 10 20:56:58.366554 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.364298    2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 10 20:56:58.366554 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.365003    2564 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 10 20:56:58.366554 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.365011    2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 10 20:56:58.366554 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365066    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 20:56:58.366554 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365072    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 20:56:58.366554 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365076    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 20:56:58.366554 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365079    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 20:56:58.366554 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365081    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 20:56:58.366554 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365084    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 20:56:58.366909 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365087    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 20:56:58.366909 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365090    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 20:56:58.366909 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365092    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 20:56:58.366909 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365095    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 20:56:58.366909 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365098    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 20:56:58.366909 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365100    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 20:56:58.366909 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365103    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 20:56:58.366909 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365106    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 20:56:58.366909 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365109    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 20:56:58.366909 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365111    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 20:56:58.366909 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365114    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 20:56:58.366909 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365117    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 20:56:58.366909 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365119    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 20:56:58.366909 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365122    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 20:56:58.366909 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365124    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 20:56:58.366909 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365127    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 20:56:58.366909 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365130    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 20:56:58.366909 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365132    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 20:56:58.366909 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365135    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 20:56:58.366909 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365137    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 20:56:58.367407 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365140    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 20:56:58.367407 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365143    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 20:56:58.367407 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365146    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 20:56:58.367407 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365150    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 20:56:58.367407 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365153    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 20:56:58.367407 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365155    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 20:56:58.367407 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365158    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 20:56:58.367407 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365161    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 20:56:58.367407 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365164    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 20:56:58.367407 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365168    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 20:56:58.367407 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365172    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 20:56:58.367407 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365174    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 20:56:58.367407 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365177    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 20:56:58.367407 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365180    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 20:56:58.367407 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365183    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 20:56:58.367407 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365185    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 20:56:58.367407 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365188    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 20:56:58.367407 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365191    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 20:56:58.367407 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365193    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 20:56:58.367407 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365196    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 20:56:58.367898 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365198    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 20:56:58.367898 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365202    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 20:56:58.367898 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365206    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 20:56:58.367898 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365209    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 20:56:58.367898 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365212    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 20:56:58.367898 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365215    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 20:56:58.367898 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365218    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 20:56:58.367898 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365221    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 20:56:58.367898 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365224    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 20:56:58.367898 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365227    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 20:56:58.367898 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365229    2564 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 20:56:58.367898 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365232    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 20:56:58.367898 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365235    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 20:56:58.367898 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365237    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 20:56:58.367898 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365240    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 20:56:58.367898 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365243    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 20:56:58.367898 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365247    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 20:56:58.367898 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365250    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 20:56:58.367898 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365253    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 20:56:58.368373 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365256    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 20:56:58.368373 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365259    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 20:56:58.368373 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365262    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 20:56:58.368373 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365265    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 20:56:58.368373 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365268    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 20:56:58.368373 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365271    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 20:56:58.368373 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365273    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 20:56:58.368373 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365276    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 20:56:58.368373 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365279    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 20:56:58.368373 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365294    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 20:56:58.368373 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365297    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 20:56:58.368373 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365299    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 20:56:58.368373 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365302    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 20:56:58.368373 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365304    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 20:56:58.368373 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365307    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 20:56:58.368373 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365310    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 20:56:58.368373 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365313    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 20:56:58.368373 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365316    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 20:56:58.368373 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365319    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 20:56:58.368840 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365322    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 20:56:58.368840 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365325    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 20:56:58.368840 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365327    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 20:56:58.368840 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365330    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 20:56:58.368840 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365333    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 20:56:58.368840 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365336    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 20:56:58.368840 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365339    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 20:56:58.368840 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365342    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 20:56:58.368840 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365344    2564 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 20:56:58.368840 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365347    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 20:56:58.368840 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365349    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 20:56:58.368840 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365352    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 20:56:58.368840 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365355    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 20:56:58.368840 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365357    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 20:56:58.368840 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365359    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 20:56:58.369229 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.365365    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 20:56:58.369229 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365471    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 20:56:58.369229 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365476    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 20:56:58.369229 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365479    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 20:56:58.369229 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365482    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 20:56:58.369229 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365484    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 20:56:58.369229 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365487    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 20:56:58.369229 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365490    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 20:56:58.369229 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365492    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 20:56:58.369229 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365494    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 20:56:58.369229 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365497    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 20:56:58.369229 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365500    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 20:56:58.369229 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365502    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 20:56:58.369229 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365505    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 20:56:58.369229 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365507    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 20:56:58.369634 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365511    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 20:56:58.369634 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365515    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 20:56:58.369634 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365518    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 20:56:58.369634 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365521    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 20:56:58.369634 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365524    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 20:56:58.369634 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365527    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 20:56:58.369634 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365530    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 20:56:58.369634 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365532    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 20:56:58.369634 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365535    2564 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 20:56:58.369634 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365537    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 20:56:58.369634 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365540    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 20:56:58.369634 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365542    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 20:56:58.369634 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365545    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 20:56:58.369634 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365548    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 20:56:58.369634 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365551    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 20:56:58.369634 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365553    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 20:56:58.369634 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365563    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 20:56:58.369634 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365567    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 20:56:58.369634 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365571    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 20:56:58.369634 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365574    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 20:56:58.370119 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365576    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 20:56:58.370119 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365579    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 20:56:58.370119 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365582    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 20:56:58.370119 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365585    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 20:56:58.370119 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365588    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 20:56:58.370119 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365590    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 20:56:58.370119 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365593    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 20:56:58.370119 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365596    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 20:56:58.370119 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365598    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 20:56:58.370119 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365601    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 20:56:58.370119 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365604    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 20:56:58.370119 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365606    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 20:56:58.370119 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365609    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 20:56:58.370119 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365612    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 20:56:58.370119 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365614    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 20:56:58.370119 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365617    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 20:56:58.370119 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365620    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 20:56:58.370119 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365622    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 20:56:58.370119 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365625    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 20:56:58.370119 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365628    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 20:56:58.370630 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365631    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 20:56:58.370630 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365634    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 20:56:58.370630 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365638    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 20:56:58.370630 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365642    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 20:56:58.370630 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365644    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 20:56:58.370630 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365647    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 20:56:58.370630 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365650    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 20:56:58.370630 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365654    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 20:56:58.370630 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365657    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 20:56:58.370630 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365659    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 20:56:58.370630 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365662    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 20:56:58.370630 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365665    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 20:56:58.370630 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365667    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 20:56:58.370630 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365670    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 20:56:58.370630 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365673    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 20:56:58.370630 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365675    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 20:56:58.370630 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365678    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 20:56:58.370630 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365680    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 20:56:58.370630 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365683    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 20:56:58.371086 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365685    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 20:56:58.371086 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365688    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 20:56:58.371086 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365690    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 20:56:58.371086 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365693    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 20:56:58.371086 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365695    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 20:56:58.371086 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365698    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 20:56:58.371086 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365701    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 20:56:58.371086 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365703    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 20:56:58.371086 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365706    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 20:56:58.371086 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365709    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 20:56:58.371086 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365711    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 20:56:58.371086 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365714    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 20:56:58.371086 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365716    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 20:56:58.371086 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365719    2564 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 20:56:58.371086 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365721    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 20:56:58.371086 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365724    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 20:56:58.371086 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365726    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 20:56:58.371086 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365729    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 20:56:58.371086 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365732    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 20:56:58.371086 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365734    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 20:56:58.371576 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365737    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 20:56:58.371576 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365740    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 20:56:58.371576 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365742    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 20:56:58.371576 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365745    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 20:56:58.371576 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365747    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 20:56:58.371576 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:56:58.365750    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 20:56:58.371576 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.365755    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 20:56:58.371576 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.365856    2564 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 10 20:56:58.371576 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.369414    2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 10 20:56:58.371576 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.370267    2564 server.go:1019] "Starting client certificate rotation"
Sep 10 20:56:58.371576 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.370373    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 10 20:56:58.371576 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.370402    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 10 20:56:58.372507 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.372484    2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 10 20:56:58.379984 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.379963    2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 10 20:56:58.388869 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.388845    2564 log.go:25] "Validated CRI v1 runtime API"
Sep 10 20:56:58.391511 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.391495    2564 log.go:25] "Validated CRI v1 image API"
Sep 10 20:56:58.393048 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.393032    2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 10 20:56:58.396676 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.396657    2564 fs.go:135] Filesystem UUIDs: map[45d2e630-56ad-4353-824d-a23d35b3ebe9:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 afcb7bd4-123c-40e7-bf56-3833c5be0a20:/dev/nvme0n1p3]
Sep 10 20:56:58.396727 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.396676    2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 10 20:56:58.401787 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.401674    2564 manager.go:216] Machine: {Timestamp:2026-09-10 20:56:58.400475204 +0000 UTC m=+0.308486956 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101513 MemoryCapacity:33164468224 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ea059b3a20cc326b04fdb3299683f SystemUUID:ec2ea059-b3a2-0cc3-26b0-4fdb3299683f BootID:54e910f7-f36a-48b8-8d68-58312a959757 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632894464 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582234112 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582234112 Type:vfs Inodes:4048397 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:63:2c:e2:b8:c7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:63:2c:e2:b8:c7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:f2:cf:68:a7:62:e9 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164468224 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 10 20:56:58.401787 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.401779    2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 10 20:56:58.401909 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.401846    2564 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 10 20:56:58.404593 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.404569    2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 10 20:56:58.404716 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.404594    2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-100.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 10 20:56:58.405389 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.405379    2564 topology_manager.go:138] "Creating topology manager with none policy"
Sep 10 20:56:58.405429 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.405390    2564 container_manager_linux.go:309] "Creating device plugin manager"
Sep 10 20:56:58.405429 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.405398    2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 10 20:56:58.406108 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.406095    2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 10 20:56:58.407520 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.407508    2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 10 20:56:58.408727 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.408708    2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 10 20:56:58.412719 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.412705    2564 state_mem.go:36] "Initialized new in-memory state store"
Sep 10 20:56:58.412832 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.412822    2564 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 10 20:56:58.412869 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.412851    2564 kubelet.go:486] "Attempting to sync node with API server"
Sep 10 20:56:58.412869 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.412860    2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 10 20:56:58.412922 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.412874    2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 10 20:56:58.412922 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.412883    2564 kubelet.go:398] "Adding apiserver pod source"
Sep 10 20:56:58.412922 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.412892    2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 10 20:56:58.413280 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.413268    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 10 20:56:58.413340 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.413306    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 10 20:56:58.415051 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.415036    2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 10 20:56:58.417661 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.417648    2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 10 20:56:58.417700 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.417678    2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 10 20:56:58.419293 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.419274    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 10 20:56:58.419332 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.419305    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 10 20:56:58.419332 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.419314    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 10 20:56:58.419332 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.419320    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 10 20:56:58.419332 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.419328    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 10 20:56:58.419332 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.419333    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 10 20:56:58.419460 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.419346    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 10 20:56:58.419460 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.419351    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 10 20:56:58.419460 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.419357    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 10 20:56:58.419460 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.419362    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 10 20:56:58.419460 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.419381    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 10 20:56:58.419460 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.419386    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 10 20:56:58.420073 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.420064    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 10 20:56:58.420103 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.420073    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 10 20:56:58.424230 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.424215    2564 server.go:1268] "Started kubelet"
Sep 10 20:56:58.424422 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.424365    2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 10 20:56:58.424504 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.424453    2564 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 10 20:56:58.424565 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.424394    2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 10 20:56:58.425096 ip-10-0-129-100 systemd[1]: Started Kubernetes Kubelet.
Sep 10 20:56:58.425741 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:56:58.425702    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-100.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 10 20:56:58.425842 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.425817    2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 10 20:56:58.425896 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:56:58.425861    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 10 20:56:58.426140 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.426120    2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-100.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 10 20:56:58.426538 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.426525    2564 server.go:310] "Adding debug handlers to kubelet server"
Sep 10 20:56:58.428359 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:56:58.428337    2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 10 20:56:58.432120 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.432102    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 10 20:56:58.432694 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.432679    2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 10 20:56:58.433031 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:56:58.432949    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-100.ec2.internal\" not found"
Sep 10 20:56:58.433378 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.433363    2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 10 20:56:58.433378 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.433364    2564 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 10 20:56:58.433494 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.433390    2564 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 10 20:56:58.433494 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.433399    2564 factory.go:55] Registering systemd factory
Sep 10 20:56:58.433494 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.433411    2564 factory.go:223] Registration of the systemd container factory successfully
Sep 10 20:56:58.433494 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.433487    2564 reconstruct.go:97] "Volume reconstruction finished"
Sep 10 20:56:58.433494 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.433493    2564 reconciler.go:29] "Reconciler: start to sync state"
Sep 10 20:56:58.433738 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.433603    2564 factory.go:153] Registering CRI-O factory
Sep 10 20:56:58.433817 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.433743    2564 factory.go:223] Registration of the crio container factory successfully
Sep 10 20:56:58.433817 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.433798    2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 10 20:56:58.433888 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.433817    2564 factory.go:103] Registering Raw factory
Sep 10 20:56:58.433888 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.433832    2564 manager.go:1196] Started watching for new ooms in manager
Sep 10 20:56:58.434260 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.434247    2564 manager.go:349] Starting recovery of all containers
Sep 10 20:56:58.435261 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:56:58.434366    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-100.ec2.internal.18d41128b0202132  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-100.ec2.internal,UID:ip-10-0-129-100.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-100.ec2.internal,},FirstTimestamp:2026-09-10 20:56:58.424189234 +0000 UTC m=+0.332200989,LastTimestamp:2026-09-10 20:56:58.424189234 +0000 UTC m=+0.332200989,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-100.ec2.internal,}"
Sep 10 20:56:58.437176 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:56:58.437155    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 10 20:56:58.437305 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:56:58.437272    2564 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-100.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 10 20:56:58.444566 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.444549    2564 manager.go:354] Recovery completed
Sep 10 20:56:58.450186 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.450173    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 20:56:58.451876 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.451854    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-100.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 20:56:58.451943 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.451893    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-100.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 20:56:58.451943 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.451908    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-100.ec2.internal" event="NodeHasSufficientPID"
Sep 10 20:56:58.452485 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.452469    2564 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 10 20:56:58.452485 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.452481    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 20:56:58.452658 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.452484    2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 10 20:56:58.452658 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.452520    2564 state_mem.go:36] "Initialized new in-memory state store"
Sep 10 20:56:58.453222 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.453203    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-100.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 20:56:58.453276 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.453239    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-100.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 20:56:58.453276 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.453255    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-100.ec2.internal" event="NodeHasSufficientPID"
Sep 10 20:56:58.454378 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:56:58.454303    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-100.ec2.internal.18d41128b1c698e0  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-100.ec2.internal,UID:ip-10-0-129-100.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-100.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-100.ec2.internal,},FirstTimestamp:2026-09-10 20:56:58.451876064 +0000 UTC m=+0.359887820,LastTimestamp:2026-09-10 20:56:58.451876064 +0000 UTC m=+0.359887820,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-100.ec2.internal,}"
Sep 10 20:56:58.459940 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.459922    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7vq64"
Sep 10 20:56:58.467128 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:56:58.467063    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-100.ec2.internal.18d41128b1c6f720  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-100.ec2.internal,UID:ip-10-0-129-100.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-129-100.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-129-100.ec2.internal,},FirstTimestamp:2026-09-10 20:56:58.451900192 +0000 UTC m=+0.359911944,LastTimestamp:2026-09-10 20:56:58.451900192 +0000 UTC m=+0.359911944,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-100.ec2.internal,}"
Sep 10 20:56:58.470619 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:56:58.470559    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-100.ec2.internal.18d41128b1c72a47  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-100.ec2.internal,UID:ip-10-0-129-100.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-129-100.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-129-100.ec2.internal,},FirstTimestamp:2026-09-10 20:56:58.451913287 +0000 UTC m=+0.359925041,LastTimestamp:2026-09-10 20:56:58.451913287 +0000 UTC m=+0.359925041,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-100.ec2.internal,}"
Sep 10 20:56:58.477257 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.477241    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7vq64"
Sep 10 20:56:58.481522 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:56:58.481465    2564 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-129-100.ec2.internal.18d41128b1c698e0\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-100.ec2.internal.18d41128b1c698e0  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-100.ec2.internal,UID:ip-10-0-129-100.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-100.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-100.ec2.internal,},FirstTimestamp:2026-09-10 20:56:58.451876064 +0000 UTC m=+0.359887820,LastTimestamp:2026-09-10 20:56:58.453221349 +0000 UTC m=+0.361233104,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-100.ec2.internal,}"
Sep 10 20:56:58.493243 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:56:58.493187    2564 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-129-100.ec2.internal.18d41128b1c6f720\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-100.ec2.internal.18d41128b1c6f720  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-100.ec2.internal,UID:ip-10-0-129-100.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-129-100.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-129-100.ec2.internal,},FirstTimestamp:2026-09-10 20:56:58.451900192 +0000 UTC m=+0.359911944,LastTimestamp:2026-09-10 20:56:58.453246986 +0000 UTC m=+0.361258739,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-100.ec2.internal,}"
Sep 10 20:56:58.597680 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:56:58.502127    2564 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-129-100.ec2.internal.18d41128b1c72a47\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-100.ec2.internal.18d41128b1c72a47  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-100.ec2.internal,UID:ip-10-0-129-100.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-129-100.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-129-100.ec2.internal,},FirstTimestamp:2026-09-10 20:56:58.451913287 +0000 UTC m=+0.359925041,LastTimestamp:2026-09-10 20:56:58.453261814 +0000 UTC m=+0.361273568,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-100.ec2.internal,}"
Sep 10 20:56:58.597680 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:56:58.533227    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-100.ec2.internal\" not found"
Sep 10 20:56:58.597680 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.596678    2564 policy_none.go:49] "None policy: Start"
Sep 10 20:56:58.597680 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.596708    2564 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 10 20:56:58.597680 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.596720    2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 10 20:56:58.598880 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.598865    2564 policy_none.go:47] "Start"
Sep 10 20:56:58.634259 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:56:58.634234    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-100.ec2.internal\" not found"
Sep 10 20:56:58.641477 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.641465    2564 manager.go:337] "Starting Device Plugin manager"
Sep 10 20:56:58.641554 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:56:58.641497    2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 10 20:56:58.641554 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.641507    2564 server.go:87] "Starting device plugin registration server"
Sep 10 20:56:58.641827 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.641803    2564 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 10 20:56:58.641827 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.641816    2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 10 20:56:58.641948 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.641909    2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 10 20:56:58.641999 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.641984    2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 10 20:56:58.641999 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.641993    2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 10 20:56:58.642545 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:56:58.642523    2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 10 20:56:58.642624 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:56:58.642580    2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-100.ec2.internal\" not found"
Sep 10 20:56:58.643814 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.643797    2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 10 20:56:58.645138 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.645124    2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 10 20:56:58.645211 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.645166    2564 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 10 20:56:58.645211 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.645185    2564 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 10 20:56:58.645327 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:56:58.645217    2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 10 20:56:58.647415 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.647395    2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 20:56:58.650683 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:56:58.650668    2564 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-129-100.ec2.internal\" not found" node="ip-10-0-129-100.ec2.internal"
Sep 10 20:56:58.742538 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.742518    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 20:56:58.743225 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.743212    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-100.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 20:56:58.743312 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.743249    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-100.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 20:56:58.743312 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.743261    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-100.ec2.internal" event="NodeHasSufficientPID"
Sep 10 20:56:58.743312 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.743305    2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-100.ec2.internal"
Sep 10 20:56:58.745321 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.745296    2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-100.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-100.ec2.internal"]
Sep 10 20:56:58.745398 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.745358    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 20:56:58.746691 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.746676    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-100.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 20:56:58.746733 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.746704    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-100.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 20:56:58.746733 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.746716    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-100.ec2.internal" event="NodeHasSufficientPID"
Sep 10 20:56:58.749065 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.749053    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 20:56:58.749180 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.749167    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-100.ec2.internal"
Sep 10 20:56:58.749215 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.749194    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 20:56:58.749832 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.749813    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-100.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 20:56:58.749916 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.749842    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-100.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 20:56:58.749916 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.749853    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-100.ec2.internal" event="NodeHasSufficientPID"
Sep 10 20:56:58.749916 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.749813    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-100.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 20:56:58.749916 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.749912    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-100.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 20:56:58.750044 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.749926    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-100.ec2.internal" event="NodeHasSufficientPID"
Sep 10 20:56:58.750334 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.750316    2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-100.ec2.internal"
Sep 10 20:56:58.750392 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:56:58.750344    2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-100.ec2.internal\": node \"ip-10-0-129-100.ec2.internal\" not found"
Sep 10 20:56:58.752040 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.752026    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-100.ec2.internal"
Sep 10 20:56:58.752101 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.752051    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 20:56:58.752643 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.752628    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-100.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 20:56:58.752707 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.752654    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-100.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 20:56:58.752707 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.752663    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-100.ec2.internal" event="NodeHasSufficientPID"
Sep 10 20:56:58.774853 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:56:58.774831    2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-100.ec2.internal\" not found" node="ip-10-0-129-100.ec2.internal"
Sep 10 20:56:58.778298 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:56:58.778267    2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-100.ec2.internal\" not found" node="ip-10-0-129-100.ec2.internal"
Sep 10 20:56:58.798877 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:56:58.798859    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-100.ec2.internal\" not found"
Sep 10 20:56:58.837201 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.837180    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c8c06af6dd33d8a03dd3e75bceae61bb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-100.ec2.internal\" (UID: \"c8c06af6dd33d8a03dd3e75bceae61bb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-100.ec2.internal"
Sep 10 20:56:58.837320 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.837202    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c8c06af6dd33d8a03dd3e75bceae61bb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-100.ec2.internal\" (UID: \"c8c06af6dd33d8a03dd3e75bceae61bb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-100.ec2.internal"
Sep 10 20:56:58.837320 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.837219    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/39d7ad530ef8927e7726fb19029c9345-config\") pod \"kube-apiserver-proxy-ip-10-0-129-100.ec2.internal\" (UID: \"39d7ad530ef8927e7726fb19029c9345\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-100.ec2.internal"
Sep 10 20:56:58.899539 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:56:58.899491    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-100.ec2.internal\" not found"
Sep 10 20:56:58.937563 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.937541    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c8c06af6dd33d8a03dd3e75bceae61bb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-100.ec2.internal\" (UID: \"c8c06af6dd33d8a03dd3e75bceae61bb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-100.ec2.internal"
Sep 10 20:56:58.937653 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.937569    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/39d7ad530ef8927e7726fb19029c9345-config\") pod \"kube-apiserver-proxy-ip-10-0-129-100.ec2.internal\" (UID: \"39d7ad530ef8927e7726fb19029c9345\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-100.ec2.internal"
Sep 10 20:56:58.937653 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.937585    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c8c06af6dd33d8a03dd3e75bceae61bb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-100.ec2.internal\" (UID: \"c8c06af6dd33d8a03dd3e75bceae61bb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-100.ec2.internal"
Sep 10 20:56:58.937653 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.937639    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c8c06af6dd33d8a03dd3e75bceae61bb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-100.ec2.internal\" (UID: \"c8c06af6dd33d8a03dd3e75bceae61bb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-100.ec2.internal"
Sep 10 20:56:58.937773 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.937652    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c8c06af6dd33d8a03dd3e75bceae61bb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-100.ec2.internal\" (UID: \"c8c06af6dd33d8a03dd3e75bceae61bb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-100.ec2.internal"
Sep 10 20:56:58.937773 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:58.937656    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/39d7ad530ef8927e7726fb19029c9345-config\") pod \"kube-apiserver-proxy-ip-10-0-129-100.ec2.internal\" (UID: \"39d7ad530ef8927e7726fb19029c9345\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-100.ec2.internal"
Sep 10 20:56:58.999557 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:56:58.999533    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-100.ec2.internal\" not found"
Sep 10 20:56:59.078757 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:59.078735    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-100.ec2.internal"
Sep 10 20:56:59.081885 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:56:59.081869    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-100.ec2.internal"
Sep 10 20:56:59.099962 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:56:59.099936    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-100.ec2.internal\" not found"
Sep 10 20:56:59.200570 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:56:59.200487    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-100.ec2.internal\" not found"
Sep 10 20:57:00.521891 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:00.521862    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-100.ec2.internal\" not found"
Sep 10 20:57:00.591397 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:00.591371    2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 10 20:57:00.591767 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:00.591501    2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 10 20:57:00.622648 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:00.622627    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-100.ec2.internal\" not found"
Sep 10 20:57:00.723021 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:00.722967    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-100.ec2.internal\" not found"
Sep 10 20:57:00.820523 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:00.820489    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-09 20:51:59 +0000 UTC" deadline="2028-05-24 08:24:57.840258102 +0000 UTC"
Sep 10 20:57:00.820523 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:00.820517    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14915h27m57.019744602s"
Sep 10 20:57:00.823631 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:00.823615    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-100.ec2.internal\" not found"
Sep 10 20:57:00.833156 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:00.833139    2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 20:57:00.854362 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:00.854339    2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-100.ec2.internal"
Sep 10 20:57:00.867322 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:00.867297    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 10 20:57:00.868882 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:00.868864    2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-100.ec2.internal"
Sep 10 20:57:00.876495 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:00.876478    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 10 20:57:00.922418 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:00.922398    2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 20:57:00.974275 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:00.974211    2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 20:57:01.023570 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:57:01.023539    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8c06af6dd33d8a03dd3e75bceae61bb.slice/crio-8b7b20ef86ed32ed9ddadce0f23f7de9a1fbd1854f4ef144a5e9cb9657d1b9d4 WatchSource:0}: Error finding container 8b7b20ef86ed32ed9ddadce0f23f7de9a1fbd1854f4ef144a5e9cb9657d1b9d4: Status 404 returned error can't find the container with id 8b7b20ef86ed32ed9ddadce0f23f7de9a1fbd1854f4ef144a5e9cb9657d1b9d4
Sep 10 20:57:01.023886 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:57:01.023868    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39d7ad530ef8927e7726fb19029c9345.slice/crio-82786ea2edec43dfddb21ae519776681625872cc17f8e2e1e84a67462ce6220a WatchSource:0}: Error finding container 82786ea2edec43dfddb21ae519776681625872cc17f8e2e1e84a67462ce6220a: Status 404 returned error can't find the container with id 82786ea2edec43dfddb21ae519776681625872cc17f8e2e1e84a67462ce6220a
Sep 10 20:57:01.028593 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.028578    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 20:57:01.635873 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.635840    2564 apiserver.go:52] "Watching apiserver"
Sep 10 20:57:01.645195 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.645165    2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 10 20:57:01.646371 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.646344    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-b5t78","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-100.ec2.internal","openshift-multus/multus-g9h2b","openshift-multus/network-metrics-daemon-zbw7p","openshift-network-diagnostics/network-check-target-srfp2","openshift-network-operator/iptables-alerter-88gjz","openshift-ovn-kubernetes/ovnkube-node-wrbhk","kube-system/global-pull-secret-syncer-gzgtl","kube-system/konnectivity-agent-v6rs4","kube-system/kube-apiserver-proxy-ip-10-0-129-100.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fs4rr","openshift-cluster-node-tuning-operator/tuned-jvdfc","openshift-dns/node-resolver-q7mfg","openshift-image-registry/node-ca-nwx8r"]
Sep 10 20:57:01.648871 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.648851    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-v6rs4"
Sep 10 20:57:01.651020 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.650994    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-q7mfg"
Sep 10 20:57:01.651604 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.651580    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 10 20:57:01.651733 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.651716    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-dh52p\""
Sep 10 20:57:01.651803 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.651762    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 10 20:57:01.654798 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.653313    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wrbhk"
Sep 10 20:57:01.654798 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.653368    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 10 20:57:01.654798 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.653696    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 10 20:57:01.654798 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.654080    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 10 20:57:01.654798 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.654260    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5kfnq\""
Sep 10 20:57:01.656003 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.655703    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 10 20:57:01.656003 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.655746    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 10 20:57:01.656003 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.655772    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 10 20:57:01.656529 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.656503    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zbw7p"
Sep 10 20:57:01.656626 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:01.656580    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zbw7p" podUID="27227947-500c-4146-a89f-798ea3bce890"
Sep 10 20:57:01.657216 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.657102    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 10 20:57:01.657749 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.657463    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-tcwhr\""
Sep 10 20:57:01.657749 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.657469    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 10 20:57:01.657749 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.657680    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 10 20:57:01.659085 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.658999    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srfp2"
Sep 10 20:57:01.659085 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:01.659061    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srfp2" podUID="8d6511c6-643b-4d56-9d77-4fd8d74b65fc"
Sep 10 20:57:01.661281 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.661262    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-88gjz"
Sep 10 20:57:01.663567 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.663549    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-b5t78"
Sep 10 20:57:01.663951 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.663797    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 10 20:57:01.664443 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.664424    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 10 20:57:01.664542 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.664500    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-9fq9x\""
Sep 10 20:57:01.664601 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.664424    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 10 20:57:01.665469 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.665443    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/279e54f7-0db1-4e2d-a998-4b3ecdf992cd-run-openvswitch\") pod \"ovnkube-node-wrbhk\" (UID: \"279e54f7-0db1-4e2d-a998-4b3ecdf992cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wrbhk"
Sep 10 20:57:01.665563 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.665488    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/279e54f7-0db1-4e2d-a998-4b3ecdf992cd-ovn-node-metrics-cert\") pod \"ovnkube-node-wrbhk\" (UID: \"279e54f7-0db1-4e2d-a998-4b3ecdf992cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wrbhk"
Sep 10 20:57:01.665563 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.665515    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/279e54f7-0db1-4e2d-a998-4b3ecdf992cd-ovnkube-script-lib\") pod \"ovnkube-node-wrbhk\" (UID: \"279e54f7-0db1-4e2d-a998-4b3ecdf992cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wrbhk"
Sep 10 20:57:01.665563 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.665538    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fb41bc68-2c7c-442e-8260-26cbf842f702-agent-certs\") pod \"konnectivity-agent-v6rs4\" (UID: \"fb41bc68-2c7c-442e-8260-26cbf842f702\") " pod="kube-system/konnectivity-agent-v6rs4"
Sep 10 20:57:01.665563 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.665549    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 10 20:57:01.665563 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.665561    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/279e54f7-0db1-4e2d-a998-4b3ecdf992cd-host-slash\") pod \"ovnkube-node-wrbhk\" (UID: \"279e54f7-0db1-4e2d-a998-4b3ecdf992cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wrbhk"
Sep 10 20:57:01.665815 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.665584    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/279e54f7-0db1-4e2d-a998-4b3ecdf992cd-var-lib-openvswitch\") pod \"ovnkube-node-wrbhk\" (UID: \"279e54f7-0db1-4e2d-a998-4b3ecdf992cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wrbhk"
Sep 10 20:57:01.665815 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.665607    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/279e54f7-0db1-4e2d-a998-4b3ecdf992cd-ovnkube-config\") pod \"ovnkube-node-wrbhk\" (UID: \"279e54f7-0db1-4e2d-a998-4b3ecdf992cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wrbhk"
Sep 10 20:57:01.665815 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.665632    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bb2b\" (UniqueName: \"kubernetes.io/projected/279e54f7-0db1-4e2d-a998-4b3ecdf992cd-kube-api-access-2bb2b\") pod \"ovnkube-node-wrbhk\" (UID: \"279e54f7-0db1-4e2d-a998-4b3ecdf992cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wrbhk"
Sep 10 20:57:01.665815 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.665659    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/279e54f7-0db1-4e2d-a998-4b3ecdf992cd-host-run-netns\") pod \"ovnkube-node-wrbhk\" (UID: \"279e54f7-0db1-4e2d-a998-4b3ecdf992cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wrbhk"
Sep 10 20:57:01.665815 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.665683    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/279e54f7-0db1-4e2d-a998-4b3ecdf992cd-run-systemd\") pod \"ovnkube-node-wrbhk\" (UID: \"279e54f7-0db1-4e2d-a998-4b3ecdf992cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wrbhk"
Sep 10 20:57:01.665815 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.665707    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fq9k\" (UniqueName: \"kubernetes.io/projected/27227947-500c-4146-a89f-798ea3bce890-kube-api-access-5fq9k\") pod \"network-metrics-daemon-zbw7p\" (UID: \"27227947-500c-4146-a89f-798ea3bce890\") " pod="openshift-multus/network-metrics-daemon-zbw7p"
Sep 10 20:57:01.665815 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.665754    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/279e54f7-0db1-4e2d-a998-4b3ecdf992cd-systemd-units\") pod \"ovnkube-node-wrbhk\" (UID: \"279e54f7-0db1-4e2d-a998-4b3ecdf992cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wrbhk"
Sep 10 20:57:01.665815 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.665776    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/279e54f7-0db1-4e2d-a998-4b3ecdf992cd-log-socket\") pod \"ovnkube-node-wrbhk\" (UID: \"279e54f7-0db1-4e2d-a998-4b3ecdf992cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wrbhk"
Sep 10 20:57:01.665815 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.665799    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/279e54f7-0db1-4e2d-a998-4b3ecdf992cd-host-kubelet\") pod \"ovnkube-node-wrbhk\" (UID: \"279e54f7-0db1-4e2d-a998-4b3ecdf992cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wrbhk"
Sep 10 20:57:01.666262 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.665836    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/279e54f7-0db1-4e2d-a998-4b3ecdf992cd-run-ovn\") pod \"ovnkube-node-wrbhk\" (UID: \"279e54f7-0db1-4e2d-a998-4b3ecdf992cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wrbhk"
Sep 10 20:57:01.666262 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.665903    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/279e54f7-0db1-4e2d-a998-4b3ecdf992cd-host-cni-netd\") pod \"ovnkube-node-wrbhk\" (UID: \"279e54f7-0db1-4e2d-a998-4b3ecdf992cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wrbhk"
Sep 10 20:57:01.666262 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.665935    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/279e54f7-0db1-4e2d-a998-4b3ecdf992cd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wrbhk\" (UID: \"279e54f7-0db1-4e2d-a998-4b3ecdf992cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wrbhk"
Sep 10 20:57:01.666262 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.665960    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27227947-500c-4146-a89f-798ea3bce890-metrics-certs\") pod \"network-metrics-daemon-zbw7p\" (UID: \"27227947-500c-4146-a89f-798ea3bce890\") " pod="openshift-multus/network-metrics-daemon-zbw7p"
Sep 10 20:57:01.666262 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.665985    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/279e54f7-0db1-4e2d-a998-4b3ecdf992cd-etc-openvswitch\") pod \"ovnkube-node-wrbhk\" (UID: \"279e54f7-0db1-4e2d-a998-4b3ecdf992cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wrbhk"
Sep 10 20:57:01.666262 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.666006    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/279e54f7-0db1-4e2d-a998-4b3ecdf992cd-node-log\") pod \"ovnkube-node-wrbhk\" (UID: \"279e54f7-0db1-4e2d-a998-4b3ecdf992cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wrbhk"
Sep 10 20:57:01.666262 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.666030    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/279e54f7-0db1-4e2d-a998-4b3ecdf992cd-env-overrides\") pod \"ovnkube-node-wrbhk\" (UID: \"279e54f7-0db1-4e2d-a998-4b3ecdf992cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wrbhk"
Sep 10 20:57:01.666262 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.666053    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9d4569d-ce78-4eaa-b2d1-22c69fb1f3bf-tmp-dir\") pod \"node-resolver-q7mfg\" (UID: \"d9d4569d-ce78-4eaa-b2d1-22c69fb1f3bf\") " pod="openshift-dns/node-resolver-q7mfg"
Sep 10 20:57:01.666262 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.666077    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/279e54f7-0db1-4e2d-a998-4b3ecdf992cd-host-cni-bin\") pod \"ovnkube-node-wrbhk\" (UID: \"279e54f7-0db1-4e2d-a998-4b3ecdf992cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wrbhk"
Sep 10 20:57:01.666262 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.666096    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gzgtl"
Sep 10 20:57:01.666262 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.666108    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pm5f\" (UniqueName: \"kubernetes.io/projected/d9d4569d-ce78-4eaa-b2d1-22c69fb1f3bf-kube-api-access-7pm5f\") pod \"node-resolver-q7mfg\" (UID: \"d9d4569d-ce78-4eaa-b2d1-22c69fb1f3bf\") " pod="openshift-dns/node-resolver-q7mfg"
Sep 10 20:57:01.666262 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.666136    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/279e54f7-0db1-4e2d-a998-4b3ecdf992cd-host-run-ovn-kubernetes\") pod \"ovnkube-node-wrbhk\" (UID: \"279e54f7-0db1-4e2d-a998-4b3ecdf992cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wrbhk"
Sep 10 20:57:01.666262 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:01.666151    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gzgtl" podUID="170f8023-6b23-45c5-b7bf-6da8b42be3cd"
Sep 10 20:57:01.666262 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.666164    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fb41bc68-2c7c-442e-8260-26cbf842f702-konnectivity-ca\") pod \"konnectivity-agent-v6rs4\" (UID: \"fb41bc68-2c7c-442e-8260-26cbf842f702\") " pod="kube-system/konnectivity-agent-v6rs4"
Sep 10 20:57:01.666262 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.666188    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d9d4569d-ce78-4eaa-b2d1-22c69fb1f3bf-hosts-file\") pod \"node-resolver-q7mfg\" (UID: \"d9d4569d-ce78-4eaa-b2d1-22c69fb1f3bf\") " pod="openshift-dns/node-resolver-q7mfg"
Sep 10 20:57:01.667797 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.667677    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 10 20:57:01.667930 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.667914    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 10 20:57:01.668292 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.668026    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-dddgs\""
Sep 10 20:57:01.668292 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.668120    2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 10 20:57:01.668292 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.668148    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 10 20:57:01.668292 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.668250    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 10 20:57:01.668531 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.668454    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-g9h2b"
Sep 10 20:57:01.672141 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.671688    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-c4mkz\""
Sep 10 20:57:01.672470 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.672452    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 10 20:57:01.673541 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.673361    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fs4rr"
Sep 10 20:57:01.675743 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.675726    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jvdfc"
Sep 10 20:57:01.677750 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.677730    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 10 20:57:01.677988 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.677966    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-cbr4f\""
Sep 10 20:57:01.678159 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.678140    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nwx8r"
Sep 10 20:57:01.678252 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.678165    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jzsrp\""
Sep 10 20:57:01.678341 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.678322    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 10 20:57:01.678435 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.678405    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 10 20:57:01.679170 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.678988    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 10 20:57:01.679170 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.679011    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 10 20:57:01.683788 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.683058    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 10 20:57:01.683788 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.683093    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-2bmjc\""
Sep 10 20:57:01.683788 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.683302    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 10 20:57:01.683788 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.683483    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 10 20:57:01.707152 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.707102    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-4shr8"
Sep 10 20:57:01.717397 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.717344    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-4shr8"
Sep 10 20:57:01.755835 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.755809    2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 10 20:57:01.767010 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.766982    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1100e6a5-d621-4dd1-b855-13eb97c00682-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-b5t78\" (UID: \"1100e6a5-d621-4dd1-b855-13eb97c00682\") " pod="openshift-multus/multus-additional-cni-plugins-b5t78"
Sep 10 20:57:01.767156 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.767029    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pm5f\" (UniqueName: \"kubernetes.io/projected/d9d4569d-ce78-4eaa-b2d1-22c69fb1f3bf-kube-api-access-7pm5f\") pod \"node-resolver-q7mfg\" (UID: \"d9d4569d-ce78-4eaa-b2d1-22c69fb1f3bf\") " pod="openshift-dns/node-resolver-q7mfg"
Sep 10 20:57:01.767156 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.767060    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/982ffbde-1f2c-4786-86e2-095af29ab25b-system-cni-dir\") pod \"multus-g9h2b\" (UID: \"982ffbde-1f2c-4786-86e2-095af29ab25b\") " pod="openshift-multus/multus-g9h2b"
Sep 10 20:57:01.767156 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.767086    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/982ffbde-1f2c-4786-86e2-095af29ab25b-host-run-multus-certs\") pod \"multus-g9h2b\" (UID: \"982ffbde-1f2c-4786-86e2-095af29ab25b\") " pod="openshift-multus/multus-g9h2b"
Sep 10 20:57:01.767156 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.767110    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvljr\" (UniqueName: \"kubernetes.io/projected/982ffbde-1f2c-4786-86e2-095af29ab25b-kube-api-access-fvljr\") pod \"multus-g9h2b\" (UID: \"982ffbde-1f2c-4786-86e2-095af29ab25b\") " pod="openshift-multus/multus-g9h2b"
Sep 10 20:57:01.767156 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.767136    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d43db309-4d3b-447c-b7b5-d1773f1acfd8-socket-dir\") pod \"aws-ebs-csi-driver-node-fs4rr\" (UID: \"d43db309-4d3b-447c-b7b5-d1773f1acfd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fs4rr"
Sep 10 20:57:01.767430 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.767159    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d43db309-4d3b-447c-b7b5-d1773f1acfd8-sys-fs\") pod \"aws-ebs-csi-driver-node-fs4rr\" (UID: \"d43db309-4d3b-447c-b7b5-d1773f1acfd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fs4rr"
Sep 10 20:57:01.767430 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.767180    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1100e6a5-d621-4dd1-b855-13eb97c00682-cnibin\") pod \"multus-additional-cni-plugins-b5t78\" (UID: \"1100e6a5-d621-4dd1-b855-13eb97c00682\") " pod="openshift-multus/multus-additional-cni-plugins-b5t78"
Sep 10 20:57:01.767430 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.767203    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1100e6a5-d621-4dd1-b855-13eb97c00682-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-b5t78\" (UID: \"1100e6a5-d621-4dd1-b855-13eb97c00682\") " pod="openshift-multus/multus-additional-cni-plugins-b5t78"
Sep 10 20:57:01.767430 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.767254    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/279e54f7-0db1-4e2d-a998-4b3ecdf992cd-host-run-ovn-kubernetes\") pod \"ovnkube-node-wrbhk\" (UID: \"279e54f7-0db1-4e2d-a998-4b3ecdf992cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wrbhk"
Sep 10 20:57:01.767430 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.767279    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/982ffbde-1f2c-4786-86e2-095af29ab25b-hostroot\") pod \"multus-g9h2b\" (UID: \"982ffbde-1f2c-4786-86e2-095af29ab25b\") " pod="openshift-multus/multus-g9h2b"
Sep 10 20:57:01.767430 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.767325    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1bd6c830-3d46-4f96-98b4-b1c595c09609-etc-kubernetes\") pod \"tuned-jvdfc\" (UID: \"1bd6c830-3d46-4f96-98b4-b1c595c09609\") " pod="openshift-cluster-node-tuning-operator/tuned-jvdfc"
Sep 10 20:57:01.767430 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.767364    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1bd6c830-3d46-4f96-98b4-b1c595c09609-lib-modules\") pod \"tuned-jvdfc\" (UID: \"1bd6c830-3d46-4f96-98b4-b1c595c09609\") " pod="openshift-cluster-node-tuning-operator/tuned-jvdfc"
Sep 10 20:57:01.767430 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.767389    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/279e54f7-0db1-4e2d-a998-4b3ecdf992cd-host-run-ovn-kubernetes\") pod \"ovnkube-node-wrbhk\" (UID: \"279e54f7-0db1-4e2d-a998-4b3ecdf992cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wrbhk"
Sep 10 20:57:01.767814 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.767433    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/279e54f7-0db1-4e2d-a998-4b3ecdf992cd-ovn-node-metrics-cert\") pod \"ovnkube-node-wrbhk\" (UID: \"279e54f7-0db1-4e2d-a998-4b3ecdf992cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wrbhk"
Sep 10 20:57:01.767814 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.767460    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/982ffbde-1f2c-4786-86e2-095af29ab25b-host-run-netns\") pod \"multus-g9h2b\" (UID: \"982ffbde-1f2c-4786-86e2-095af29ab25b\") " pod="openshift-multus/multus-g9h2b"
Sep 10 20:57:01.767814 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.767510    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/982ffbde-1f2c-4786-86e2-095af29ab25b-host-var-lib-cni-multus\") pod \"multus-g9h2b\" (UID: \"982ffbde-1f2c-4786-86e2-095af29ab25b\") " pod="openshift-multus/multus-g9h2b"
Sep 10 20:57:01.767814 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.767535    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d43db309-4d3b-447c-b7b5-d1773f1acfd8-etc-selinux\") pod \"aws-ebs-csi-driver-node-fs4rr\" (UID: \"d43db309-4d3b-447c-b7b5-d1773f1acfd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fs4rr"
Sep 10 20:57:01.767814 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.767559    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1100e6a5-d621-4dd1-b855-13eb97c00682-cni-binary-copy\") pod \"multus-additional-cni-plugins-b5t78\" (UID: \"1100e6a5-d621-4dd1-b855-13eb97c00682\") " pod="openshift-multus/multus-additional-cni-plugins-b5t78"
Sep 10 20:57:01.767814 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.767581    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1bd6c830-3d46-4f96-98b4-b1c595c09609-etc-modprobe-d\") pod \"tuned-jvdfc\" (UID: \"1bd6c830-3d46-4f96-98b4-b1c595c09609\") " pod="openshift-cluster-node-tuning-operator/tuned-jvdfc"
Sep 10 20:57:01.767814 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.767605    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1bd6c830-3d46-4f96-98b4-b1c595c09609-var-lib-kubelet\") pod \"tuned-jvdfc\" (UID: \"1bd6c830-3d46-4f96-98b4-b1c595c09609\") " pod="openshift-cluster-node-tuning-operator/tuned-jvdfc"
Sep 10 20:57:01.767814 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.767653    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fb41bc68-2c7c-442e-8260-26cbf842f702-agent-certs\") pod \"konnectivity-agent-v6rs4\" (UID: \"fb41bc68-2c7c-442e-8260-26cbf842f702\") " pod="kube-system/konnectivity-agent-v6rs4"
Sep 10 20:57:01.767814 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.767678    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/279e54f7-0db1-4e2d-a998-4b3ecdf992cd-host-slash\") pod \"ovnkube-node-wrbhk\" (UID: \"279e54f7-0db1-4e2d-a998-4b3ecdf992cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wrbhk"
Sep 10 20:57:01.767814 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.767702    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/279e54f7-0db1-4e2d-a998-4b3ecdf992cd-var-lib-openvswitch\") pod \"ovnkube-node-wrbhk\" (UID: \"279e54f7-0db1-4e2d-a998-4b3ecdf992cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wrbhk"
Sep 10 20:57:01.767814 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.767727    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bb2b\" (UniqueName: \"kubernetes.io/projected/279e54f7-0db1-4e2d-a998-4b3ecdf992cd-kube-api-access-2bb2b\") pod \"ovnkube-node-wrbhk\" (UID: \"279e54f7-0db1-4e2d-a998-4b3ecdf992cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wrbhk"
Sep 10 20:57:01.767814 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.767751    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/982ffbde-1f2c-4786-86e2-095af29ab25b-cnibin\") pod \"multus-g9h2b\" (UID: \"982ffbde-1f2c-4786-86e2-095af29ab25b\") " pod="openshift-multus/multus-g9h2b"
Sep 10 20:57:01.767814 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.767775    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1bd6c830-3d46-4f96-98b4-b1c595c09609-etc-tuned\") pod \"tuned-jvdfc\" (UID: \"1bd6c830-3d46-4f96-98b4-b1c595c09609\") " pod="openshift-cluster-node-tuning-operator/tuned-jvdfc"
Sep 10 20:57:01.767814 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.767797    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1bd6c830-3d46-4f96-98b4-b1c595c09609-tmp\") pod \"tuned-jvdfc\" (UID: \"1bd6c830-3d46-4f96-98b4-b1c595c09609\") " pod="openshift-cluster-node-tuning-operator/tuned-jvdfc"
Sep 10 20:57:01.768518 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.767820    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/982ffbde-1f2c-4786-86e2-095af29ab25b-host-var-lib-kubelet\") pod \"multus-g9h2b\" (UID: \"982ffbde-1f2c-4786-86e2-095af29ab25b\") " pod="openshift-multus/multus-g9h2b"
Sep 10 20:57:01.768518 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.767844    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/170f8023-6b23-45c5-b7bf-6da8b42be3cd-dbus\") pod \"global-pull-secret-syncer-gzgtl\" (UID: \"170f8023-6b23-45c5-b7bf-6da8b42be3cd\") " pod="kube-system/global-pull-secret-syncer-gzgtl"
Sep 10 20:57:01.768518 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.767929    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1bd6c830-3d46-4f96-98b4-b1c595c09609-etc-sysctl-conf\") pod \"tuned-jvdfc\" (UID: \"1bd6c830-3d46-4f96-98b4-b1c595c09609\") " pod="openshift-cluster-node-tuning-operator/tuned-jvdfc"
Sep 10 20:57:01.768518 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.767956    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/279e54f7-0db1-4e2d-a998-4b3ecdf992cd-log-socket\") pod \"ovnkube-node-wrbhk\" (UID: \"279e54f7-0db1-4e2d-a998-4b3ecdf992cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wrbhk"
Sep 10 20:57:01.768518 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.767981    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kntpt\" (UniqueName: \"kubernetes.io/projected/d43db309-4d3b-447c-b7b5-d1773f1acfd8-kube-api-access-kntpt\") pod \"aws-ebs-csi-driver-node-fs4rr\" (UID: \"d43db309-4d3b-447c-b7b5-d1773f1acfd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fs4rr"
Sep 10 20:57:01.768518 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.768004    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1bd6c830-3d46-4f96-98b4-b1c595c09609-host\") pod \"tuned-jvdfc\" (UID: \"1bd6c830-3d46-4f96-98b4-b1c595c09609\") " pod="openshift-cluster-node-tuning-operator/tuned-jvdfc"
Sep 10 20:57:01.768518 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.768029    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5b37372b-e18e-4c13-abff-11909b3192fb-serviceca\") pod \"node-ca-nwx8r\" (UID: \"5b37372b-e18e-4c13-abff-11909b3192fb\") " pod="openshift-image-registry/node-ca-nwx8r"
Sep 10 20:57:01.768518 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.768053    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/279e54f7-0db1-4e2d-a998-4b3ecdf992cd-host-kubelet\") pod \"ovnkube-node-wrbhk\" (UID: \"279e54f7-0db1-4e2d-a998-4b3ecdf992cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wrbhk"
Sep 10 20:57:01.768518 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.768079    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/279e54f7-0db1-4e2d-a998-4b3ecdf992cd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wrbhk\" (UID: \"279e54f7-0db1-4e2d-a998-4b3ecdf992cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wrbhk"
Sep 10 20:57:01.768518 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.768102    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/982ffbde-1f2c-4786-86e2-095af29ab25b-host-var-lib-cni-bin\") pod \"multus-g9h2b\" (UID: \"982ffbde-1f2c-4786-86e2-095af29ab25b\") " pod="openshift-multus/multus-g9h2b"
Sep 10 20:57:01.768518 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.768127    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/982ffbde-1f2c-4786-86e2-095af29ab25b-multus-daemon-config\") pod \"multus-g9h2b\" (UID: \"982ffbde-1f2c-4786-86e2-095af29ab25b\") " pod="openshift-multus/multus-g9h2b"
Sep 10 20:57:01.768518 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.768151    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1100e6a5-d621-4dd1-b855-13eb97c00682-tuning-conf-dir\") pod \"multus-additional-cni-plugins-b5t78\" (UID: \"1100e6a5-d621-4dd1-b855-13eb97c00682\") " pod="openshift-multus/multus-additional-cni-plugins-b5t78"
Sep 10 20:57:01.768518 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.768174    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1bd6c830-3d46-4f96-98b4-b1c595c09609-etc-systemd\") pod \"tuned-jvdfc\" (UID: \"1bd6c830-3d46-4f96-98b4-b1c595c09609\") " pod="openshift-cluster-node-tuning-operator/tuned-jvdfc"
Sep 10 20:57:01.768518 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.768220    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5b37372b-e18e-4c13-abff-11909b3192fb-host\") pod \"node-ca-nwx8r\" (UID: \"5b37372b-e18e-4c13-abff-11909b3192fb\") " pod="openshift-image-registry/node-ca-nwx8r"
Sep 10 20:57:01.768518 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.768262    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d43db309-4d3b-447c-b7b5-d1773f1acfd8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fs4rr\" (UID: \"d43db309-4d3b-447c-b7b5-d1773f1acfd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fs4rr"
Sep 10 20:57:01.768518 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.768340    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/279e54f7-0db1-4e2d-a998-4b3ecdf992cd-etc-openvswitch\") pod \"ovnkube-node-wrbhk\" (UID: \"279e54f7-0db1-4e2d-a998-4b3ecdf992cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wrbhk"
Sep 10 20:57:01.768518 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.768370    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/279e54f7-0db1-4e2d-a998-4b3ecdf992cd-env-overrides\") pod \"ovnkube-node-wrbhk\" (UID: \"279e54f7-0db1-4e2d-a998-4b3ecdf992cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wrbhk"
Sep 10 20:57:01.769330 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.768395    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9d4569d-ce78-4eaa-b2d1-22c69fb1f3bf-tmp-dir\") pod \"node-resolver-q7mfg\" (UID: \"d9d4569d-ce78-4eaa-b2d1-22c69fb1f3bf\") " pod="openshift-dns/node-resolver-q7mfg"
Sep 10 20:57:01.769330 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.768398    2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 10 20:57:01.769330 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.768453    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2678k\" (UniqueName: \"kubernetes.io/projected/8d6511c6-643b-4d56-9d77-4fd8d74b65fc-kube-api-access-2678k\") pod \"network-check-target-srfp2\" (UID: \"8d6511c6-643b-4d56-9d77-4fd8d74b65fc\") " pod="openshift-network-diagnostics/network-check-target-srfp2"
Sep 10 20:57:01.769330 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.768484    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/279e54f7-0db1-4e2d-a998-4b3ecdf992cd-host-cni-bin\") pod \"ovnkube-node-wrbhk\" (UID: \"279e54f7-0db1-4e2d-a998-4b3ecdf992cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wrbhk"
Sep 10 20:57:01.769330 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.768521    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1bd6c830-3d46-4f96-98b4-b1c595c09609-etc-sysconfig\") pod \"tuned-jvdfc\" (UID: \"1bd6c830-3d46-4f96-98b4-b1c595c09609\") " pod="openshift-cluster-node-tuning-operator/tuned-jvdfc"
Sep 10 20:57:01.769330 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.768548    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8w85\" (UniqueName: \"kubernetes.io/projected/1bd6c830-3d46-4f96-98b4-b1c595c09609-kube-api-access-z8w85\") pod \"tuned-jvdfc\" (UID: \"1bd6c830-3d46-4f96-98b4-b1c595c09609\") " pod="openshift-cluster-node-tuning-operator/tuned-jvdfc"
Sep 10 20:57:01.769330 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.768572    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bl569\" (UniqueName: \"kubernetes.io/projected/1100e6a5-d621-4dd1-b855-13eb97c00682-kube-api-access-bl569\") pod \"multus-additional-cni-plugins-b5t78\" (UID: \"1100e6a5-d621-4dd1-b855-13eb97c00682\") " pod="openshift-multus/multus-additional-cni-plugins-b5t78"
Sep 10 20:57:01.769330 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.768597    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/170f8023-6b23-45c5-b7bf-6da8b42be3cd-kubelet-config\") pod \"global-pull-secret-syncer-gzgtl\" (UID: \"170f8023-6b23-45c5-b7bf-6da8b42be3cd\") " pod="kube-system/global-pull-secret-syncer-gzgtl"
Sep 10 20:57:01.769330 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.768621    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1bd6c830-3d46-4f96-98b4-b1c595c09609-run\") pod \"tuned-jvdfc\" (UID: \"1bd6c830-3d46-4f96-98b4-b1c595c09609\") " pod="openshift-cluster-node-tuning-operator/tuned-jvdfc"
Sep 10 20:57:01.769330 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.768647    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fb41bc68-2c7c-442e-8260-26cbf842f702-konnectivity-ca\") pod \"konnectivity-agent-v6rs4\" (UID: \"fb41bc68-2c7c-442e-8260-26cbf842f702\") " pod="kube-system/konnectivity-agent-v6rs4"
Sep 10 20:57:01.769330 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.768673    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d9d4569d-ce78-4eaa-b2d1-22c69fb1f3bf-hosts-file\") pod \"node-resolver-q7mfg\" (UID: \"d9d4569d-ce78-4eaa-b2d1-22c69fb1f3bf\") " pod="openshift-dns/node-resolver-q7mfg"
Sep 10 20:57:01.769330 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.768698    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/279e54f7-0db1-4e2d-a998-4b3ecdf992cd-run-openvswitch\") pod \"ovnkube-node-wrbhk\" (UID: \"279e54f7-0db1-4e2d-a998-4b3ecdf992cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wrbhk"
Sep 10 20:57:01.769330 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.768716    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/279e54f7-0db1-4e2d-a998-4b3ecdf992cd-host-slash\") pod \"ovnkube-node-wrbhk\" (UID: \"279e54f7-0db1-4e2d-a998-4b3ecdf992cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wrbhk"
Sep 10 20:57:01.769330 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.768722    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/279e54f7-0db1-4e2d-a998-4b3ecdf992cd-ovnkube-script-lib\") pod \"ovnkube-node-wrbhk\" (UID: \"279e54f7-0db1-4e2d-a998-4b3ecdf992cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wrbhk"
Sep 10 20:57:01.769330 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.768761    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d77691cf-bad6-4eb6-ab44-20ad29fad22f-iptables-alerter-script\") pod \"iptables-alerter-88gjz\" (UID: \"d77691cf-bad6-4eb6-ab44-20ad29fad22f\") " pod="openshift-network-operator/iptables-alerter-88gjz"
Sep 10 20:57:01.769330 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.768903    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/170f8023-6b23-45c5-b7bf-6da8b42be3cd-original-pull-secret\") pod \"global-pull-secret-syncer-gzgtl\" (UID: \"170f8023-6b23-45c5-b7bf-6da8b42be3cd\") " pod="kube-system/global-pull-secret-syncer-gzgtl"
Sep 10 20:57:01.769330 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.768930    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1bd6c830-3d46-4f96-98b4-b1c595c09609-etc-sysctl-d\") pod \"tuned-jvdfc\" (UID: \"1bd6c830-3d46-4f96-98b4-b1c595c09609\") " pod="openshift-cluster-node-tuning-operator/tuned-jvdfc"
Sep 10 20:57:01.770030 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.768958    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/279e54f7-0db1-4e2d-a998-4b3ecdf992cd-ovnkube-config\") pod \"ovnkube-node-wrbhk\" (UID: \"279e54f7-0db1-4e2d-a998-4b3ecdf992cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wrbhk"
Sep 10 20:57:01.770030 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.768986    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jz5gh\" (UniqueName: \"kubernetes.io/projected/5b37372b-e18e-4c13-abff-11909b3192fb-kube-api-access-jz5gh\") pod \"node-ca-nwx8r\" (UID: \"5b37372b-e18e-4c13-abff-11909b3192fb\") " pod="openshift-image-registry/node-ca-nwx8r"
Sep 10 20:57:01.770030 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.769015    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/279e54f7-0db1-4e2d-a998-4b3ecdf992cd-host-run-netns\") pod \"ovnkube-node-wrbhk\" (UID: \"279e54f7-0db1-4e2d-a998-4b3ecdf992cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wrbhk"
Sep 10 20:57:01.770030 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.769049    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/279e54f7-0db1-4e2d-a998-4b3ecdf992cd-run-systemd\") pod \"ovnkube-node-wrbhk\" (UID: \"279e54f7-0db1-4e2d-a998-4b3ecdf992cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wrbhk"
Sep 10 20:57:01.770030 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.769076    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fq9k\" (UniqueName: \"kubernetes.io/projected/27227947-500c-4146-a89f-798ea3bce890-kube-api-access-5fq9k\") pod \"network-metrics-daemon-zbw7p\" (UID: \"27227947-500c-4146-a89f-798ea3bce890\") " pod="openshift-multus/network-metrics-daemon-zbw7p"
Sep 10 20:57:01.770030 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.769103    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/982ffbde-1f2c-4786-86e2-095af29ab25b-multus-socket-dir-parent\") pod \"multus-g9h2b\" (UID: \"982ffbde-1f2c-4786-86e2-095af29ab25b\") " pod="openshift-multus/multus-g9h2b"
Sep 10 20:57:01.770030 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.769127    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d43db309-4d3b-447c-b7b5-d1773f1acfd8-registration-dir\") pod \"aws-ebs-csi-driver-node-fs4rr\" (UID: \"d43db309-4d3b-447c-b7b5-d1773f1acfd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fs4rr"
Sep 10 20:57:01.770030 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.769153    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1bd6c830-3d46-4f96-98b4-b1c595c09609-sys\") pod \"tuned-jvdfc\" (UID: \"1bd6c830-3d46-4f96-98b4-b1c595c09609\") " pod="openshift-cluster-node-tuning-operator/tuned-jvdfc"
Sep 10 20:57:01.770030 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.769178    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/279e54f7-0db1-4e2d-a998-4b3ecdf992cd-systemd-units\") pod \"ovnkube-node-wrbhk\" (UID: \"279e54f7-0db1-4e2d-a998-4b3ecdf992cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wrbhk"
Sep 10 20:57:01.770030 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.769204    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/982ffbde-1f2c-4786-86e2-095af29ab25b-host-run-k8s-cni-cncf-io\") pod \"multus-g9h2b\" (UID: \"982ffbde-1f2c-4786-86e2-095af29ab25b\") " pod="openshift-multus/multus-g9h2b"
Sep 10 20:57:01.770030 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.769242    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/982ffbde-1f2c-4786-86e2-095af29ab25b-multus-conf-dir\") pod \"multus-g9h2b\" (UID: \"982ffbde-1f2c-4786-86e2-095af29ab25b\") " pod="openshift-multus/multus-g9h2b"
Sep 10 20:57:01.770030 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.769268    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/279e54f7-0db1-4e2d-a998-4b3ecdf992cd-run-ovn\") pod \"ovnkube-node-wrbhk\" (UID: \"279e54f7-0db1-4e2d-a998-4b3ecdf992cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wrbhk"
Sep 10 20:57:01.770030 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.769292    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/279e54f7-0db1-4e2d-a998-4b3ecdf992cd-host-cni-netd\") pod \"ovnkube-node-wrbhk\" (UID: \"279e54f7-0db1-4e2d-a998-4b3ecdf992cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wrbhk"
Sep 10 20:57:01.770030 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.769318    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d77691cf-bad6-4eb6-ab44-20ad29fad22f-host-slash\") pod \"iptables-alerter-88gjz\" (UID: \"d77691cf-bad6-4eb6-ab44-20ad29fad22f\") " pod="openshift-network-operator/iptables-alerter-88gjz"
Sep 10 20:57:01.770030 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.769342    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/982ffbde-1f2c-4786-86e2-095af29ab25b-multus-cni-dir\") pod \"multus-g9h2b\" (UID: \"982ffbde-1f2c-4786-86e2-095af29ab25b\") " pod="openshift-multus/multus-g9h2b"
Sep 10 20:57:01.770030 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.769367    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d43db309-4d3b-447c-b7b5-d1773f1acfd8-device-dir\") pod \"aws-ebs-csi-driver-node-fs4rr\" (UID: \"d43db309-4d3b-447c-b7b5-d1773f1acfd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fs4rr"
Sep 10 20:57:01.770030 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.769395    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27227947-500c-4146-a89f-798ea3bce890-metrics-certs\") pod \"network-metrics-daemon-zbw7p\" (UID: \"27227947-500c-4146-a89f-798ea3bce890\") " pod="openshift-multus/network-metrics-daemon-zbw7p"
Sep 10 20:57:01.770850 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.769421    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/279e54f7-0db1-4e2d-a998-4b3ecdf992cd-node-log\") pod \"ovnkube-node-wrbhk\" (UID: \"279e54f7-0db1-4e2d-a998-4b3ecdf992cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wrbhk"
Sep 10 20:57:01.770850 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.769448    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5gjk\" (UniqueName: \"kubernetes.io/projected/d77691cf-bad6-4eb6-ab44-20ad29fad22f-kube-api-access-v5gjk\") pod \"iptables-alerter-88gjz\" (UID: \"d77691cf-bad6-4eb6-ab44-20ad29fad22f\") " pod="openshift-network-operator/iptables-alerter-88gjz"
Sep 10 20:57:01.770850 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.769479    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/982ffbde-1f2c-4786-86e2-095af29ab25b-cni-binary-copy\") pod \"multus-g9h2b\" (UID: \"982ffbde-1f2c-4786-86e2-095af29ab25b\") " pod="openshift-multus/multus-g9h2b"
Sep 10 20:57:01.770850 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.769503    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/982ffbde-1f2c-4786-86e2-095af29ab25b-etc-kubernetes\") pod \"multus-g9h2b\" (UID: \"982ffbde-1f2c-4786-86e2-095af29ab25b\") " pod="openshift-multus/multus-g9h2b"
Sep 10 20:57:01.770850 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.769530    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1100e6a5-d621-4dd1-b855-13eb97c00682-system-cni-dir\") pod \"multus-additional-cni-plugins-b5t78\" (UID: \"1100e6a5-d621-4dd1-b855-13eb97c00682\") " pod="openshift-multus/multus-additional-cni-plugins-b5t78"
Sep 10 20:57:01.770850 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.769592    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/279e54f7-0db1-4e2d-a998-4b3ecdf992cd-ovnkube-script-lib\") pod \"ovnkube-node-wrbhk\" (UID: \"279e54f7-0db1-4e2d-a998-4b3ecdf992cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wrbhk"
Sep 10 20:57:01.770850 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.769606    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/279e54f7-0db1-4e2d-a998-4b3ecdf992cd-var-lib-openvswitch\") pod \"ovnkube-node-wrbhk\" (UID: \"279e54f7-0db1-4e2d-a998-4b3ecdf992cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wrbhk"
Sep 10 20:57:01.770850 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.769659    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/279e54f7-0db1-4e2d-a998-4b3ecdf992cd-etc-openvswitch\") pod \"ovnkube-node-wrbhk\" (UID: \"279e54f7-0db1-4e2d-a998-4b3ecdf992cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wrbhk"
Sep 10 20:57:01.770850 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.769676    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/279e54f7-0db1-4e2d-a998-4b3ecdf992cd-run-openvswitch\") pod \"ovnkube-node-wrbhk\" (UID: \"279e54f7-0db1-4e2d-a998-4b3ecdf992cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wrbhk"
Sep 10 20:57:01.770850 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.769718    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/279e54f7-0db1-4e2d-a998-4b3ecdf992cd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wrbhk\" (UID: \"279e54f7-0db1-4e2d-a998-4b3ecdf992cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wrbhk"
Sep 10 20:57:01.770850 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.769754    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/279e54f7-0db1-4e2d-a998-4b3ecdf992cd-log-socket\") pod \"ovnkube-node-wrbhk\" (UID: \"279e54f7-0db1-4e2d-a998-4b3ecdf992cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wrbhk"
Sep 10 20:57:01.770850 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.770131    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/279e54f7-0db1-4e2d-a998-4b3ecdf992cd-ovnkube-config\") pod \"ovnkube-node-wrbhk\" (UID: \"279e54f7-0db1-4e2d-a998-4b3ecdf992cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wrbhk"
Sep 10 20:57:01.770850 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.770190    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/279e54f7-0db1-4e2d-a998-4b3ecdf992cd-run-ovn\") pod \"ovnkube-node-wrbhk\" (UID: \"279e54f7-0db1-4e2d-a998-4b3ecdf992cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wrbhk"
Sep 10 20:57:01.770850 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.770190    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/279e54f7-0db1-4e2d-a998-4b3ecdf992cd-host-kubelet\") pod \"ovnkube-node-wrbhk\" (UID: \"279e54f7-0db1-4e2d-a998-4b3ecdf992cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wrbhk"
Sep 10 20:57:01.770850 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.770253    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/279e54f7-0db1-4e2d-a998-4b3ecdf992cd-host-cni-netd\") pod \"ovnkube-node-wrbhk\" (UID: \"279e54f7-0db1-4e2d-a998-4b3ecdf992cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wrbhk"
Sep 10 20:57:01.770850 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.770264    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/279e54f7-0db1-4e2d-a998-4b3ecdf992cd-host-run-netns\") pod \"ovnkube-node-wrbhk\" (UID: \"279e54f7-0db1-4e2d-a998-4b3ecdf992cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wrbhk"
Sep 10 20:57:01.770850 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.770319    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/279e54f7-0db1-4e2d-a998-4b3ecdf992cd-run-systemd\") pod \"ovnkube-node-wrbhk\" (UID: \"279e54f7-0db1-4e2d-a998-4b3ecdf992cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wrbhk"
Sep 10 20:57:01.770850 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:01.770360    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 20:57:01.771707 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:01.770431    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27227947-500c-4146-a89f-798ea3bce890-metrics-certs podName:27227947-500c-4146-a89f-798ea3bce890 nodeName:}" failed. No retries permitted until 2026-09-10 20:57:02.27040085 +0000 UTC m=+2.957468111 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/27227947-500c-4146-a89f-798ea3bce890-metrics-certs") pod "network-metrics-daemon-zbw7p" (UID: "27227947-500c-4146-a89f-798ea3bce890") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 20:57:01.771707 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.770555    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/279e54f7-0db1-4e2d-a998-4b3ecdf992cd-node-log\") pod \"ovnkube-node-wrbhk\" (UID: \"279e54f7-0db1-4e2d-a998-4b3ecdf992cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wrbhk"
Sep 10 20:57:01.771707 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.770604    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/279e54f7-0db1-4e2d-a998-4b3ecdf992cd-systemd-units\") pod \"ovnkube-node-wrbhk\" (UID: \"279e54f7-0db1-4e2d-a998-4b3ecdf992cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wrbhk"
Sep 10 20:57:01.771707 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.770622    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d9d4569d-ce78-4eaa-b2d1-22c69fb1f3bf-hosts-file\") pod \"node-resolver-q7mfg\" (UID: \"d9d4569d-ce78-4eaa-b2d1-22c69fb1f3bf\") " pod="openshift-dns/node-resolver-q7mfg"
Sep 10 20:57:01.771707 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.770651    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/279e54f7-0db1-4e2d-a998-4b3ecdf992cd-host-cni-bin\") pod \"ovnkube-node-wrbhk\" (UID: \"279e54f7-0db1-4e2d-a998-4b3ecdf992cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wrbhk"
Sep 10 20:57:01.771707 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.770683    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9d4569d-ce78-4eaa-b2d1-22c69fb1f3bf-tmp-dir\") pod \"node-resolver-q7mfg\" (UID: \"d9d4569d-ce78-4eaa-b2d1-22c69fb1f3bf\") " pod="openshift-dns/node-resolver-q7mfg"
Sep 10 20:57:01.771707 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.770798    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/279e54f7-0db1-4e2d-a998-4b3ecdf992cd-env-overrides\") pod \"ovnkube-node-wrbhk\" (UID: \"279e54f7-0db1-4e2d-a998-4b3ecdf992cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wrbhk"
Sep 10 20:57:01.771707 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.771100    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fb41bc68-2c7c-442e-8260-26cbf842f702-konnectivity-ca\") pod \"konnectivity-agent-v6rs4\" (UID: \"fb41bc68-2c7c-442e-8260-26cbf842f702\") " pod="kube-system/konnectivity-agent-v6rs4"
Sep 10 20:57:01.773187 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.773019    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/279e54f7-0db1-4e2d-a998-4b3ecdf992cd-ovn-node-metrics-cert\") pod \"ovnkube-node-wrbhk\" (UID: \"279e54f7-0db1-4e2d-a998-4b3ecdf992cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wrbhk"
Sep 10 20:57:01.773327 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.773162    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fb41bc68-2c7c-442e-8260-26cbf842f702-agent-certs\") pod \"konnectivity-agent-v6rs4\" (UID: \"fb41bc68-2c7c-442e-8260-26cbf842f702\") " pod="kube-system/konnectivity-agent-v6rs4"
Sep 10 20:57:01.783316 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.783291    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bb2b\" (UniqueName: \"kubernetes.io/projected/279e54f7-0db1-4e2d-a998-4b3ecdf992cd-kube-api-access-2bb2b\") pod \"ovnkube-node-wrbhk\" (UID: \"279e54f7-0db1-4e2d-a998-4b3ecdf992cd\") " pod="openshift-ovn-kubernetes/ovnkube-node-wrbhk"
Sep 10 20:57:01.786439 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.786413    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pm5f\" (UniqueName: \"kubernetes.io/projected/d9d4569d-ce78-4eaa-b2d1-22c69fb1f3bf-kube-api-access-7pm5f\") pod \"node-resolver-q7mfg\" (UID: \"d9d4569d-ce78-4eaa-b2d1-22c69fb1f3bf\") " pod="openshift-dns/node-resolver-q7mfg"
Sep 10 20:57:01.787331 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.787307    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fq9k\" (UniqueName: \"kubernetes.io/projected/27227947-500c-4146-a89f-798ea3bce890-kube-api-access-5fq9k\") pod \"network-metrics-daemon-zbw7p\" (UID: \"27227947-500c-4146-a89f-798ea3bce890\") " pod="openshift-multus/network-metrics-daemon-zbw7p"
Sep 10 20:57:01.872116 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.871687    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/982ffbde-1f2c-4786-86e2-095af29ab25b-host-run-netns\") pod \"multus-g9h2b\" (UID: \"982ffbde-1f2c-4786-86e2-095af29ab25b\") " pod="openshift-multus/multus-g9h2b"
Sep 10 20:57:01.872116 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.871736    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/982ffbde-1f2c-4786-86e2-095af29ab25b-host-var-lib-cni-multus\") pod \"multus-g9h2b\" (UID: \"982ffbde-1f2c-4786-86e2-095af29ab25b\") " pod="openshift-multus/multus-g9h2b"
Sep 10 20:57:01.872116 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.871767    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d43db309-4d3b-447c-b7b5-d1773f1acfd8-etc-selinux\") pod \"aws-ebs-csi-driver-node-fs4rr\" (UID: \"d43db309-4d3b-447c-b7b5-d1773f1acfd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fs4rr"
Sep 10 20:57:01.872116 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.871795    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1100e6a5-d621-4dd1-b855-13eb97c00682-cni-binary-copy\") pod \"multus-additional-cni-plugins-b5t78\" (UID: \"1100e6a5-d621-4dd1-b855-13eb97c00682\") " pod="openshift-multus/multus-additional-cni-plugins-b5t78"
Sep 10 20:57:01.872116 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.871824    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1bd6c830-3d46-4f96-98b4-b1c595c09609-etc-modprobe-d\") pod \"tuned-jvdfc\" (UID: \"1bd6c830-3d46-4f96-98b4-b1c595c09609\") " pod="openshift-cluster-node-tuning-operator/tuned-jvdfc"
Sep 10 20:57:01.872116 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.871851    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1bd6c830-3d46-4f96-98b4-b1c595c09609-var-lib-kubelet\") pod \"tuned-jvdfc\" (UID: \"1bd6c830-3d46-4f96-98b4-b1c595c09609\") " pod="openshift-cluster-node-tuning-operator/tuned-jvdfc"
Sep 10 20:57:01.872116 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.871882    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/982ffbde-1f2c-4786-86e2-095af29ab25b-cnibin\") pod \"multus-g9h2b\" (UID: \"982ffbde-1f2c-4786-86e2-095af29ab25b\") " pod="openshift-multus/multus-g9h2b"
Sep 10 20:57:01.872116 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.871929    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1bd6c830-3d46-4f96-98b4-b1c595c09609-etc-tuned\") pod \"tuned-jvdfc\" (UID: \"1bd6c830-3d46-4f96-98b4-b1c595c09609\") " pod="openshift-cluster-node-tuning-operator/tuned-jvdfc"
Sep 10 20:57:01.872116 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.871950    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1bd6c830-3d46-4f96-98b4-b1c595c09609-tmp\") pod \"tuned-jvdfc\" (UID: \"1bd6c830-3d46-4f96-98b4-b1c595c09609\") " pod="openshift-cluster-node-tuning-operator/tuned-jvdfc"
Sep 10 20:57:01.872116 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.871977    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/982ffbde-1f2c-4786-86e2-095af29ab25b-host-var-lib-kubelet\") pod \"multus-g9h2b\" (UID: \"982ffbde-1f2c-4786-86e2-095af29ab25b\") " pod="openshift-multus/multus-g9h2b"
Sep 10 20:57:01.872116 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.872003    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/170f8023-6b23-45c5-b7bf-6da8b42be3cd-dbus\") pod \"global-pull-secret-syncer-gzgtl\" (UID: \"170f8023-6b23-45c5-b7bf-6da8b42be3cd\") " pod="kube-system/global-pull-secret-syncer-gzgtl"
Sep 10 20:57:01.872116 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.872033    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1bd6c830-3d46-4f96-98b4-b1c595c09609-etc-sysctl-conf\") pod \"tuned-jvdfc\" (UID: \"1bd6c830-3d46-4f96-98b4-b1c595c09609\") " pod="openshift-cluster-node-tuning-operator/tuned-jvdfc"
Sep 10 20:57:01.872116 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.872060    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kntpt\" (UniqueName: \"kubernetes.io/projected/d43db309-4d3b-447c-b7b5-d1773f1acfd8-kube-api-access-kntpt\") pod \"aws-ebs-csi-driver-node-fs4rr\" (UID: \"d43db309-4d3b-447c-b7b5-d1773f1acfd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fs4rr"
Sep 10 20:57:01.872116 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.872107    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1bd6c830-3d46-4f96-98b4-b1c595c09609-host\") pod \"tuned-jvdfc\" (UID: \"1bd6c830-3d46-4f96-98b4-b1c595c09609\") " pod="openshift-cluster-node-tuning-operator/tuned-jvdfc"
Sep 10 20:57:01.872116 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.872135    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5b37372b-e18e-4c13-abff-11909b3192fb-serviceca\") pod \"node-ca-nwx8r\" (UID: \"5b37372b-e18e-4c13-abff-11909b3192fb\") " pod="openshift-image-registry/node-ca-nwx8r"
Sep 10 20:57:01.872979 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.872163    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/982ffbde-1f2c-4786-86e2-095af29ab25b-host-var-lib-cni-bin\") pod \"multus-g9h2b\" (UID: \"982ffbde-1f2c-4786-86e2-095af29ab25b\") " pod="openshift-multus/multus-g9h2b"
Sep 10 20:57:01.872979 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.872190    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/982ffbde-1f2c-4786-86e2-095af29ab25b-multus-daemon-config\") pod \"multus-g9h2b\" (UID: \"982ffbde-1f2c-4786-86e2-095af29ab25b\") " pod="openshift-multus/multus-g9h2b"
Sep 10 20:57:01.872979 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.872224    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1100e6a5-d621-4dd1-b855-13eb97c00682-tuning-conf-dir\") pod \"multus-additional-cni-plugins-b5t78\" (UID: \"1100e6a5-d621-4dd1-b855-13eb97c00682\") " pod="openshift-multus/multus-additional-cni-plugins-b5t78"
Sep 10 20:57:01.872979 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.872268    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1bd6c830-3d46-4f96-98b4-b1c595c09609-etc-systemd\") pod \"tuned-jvdfc\" (UID: \"1bd6c830-3d46-4f96-98b4-b1c595c09609\") " pod="openshift-cluster-node-tuning-operator/tuned-jvdfc"
Sep 10 20:57:01.872979 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.872294    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5b37372b-e18e-4c13-abff-11909b3192fb-host\") pod \"node-ca-nwx8r\" (UID: \"5b37372b-e18e-4c13-abff-11909b3192fb\") " pod="openshift-image-registry/node-ca-nwx8r"
Sep 10 20:57:01.872979 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.872353    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d43db309-4d3b-447c-b7b5-d1773f1acfd8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fs4rr\" (UID: \"d43db309-4d3b-447c-b7b5-d1773f1acfd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fs4rr"
Sep 10 20:57:01.872979 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.872382    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2678k\" (UniqueName: \"kubernetes.io/projected/8d6511c6-643b-4d56-9d77-4fd8d74b65fc-kube-api-access-2678k\") pod \"network-check-target-srfp2\" (UID: \"8d6511c6-643b-4d56-9d77-4fd8d74b65fc\") " pod="openshift-network-diagnostics/network-check-target-srfp2"
Sep 10 20:57:01.872979 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.872478    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1bd6c830-3d46-4f96-98b4-b1c595c09609-etc-sysconfig\") pod \"tuned-jvdfc\" (UID: \"1bd6c830-3d46-4f96-98b4-b1c595c09609\") " pod="openshift-cluster-node-tuning-operator/tuned-jvdfc"
Sep 10 20:57:01.872979 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.872507    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8w85\" (UniqueName: \"kubernetes.io/projected/1bd6c830-3d46-4f96-98b4-b1c595c09609-kube-api-access-z8w85\") pod \"tuned-jvdfc\" (UID: \"1bd6c830-3d46-4f96-98b4-b1c595c09609\") " pod="openshift-cluster-node-tuning-operator/tuned-jvdfc"
Sep 10 20:57:01.872979 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.872535    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bl569\" (UniqueName: \"kubernetes.io/projected/1100e6a5-d621-4dd1-b855-13eb97c00682-kube-api-access-bl569\") pod \"multus-additional-cni-plugins-b5t78\" (UID: \"1100e6a5-d621-4dd1-b855-13eb97c00682\") " pod="openshift-multus/multus-additional-cni-plugins-b5t78"
Sep 10 20:57:01.872979 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.872574    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/170f8023-6b23-45c5-b7bf-6da8b42be3cd-kubelet-config\") pod \"global-pull-secret-syncer-gzgtl\" (UID: \"170f8023-6b23-45c5-b7bf-6da8b42be3cd\") " pod="kube-system/global-pull-secret-syncer-gzgtl"
Sep 10 20:57:01.872979 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.872596    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1bd6c830-3d46-4f96-98b4-b1c595c09609-run\") pod \"tuned-jvdfc\" (UID: \"1bd6c830-3d46-4f96-98b4-b1c595c09609\") " pod="openshift-cluster-node-tuning-operator/tuned-jvdfc"
Sep 10 20:57:01.872979 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.872629    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d77691cf-bad6-4eb6-ab44-20ad29fad22f-iptables-alerter-script\") pod \"iptables-alerter-88gjz\" (UID: \"d77691cf-bad6-4eb6-ab44-20ad29fad22f\") " pod="openshift-network-operator/iptables-alerter-88gjz"
Sep 10 20:57:01.872979 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.872677    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/170f8023-6b23-45c5-b7bf-6da8b42be3cd-original-pull-secret\") pod \"global-pull-secret-syncer-gzgtl\" (UID: \"170f8023-6b23-45c5-b7bf-6da8b42be3cd\") " pod="kube-system/global-pull-secret-syncer-gzgtl"
Sep 10 20:57:01.872979 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.872707    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1bd6c830-3d46-4f96-98b4-b1c595c09609-etc-sysctl-d\") pod \"tuned-jvdfc\" (UID: \"1bd6c830-3d46-4f96-98b4-b1c595c09609\") " pod="openshift-cluster-node-tuning-operator/tuned-jvdfc"
Sep 10 20:57:01.872979 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.872735    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jz5gh\" (UniqueName: \"kubernetes.io/projected/5b37372b-e18e-4c13-abff-11909b3192fb-kube-api-access-jz5gh\") pod \"node-ca-nwx8r\" (UID: \"5b37372b-e18e-4c13-abff-11909b3192fb\") " pod="openshift-image-registry/node-ca-nwx8r"
Sep 10 20:57:01.872979 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.872752    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1100e6a5-d621-4dd1-b855-13eb97c00682-cni-binary-copy\") pod \"multus-additional-cni-plugins-b5t78\" (UID: \"1100e6a5-d621-4dd1-b855-13eb97c00682\") " pod="openshift-multus/multus-additional-cni-plugins-b5t78"
Sep 10 20:57:01.873581 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.872794    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/982ffbde-1f2c-4786-86e2-095af29ab25b-multus-socket-dir-parent\") pod \"multus-g9h2b\" (UID: \"982ffbde-1f2c-4786-86e2-095af29ab25b\") " pod="openshift-multus/multus-g9h2b"
Sep 10 20:57:01.873581 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.872825    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d43db309-4d3b-447c-b7b5-d1773f1acfd8-registration-dir\") pod \"aws-ebs-csi-driver-node-fs4rr\" (UID: \"d43db309-4d3b-447c-b7b5-d1773f1acfd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fs4rr"
Sep 10 20:57:01.873581 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.872839    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/982ffbde-1f2c-4786-86e2-095af29ab25b-host-run-netns\") pod \"multus-g9h2b\" (UID: \"982ffbde-1f2c-4786-86e2-095af29ab25b\") " pod="openshift-multus/multus-g9h2b"
Sep 10 20:57:01.873581 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.872883    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1bd6c830-3d46-4f96-98b4-b1c595c09609-sys\") pod \"tuned-jvdfc\" (UID: \"1bd6c830-3d46-4f96-98b4-b1c595c09609\") " pod="openshift-cluster-node-tuning-operator/tuned-jvdfc"
Sep 10 20:57:01.873581 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.872919    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d43db309-4d3b-447c-b7b5-d1773f1acfd8-registration-dir\") pod \"aws-ebs-csi-driver-node-fs4rr\" (UID: \"d43db309-4d3b-447c-b7b5-d1773f1acfd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fs4rr"
Sep 10 20:57:01.873581 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.872922    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/982ffbde-1f2c-4786-86e2-095af29ab25b-host-run-k8s-cni-cncf-io\") pod \"multus-g9h2b\" (UID: \"982ffbde-1f2c-4786-86e2-095af29ab25b\") " pod="openshift-multus/multus-g9h2b"
Sep 10 20:57:01.873581 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.872948    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/982ffbde-1f2c-4786-86e2-095af29ab25b-multus-conf-dir\") pod \"multus-g9h2b\" (UID: \"982ffbde-1f2c-4786-86e2-095af29ab25b\") " pod="openshift-multus/multus-g9h2b"
Sep 10 20:57:01.873581 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.873008    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d77691cf-bad6-4eb6-ab44-20ad29fad22f-host-slash\") pod \"iptables-alerter-88gjz\" (UID: \"d77691cf-bad6-4eb6-ab44-20ad29fad22f\") " pod="openshift-network-operator/iptables-alerter-88gjz"
Sep 10 20:57:01.873581 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.873039    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/982ffbde-1f2c-4786-86e2-095af29ab25b-multus-cni-dir\") pod \"multus-g9h2b\" (UID: \"982ffbde-1f2c-4786-86e2-095af29ab25b\") " pod="openshift-multus/multus-g9h2b"
Sep 10 20:57:01.873581 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.873044    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1bd6c830-3d46-4f96-98b4-b1c595c09609-etc-modprobe-d\") pod \"tuned-jvdfc\" (UID: \"1bd6c830-3d46-4f96-98b4-b1c595c09609\") " pod="openshift-cluster-node-tuning-operator/tuned-jvdfc"
Sep 10 20:57:01.873581 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.873099    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d43db309-4d3b-447c-b7b5-d1773f1acfd8-device-dir\") pod \"aws-ebs-csi-driver-node-fs4rr\" (UID: \"d43db309-4d3b-447c-b7b5-d1773f1acfd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fs4rr"
Sep 10 20:57:01.873581 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.873112    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1bd6c830-3d46-4f96-98b4-b1c595c09609-var-lib-kubelet\") pod \"tuned-jvdfc\" (UID: \"1bd6c830-3d46-4f96-98b4-b1c595c09609\") " pod="openshift-cluster-node-tuning-operator/tuned-jvdfc"
Sep 10 20:57:01.873581 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.873154    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5gjk\" (UniqueName: \"kubernetes.io/projected/d77691cf-bad6-4eb6-ab44-20ad29fad22f-kube-api-access-v5gjk\") pod \"iptables-alerter-88gjz\" (UID: \"d77691cf-bad6-4eb6-ab44-20ad29fad22f\") " pod="openshift-network-operator/iptables-alerter-88gjz"
Sep 10 20:57:01.873581 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.873172    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/982ffbde-1f2c-4786-86e2-095af29ab25b-cnibin\") pod \"multus-g9h2b\" (UID: \"982ffbde-1f2c-4786-86e2-095af29ab25b\") " pod="openshift-multus/multus-g9h2b"
Sep 10 20:57:01.873581 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.873189    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/982ffbde-1f2c-4786-86e2-095af29ab25b-cni-binary-copy\") pod \"multus-g9h2b\" (UID: \"982ffbde-1f2c-4786-86e2-095af29ab25b\") " pod="openshift-multus/multus-g9h2b"
Sep 10 20:57:01.873581 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.873261    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/982ffbde-1f2c-4786-86e2-095af29ab25b-etc-kubernetes\") pod \"multus-g9h2b\" (UID: \"982ffbde-1f2c-4786-86e2-095af29ab25b\") " pod="openshift-multus/multus-g9h2b"
Sep 10 20:57:01.873581 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.873289    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1100e6a5-d621-4dd1-b855-13eb97c00682-system-cni-dir\") pod \"multus-additional-cni-plugins-b5t78\" (UID: \"1100e6a5-d621-4dd1-b855-13eb97c00682\") " pod="openshift-multus/multus-additional-cni-plugins-b5t78"
Sep 10 20:57:01.874392 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.873321    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1100e6a5-d621-4dd1-b855-13eb97c00682-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-b5t78\" (UID: \"1100e6a5-d621-4dd1-b855-13eb97c00682\") " pod="openshift-multus/multus-additional-cni-plugins-b5t78"
Sep 10 20:57:01.874392 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.873383    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/982ffbde-1f2c-4786-86e2-095af29ab25b-system-cni-dir\") pod \"multus-g9h2b\" (UID: \"982ffbde-1f2c-4786-86e2-095af29ab25b\") " pod="openshift-multus/multus-g9h2b"
Sep 10 20:57:01.874392 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.873439    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/982ffbde-1f2c-4786-86e2-095af29ab25b-host-run-multus-certs\") pod \"multus-g9h2b\" (UID: \"982ffbde-1f2c-4786-86e2-095af29ab25b\") " pod="openshift-multus/multus-g9h2b"
Sep 10 20:57:01.874392 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.873481    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvljr\" (UniqueName: \"kubernetes.io/projected/982ffbde-1f2c-4786-86e2-095af29ab25b-kube-api-access-fvljr\") pod \"multus-g9h2b\" (UID: \"982ffbde-1f2c-4786-86e2-095af29ab25b\") " pod="openshift-multus/multus-g9h2b"
Sep 10 20:57:01.874392 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.873505    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d43db309-4d3b-447c-b7b5-d1773f1acfd8-socket-dir\") pod \"aws-ebs-csi-driver-node-fs4rr\" (UID: \"d43db309-4d3b-447c-b7b5-d1773f1acfd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fs4rr"
Sep 10 20:57:01.874392 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.873535    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d43db309-4d3b-447c-b7b5-d1773f1acfd8-sys-fs\") pod \"aws-ebs-csi-driver-node-fs4rr\" (UID: \"d43db309-4d3b-447c-b7b5-d1773f1acfd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fs4rr"
Sep 10 20:57:01.874392 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.873565    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1100e6a5-d621-4dd1-b855-13eb97c00682-cnibin\") pod \"multus-additional-cni-plugins-b5t78\" (UID: \"1100e6a5-d621-4dd1-b855-13eb97c00682\") " pod="openshift-multus/multus-additional-cni-plugins-b5t78"
Sep 10 20:57:01.874392 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.873614    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1100e6a5-d621-4dd1-b855-13eb97c00682-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-b5t78\" (UID: \"1100e6a5-d621-4dd1-b855-13eb97c00682\") " pod="openshift-multus/multus-additional-cni-plugins-b5t78"
Sep 10 20:57:01.874392 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.873686    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/982ffbde-1f2c-4786-86e2-095af29ab25b-hostroot\") pod \"multus-g9h2b\" (UID: \"982ffbde-1f2c-4786-86e2-095af29ab25b\") " pod="openshift-multus/multus-g9h2b"
Sep 10 20:57:01.874392 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.873713    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1bd6c830-3d46-4f96-98b4-b1c595c09609-etc-kubernetes\") pod \"tuned-jvdfc\" (UID: \"1bd6c830-3d46-4f96-98b4-b1c595c09609\") " pod="openshift-cluster-node-tuning-operator/tuned-jvdfc"
Sep 10 20:57:01.874392 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.873743    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1bd6c830-3d46-4f96-98b4-b1c595c09609-lib-modules\") pod \"tuned-jvdfc\" (UID: \"1bd6c830-3d46-4f96-98b4-b1c595c09609\") " pod="openshift-cluster-node-tuning-operator/tuned-jvdfc"
Sep 10 20:57:01.874392 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.873746    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5b37372b-e18e-4c13-abff-11909b3192fb-host\") pod \"node-ca-nwx8r\" (UID: \"5b37372b-e18e-4c13-abff-11909b3192fb\") " pod="openshift-image-registry/node-ca-nwx8r"
Sep 10 20:57:01.874392 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.873779    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1bd6c830-3d46-4f96-98b4-b1c595c09609-host\") pod \"tuned-jvdfc\" (UID: \"1bd6c830-3d46-4f96-98b4-b1c595c09609\") " pod="openshift-cluster-node-tuning-operator/tuned-jvdfc"
Sep 10 20:57:01.874392 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.873880    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d43db309-4d3b-447c-b7b5-d1773f1acfd8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fs4rr\" (UID: \"d43db309-4d3b-447c-b7b5-d1773f1acfd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fs4rr"
Sep 10 20:57:01.874392 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.873893    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/982ffbde-1f2c-4786-86e2-095af29ab25b-host-var-lib-cni-multus\") pod \"multus-g9h2b\" (UID: \"982ffbde-1f2c-4786-86e2-095af29ab25b\") " pod="openshift-multus/multus-g9h2b"
Sep 10 20:57:01.874392 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.874103    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1bd6c830-3d46-4f96-98b4-b1c595c09609-etc-sysconfig\") pod \"tuned-jvdfc\" (UID: \"1bd6c830-3d46-4f96-98b4-b1c595c09609\") " pod="openshift-cluster-node-tuning-operator/tuned-jvdfc"
Sep 10 20:57:01.874392 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.874278    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d43db309-4d3b-447c-b7b5-d1773f1acfd8-etc-selinux\") pod \"aws-ebs-csi-driver-node-fs4rr\" (UID: \"d43db309-4d3b-447c-b7b5-d1773f1acfd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fs4rr"
Sep 10 20:57:01.875298 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.874292    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d43db309-4d3b-447c-b7b5-d1773f1acfd8-socket-dir\") pod \"aws-ebs-csi-driver-node-fs4rr\" (UID: \"d43db309-4d3b-447c-b7b5-d1773f1acfd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fs4rr"
Sep 10 20:57:01.875298 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.874362    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1100e6a5-d621-4dd1-b855-13eb97c00682-cnibin\") pod \"multus-additional-cni-plugins-b5t78\" (UID: \"1100e6a5-d621-4dd1-b855-13eb97c00682\") " pod="openshift-multus/multus-additional-cni-plugins-b5t78"
Sep 10 20:57:01.875298 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.874415    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/982ffbde-1f2c-4786-86e2-095af29ab25b-hostroot\") pod \"multus-g9h2b\" (UID: \"982ffbde-1f2c-4786-86e2-095af29ab25b\") " pod="openshift-multus/multus-g9h2b"
Sep 10 20:57:01.875298 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.874453    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1bd6c830-3d46-4f96-98b4-b1c595c09609-sys\") pod \"tuned-jvdfc\" (UID: \"1bd6c830-3d46-4f96-98b4-b1c595c09609\") " pod="openshift-cluster-node-tuning-operator/tuned-jvdfc"
Sep 10 20:57:01.875298 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.874515    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/982ffbde-1f2c-4786-86e2-095af29ab25b-host-run-k8s-cni-cncf-io\") pod \"multus-g9h2b\" (UID: \"982ffbde-1f2c-4786-86e2-095af29ab25b\") " pod="openshift-multus/multus-g9h2b"
Sep 10 20:57:01.875298 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.874560    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/982ffbde-1f2c-4786-86e2-095af29ab25b-multus-conf-dir\") pod \"multus-g9h2b\" (UID: \"982ffbde-1f2c-4786-86e2-095af29ab25b\") " pod="openshift-multus/multus-g9h2b"
Sep 10 20:57:01.875298 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.874610    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d77691cf-bad6-4eb6-ab44-20ad29fad22f-host-slash\") pod \"iptables-alerter-88gjz\" (UID: \"d77691cf-bad6-4eb6-ab44-20ad29fad22f\") " pod="openshift-network-operator/iptables-alerter-88gjz"
Sep 10 20:57:01.875298 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.874678    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5b37372b-e18e-4c13-abff-11909b3192fb-serviceca\") pod \"node-ca-nwx8r\" (UID: \"5b37372b-e18e-4c13-abff-11909b3192fb\") " pod="openshift-image-registry/node-ca-nwx8r"
Sep 10 20:57:01.875298 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.874704    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/982ffbde-1f2c-4786-86e2-095af29ab25b-multus-cni-dir\") pod \"multus-g9h2b\" (UID: \"982ffbde-1f2c-4786-86e2-095af29ab25b\") " pod="openshift-multus/multus-g9h2b"
Sep 10 20:57:01.875298 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.874713    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1bd6c830-3d46-4f96-98b4-b1c595c09609-lib-modules\") pod \"tuned-jvdfc\" (UID: \"1bd6c830-3d46-4f96-98b4-b1c595c09609\") " pod="openshift-cluster-node-tuning-operator/tuned-jvdfc"
Sep 10 20:57:01.875298 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.874761    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d43db309-4d3b-447c-b7b5-d1773f1acfd8-device-dir\") pod \"aws-ebs-csi-driver-node-fs4rr\" (UID: \"d43db309-4d3b-447c-b7b5-d1773f1acfd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fs4rr"
Sep 10 20:57:01.875298 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.874768    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1bd6c830-3d46-4f96-98b4-b1c595c09609-etc-kubernetes\") pod \"tuned-jvdfc\" (UID: \"1bd6c830-3d46-4f96-98b4-b1c595c09609\") " pod="openshift-cluster-node-tuning-operator/tuned-jvdfc"
Sep 10 20:57:01.875298 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.874825    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1bd6c830-3d46-4f96-98b4-b1c595c09609-run\") pod \"tuned-jvdfc\" (UID: \"1bd6c830-3d46-4f96-98b4-b1c595c09609\") " pod="openshift-cluster-node-tuning-operator/tuned-jvdfc"
Sep 10 20:57:01.875298 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:01.874860    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 20:57:01.875298 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:01.874919    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/170f8023-6b23-45c5-b7bf-6da8b42be3cd-original-pull-secret podName:170f8023-6b23-45c5-b7bf-6da8b42be3cd nodeName:}" failed. No retries permitted until 2026-09-10 20:57:02.374896719 +0000 UTC m=+3.061963981 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/170f8023-6b23-45c5-b7bf-6da8b42be3cd-original-pull-secret") pod "global-pull-secret-syncer-gzgtl" (UID: "170f8023-6b23-45c5-b7bf-6da8b42be3cd") : object "kube-system"/"original-pull-secret" not registered
Sep 10 20:57:01.875298 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.875042    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1100e6a5-d621-4dd1-b855-13eb97c00682-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-b5t78\" (UID: \"1100e6a5-d621-4dd1-b855-13eb97c00682\") " pod="openshift-multus/multus-additional-cni-plugins-b5t78"
Sep 10 20:57:01.875298 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.875069    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d43db309-4d3b-447c-b7b5-d1773f1acfd8-sys-fs\") pod \"aws-ebs-csi-driver-node-fs4rr\" (UID: \"d43db309-4d3b-447c-b7b5-d1773f1acfd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fs4rr"
Sep 10 20:57:01.875985 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.875126    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/170f8023-6b23-45c5-b7bf-6da8b42be3cd-dbus\") pod \"global-pull-secret-syncer-gzgtl\" (UID: \"170f8023-6b23-45c5-b7bf-6da8b42be3cd\") " pod="kube-system/global-pull-secret-syncer-gzgtl"
Sep 10 20:57:01.875985 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.875170    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/982ffbde-1f2c-4786-86e2-095af29ab25b-host-var-lib-cni-bin\") pod \"multus-g9h2b\" (UID: \"982ffbde-1f2c-4786-86e2-095af29ab25b\") " pod="openshift-multus/multus-g9h2b"
Sep 10 20:57:01.875985 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.875214    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1bd6c830-3d46-4f96-98b4-b1c595c09609-etc-sysctl-d\") pod \"tuned-jvdfc\" (UID: \"1bd6c830-3d46-4f96-98b4-b1c595c09609\") " pod="openshift-cluster-node-tuning-operator/tuned-jvdfc"
Sep 10 20:57:01.875985 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.875392    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1100e6a5-d621-4dd1-b855-13eb97c00682-tuning-conf-dir\") pod \"multus-additional-cni-plugins-b5t78\" (UID: \"1100e6a5-d621-4dd1-b855-13eb97c00682\") " pod="openshift-multus/multus-additional-cni-plugins-b5t78"
Sep 10 20:57:01.875985 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.875564    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1bd6c830-3d46-4f96-98b4-b1c595c09609-etc-sysctl-conf\") pod \"tuned-jvdfc\" (UID: \"1bd6c830-3d46-4f96-98b4-b1c595c09609\") " pod="openshift-cluster-node-tuning-operator/tuned-jvdfc"
Sep 10 20:57:01.875985 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.875618    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d77691cf-bad6-4eb6-ab44-20ad29fad22f-iptables-alerter-script\") pod \"iptables-alerter-88gjz\" (UID: \"d77691cf-bad6-4eb6-ab44-20ad29fad22f\") " pod="openshift-network-operator/iptables-alerter-88gjz"
Sep 10 20:57:01.875985 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.875774    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/982ffbde-1f2c-4786-86e2-095af29ab25b-multus-daemon-config\") pod \"multus-g9h2b\" (UID: \"982ffbde-1f2c-4786-86e2-095af29ab25b\") " pod="openshift-multus/multus-g9h2b"
Sep 10 20:57:01.875985 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.875864    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1bd6c830-3d46-4f96-98b4-b1c595c09609-etc-systemd\") pod \"tuned-jvdfc\" (UID: \"1bd6c830-3d46-4f96-98b4-b1c595c09609\") " pod="openshift-cluster-node-tuning-operator/tuned-jvdfc"
Sep 10 20:57:01.875985 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.875914    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/982ffbde-1f2c-4786-86e2-095af29ab25b-multus-socket-dir-parent\") pod \"multus-g9h2b\" (UID: \"982ffbde-1f2c-4786-86e2-095af29ab25b\") " pod="openshift-multus/multus-g9h2b"
Sep 10 20:57:01.875985 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.875923    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/982ffbde-1f2c-4786-86e2-095af29ab25b-cni-binary-copy\") pod \"multus-g9h2b\" (UID: \"982ffbde-1f2c-4786-86e2-095af29ab25b\") " pod="openshift-multus/multus-g9h2b"
Sep 10 20:57:01.875985 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.875956    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/170f8023-6b23-45c5-b7bf-6da8b42be3cd-kubelet-config\") pod \"global-pull-secret-syncer-gzgtl\" (UID: \"170f8023-6b23-45c5-b7bf-6da8b42be3cd\") " pod="kube-system/global-pull-secret-syncer-gzgtl"
Sep 10 20:57:01.876384 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.876012    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/982ffbde-1f2c-4786-86e2-095af29ab25b-system-cni-dir\") pod \"multus-g9h2b\" (UID: \"982ffbde-1f2c-4786-86e2-095af29ab25b\") " pod="openshift-multus/multus-g9h2b"
Sep 10 20:57:01.876384 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.876064    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/982ffbde-1f2c-4786-86e2-095af29ab25b-etc-kubernetes\") pod \"multus-g9h2b\" (UID: \"982ffbde-1f2c-4786-86e2-095af29ab25b\") " pod="openshift-multus/multus-g9h2b"
Sep 10 20:57:01.876384 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.876078    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1100e6a5-d621-4dd1-b855-13eb97c00682-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-b5t78\" (UID: \"1100e6a5-d621-4dd1-b855-13eb97c00682\") " pod="openshift-multus/multus-additional-cni-plugins-b5t78"
Sep 10 20:57:01.876467 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.876387    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/982ffbde-1f2c-4786-86e2-095af29ab25b-host-var-lib-kubelet\") pod \"multus-g9h2b\" (UID: \"982ffbde-1f2c-4786-86e2-095af29ab25b\") " pod="openshift-multus/multus-g9h2b"
Sep 10 20:57:01.876467 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.876408    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1bd6c830-3d46-4f96-98b4-b1c595c09609-etc-tuned\") pod \"tuned-jvdfc\" (UID: \"1bd6c830-3d46-4f96-98b4-b1c595c09609\") " pod="openshift-cluster-node-tuning-operator/tuned-jvdfc"
Sep 10 20:57:01.876467 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.876412    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1bd6c830-3d46-4f96-98b4-b1c595c09609-tmp\") pod \"tuned-jvdfc\" (UID: \"1bd6c830-3d46-4f96-98b4-b1c595c09609\") " pod="openshift-cluster-node-tuning-operator/tuned-jvdfc"
Sep 10 20:57:01.877597 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.876597    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1100e6a5-d621-4dd1-b855-13eb97c00682-system-cni-dir\") pod \"multus-additional-cni-plugins-b5t78\" (UID: \"1100e6a5-d621-4dd1-b855-13eb97c00682\") " pod="openshift-multus/multus-additional-cni-plugins-b5t78"
Sep 10 20:57:01.877597 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.876608    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/982ffbde-1f2c-4786-86e2-095af29ab25b-host-run-multus-certs\") pod \"multus-g9h2b\" (UID: \"982ffbde-1f2c-4786-86e2-095af29ab25b\") " pod="openshift-multus/multus-g9h2b"
Sep 10 20:57:01.879027 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.878959    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-100.ec2.internal" event={"ID":"c8c06af6dd33d8a03dd3e75bceae61bb","Type":"ContainerStarted","Data":"8b7b20ef86ed32ed9ddadce0f23f7de9a1fbd1854f4ef144a5e9cb9657d1b9d4"}
Sep 10 20:57:01.880738 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.880719    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-100.ec2.internal" event={"ID":"39d7ad530ef8927e7726fb19029c9345","Type":"ContainerStarted","Data":"82786ea2edec43dfddb21ae519776681625872cc17f8e2e1e84a67462ce6220a"}
Sep 10 20:57:01.884997 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:01.884906    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 20:57:01.884997 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:01.884931    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 20:57:01.884997 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:01.884946    2564 projected.go:196] Error preparing data for projected volume kube-api-access-2678k for pod openshift-network-diagnostics/network-check-target-srfp2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 20:57:01.885341 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:01.885008    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8d6511c6-643b-4d56-9d77-4fd8d74b65fc-kube-api-access-2678k podName:8d6511c6-643b-4d56-9d77-4fd8d74b65fc nodeName:}" failed. No retries permitted until 2026-09-10 20:57:02.384990299 +0000 UTC m=+3.072057578 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2678k" (UniqueName: "kubernetes.io/projected/8d6511c6-643b-4d56-9d77-4fd8d74b65fc-kube-api-access-2678k") pod "network-check-target-srfp2" (UID: "8d6511c6-643b-4d56-9d77-4fd8d74b65fc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 20:57:01.888286 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.888186    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvljr\" (UniqueName: \"kubernetes.io/projected/982ffbde-1f2c-4786-86e2-095af29ab25b-kube-api-access-fvljr\") pod \"multus-g9h2b\" (UID: \"982ffbde-1f2c-4786-86e2-095af29ab25b\") " pod="openshift-multus/multus-g9h2b"
Sep 10 20:57:01.891940 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.891912    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bl569\" (UniqueName: \"kubernetes.io/projected/1100e6a5-d621-4dd1-b855-13eb97c00682-kube-api-access-bl569\") pod \"multus-additional-cni-plugins-b5t78\" (UID: \"1100e6a5-d621-4dd1-b855-13eb97c00682\") " pod="openshift-multus/multus-additional-cni-plugins-b5t78"
Sep 10 20:57:01.892439 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.892395    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8w85\" (UniqueName: \"kubernetes.io/projected/1bd6c830-3d46-4f96-98b4-b1c595c09609-kube-api-access-z8w85\") pod \"tuned-jvdfc\" (UID: \"1bd6c830-3d46-4f96-98b4-b1c595c09609\") " pod="openshift-cluster-node-tuning-operator/tuned-jvdfc"
Sep 10 20:57:01.892821 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.892753    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5gjk\" (UniqueName: \"kubernetes.io/projected/d77691cf-bad6-4eb6-ab44-20ad29fad22f-kube-api-access-v5gjk\") pod \"iptables-alerter-88gjz\" (UID: \"d77691cf-bad6-4eb6-ab44-20ad29fad22f\") " pod="openshift-network-operator/iptables-alerter-88gjz"
Sep 10 20:57:01.893244 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.893210    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jz5gh\" (UniqueName: \"kubernetes.io/projected/5b37372b-e18e-4c13-abff-11909b3192fb-kube-api-access-jz5gh\") pod \"node-ca-nwx8r\" (UID: \"5b37372b-e18e-4c13-abff-11909b3192fb\") " pod="openshift-image-registry/node-ca-nwx8r"
Sep 10 20:57:01.893551 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.893506    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kntpt\" (UniqueName: \"kubernetes.io/projected/d43db309-4d3b-447c-b7b5-d1773f1acfd8-kube-api-access-kntpt\") pod \"aws-ebs-csi-driver-node-fs4rr\" (UID: \"d43db309-4d3b-447c-b7b5-d1773f1acfd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fs4rr"
Sep 10 20:57:01.961675 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.961616    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-v6rs4"
Sep 10 20:57:01.973442 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.973333    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-q7mfg"
Sep 10 20:57:01.983943 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.983920    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wrbhk"
Sep 10 20:57:01.984051 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:57:01.983985    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9d4569d_ce78_4eaa_b2d1_22c69fb1f3bf.slice/crio-79d807ad3ae78c9a77f89dbf3266042b8a87e3bd4390724db8e728c0e66b9b42 WatchSource:0}: Error finding container 79d807ad3ae78c9a77f89dbf3266042b8a87e3bd4390724db8e728c0e66b9b42: Status 404 returned error can't find the container with id 79d807ad3ae78c9a77f89dbf3266042b8a87e3bd4390724db8e728c0e66b9b42
Sep 10 20:57:01.992858 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:01.992694    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-88gjz"
Sep 10 20:57:01.993942 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:57:01.993922    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod279e54f7_0db1_4e2d_a998_4b3ecdf992cd.slice/crio-cb2451c455b106a553d926dd1220a6952ecb777c34609094377567cedc3184af WatchSource:0}: Error finding container cb2451c455b106a553d926dd1220a6952ecb777c34609094377567cedc3184af: Status 404 returned error can't find the container with id cb2451c455b106a553d926dd1220a6952ecb777c34609094377567cedc3184af
Sep 10 20:57:02.001534 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:02.001480    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-b5t78"
Sep 10 20:57:02.001790 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:57:02.001766    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd77691cf_bad6_4eb6_ab44_20ad29fad22f.slice/crio-cabee3657a2c816a58e93a143e6d7ee80ffb83e0c2e50b733a427bc6db9c018a WatchSource:0}: Error finding container cabee3657a2c816a58e93a143e6d7ee80ffb83e0c2e50b733a427bc6db9c018a: Status 404 returned error can't find the container with id cabee3657a2c816a58e93a143e6d7ee80ffb83e0c2e50b733a427bc6db9c018a
Sep 10 20:57:02.010530 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:02.010490    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-g9h2b"
Sep 10 20:57:02.020587 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:02.020560    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fs4rr"
Sep 10 20:57:02.027418 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:02.027322    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jvdfc"
Sep 10 20:57:02.035036 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:02.035016    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nwx8r"
Sep 10 20:57:02.117976 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:02.117944    2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 20:57:02.276424 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:02.276350    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27227947-500c-4146-a89f-798ea3bce890-metrics-certs\") pod \"network-metrics-daemon-zbw7p\" (UID: \"27227947-500c-4146-a89f-798ea3bce890\") " pod="openshift-multus/network-metrics-daemon-zbw7p"
Sep 10 20:57:02.276572 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:02.276461    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 20:57:02.276572 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:02.276527    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27227947-500c-4146-a89f-798ea3bce890-metrics-certs podName:27227947-500c-4146-a89f-798ea3bce890 nodeName:}" failed. No retries permitted until 2026-09-10 20:57:03.276507253 +0000 UTC m=+3.963574515 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/27227947-500c-4146-a89f-798ea3bce890-metrics-certs") pod "network-metrics-daemon-zbw7p" (UID: "27227947-500c-4146-a89f-798ea3bce890") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 20:57:02.377674 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:02.377641    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/170f8023-6b23-45c5-b7bf-6da8b42be3cd-original-pull-secret\") pod \"global-pull-secret-syncer-gzgtl\" (UID: \"170f8023-6b23-45c5-b7bf-6da8b42be3cd\") " pod="kube-system/global-pull-secret-syncer-gzgtl"
Sep 10 20:57:02.377832 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:02.377785    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 20:57:02.377876 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:02.377844    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/170f8023-6b23-45c5-b7bf-6da8b42be3cd-original-pull-secret podName:170f8023-6b23-45c5-b7bf-6da8b42be3cd nodeName:}" failed. No retries permitted until 2026-09-10 20:57:03.377831391 +0000 UTC m=+4.064898648 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/170f8023-6b23-45c5-b7bf-6da8b42be3cd-original-pull-secret") pod "global-pull-secret-syncer-gzgtl" (UID: "170f8023-6b23-45c5-b7bf-6da8b42be3cd") : object "kube-system"/"original-pull-secret" not registered
Sep 10 20:57:02.478516 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:02.478478    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2678k\" (UniqueName: \"kubernetes.io/projected/8d6511c6-643b-4d56-9d77-4fd8d74b65fc-kube-api-access-2678k\") pod \"network-check-target-srfp2\" (UID: \"8d6511c6-643b-4d56-9d77-4fd8d74b65fc\") " pod="openshift-network-diagnostics/network-check-target-srfp2"
Sep 10 20:57:02.478728 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:02.478689    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 20:57:02.478728 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:02.478715    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 20:57:02.478728 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:02.478727    2564 projected.go:196] Error preparing data for projected volume kube-api-access-2678k for pod openshift-network-diagnostics/network-check-target-srfp2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 20:57:02.478980 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:02.478787    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8d6511c6-643b-4d56-9d77-4fd8d74b65fc-kube-api-access-2678k podName:8d6511c6-643b-4d56-9d77-4fd8d74b65fc nodeName:}" failed. No retries permitted until 2026-09-10 20:57:03.47877013 +0000 UTC m=+4.165837388 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2678k" (UniqueName: "kubernetes.io/projected/8d6511c6-643b-4d56-9d77-4fd8d74b65fc-kube-api-access-2678k") pod "network-check-target-srfp2" (UID: "8d6511c6-643b-4d56-9d77-4fd8d74b65fc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 20:57:02.720734 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:02.720627    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 20:52:01 +0000 UTC" deadline="2028-02-22 17:23:29.951176432 +0000 UTC"
Sep 10 20:57:02.720734 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:02.720692    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12716h26m27.230495312s"
Sep 10 20:57:02.867384 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:02.867353    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zbw7p"
Sep 10 20:57:02.867525 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:02.867493    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zbw7p" podUID="27227947-500c-4146-a89f-798ea3bce890"
Sep 10 20:57:02.885192 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:02.885158    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-88gjz" event={"ID":"d77691cf-bad6-4eb6-ab44-20ad29fad22f","Type":"ContainerStarted","Data":"cabee3657a2c816a58e93a143e6d7ee80ffb83e0c2e50b733a427bc6db9c018a"}
Sep 10 20:57:02.886681 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:02.886659    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wrbhk" event={"ID":"279e54f7-0db1-4e2d-a998-4b3ecdf992cd","Type":"ContainerStarted","Data":"cb2451c455b106a553d926dd1220a6952ecb777c34609094377567cedc3184af"}
Sep 10 20:57:02.888178 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:02.888154    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-q7mfg" event={"ID":"d9d4569d-ce78-4eaa-b2d1-22c69fb1f3bf","Type":"ContainerStarted","Data":"79d807ad3ae78c9a77f89dbf3266042b8a87e3bd4390724db8e728c0e66b9b42"}
Sep 10 20:57:02.889858 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:02.889702    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-v6rs4" event={"ID":"fb41bc68-2c7c-442e-8260-26cbf842f702","Type":"ContainerStarted","Data":"af15220c32ffc1d46e5c5cd22588b47839cdcafdc9fecb019f93bcb7b98f4b2e"}
Sep 10 20:57:03.262430 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:57:03.262294    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd43db309_4d3b_447c_b7b5_d1773f1acfd8.slice/crio-45bf7e4b33b74832281c7fa235cbc1495e9597c99c8b7e7f0b0008aaf048ca0e WatchSource:0}: Error finding container 45bf7e4b33b74832281c7fa235cbc1495e9597c99c8b7e7f0b0008aaf048ca0e: Status 404 returned error can't find the container with id 45bf7e4b33b74832281c7fa235cbc1495e9597c99c8b7e7f0b0008aaf048ca0e
Sep 10 20:57:03.276599 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:57:03.275891    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b37372b_e18e_4c13_abff_11909b3192fb.slice/crio-20758daffb8c10eb27bdf44003a55103bdec6377a487d6c058d61efb5d584a06 WatchSource:0}: Error finding container 20758daffb8c10eb27bdf44003a55103bdec6377a487d6c058d61efb5d584a06: Status 404 returned error can't find the container with id 20758daffb8c10eb27bdf44003a55103bdec6377a487d6c058d61efb5d584a06
Sep 10 20:57:03.279825 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:57:03.278408    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod982ffbde_1f2c_4786_86e2_095af29ab25b.slice/crio-b96545e645261fa048ab3372471e6692b3fd29f2437529d2616e4b4c4d45ac28 WatchSource:0}: Error finding container b96545e645261fa048ab3372471e6692b3fd29f2437529d2616e4b4c4d45ac28: Status 404 returned error can't find the container with id b96545e645261fa048ab3372471e6692b3fd29f2437529d2616e4b4c4d45ac28
Sep 10 20:57:03.282511 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:57:03.280689    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1100e6a5_d621_4dd1_b855_13eb97c00682.slice/crio-cd07f2ffcdeb8eea3e1643cd930757a9ded2b7887ad3eef3db3d23c59efeedbc WatchSource:0}: Error finding container cd07f2ffcdeb8eea3e1643cd930757a9ded2b7887ad3eef3db3d23c59efeedbc: Status 404 returned error can't find the container with id cd07f2ffcdeb8eea3e1643cd930757a9ded2b7887ad3eef3db3d23c59efeedbc
Sep 10 20:57:03.285466 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:03.285252    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27227947-500c-4146-a89f-798ea3bce890-metrics-certs\") pod \"network-metrics-daemon-zbw7p\" (UID: \"27227947-500c-4146-a89f-798ea3bce890\") " pod="openshift-multus/network-metrics-daemon-zbw7p"
Sep 10 20:57:03.285466 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:03.285365    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 20:57:03.285466 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:03.285421    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27227947-500c-4146-a89f-798ea3bce890-metrics-certs podName:27227947-500c-4146-a89f-798ea3bce890 nodeName:}" failed. No retries permitted until 2026-09-10 20:57:05.285402448 +0000 UTC m=+5.972469720 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/27227947-500c-4146-a89f-798ea3bce890-metrics-certs") pod "network-metrics-daemon-zbw7p" (UID: "27227947-500c-4146-a89f-798ea3bce890") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 20:57:03.386380 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:03.386352    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/170f8023-6b23-45c5-b7bf-6da8b42be3cd-original-pull-secret\") pod \"global-pull-secret-syncer-gzgtl\" (UID: \"170f8023-6b23-45c5-b7bf-6da8b42be3cd\") " pod="kube-system/global-pull-secret-syncer-gzgtl"
Sep 10 20:57:03.386520 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:03.386488    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 20:57:03.386583 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:03.386553    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/170f8023-6b23-45c5-b7bf-6da8b42be3cd-original-pull-secret podName:170f8023-6b23-45c5-b7bf-6da8b42be3cd nodeName:}" failed. No retries permitted until 2026-09-10 20:57:05.386533013 +0000 UTC m=+6.073600291 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/170f8023-6b23-45c5-b7bf-6da8b42be3cd-original-pull-secret") pod "global-pull-secret-syncer-gzgtl" (UID: "170f8023-6b23-45c5-b7bf-6da8b42be3cd") : object "kube-system"/"original-pull-secret" not registered
Sep 10 20:57:03.487218 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:03.487175    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2678k\" (UniqueName: \"kubernetes.io/projected/8d6511c6-643b-4d56-9d77-4fd8d74b65fc-kube-api-access-2678k\") pod \"network-check-target-srfp2\" (UID: \"8d6511c6-643b-4d56-9d77-4fd8d74b65fc\") " pod="openshift-network-diagnostics/network-check-target-srfp2"
Sep 10 20:57:03.487431 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:03.487413    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 20:57:03.487513 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:03.487438    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 20:57:03.487513 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:03.487451    2564 projected.go:196] Error preparing data for projected volume kube-api-access-2678k for pod openshift-network-diagnostics/network-check-target-srfp2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 20:57:03.487513 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:03.487506    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8d6511c6-643b-4d56-9d77-4fd8d74b65fc-kube-api-access-2678k podName:8d6511c6-643b-4d56-9d77-4fd8d74b65fc nodeName:}" failed. No retries permitted until 2026-09-10 20:57:05.487487239 +0000 UTC m=+6.174554499 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2678k" (UniqueName: "kubernetes.io/projected/8d6511c6-643b-4d56-9d77-4fd8d74b65fc-kube-api-access-2678k") pod "network-check-target-srfp2" (UID: "8d6511c6-643b-4d56-9d77-4fd8d74b65fc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 20:57:03.721158 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:03.721108    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 20:52:01 +0000 UTC" deadline="2028-03-31 08:02:18.882279201 +0000 UTC"
Sep 10 20:57:03.721158 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:03.721138    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13619h5m15.161144821s"
Sep 10 20:57:03.870476 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:03.869806    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gzgtl"
Sep 10 20:57:03.870476 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:03.869928    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gzgtl" podUID="170f8023-6b23-45c5-b7bf-6da8b42be3cd"
Sep 10 20:57:03.870476 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:03.870327    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srfp2"
Sep 10 20:57:03.870476 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:03.870414    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srfp2" podUID="8d6511c6-643b-4d56-9d77-4fd8d74b65fc"
Sep 10 20:57:03.895272 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:03.895125    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fs4rr" event={"ID":"d43db309-4d3b-447c-b7b5-d1773f1acfd8","Type":"ContainerStarted","Data":"45bf7e4b33b74832281c7fa235cbc1495e9597c99c8b7e7f0b0008aaf048ca0e"}
Sep 10 20:57:03.897917 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:03.897890    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-100.ec2.internal" event={"ID":"c8c06af6dd33d8a03dd3e75bceae61bb","Type":"ContainerStarted","Data":"fa63568b368ddb7c47b60b727d9cc6deb967424282b712d644c89d328881822e"}
Sep 10 20:57:03.899630 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:03.899605    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nwx8r" event={"ID":"5b37372b-e18e-4c13-abff-11909b3192fb","Type":"ContainerStarted","Data":"20758daffb8c10eb27bdf44003a55103bdec6377a487d6c058d61efb5d584a06"}
Sep 10 20:57:03.901819 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:03.901796    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jvdfc" event={"ID":"1bd6c830-3d46-4f96-98b4-b1c595c09609","Type":"ContainerStarted","Data":"8bac950b8863bf0aff1095de34d07f72221602faaee6630557440953ff33b578"}
Sep 10 20:57:03.904016 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:03.903989    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-100.ec2.internal" event={"ID":"39d7ad530ef8927e7726fb19029c9345","Type":"ContainerStarted","Data":"5c90dcf0577dafe7e30380e533704e8e0dac82ed4fd97b25e1b0a152368a43d9"}
Sep 10 20:57:03.905888 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:03.905866    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b5t78" event={"ID":"1100e6a5-d621-4dd1-b855-13eb97c00682","Type":"ContainerStarted","Data":"cd07f2ffcdeb8eea3e1643cd930757a9ded2b7887ad3eef3db3d23c59efeedbc"}
Sep 10 20:57:03.907096 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:03.907075    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-g9h2b" event={"ID":"982ffbde-1f2c-4786-86e2-095af29ab25b","Type":"ContainerStarted","Data":"b96545e645261fa048ab3372471e6692b3fd29f2437529d2616e4b4c4d45ac28"}
Sep 10 20:57:03.942845 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:03.941978    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-100.ec2.internal" podStartSLOduration=3.9419569450000003 podStartE2EDuration="3.941956945s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 20:57:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:57:03.941878685 +0000 UTC m=+4.628945966" watchObservedRunningTime="2026-09-10 20:57:03.941956945 +0000 UTC m=+4.629024223"
Sep 10 20:57:04.866883 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:04.866851    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zbw7p"
Sep 10 20:57:04.867488 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:04.866993    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zbw7p" podUID="27227947-500c-4146-a89f-798ea3bce890"
Sep 10 20:57:04.915189 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:04.915150    2564 generic.go:356] "Generic (PLEG): container finished" podID="c8c06af6dd33d8a03dd3e75bceae61bb" containerID="fa63568b368ddb7c47b60b727d9cc6deb967424282b712d644c89d328881822e" exitCode=0
Sep 10 20:57:04.916106 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:04.916076    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-100.ec2.internal" event={"ID":"c8c06af6dd33d8a03dd3e75bceae61bb","Type":"ContainerDied","Data":"fa63568b368ddb7c47b60b727d9cc6deb967424282b712d644c89d328881822e"}
Sep 10 20:57:05.303118 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:05.302879    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27227947-500c-4146-a89f-798ea3bce890-metrics-certs\") pod \"network-metrics-daemon-zbw7p\" (UID: \"27227947-500c-4146-a89f-798ea3bce890\") " pod="openshift-multus/network-metrics-daemon-zbw7p"
Sep 10 20:57:05.303118 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:05.303028    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 20:57:05.303118 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:05.303095    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27227947-500c-4146-a89f-798ea3bce890-metrics-certs podName:27227947-500c-4146-a89f-798ea3bce890 nodeName:}" failed. No retries permitted until 2026-09-10 20:57:09.303075237 +0000 UTC m=+9.990142498 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/27227947-500c-4146-a89f-798ea3bce890-metrics-certs") pod "network-metrics-daemon-zbw7p" (UID: "27227947-500c-4146-a89f-798ea3bce890") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 20:57:05.404822 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:05.404267    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/170f8023-6b23-45c5-b7bf-6da8b42be3cd-original-pull-secret\") pod \"global-pull-secret-syncer-gzgtl\" (UID: \"170f8023-6b23-45c5-b7bf-6da8b42be3cd\") " pod="kube-system/global-pull-secret-syncer-gzgtl"
Sep 10 20:57:05.404822 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:05.404432    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 20:57:05.404822 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:05.404494    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/170f8023-6b23-45c5-b7bf-6da8b42be3cd-original-pull-secret podName:170f8023-6b23-45c5-b7bf-6da8b42be3cd nodeName:}" failed. No retries permitted until 2026-09-10 20:57:09.404477843 +0000 UTC m=+10.091545105 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/170f8023-6b23-45c5-b7bf-6da8b42be3cd-original-pull-secret") pod "global-pull-secret-syncer-gzgtl" (UID: "170f8023-6b23-45c5-b7bf-6da8b42be3cd") : object "kube-system"/"original-pull-secret" not registered
Sep 10 20:57:05.505312 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:05.505276    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2678k\" (UniqueName: \"kubernetes.io/projected/8d6511c6-643b-4d56-9d77-4fd8d74b65fc-kube-api-access-2678k\") pod \"network-check-target-srfp2\" (UID: \"8d6511c6-643b-4d56-9d77-4fd8d74b65fc\") " pod="openshift-network-diagnostics/network-check-target-srfp2"
Sep 10 20:57:05.505507 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:05.505489    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 20:57:05.505577 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:05.505517    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 20:57:05.505577 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:05.505531    2564 projected.go:196] Error preparing data for projected volume kube-api-access-2678k for pod openshift-network-diagnostics/network-check-target-srfp2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 20:57:05.505662 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:05.505588    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8d6511c6-643b-4d56-9d77-4fd8d74b65fc-kube-api-access-2678k podName:8d6511c6-643b-4d56-9d77-4fd8d74b65fc nodeName:}" failed. No retries permitted until 2026-09-10 20:57:09.505569902 +0000 UTC m=+10.192637179 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2678k" (UniqueName: "kubernetes.io/projected/8d6511c6-643b-4d56-9d77-4fd8d74b65fc-kube-api-access-2678k") pod "network-check-target-srfp2" (UID: "8d6511c6-643b-4d56-9d77-4fd8d74b65fc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 20:57:05.870289 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:05.869642    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srfp2"
Sep 10 20:57:05.870289 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:05.869770    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srfp2" podUID="8d6511c6-643b-4d56-9d77-4fd8d74b65fc"
Sep 10 20:57:05.870289 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:05.870132    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gzgtl"
Sep 10 20:57:05.870289 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:05.870221    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gzgtl" podUID="170f8023-6b23-45c5-b7bf-6da8b42be3cd"
Sep 10 20:57:06.866373 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:06.866344    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zbw7p"
Sep 10 20:57:06.866560 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:06.866478    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zbw7p" podUID="27227947-500c-4146-a89f-798ea3bce890"
Sep 10 20:57:07.867809 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:07.867320    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srfp2"
Sep 10 20:57:07.867809 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:07.867445    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srfp2" podUID="8d6511c6-643b-4d56-9d77-4fd8d74b65fc"
Sep 10 20:57:07.870259 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:07.868418    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gzgtl"
Sep 10 20:57:07.870259 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:07.868534    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gzgtl" podUID="170f8023-6b23-45c5-b7bf-6da8b42be3cd"
Sep 10 20:57:08.867040 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:08.866957    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zbw7p"
Sep 10 20:57:08.867200 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:08.867101    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zbw7p" podUID="27227947-500c-4146-a89f-798ea3bce890"
Sep 10 20:57:09.336940 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:09.336854    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27227947-500c-4146-a89f-798ea3bce890-metrics-certs\") pod \"network-metrics-daemon-zbw7p\" (UID: \"27227947-500c-4146-a89f-798ea3bce890\") " pod="openshift-multus/network-metrics-daemon-zbw7p"
Sep 10 20:57:09.337416 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:09.337021    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 20:57:09.337416 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:09.337084    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27227947-500c-4146-a89f-798ea3bce890-metrics-certs podName:27227947-500c-4146-a89f-798ea3bce890 nodeName:}" failed. No retries permitted until 2026-09-10 20:57:17.337066998 +0000 UTC m=+18.024134258 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/27227947-500c-4146-a89f-798ea3bce890-metrics-certs") pod "network-metrics-daemon-zbw7p" (UID: "27227947-500c-4146-a89f-798ea3bce890") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 20:57:09.438262 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:09.438204    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/170f8023-6b23-45c5-b7bf-6da8b42be3cd-original-pull-secret\") pod \"global-pull-secret-syncer-gzgtl\" (UID: \"170f8023-6b23-45c5-b7bf-6da8b42be3cd\") " pod="kube-system/global-pull-secret-syncer-gzgtl"
Sep 10 20:57:09.438427 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:09.438415    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 20:57:09.438555 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:09.438472    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/170f8023-6b23-45c5-b7bf-6da8b42be3cd-original-pull-secret podName:170f8023-6b23-45c5-b7bf-6da8b42be3cd nodeName:}" failed. No retries permitted until 2026-09-10 20:57:17.438455479 +0000 UTC m=+18.125522741 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/170f8023-6b23-45c5-b7bf-6da8b42be3cd-original-pull-secret") pod "global-pull-secret-syncer-gzgtl" (UID: "170f8023-6b23-45c5-b7bf-6da8b42be3cd") : object "kube-system"/"original-pull-secret" not registered
Sep 10 20:57:09.538975 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:09.538883    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2678k\" (UniqueName: \"kubernetes.io/projected/8d6511c6-643b-4d56-9d77-4fd8d74b65fc-kube-api-access-2678k\") pod \"network-check-target-srfp2\" (UID: \"8d6511c6-643b-4d56-9d77-4fd8d74b65fc\") " pod="openshift-network-diagnostics/network-check-target-srfp2"
Sep 10 20:57:09.539136 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:09.539030    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 20:57:09.539136 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:09.539051    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 20:57:09.539136 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:09.539063    2564 projected.go:196] Error preparing data for projected volume kube-api-access-2678k for pod openshift-network-diagnostics/network-check-target-srfp2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 20:57:09.539136 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:09.539119    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8d6511c6-643b-4d56-9d77-4fd8d74b65fc-kube-api-access-2678k podName:8d6511c6-643b-4d56-9d77-4fd8d74b65fc nodeName:}" failed. No retries permitted until 2026-09-10 20:57:17.539103212 +0000 UTC m=+18.226170471 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-2678k" (UniqueName: "kubernetes.io/projected/8d6511c6-643b-4d56-9d77-4fd8d74b65fc-kube-api-access-2678k") pod "network-check-target-srfp2" (UID: "8d6511c6-643b-4d56-9d77-4fd8d74b65fc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 20:57:09.869709 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:09.869677    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srfp2"
Sep 10 20:57:09.869867 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:09.869782    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srfp2" podUID="8d6511c6-643b-4d56-9d77-4fd8d74b65fc"
Sep 10 20:57:09.870136 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:09.870117    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gzgtl"
Sep 10 20:57:09.870247 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:09.870217    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gzgtl" podUID="170f8023-6b23-45c5-b7bf-6da8b42be3cd"
Sep 10 20:57:10.866914 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:10.866878    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zbw7p"
Sep 10 20:57:10.867378 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:10.867014    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zbw7p" podUID="27227947-500c-4146-a89f-798ea3bce890"
Sep 10 20:57:11.866859 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:11.866801    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srfp2"
Sep 10 20:57:11.866859 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:11.866816    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gzgtl"
Sep 10 20:57:11.867364 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:11.866929    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srfp2" podUID="8d6511c6-643b-4d56-9d77-4fd8d74b65fc"
Sep 10 20:57:11.867364 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:11.867067    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gzgtl" podUID="170f8023-6b23-45c5-b7bf-6da8b42be3cd"
Sep 10 20:57:12.866342 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:12.866303    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zbw7p"
Sep 10 20:57:12.866524 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:12.866422    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zbw7p" podUID="27227947-500c-4146-a89f-798ea3bce890"
Sep 10 20:57:13.867127 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:13.867089    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srfp2"
Sep 10 20:57:13.867604 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:13.867095    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gzgtl"
Sep 10 20:57:13.867604 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:13.867215    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srfp2" podUID="8d6511c6-643b-4d56-9d77-4fd8d74b65fc"
Sep 10 20:57:13.867604 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:13.867318    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gzgtl" podUID="170f8023-6b23-45c5-b7bf-6da8b42be3cd"
Sep 10 20:57:14.866998 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:14.866964    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zbw7p"
Sep 10 20:57:14.867179 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:14.867096    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zbw7p" podUID="27227947-500c-4146-a89f-798ea3bce890"
Sep 10 20:57:15.867285 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:15.867190    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srfp2"
Sep 10 20:57:15.867715 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:15.867190    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gzgtl"
Sep 10 20:57:15.867715 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:15.867338    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srfp2" podUID="8d6511c6-643b-4d56-9d77-4fd8d74b65fc"
Sep 10 20:57:15.867715 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:15.867433    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gzgtl" podUID="170f8023-6b23-45c5-b7bf-6da8b42be3cd"
Sep 10 20:57:16.866918 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:16.866883    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zbw7p"
Sep 10 20:57:16.867107 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:16.866990    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zbw7p" podUID="27227947-500c-4146-a89f-798ea3bce890"
Sep 10 20:57:17.393600 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:17.393562    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27227947-500c-4146-a89f-798ea3bce890-metrics-certs\") pod \"network-metrics-daemon-zbw7p\" (UID: \"27227947-500c-4146-a89f-798ea3bce890\") " pod="openshift-multus/network-metrics-daemon-zbw7p"
Sep 10 20:57:17.394033 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:17.393730    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 20:57:17.394033 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:17.393801    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27227947-500c-4146-a89f-798ea3bce890-metrics-certs podName:27227947-500c-4146-a89f-798ea3bce890 nodeName:}" failed. No retries permitted until 2026-09-10 20:57:33.393785563 +0000 UTC m=+34.080852820 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/27227947-500c-4146-a89f-798ea3bce890-metrics-certs") pod "network-metrics-daemon-zbw7p" (UID: "27227947-500c-4146-a89f-798ea3bce890") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 20:57:17.494836 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:17.494805    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/170f8023-6b23-45c5-b7bf-6da8b42be3cd-original-pull-secret\") pod \"global-pull-secret-syncer-gzgtl\" (UID: \"170f8023-6b23-45c5-b7bf-6da8b42be3cd\") " pod="kube-system/global-pull-secret-syncer-gzgtl"
Sep 10 20:57:17.495007 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:17.494973    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 20:57:17.495065 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:17.495048    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/170f8023-6b23-45c5-b7bf-6da8b42be3cd-original-pull-secret podName:170f8023-6b23-45c5-b7bf-6da8b42be3cd nodeName:}" failed. No retries permitted until 2026-09-10 20:57:33.495026622 +0000 UTC m=+34.182093883 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/170f8023-6b23-45c5-b7bf-6da8b42be3cd-original-pull-secret") pod "global-pull-secret-syncer-gzgtl" (UID: "170f8023-6b23-45c5-b7bf-6da8b42be3cd") : object "kube-system"/"original-pull-secret" not registered
Sep 10 20:57:17.595656 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:17.595619    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2678k\" (UniqueName: \"kubernetes.io/projected/8d6511c6-643b-4d56-9d77-4fd8d74b65fc-kube-api-access-2678k\") pod \"network-check-target-srfp2\" (UID: \"8d6511c6-643b-4d56-9d77-4fd8d74b65fc\") " pod="openshift-network-diagnostics/network-check-target-srfp2"
Sep 10 20:57:17.595815 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:17.595765    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 20:57:17.595815 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:17.595793    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 20:57:17.595815 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:17.595806    2564 projected.go:196] Error preparing data for projected volume kube-api-access-2678k for pod openshift-network-diagnostics/network-check-target-srfp2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 20:57:17.595983 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:17.595864    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8d6511c6-643b-4d56-9d77-4fd8d74b65fc-kube-api-access-2678k podName:8d6511c6-643b-4d56-9d77-4fd8d74b65fc nodeName:}" failed. No retries permitted until 2026-09-10 20:57:33.595846657 +0000 UTC m=+34.282913914 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-2678k" (UniqueName: "kubernetes.io/projected/8d6511c6-643b-4d56-9d77-4fd8d74b65fc-kube-api-access-2678k") pod "network-check-target-srfp2" (UID: "8d6511c6-643b-4d56-9d77-4fd8d74b65fc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 20:57:17.869843 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:17.869764    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srfp2"
Sep 10 20:57:17.869973 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:17.869886    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srfp2" podUID="8d6511c6-643b-4d56-9d77-4fd8d74b65fc"
Sep 10 20:57:17.869973 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:17.869938    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gzgtl"
Sep 10 20:57:17.870082 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:17.870058    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gzgtl" podUID="170f8023-6b23-45c5-b7bf-6da8b42be3cd"
Sep 10 20:57:18.867177 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:18.866919    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zbw7p"
Sep 10 20:57:18.867633 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:18.867301    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zbw7p" podUID="27227947-500c-4146-a89f-798ea3bce890"
Sep 10 20:57:19.867455 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:19.867329    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gzgtl"
Sep 10 20:57:19.867903 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:19.867545    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gzgtl" podUID="170f8023-6b23-45c5-b7bf-6da8b42be3cd"
Sep 10 20:57:19.867903 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:19.867411    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srfp2"
Sep 10 20:57:19.867903 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:19.867661    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srfp2" podUID="8d6511c6-643b-4d56-9d77-4fd8d74b65fc"
Sep 10 20:57:19.946382 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:19.946357    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wrbhk_279e54f7-0db1-4e2d-a998-4b3ecdf992cd/ovn-acl-logging/0.log"
Sep 10 20:57:19.946955 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:19.946892    2564 generic.go:356] "Generic (PLEG): container finished" podID="279e54f7-0db1-4e2d-a998-4b3ecdf992cd" containerID="0384f152e0ec8065936e0316ac4a178b4590a8c40917cd9aeeac4bda66e8c1df" exitCode=1
Sep 10 20:57:19.947057 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:19.946980    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wrbhk" event={"ID":"279e54f7-0db1-4e2d-a998-4b3ecdf992cd","Type":"ContainerStarted","Data":"ca0c601d53533d3c7a79e958d8be1577cd8546bd02a73eb21b7f83b3fb368c71"}
Sep 10 20:57:19.947116 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:19.947059    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wrbhk" event={"ID":"279e54f7-0db1-4e2d-a998-4b3ecdf992cd","Type":"ContainerStarted","Data":"ea2cc3386e9233730ac71a9544f115e0ad91efcdb2be0ec0ca37c5464af2e14d"}
Sep 10 20:57:19.947116 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:19.947107    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wrbhk" event={"ID":"279e54f7-0db1-4e2d-a998-4b3ecdf992cd","Type":"ContainerDied","Data":"0384f152e0ec8065936e0316ac4a178b4590a8c40917cd9aeeac4bda66e8c1df"}
Sep 10 20:57:19.947253 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:19.947157    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wrbhk" event={"ID":"279e54f7-0db1-4e2d-a998-4b3ecdf992cd","Type":"ContainerStarted","Data":"d6f9a47866acb0684558bf2adcb21d474b5b6224b35b5958968c598d1d9c6e2a"}
Sep 10 20:57:19.951086 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:19.951048    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-q7mfg" event={"ID":"d9d4569d-ce78-4eaa-b2d1-22c69fb1f3bf","Type":"ContainerStarted","Data":"922d9f0c1f6e735703515fdca23fee06e5a96a505473ea54941e96b17f1f111e"}
Sep 10 20:57:19.953010 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:19.952976    2564 generic.go:356] "Generic (PLEG): container finished" podID="1100e6a5-d621-4dd1-b855-13eb97c00682" containerID="a8d921b496b6475383430a0286ee6e8ef5d2c9323f346683b0dd98605581cb63" exitCode=0
Sep 10 20:57:19.953112 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:19.953059    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b5t78" event={"ID":"1100e6a5-d621-4dd1-b855-13eb97c00682","Type":"ContainerDied","Data":"a8d921b496b6475383430a0286ee6e8ef5d2c9323f346683b0dd98605581cb63"}
Sep 10 20:57:19.955327 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:19.955301    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fs4rr" event={"ID":"d43db309-4d3b-447c-b7b5-d1773f1acfd8","Type":"ContainerStarted","Data":"045bfc8fb3d416461c8072df7f6508685b9afb383863a5a26d6c232af976c7e3"}
Sep 10 20:57:19.958162 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:19.958122    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-100.ec2.internal" event={"ID":"c8c06af6dd33d8a03dd3e75bceae61bb","Type":"ContainerStarted","Data":"cc382f698fa9dddb0bb39417f37240119071602d42986bc853dbc115c41b0967"}
Sep 10 20:57:19.960675 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:19.960654    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-v6rs4" event={"ID":"fb41bc68-2c7c-442e-8260-26cbf842f702","Type":"ContainerStarted","Data":"3e91f78105e944db92ac4a599fd5c7dfdf946dba4c3f5ca8850aa856121a2f76"}
Sep 10 20:57:19.963063 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:19.963039    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nwx8r" event={"ID":"5b37372b-e18e-4c13-abff-11909b3192fb","Type":"ContainerStarted","Data":"23993ca67fbb3e269a248776c939e75a62526977d08936c63b2d4ee2e561e751"}
Sep 10 20:57:19.965328 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:19.965308    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jvdfc" event={"ID":"1bd6c830-3d46-4f96-98b4-b1c595c09609","Type":"ContainerStarted","Data":"0a93fe702c9c74fe2bc3dea54e1775c7c2683f2a2d602e45c5b42273400ad69e"}
Sep 10 20:57:19.999999 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:19.999951    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-q7mfg" podStartSLOduration=11.198677181 podStartE2EDuration="20.999931349s" totalImagesPullingTime="9.801254168s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 20:56:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:57:19.977167971 +0000 UTC m=+20.664235250" watchObservedRunningTime="2026-09-10 20:57:19.999931349 +0000 UTC m=+20.686998630"
Sep 10 20:57:20.000124 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:20.000049    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-nwx8r" podStartSLOduration=4.042309097 podStartE2EDuration="20.000040061s" totalImagesPullingTime="15.957730964s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 20:57:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:57:19.999705749 +0000 UTC m=+20.686773028" watchObservedRunningTime="2026-09-10 20:57:20.000040061 +0000 UTC m=+20.687107366"
Sep 10 20:57:20.026884 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:20.026835    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-v6rs4" podStartSLOduration=14.355700624 podStartE2EDuration="21.026817109s" totalImagesPullingTime="6.671116485s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:56:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:57:20.026251975 +0000 UTC m=+20.713319254" watchObservedRunningTime="2026-09-10 20:57:20.026817109 +0000 UTC m=+20.713884369"
Sep 10 20:57:20.072765 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:20.072714    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-jvdfc" podStartSLOduration=4.111845187 podStartE2EDuration="20.072695475s" totalImagesPullingTime="15.960850288s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 20:57:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:57:20.050932686 +0000 UTC m=+20.737999966" watchObservedRunningTime="2026-09-10 20:57:20.072695475 +0000 UTC m=+20.759762755"
Sep 10 20:57:20.073059 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:20.073029    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-100.ec2.internal" podStartSLOduration=20.073022431 podStartE2EDuration="20.073022431s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 20:57:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:57:20.072192302 +0000 UTC m=+20.759259582" watchObservedRunningTime="2026-09-10 20:57:20.073022431 +0000 UTC m=+20.760089711"
Sep 10 20:57:20.465257 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:20.465069    2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 10 20:57:20.866541 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:20.866428    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zbw7p"
Sep 10 20:57:20.866687 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:20.866559    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zbw7p" podUID="27227947-500c-4146-a89f-798ea3bce890"
Sep 10 20:57:20.869667 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:20.869570    2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-10T20:57:20.465256214Z","UUID":"96e175d1-749a-46e3-bfaf-e2378f4fd92b","Handler":null,"Name":"","Endpoint":""}
Sep 10 20:57:20.871346 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:20.871322    2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 10 20:57:20.871497 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:20.871354    2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 10 20:57:20.971590 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:20.971559    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wrbhk_279e54f7-0db1-4e2d-a998-4b3ecdf992cd/ovn-acl-logging/0.log"
Sep 10 20:57:20.972044 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:20.972009    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wrbhk" event={"ID":"279e54f7-0db1-4e2d-a998-4b3ecdf992cd","Type":"ContainerStarted","Data":"938fbb3f15be404cd72c47ce2bed70b847f4797a7a18637d4c4bea30db6cf3e7"}
Sep 10 20:57:20.972154 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:20.972103    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wrbhk" event={"ID":"279e54f7-0db1-4e2d-a998-4b3ecdf992cd","Type":"ContainerStarted","Data":"7da719d1ff14f715370a8598e462268d9437fea180747c6726746550352acf5f"}
Sep 10 20:57:20.974074 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:20.974028    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-g9h2b" event={"ID":"982ffbde-1f2c-4786-86e2-095af29ab25b","Type":"ContainerStarted","Data":"83f7bce02d2470d79ea2d607bd2c234bf939d9afc95246de7bb358d91cda7dc3"}
Sep 10 20:57:20.976295 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:20.976269    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fs4rr" event={"ID":"d43db309-4d3b-447c-b7b5-d1773f1acfd8","Type":"ContainerStarted","Data":"7107555bd979286c53833b27dcd83936f1f900d11730e0360d405e0098b6eed4"}
Sep 10 20:57:20.978391 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:20.978360    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-88gjz" event={"ID":"d77691cf-bad6-4eb6-ab44-20ad29fad22f","Type":"ContainerStarted","Data":"57809ddf48006dbd1714e6a0714ba618c858e1d3a55dd98fe4eef51e0f80c9bc"}
Sep 10 20:57:20.998166 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:20.998115    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-g9h2b" podStartSLOduration=4.361404094 podStartE2EDuration="20.998102162s" totalImagesPullingTime="16.636698068s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 20:57:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:57:20.9975727 +0000 UTC m=+21.684639983" watchObservedRunningTime="2026-09-10 20:57:20.998102162 +0000 UTC m=+21.685169441"
Sep 10 20:57:21.015363 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:21.015251    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-88gjz" podStartSLOduration=7.853268523 podStartE2EDuration="21.015221092s" totalImagesPullingTime="13.161952569s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 20:57:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:57:21.015154467 +0000 UTC m=+21.702221745" watchObservedRunningTime="2026-09-10 20:57:21.015221092 +0000 UTC m=+21.702288372"
Sep 10 20:57:21.867375 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:21.867335    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gzgtl"
Sep 10 20:57:21.867375 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:21.867371    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srfp2"
Sep 10 20:57:21.867716 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:21.867464    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gzgtl" podUID="170f8023-6b23-45c5-b7bf-6da8b42be3cd"
Sep 10 20:57:21.867716 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:21.867598    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srfp2" podUID="8d6511c6-643b-4d56-9d77-4fd8d74b65fc"
Sep 10 20:57:21.983302 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:21.983259    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fs4rr" event={"ID":"d43db309-4d3b-447c-b7b5-d1773f1acfd8","Type":"ContainerStarted","Data":"04055d68db4c4a7b11dea1fc6932424921a07e50710b89a34a1fb1a125a2b3be"}
Sep 10 20:57:22.017012 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:22.016959    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fs4rr" podStartSLOduration=4.559018996 podStartE2EDuration="22.016939806s" totalImagesPullingTime="17.45792081s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 20:57:00 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:57:22.012915682 +0000 UTC m=+22.699982962" watchObservedRunningTime="2026-09-10 20:57:22.016939806 +0000 UTC m=+22.704007085"
Sep 10 20:57:22.866395 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:22.866366    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zbw7p"
Sep 10 20:57:22.866582 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:22.866503    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zbw7p" podUID="27227947-500c-4146-a89f-798ea3bce890"
Sep 10 20:57:22.989359 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:22.989330    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wrbhk_279e54f7-0db1-4e2d-a998-4b3ecdf992cd/ovn-acl-logging/0.log"
Sep 10 20:57:22.989809 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:22.989736    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wrbhk" event={"ID":"279e54f7-0db1-4e2d-a998-4b3ecdf992cd","Type":"ContainerStarted","Data":"0a04451e13e6a83c36bb402db4cc0015a34830c0edc1a3335ee8abf7319b1dbb"}
Sep 10 20:57:23.215107 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:23.215040    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-v6rs4"
Sep 10 20:57:23.215699 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:23.215670    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-v6rs4"
Sep 10 20:57:23.867207 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:23.867180    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srfp2"
Sep 10 20:57:23.867457 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:23.867295    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srfp2" podUID="8d6511c6-643b-4d56-9d77-4fd8d74b65fc"
Sep 10 20:57:23.867457 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:23.867344    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gzgtl"
Sep 10 20:57:23.867457 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:23.867424    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gzgtl" podUID="170f8023-6b23-45c5-b7bf-6da8b42be3cd"
Sep 10 20:57:23.993962 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:23.993930    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b5t78" event={"ID":"1100e6a5-d621-4dd1-b855-13eb97c00682","Type":"ContainerStarted","Data":"2e72f9876a66fcdc23c27aae385f449a7afcb34af21aa1bff63631d5a1433a94"}
Sep 10 20:57:24.867480 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:24.867268    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zbw7p"
Sep 10 20:57:24.867639 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:24.867575    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zbw7p" podUID="27227947-500c-4146-a89f-798ea3bce890"
Sep 10 20:57:24.997639 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:24.997613    2564 generic.go:356] "Generic (PLEG): container finished" podID="1100e6a5-d621-4dd1-b855-13eb97c00682" containerID="2e72f9876a66fcdc23c27aae385f449a7afcb34af21aa1bff63631d5a1433a94" exitCode=0
Sep 10 20:57:24.997984 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:24.997701    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b5t78" event={"ID":"1100e6a5-d621-4dd1-b855-13eb97c00682","Type":"ContainerDied","Data":"2e72f9876a66fcdc23c27aae385f449a7afcb34af21aa1bff63631d5a1433a94"}
Sep 10 20:57:25.001338 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:25.001321    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wrbhk_279e54f7-0db1-4e2d-a998-4b3ecdf992cd/ovn-acl-logging/0.log"
Sep 10 20:57:25.001683 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:25.001662    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wrbhk" event={"ID":"279e54f7-0db1-4e2d-a998-4b3ecdf992cd","Type":"ContainerStarted","Data":"a086c09892d56acf26d4b26390fe1cff5309006204bb28c1f147594b8bcc1497"}
Sep 10 20:57:25.001967 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:25.001953    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wrbhk"
Sep 10 20:57:25.002104 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:25.002090    2564 scope.go:117] "RemoveContainer" containerID="0384f152e0ec8065936e0316ac4a178b4590a8c40917cd9aeeac4bda66e8c1df"
Sep 10 20:57:25.018931 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:25.018910    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wrbhk"
Sep 10 20:57:25.867087 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:25.867061    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gzgtl"
Sep 10 20:57:25.867207 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:25.867186    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gzgtl" podUID="170f8023-6b23-45c5-b7bf-6da8b42be3cd"
Sep 10 20:57:25.867283 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:25.867265    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srfp2"
Sep 10 20:57:25.867400 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:25.867374    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srfp2" podUID="8d6511c6-643b-4d56-9d77-4fd8d74b65fc"
Sep 10 20:57:26.008582 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:26.008558    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wrbhk_279e54f7-0db1-4e2d-a998-4b3ecdf992cd/ovn-acl-logging/0.log"
Sep 10 20:57:26.009211 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:26.008992    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wrbhk" event={"ID":"279e54f7-0db1-4e2d-a998-4b3ecdf992cd","Type":"ContainerStarted","Data":"9216a9dba1d8cea2cd8f8d1f6ddb259d76236244a9f794472a4c40d2b0ece5b8"}
Sep 10 20:57:26.009211 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:26.009094    2564 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 10 20:57:26.009521 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:26.009485    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wrbhk"
Sep 10 20:57:26.011691 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:26.011667    2564 generic.go:356] "Generic (PLEG): container finished" podID="1100e6a5-d621-4dd1-b855-13eb97c00682" containerID="8a2f58f83fce639b28cc3435b208fb9f7f0350033eae68c48e152519faced193" exitCode=0
Sep 10 20:57:26.011766 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:26.011717    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b5t78" event={"ID":"1100e6a5-d621-4dd1-b855-13eb97c00682","Type":"ContainerDied","Data":"8a2f58f83fce639b28cc3435b208fb9f7f0350033eae68c48e152519faced193"}
Sep 10 20:57:26.025483 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:26.025454    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wrbhk"
Sep 10 20:57:26.052963 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:26.052921    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-wrbhk" podStartSLOduration=8.522360429999999 podStartE2EDuration="26.052906428s" totalImagesPullingTime="17.530545998s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 20:57:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:57:26.051752734 +0000 UTC m=+26.738820013" watchObservedRunningTime="2026-09-10 20:57:26.052906428 +0000 UTC m=+26.739973706"
Sep 10 20:57:26.509812 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:26.509782    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-srfp2"]
Sep 10 20:57:26.509965 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:26.509940    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srfp2"
Sep 10 20:57:26.510080 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:26.510046    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srfp2" podUID="8d6511c6-643b-4d56-9d77-4fd8d74b65fc"
Sep 10 20:57:26.516548 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:26.516263    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gzgtl"]
Sep 10 20:57:26.516548 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:26.516363    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gzgtl"
Sep 10 20:57:26.516548 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:26.516452    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gzgtl" podUID="170f8023-6b23-45c5-b7bf-6da8b42be3cd"
Sep 10 20:57:26.517171 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:26.517144    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zbw7p"]
Sep 10 20:57:26.517301 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:26.517282    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zbw7p"
Sep 10 20:57:26.517409 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:26.517389    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zbw7p" podUID="27227947-500c-4146-a89f-798ea3bce890"
Sep 10 20:57:27.016421 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:27.016389    2564 generic.go:356] "Generic (PLEG): container finished" podID="1100e6a5-d621-4dd1-b855-13eb97c00682" containerID="6b64a22b9ddabedbe11334ce00f563c3f6a5e2ef50a629c3fcda3fafcffd1881" exitCode=0
Sep 10 20:57:27.016939 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:27.016476    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b5t78" event={"ID":"1100e6a5-d621-4dd1-b855-13eb97c00682","Type":"ContainerDied","Data":"6b64a22b9ddabedbe11334ce00f563c3f6a5e2ef50a629c3fcda3fafcffd1881"}
Sep 10 20:57:27.016939 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:27.016628    2564 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 10 20:57:27.445480 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:27.445411    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-v6rs4"
Sep 10 20:57:27.445677 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:27.445530    2564 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 10 20:57:27.446338 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:27.446311    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-v6rs4"
Sep 10 20:57:27.866656 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:27.866578    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zbw7p"
Sep 10 20:57:27.866894 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:27.866579    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gzgtl"
Sep 10 20:57:27.866894 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:27.866712    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zbw7p" podUID="27227947-500c-4146-a89f-798ea3bce890"
Sep 10 20:57:27.866894 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:27.866585    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srfp2"
Sep 10 20:57:27.866894 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:27.866814    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gzgtl" podUID="170f8023-6b23-45c5-b7bf-6da8b42be3cd"
Sep 10 20:57:27.866894 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:27.866879    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srfp2" podUID="8d6511c6-643b-4d56-9d77-4fd8d74b65fc"
Sep 10 20:57:28.018989 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:28.018966    2564 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 10 20:57:28.868011 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:28.867927    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wrbhk"
Sep 10 20:57:29.033819 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:29.033774    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-wrbhk" podUID="279e54f7-0db1-4e2d-a998-4b3ecdf992cd" containerName="ovnkube-controller" probeResult="failure" output=""
Sep 10 20:57:29.868043 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:29.868004    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zbw7p"
Sep 10 20:57:29.868204 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:29.868100    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gzgtl"
Sep 10 20:57:29.868204 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:29.868141    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srfp2"
Sep 10 20:57:29.868204 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:29.868168    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zbw7p" podUID="27227947-500c-4146-a89f-798ea3bce890"
Sep 10 20:57:29.868376 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:29.868209    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srfp2" podUID="8d6511c6-643b-4d56-9d77-4fd8d74b65fc"
Sep 10 20:57:29.868376 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:29.868304    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gzgtl" podUID="170f8023-6b23-45c5-b7bf-6da8b42be3cd"
Sep 10 20:57:31.867107 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:31.867057    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srfp2"
Sep 10 20:57:31.867107 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:31.867071    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gzgtl"
Sep 10 20:57:31.867517 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:31.867064    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zbw7p"
Sep 10 20:57:31.867517 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:31.867176    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srfp2" podUID="8d6511c6-643b-4d56-9d77-4fd8d74b65fc"
Sep 10 20:57:31.867517 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:31.867224    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zbw7p" podUID="27227947-500c-4146-a89f-798ea3bce890"
Sep 10 20:57:31.867517 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:31.867304    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gzgtl" podUID="170f8023-6b23-45c5-b7bf-6da8b42be3cd"
Sep 10 20:57:32.031491 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:32.031463    2564 generic.go:356] "Generic (PLEG): container finished" podID="1100e6a5-d621-4dd1-b855-13eb97c00682" containerID="8c3b65b5c77cd613dde8718177212bc201999b0f916ac268dc9cbf652953a1a4" exitCode=0
Sep 10 20:57:32.031590 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:32.031507    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b5t78" event={"ID":"1100e6a5-d621-4dd1-b855-13eb97c00682","Type":"ContainerDied","Data":"8c3b65b5c77cd613dde8718177212bc201999b0f916ac268dc9cbf652953a1a4"}
Sep 10 20:57:32.571127 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:32.570955    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-100.ec2.internal" event="NodeReady"
Sep 10 20:57:32.571217 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:32.571207    2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 10 20:57:32.650370 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:32.650342    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-kr6rh"]
Sep 10 20:57:32.667889 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:32.667869    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kr6rh"
Sep 10 20:57:32.667889 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:32.667879    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-mv4zr"]
Sep 10 20:57:32.678713 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:32.678691    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 10 20:57:32.678818 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:32.678786    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jw26g\""
Sep 10 20:57:32.679023 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:32.679008    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 10 20:57:32.689167 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:32.689149    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kr6rh"]
Sep 10 20:57:32.689279 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:32.689185    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mv4zr"]
Sep 10 20:57:32.689349 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:32.689295    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mv4zr"
Sep 10 20:57:32.694861 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:32.694844    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 10 20:57:32.694948 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:32.694875    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-kgg6r\""
Sep 10 20:57:32.695007 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:32.694989    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 10 20:57:32.695088 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:32.695074    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 10 20:57:32.806018 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:32.805952    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a3b44ac1-2723-46ab-92b2-c92e3512b2d7-config-volume\") pod \"dns-default-kr6rh\" (UID: \"a3b44ac1-2723-46ab-92b2-c92e3512b2d7\") " pod="openshift-dns/dns-default-kr6rh"
Sep 10 20:57:32.806018 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:32.806007    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3b44ac1-2723-46ab-92b2-c92e3512b2d7-tmp-dir\") pod \"dns-default-kr6rh\" (UID: \"a3b44ac1-2723-46ab-92b2-c92e3512b2d7\") " pod="openshift-dns/dns-default-kr6rh"
Sep 10 20:57:32.806173 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:32.806032    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-489xt\" (UniqueName: \"kubernetes.io/projected/a3b44ac1-2723-46ab-92b2-c92e3512b2d7-kube-api-access-489xt\") pod \"dns-default-kr6rh\" (UID: \"a3b44ac1-2723-46ab-92b2-c92e3512b2d7\") " pod="openshift-dns/dns-default-kr6rh"
Sep 10 20:57:32.806173 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:32.806080    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a3b44ac1-2723-46ab-92b2-c92e3512b2d7-metrics-tls\") pod \"dns-default-kr6rh\" (UID: \"a3b44ac1-2723-46ab-92b2-c92e3512b2d7\") " pod="openshift-dns/dns-default-kr6rh"
Sep 10 20:57:32.806173 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:32.806105    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zdt4\" (UniqueName: \"kubernetes.io/projected/9d1aef14-c1f3-402c-8232-a212f2354624-kube-api-access-9zdt4\") pod \"ingress-canary-mv4zr\" (UID: \"9d1aef14-c1f3-402c-8232-a212f2354624\") " pod="openshift-ingress-canary/ingress-canary-mv4zr"
Sep 10 20:57:32.806173 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:32.806135    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9d1aef14-c1f3-402c-8232-a212f2354624-cert\") pod \"ingress-canary-mv4zr\" (UID: \"9d1aef14-c1f3-402c-8232-a212f2354624\") " pod="openshift-ingress-canary/ingress-canary-mv4zr"
Sep 10 20:57:32.906380 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:32.906356    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a3b44ac1-2723-46ab-92b2-c92e3512b2d7-metrics-tls\") pod \"dns-default-kr6rh\" (UID: \"a3b44ac1-2723-46ab-92b2-c92e3512b2d7\") " pod="openshift-dns/dns-default-kr6rh"
Sep 10 20:57:32.906729 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:32.906384    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zdt4\" (UniqueName: \"kubernetes.io/projected/9d1aef14-c1f3-402c-8232-a212f2354624-kube-api-access-9zdt4\") pod \"ingress-canary-mv4zr\" (UID: \"9d1aef14-c1f3-402c-8232-a212f2354624\") " pod="openshift-ingress-canary/ingress-canary-mv4zr"
Sep 10 20:57:32.906729 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:32.906410    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9d1aef14-c1f3-402c-8232-a212f2354624-cert\") pod \"ingress-canary-mv4zr\" (UID: \"9d1aef14-c1f3-402c-8232-a212f2354624\") " pod="openshift-ingress-canary/ingress-canary-mv4zr"
Sep 10 20:57:32.906729 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:32.906449    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a3b44ac1-2723-46ab-92b2-c92e3512b2d7-config-volume\") pod \"dns-default-kr6rh\" (UID: \"a3b44ac1-2723-46ab-92b2-c92e3512b2d7\") " pod="openshift-dns/dns-default-kr6rh"
Sep 10 20:57:32.906729 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:32.906621    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 20:57:32.906729 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:32.906683    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3b44ac1-2723-46ab-92b2-c92e3512b2d7-metrics-tls podName:a3b44ac1-2723-46ab-92b2-c92e3512b2d7 nodeName:}" failed. No retries permitted until 2026-09-10 20:57:33.406663477 +0000 UTC m=+34.093730737 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a3b44ac1-2723-46ab-92b2-c92e3512b2d7-metrics-tls") pod "dns-default-kr6rh" (UID: "a3b44ac1-2723-46ab-92b2-c92e3512b2d7") : secret "dns-default-metrics-tls" not found
Sep 10 20:57:32.906948 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:32.906831    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3b44ac1-2723-46ab-92b2-c92e3512b2d7-tmp-dir\") pod \"dns-default-kr6rh\" (UID: \"a3b44ac1-2723-46ab-92b2-c92e3512b2d7\") " pod="openshift-dns/dns-default-kr6rh"
Sep 10 20:57:32.906948 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:32.906858    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-489xt\" (UniqueName: \"kubernetes.io/projected/a3b44ac1-2723-46ab-92b2-c92e3512b2d7-kube-api-access-489xt\") pod \"dns-default-kr6rh\" (UID: \"a3b44ac1-2723-46ab-92b2-c92e3512b2d7\") " pod="openshift-dns/dns-default-kr6rh"
Sep 10 20:57:32.907016 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:32.906991    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a3b44ac1-2723-46ab-92b2-c92e3512b2d7-config-volume\") pod \"dns-default-kr6rh\" (UID: \"a3b44ac1-2723-46ab-92b2-c92e3512b2d7\") " pod="openshift-dns/dns-default-kr6rh"
Sep 10 20:57:32.907112 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:32.907095    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3b44ac1-2723-46ab-92b2-c92e3512b2d7-tmp-dir\") pod \"dns-default-kr6rh\" (UID: \"a3b44ac1-2723-46ab-92b2-c92e3512b2d7\") " pod="openshift-dns/dns-default-kr6rh"
Sep 10 20:57:32.910762 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:32.910741    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9d1aef14-c1f3-402c-8232-a212f2354624-cert\") pod \"ingress-canary-mv4zr\" (UID: \"9d1aef14-c1f3-402c-8232-a212f2354624\") " pod="openshift-ingress-canary/ingress-canary-mv4zr"
Sep 10 20:57:32.945927 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:32.945909    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-489xt\" (UniqueName: \"kubernetes.io/projected/a3b44ac1-2723-46ab-92b2-c92e3512b2d7-kube-api-access-489xt\") pod \"dns-default-kr6rh\" (UID: \"a3b44ac1-2723-46ab-92b2-c92e3512b2d7\") " pod="openshift-dns/dns-default-kr6rh"
Sep 10 20:57:32.958587 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:32.958560    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zdt4\" (UniqueName: \"kubernetes.io/projected/9d1aef14-c1f3-402c-8232-a212f2354624-kube-api-access-9zdt4\") pod \"ingress-canary-mv4zr\" (UID: \"9d1aef14-c1f3-402c-8232-a212f2354624\") " pod="openshift-ingress-canary/ingress-canary-mv4zr"
Sep 10 20:57:32.996569 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:32.996547    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mv4zr"
Sep 10 20:57:33.037650 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:33.037623    2564 generic.go:356] "Generic (PLEG): container finished" podID="1100e6a5-d621-4dd1-b855-13eb97c00682" containerID="da27badafef7b3c21c59ff6220b8389e06baabd13b344f6ef969098bc146e5ad" exitCode=0
Sep 10 20:57:33.037778 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:33.037664    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b5t78" event={"ID":"1100e6a5-d621-4dd1-b855-13eb97c00682","Type":"ContainerDied","Data":"da27badafef7b3c21c59ff6220b8389e06baabd13b344f6ef969098bc146e5ad"}
Sep 10 20:57:33.308714 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:33.308684    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mv4zr"]
Sep 10 20:57:33.312331 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:57:33.312307    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d1aef14_c1f3_402c_8232_a212f2354624.slice/crio-04bb2b756fc06ff9c66c8ae8af761bcb80a8e11800addf25151702028c91c252 WatchSource:0}: Error finding container 04bb2b756fc06ff9c66c8ae8af761bcb80a8e11800addf25151702028c91c252: Status 404 returned error can't find the container with id 04bb2b756fc06ff9c66c8ae8af761bcb80a8e11800addf25151702028c91c252
Sep 10 20:57:33.411800 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:33.411772    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27227947-500c-4146-a89f-798ea3bce890-metrics-certs\") pod \"network-metrics-daemon-zbw7p\" (UID: \"27227947-500c-4146-a89f-798ea3bce890\") " pod="openshift-multus/network-metrics-daemon-zbw7p"
Sep 10 20:57:33.412047 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:33.411822    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a3b44ac1-2723-46ab-92b2-c92e3512b2d7-metrics-tls\") pod \"dns-default-kr6rh\" (UID: \"a3b44ac1-2723-46ab-92b2-c92e3512b2d7\") " pod="openshift-dns/dns-default-kr6rh"
Sep 10 20:57:33.412047 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:33.411916    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 20:57:33.412047 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:33.411930    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 20:57:33.412047 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:33.411971    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27227947-500c-4146-a89f-798ea3bce890-metrics-certs podName:27227947-500c-4146-a89f-798ea3bce890 nodeName:}" failed. No retries permitted until 2026-09-10 20:58:05.411956109 +0000 UTC m=+66.099023367 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/27227947-500c-4146-a89f-798ea3bce890-metrics-certs") pod "network-metrics-daemon-zbw7p" (UID: "27227947-500c-4146-a89f-798ea3bce890") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 20:57:33.412047 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:33.411986    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3b44ac1-2723-46ab-92b2-c92e3512b2d7-metrics-tls podName:a3b44ac1-2723-46ab-92b2-c92e3512b2d7 nodeName:}" failed. No retries permitted until 2026-09-10 20:57:34.411979765 +0000 UTC m=+35.099047021 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a3b44ac1-2723-46ab-92b2-c92e3512b2d7-metrics-tls") pod "dns-default-kr6rh" (UID: "a3b44ac1-2723-46ab-92b2-c92e3512b2d7") : secret "dns-default-metrics-tls" not found
Sep 10 20:57:33.513072 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:33.513048    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/170f8023-6b23-45c5-b7bf-6da8b42be3cd-original-pull-secret\") pod \"global-pull-secret-syncer-gzgtl\" (UID: \"170f8023-6b23-45c5-b7bf-6da8b42be3cd\") " pod="kube-system/global-pull-secret-syncer-gzgtl"
Sep 10 20:57:33.513165 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:33.513144    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 20:57:33.513206 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:33.513186    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/170f8023-6b23-45c5-b7bf-6da8b42be3cd-original-pull-secret podName:170f8023-6b23-45c5-b7bf-6da8b42be3cd nodeName:}" failed. No retries permitted until 2026-09-10 20:58:05.513175827 +0000 UTC m=+66.200243083 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/170f8023-6b23-45c5-b7bf-6da8b42be3cd-original-pull-secret") pod "global-pull-secret-syncer-gzgtl" (UID: "170f8023-6b23-45c5-b7bf-6da8b42be3cd") : object "kube-system"/"original-pull-secret" not registered
Sep 10 20:57:33.613294 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:33.613215    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2678k\" (UniqueName: \"kubernetes.io/projected/8d6511c6-643b-4d56-9d77-4fd8d74b65fc-kube-api-access-2678k\") pod \"network-check-target-srfp2\" (UID: \"8d6511c6-643b-4d56-9d77-4fd8d74b65fc\") " pod="openshift-network-diagnostics/network-check-target-srfp2"
Sep 10 20:57:33.613380 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:33.613354    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 20:57:33.613380 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:33.613373    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 20:57:33.613459 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:33.613382    2564 projected.go:196] Error preparing data for projected volume kube-api-access-2678k for pod openshift-network-diagnostics/network-check-target-srfp2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 20:57:33.613459 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:33.613421    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8d6511c6-643b-4d56-9d77-4fd8d74b65fc-kube-api-access-2678k podName:8d6511c6-643b-4d56-9d77-4fd8d74b65fc nodeName:}" failed. No retries permitted until 2026-09-10 20:58:05.613410598 +0000 UTC m=+66.300477855 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-2678k" (UniqueName: "kubernetes.io/projected/8d6511c6-643b-4d56-9d77-4fd8d74b65fc-kube-api-access-2678k") pod "network-check-target-srfp2" (UID: "8d6511c6-643b-4d56-9d77-4fd8d74b65fc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 20:57:33.866384 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:33.866311    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zbw7p"
Sep 10 20:57:33.866540 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:33.866311    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gzgtl"
Sep 10 20:57:33.866540 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:33.866327    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srfp2"
Sep 10 20:57:33.872334 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:33.872314    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zr4bv\""
Sep 10 20:57:33.872445 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:33.872335    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 10 20:57:33.872876 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:33.872853    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 10 20:57:33.873031 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:33.872860    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 10 20:57:33.873267 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:33.873248    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 10 20:57:33.873371 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:33.873288    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gncgs\""
Sep 10 20:57:34.041725 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:34.041687    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mv4zr" event={"ID":"9d1aef14-c1f3-402c-8232-a212f2354624","Type":"ContainerStarted","Data":"04bb2b756fc06ff9c66c8ae8af761bcb80a8e11800addf25151702028c91c252"}
Sep 10 20:57:34.045669 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:34.045642    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b5t78" event={"ID":"1100e6a5-d621-4dd1-b855-13eb97c00682","Type":"ContainerStarted","Data":"d08d31145766930b6961455fcf228162b8b46711bac2d472432ec1677022eb4a"}
Sep 10 20:57:34.078634 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:34.078592    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-b5t78" podStartSLOduration=8.093260465 podStartE2EDuration="34.078578863s" totalImagesPullingTime="25.985318398s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 20:57:00 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:57:34.078368399 +0000 UTC m=+34.765435678" watchObservedRunningTime="2026-09-10 20:57:34.078578863 +0000 UTC m=+34.765646144"
Sep 10 20:57:34.419877 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:34.419840    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a3b44ac1-2723-46ab-92b2-c92e3512b2d7-metrics-tls\") pod \"dns-default-kr6rh\" (UID: \"a3b44ac1-2723-46ab-92b2-c92e3512b2d7\") " pod="openshift-dns/dns-default-kr6rh"
Sep 10 20:57:34.420055 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:34.419972    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 20:57:34.420113 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:34.420056    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3b44ac1-2723-46ab-92b2-c92e3512b2d7-metrics-tls podName:a3b44ac1-2723-46ab-92b2-c92e3512b2d7 nodeName:}" failed. No retries permitted until 2026-09-10 20:57:36.420040265 +0000 UTC m=+37.107107522 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a3b44ac1-2723-46ab-92b2-c92e3512b2d7-metrics-tls") pod "dns-default-kr6rh" (UID: "a3b44ac1-2723-46ab-92b2-c92e3512b2d7") : secret "dns-default-metrics-tls" not found
Sep 10 20:57:36.051981 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:36.051942    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mv4zr" event={"ID":"9d1aef14-c1f3-402c-8232-a212f2354624","Type":"ContainerStarted","Data":"e0a19104fc6009e7160a3ef77a9324fd30f6d23e7c32370e6e4d9f2629368d75"}
Sep 10 20:57:36.080055 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:36.080012    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-mv4zr" podStartSLOduration=1.7026917190000002 podStartE2EDuration="4.079995775s" totalImagesPullingTime="2.377304056s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:57:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:57:36.078748573 +0000 UTC m=+36.765815852" watchObservedRunningTime="2026-09-10 20:57:36.079995775 +0000 UTC m=+36.767063054"
Sep 10 20:57:36.433746 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:36.433672    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a3b44ac1-2723-46ab-92b2-c92e3512b2d7-metrics-tls\") pod \"dns-default-kr6rh\" (UID: \"a3b44ac1-2723-46ab-92b2-c92e3512b2d7\") " pod="openshift-dns/dns-default-kr6rh"
Sep 10 20:57:36.433879 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:36.433790    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 20:57:36.433879 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:36.433841    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3b44ac1-2723-46ab-92b2-c92e3512b2d7-metrics-tls podName:a3b44ac1-2723-46ab-92b2-c92e3512b2d7 nodeName:}" failed. No retries permitted until 2026-09-10 20:57:40.433828549 +0000 UTC m=+41.120895811 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a3b44ac1-2723-46ab-92b2-c92e3512b2d7-metrics-tls") pod "dns-default-kr6rh" (UID: "a3b44ac1-2723-46ab-92b2-c92e3512b2d7") : secret "dns-default-metrics-tls" not found
Sep 10 20:57:40.456664 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:40.456621    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a3b44ac1-2723-46ab-92b2-c92e3512b2d7-metrics-tls\") pod \"dns-default-kr6rh\" (UID: \"a3b44ac1-2723-46ab-92b2-c92e3512b2d7\") " pod="openshift-dns/dns-default-kr6rh"
Sep 10 20:57:40.457041 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:40.456766    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 20:57:40.457041 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:40.456833    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3b44ac1-2723-46ab-92b2-c92e3512b2d7-metrics-tls podName:a3b44ac1-2723-46ab-92b2-c92e3512b2d7 nodeName:}" failed. No retries permitted until 2026-09-10 20:57:48.456818759 +0000 UTC m=+49.143886019 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a3b44ac1-2723-46ab-92b2-c92e3512b2d7-metrics-tls") pod "dns-default-kr6rh" (UID: "a3b44ac1-2723-46ab-92b2-c92e3512b2d7") : secret "dns-default-metrics-tls" not found
Sep 10 20:57:41.422241 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.422192    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-rc5g6"]
Sep 10 20:57:41.445381 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.445348    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-cd9hp"]
Sep 10 20:57:41.445537 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.445475    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-rc5g6"
Sep 10 20:57:41.447855 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.447833    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-grpjm\""
Sep 10 20:57:41.459049 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.459030    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-cd9hp"
Sep 10 20:57:41.469445 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.469423    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 10 20:57:41.471219 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.471195    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-rc5g6"]
Sep 10 20:57:41.472793 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.472704    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 10 20:57:41.472793 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.472704    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 10 20:57:41.472973 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.472961    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-gfq2b\""
Sep 10 20:57:41.475152 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.475130    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 10 20:57:41.481639 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.481621    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 10 20:57:41.502920 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.502894    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-cd9hp"]
Sep 10 20:57:41.564098 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.564061    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0432bad8-86f5-4b0e-a0d4-2fdb728223f2-serving-cert\") pod \"console-operator-696884fb9c-cd9hp\" (UID: \"0432bad8-86f5-4b0e-a0d4-2fdb728223f2\") " pod="openshift-console-operator/console-operator-696884fb9c-cd9hp"
Sep 10 20:57:41.564360 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.564105    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-229ns\" (UniqueName: \"kubernetes.io/projected/0432bad8-86f5-4b0e-a0d4-2fdb728223f2-kube-api-access-229ns\") pod \"console-operator-696884fb9c-cd9hp\" (UID: \"0432bad8-86f5-4b0e-a0d4-2fdb728223f2\") " pod="openshift-console-operator/console-operator-696884fb9c-cd9hp"
Sep 10 20:57:41.564360 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.564128    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkcpp\" (UniqueName: \"kubernetes.io/projected/0f6537ae-5ab5-4877-a7a5-9ea4d42835df-kube-api-access-gkcpp\") pod \"network-check-source-6f8b768455-rc5g6\" (UID: \"0f6537ae-5ab5-4877-a7a5-9ea4d42835df\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-rc5g6"
Sep 10 20:57:41.564360 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.564204    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0432bad8-86f5-4b0e-a0d4-2fdb728223f2-trusted-ca\") pod \"console-operator-696884fb9c-cd9hp\" (UID: \"0432bad8-86f5-4b0e-a0d4-2fdb728223f2\") " pod="openshift-console-operator/console-operator-696884fb9c-cd9hp"
Sep 10 20:57:41.564360 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.564263    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0432bad8-86f5-4b0e-a0d4-2fdb728223f2-config\") pod \"console-operator-696884fb9c-cd9hp\" (UID: \"0432bad8-86f5-4b0e-a0d4-2fdb728223f2\") " pod="openshift-console-operator/console-operator-696884fb9c-cd9hp"
Sep 10 20:57:41.592275 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.592241    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6c999c4888-wrq4b"]
Sep 10 20:57:41.611124 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.611097    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6c999c4888-wrq4b"
Sep 10 20:57:41.614537 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.614518    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 10 20:57:41.614784 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.614767    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 10 20:57:41.615394 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.615375    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 10 20:57:41.615489 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.615394    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 10 20:57:41.615489 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.615378    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 10 20:57:41.615807 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.615793    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 10 20:57:41.637049 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.637028    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-b4znc\""
Sep 10 20:57:41.644498 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.644476    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6c999c4888-wrq4b"]
Sep 10 20:57:41.664800 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.664774    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0432bad8-86f5-4b0e-a0d4-2fdb728223f2-serving-cert\") pod \"console-operator-696884fb9c-cd9hp\" (UID: \"0432bad8-86f5-4b0e-a0d4-2fdb728223f2\") " pod="openshift-console-operator/console-operator-696884fb9c-cd9hp"
Sep 10 20:57:41.664912 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.664805    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-229ns\" (UniqueName: \"kubernetes.io/projected/0432bad8-86f5-4b0e-a0d4-2fdb728223f2-kube-api-access-229ns\") pod \"console-operator-696884fb9c-cd9hp\" (UID: \"0432bad8-86f5-4b0e-a0d4-2fdb728223f2\") " pod="openshift-console-operator/console-operator-696884fb9c-cd9hp"
Sep 10 20:57:41.664912 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.664827    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkcpp\" (UniqueName: \"kubernetes.io/projected/0f6537ae-5ab5-4877-a7a5-9ea4d42835df-kube-api-access-gkcpp\") pod \"network-check-source-6f8b768455-rc5g6\" (UID: \"0f6537ae-5ab5-4877-a7a5-9ea4d42835df\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-rc5g6"
Sep 10 20:57:41.664912 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.664863    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0432bad8-86f5-4b0e-a0d4-2fdb728223f2-trusted-ca\") pod \"console-operator-696884fb9c-cd9hp\" (UID: \"0432bad8-86f5-4b0e-a0d4-2fdb728223f2\") " pod="openshift-console-operator/console-operator-696884fb9c-cd9hp"
Sep 10 20:57:41.664912 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.664896    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0432bad8-86f5-4b0e-a0d4-2fdb728223f2-config\") pod \"console-operator-696884fb9c-cd9hp\" (UID: \"0432bad8-86f5-4b0e-a0d4-2fdb728223f2\") " pod="openshift-console-operator/console-operator-696884fb9c-cd9hp"
Sep 10 20:57:41.665619 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.665598    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0432bad8-86f5-4b0e-a0d4-2fdb728223f2-config\") pod \"console-operator-696884fb9c-cd9hp\" (UID: \"0432bad8-86f5-4b0e-a0d4-2fdb728223f2\") " pod="openshift-console-operator/console-operator-696884fb9c-cd9hp"
Sep 10 20:57:41.665716 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.665648    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0432bad8-86f5-4b0e-a0d4-2fdb728223f2-trusted-ca\") pod \"console-operator-696884fb9c-cd9hp\" (UID: \"0432bad8-86f5-4b0e-a0d4-2fdb728223f2\") " pod="openshift-console-operator/console-operator-696884fb9c-cd9hp"
Sep 10 20:57:41.668351 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.668330    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0432bad8-86f5-4b0e-a0d4-2fdb728223f2-serving-cert\") pod \"console-operator-696884fb9c-cd9hp\" (UID: \"0432bad8-86f5-4b0e-a0d4-2fdb728223f2\") " pod="openshift-console-operator/console-operator-696884fb9c-cd9hp"
Sep 10 20:57:41.693668 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.693578    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5844b856db-6bmfj"]
Sep 10 20:57:41.714990 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.714962    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-jfjlv"]
Sep 10 20:57:41.715112 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.715042    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-6bmfj"
Sep 10 20:57:41.718244 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.718204    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 10 20:57:41.718705 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.718591    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 10 20:57:41.719220 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.719198    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 10 20:57:41.719347 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.719205    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-cz6z7\""
Sep 10 20:57:41.720210 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.720191    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 10 20:57:41.720927 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.720864    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkcpp\" (UniqueName: \"kubernetes.io/projected/0f6537ae-5ab5-4877-a7a5-9ea4d42835df-kube-api-access-gkcpp\") pod \"network-check-source-6f8b768455-rc5g6\" (UID: \"0f6537ae-5ab5-4877-a7a5-9ea4d42835df\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-rc5g6"
Sep 10 20:57:41.721722 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.721702    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-229ns\" (UniqueName: \"kubernetes.io/projected/0432bad8-86f5-4b0e-a0d4-2fdb728223f2-kube-api-access-229ns\") pod \"console-operator-696884fb9c-cd9hp\" (UID: \"0432bad8-86f5-4b0e-a0d4-2fdb728223f2\") " pod="openshift-console-operator/console-operator-696884fb9c-cd9hp"
Sep 10 20:57:41.734799 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.734772    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 10 20:57:41.737080 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.737062    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-jfjlv"]
Sep 10 20:57:41.737186 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.737154    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-jfjlv"
Sep 10 20:57:41.741547 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.741528    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-6bmfj"]
Sep 10 20:57:41.745223 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.745206    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 10 20:57:41.745565 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.745550    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-cmfrq\""
Sep 10 20:57:41.745733 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.745721    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 10 20:57:41.749656 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.749641    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 10 20:57:41.753752 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.753736    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-rc5g6"
Sep 10 20:57:41.765939 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.765923    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-cd9hp"
Sep 10 20:57:41.766077 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.766060    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c1c5af58-1a57-4208-b8ac-0a37ef4efd70-stats-auth\") pod \"router-default-6c999c4888-wrq4b\" (UID: \"c1c5af58-1a57-4208-b8ac-0a37ef4efd70\") " pod="openshift-ingress/router-default-6c999c4888-wrq4b"
Sep 10 20:57:41.766122 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.766100    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c1c5af58-1a57-4208-b8ac-0a37ef4efd70-default-certificate\") pod \"router-default-6c999c4888-wrq4b\" (UID: \"c1c5af58-1a57-4208-b8ac-0a37ef4efd70\") " pod="openshift-ingress/router-default-6c999c4888-wrq4b"
Sep 10 20:57:41.766122 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.766118    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1c5af58-1a57-4208-b8ac-0a37ef4efd70-service-ca-bundle\") pod \"router-default-6c999c4888-wrq4b\" (UID: \"c1c5af58-1a57-4208-b8ac-0a37ef4efd70\") " pod="openshift-ingress/router-default-6c999c4888-wrq4b"
Sep 10 20:57:41.766192 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.766145    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1c5af58-1a57-4208-b8ac-0a37ef4efd70-metrics-certs\") pod \"router-default-6c999c4888-wrq4b\" (UID: \"c1c5af58-1a57-4208-b8ac-0a37ef4efd70\") " pod="openshift-ingress/router-default-6c999c4888-wrq4b"
Sep 10 20:57:41.766245 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.766187    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qjxk\" (UniqueName: \"kubernetes.io/projected/c1c5af58-1a57-4208-b8ac-0a37ef4efd70-kube-api-access-7qjxk\") pod \"router-default-6c999c4888-wrq4b\" (UID: \"c1c5af58-1a57-4208-b8ac-0a37ef4efd70\") " pod="openshift-ingress/router-default-6c999c4888-wrq4b"
Sep 10 20:57:41.862392 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.862369    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-vhb8c"]
Sep 10 20:57:41.866748 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.866723    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1c5af58-1a57-4208-b8ac-0a37ef4efd70-metrics-certs\") pod \"router-default-6c999c4888-wrq4b\" (UID: \"c1c5af58-1a57-4208-b8ac-0a37ef4efd70\") " pod="openshift-ingress/router-default-6c999c4888-wrq4b"
Sep 10 20:57:41.866830 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.866759    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qjxk\" (UniqueName: \"kubernetes.io/projected/c1c5af58-1a57-4208-b8ac-0a37ef4efd70-kube-api-access-7qjxk\") pod \"router-default-6c999c4888-wrq4b\" (UID: \"c1c5af58-1a57-4208-b8ac-0a37ef4efd70\") " pod="openshift-ingress/router-default-6c999c4888-wrq4b"
Sep 10 20:57:41.866830 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.866814    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/113738d6-eb6e-43ad-919c-53f9fd812a66-service-ca-bundle\") pod \"insights-operator-5844b856db-6bmfj\" (UID: \"113738d6-eb6e-43ad-919c-53f9fd812a66\") " pod="openshift-insights/insights-operator-5844b856db-6bmfj"
Sep 10 20:57:41.866901 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.866837    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/113738d6-eb6e-43ad-919c-53f9fd812a66-serving-cert\") pod \"insights-operator-5844b856db-6bmfj\" (UID: \"113738d6-eb6e-43ad-919c-53f9fd812a66\") " pod="openshift-insights/insights-operator-5844b856db-6bmfj"
Sep 10 20:57:41.866901 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.866867    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/113738d6-eb6e-43ad-919c-53f9fd812a66-snapshots\") pod \"insights-operator-5844b856db-6bmfj\" (UID: \"113738d6-eb6e-43ad-919c-53f9fd812a66\") " pod="openshift-insights/insights-operator-5844b856db-6bmfj"
Sep 10 20:57:41.866901 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:41.866871    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 10 20:57:41.867017 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:41.866945    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1c5af58-1a57-4208-b8ac-0a37ef4efd70-metrics-certs podName:c1c5af58-1a57-4208-b8ac-0a37ef4efd70 nodeName:}" failed. No retries permitted until 2026-09-10 20:57:42.366932377 +0000 UTC m=+43.053999633 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c1c5af58-1a57-4208-b8ac-0a37ef4efd70-metrics-certs") pod "router-default-6c999c4888-wrq4b" (UID: "c1c5af58-1a57-4208-b8ac-0a37ef4efd70") : secret "router-metrics-certs-default" not found
Sep 10 20:57:41.867070 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.867037    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3d771666-1913-4566-ba69-a66a3b7b3c8d-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-jfjlv\" (UID: \"3d771666-1913-4566-ba69-a66a3b7b3c8d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-jfjlv"
Sep 10 20:57:41.867159 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.867113    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c1c5af58-1a57-4208-b8ac-0a37ef4efd70-stats-auth\") pod \"router-default-6c999c4888-wrq4b\" (UID: \"c1c5af58-1a57-4208-b8ac-0a37ef4efd70\") " pod="openshift-ingress/router-default-6c999c4888-wrq4b"
Sep 10 20:57:41.867208 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.867167    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9572x\" (UniqueName: \"kubernetes.io/projected/3d771666-1913-4566-ba69-a66a3b7b3c8d-kube-api-access-9572x\") pod \"cluster-samples-operator-86499c89c4-jfjlv\" (UID: \"3d771666-1913-4566-ba69-a66a3b7b3c8d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-jfjlv"
Sep 10 20:57:41.867208 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.867199    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gfml\" (UniqueName: \"kubernetes.io/projected/113738d6-eb6e-43ad-919c-53f9fd812a66-kube-api-access-2gfml\") pod \"insights-operator-5844b856db-6bmfj\" (UID: \"113738d6-eb6e-43ad-919c-53f9fd812a66\") " pod="openshift-insights/insights-operator-5844b856db-6bmfj"
Sep 10 20:57:41.867392 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.867372    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/113738d6-eb6e-43ad-919c-53f9fd812a66-tmp\") pod \"insights-operator-5844b856db-6bmfj\" (UID: \"113738d6-eb6e-43ad-919c-53f9fd812a66\") " pod="openshift-insights/insights-operator-5844b856db-6bmfj"
Sep 10 20:57:41.867435 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.867409    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/113738d6-eb6e-43ad-919c-53f9fd812a66-trusted-ca-bundle\") pod \"insights-operator-5844b856db-6bmfj\" (UID: \"113738d6-eb6e-43ad-919c-53f9fd812a66\") " pod="openshift-insights/insights-operator-5844b856db-6bmfj"
Sep 10 20:57:41.867503 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.867481    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c1c5af58-1a57-4208-b8ac-0a37ef4efd70-default-certificate\") pod \"router-default-6c999c4888-wrq4b\" (UID: \"c1c5af58-1a57-4208-b8ac-0a37ef4efd70\") " pod="openshift-ingress/router-default-6c999c4888-wrq4b"
Sep 10 20:57:41.867550 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.867519    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1c5af58-1a57-4208-b8ac-0a37ef4efd70-service-ca-bundle\") pod \"router-default-6c999c4888-wrq4b\" (UID: \"c1c5af58-1a57-4208-b8ac-0a37ef4efd70\") " pod="openshift-ingress/router-default-6c999c4888-wrq4b"
Sep 10 20:57:41.867668 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:41.867641    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c1c5af58-1a57-4208-b8ac-0a37ef4efd70-service-ca-bundle podName:c1c5af58-1a57-4208-b8ac-0a37ef4efd70 nodeName:}" failed. No retries permitted until 2026-09-10 20:57:42.367627263 +0000 UTC m=+43.054694536 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c1c5af58-1a57-4208-b8ac-0a37ef4efd70-service-ca-bundle") pod "router-default-6c999c4888-wrq4b" (UID: "c1c5af58-1a57-4208-b8ac-0a37ef4efd70") : configmap references non-existent config key: service-ca.crt
Sep 10 20:57:41.870071 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.870049    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c1c5af58-1a57-4208-b8ac-0a37ef4efd70-stats-auth\") pod \"router-default-6c999c4888-wrq4b\" (UID: \"c1c5af58-1a57-4208-b8ac-0a37ef4efd70\") " pod="openshift-ingress/router-default-6c999c4888-wrq4b"
Sep 10 20:57:41.870400 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.870384    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c1c5af58-1a57-4208-b8ac-0a37ef4efd70-default-certificate\") pod \"router-default-6c999c4888-wrq4b\" (UID: \"c1c5af58-1a57-4208-b8ac-0a37ef4efd70\") " pod="openshift-ingress/router-default-6c999c4888-wrq4b"
Sep 10 20:57:41.888044 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.888018    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qjxk\" (UniqueName: \"kubernetes.io/projected/c1c5af58-1a57-4208-b8ac-0a37ef4efd70-kube-api-access-7qjxk\") pod \"router-default-6c999c4888-wrq4b\" (UID: \"c1c5af58-1a57-4208-b8ac-0a37ef4efd70\") " pod="openshift-ingress/router-default-6c999c4888-wrq4b"
Sep 10 20:57:41.889808 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.889793    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-vhb8c"
Sep 10 20:57:41.896019 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.895886    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 10 20:57:41.896019 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.895898    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 10 20:57:41.896157 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.896141    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 10 20:57:41.896352 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.896337    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-vkpth\""
Sep 10 20:57:41.896416 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.896372    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 10 20:57:41.909223 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.909196    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-vhb8c"]
Sep 10 20:57:41.968705 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.968619    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/113738d6-eb6e-43ad-919c-53f9fd812a66-service-ca-bundle\") pod \"insights-operator-5844b856db-6bmfj\" (UID: \"113738d6-eb6e-43ad-919c-53f9fd812a66\") " pod="openshift-insights/insights-operator-5844b856db-6bmfj"
Sep 10 20:57:41.968705 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.968655    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/113738d6-eb6e-43ad-919c-53f9fd812a66-serving-cert\") pod \"insights-operator-5844b856db-6bmfj\" (UID: \"113738d6-eb6e-43ad-919c-53f9fd812a66\") " pod="openshift-insights/insights-operator-5844b856db-6bmfj"
Sep 10 20:57:41.968705 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.968682    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/113738d6-eb6e-43ad-919c-53f9fd812a66-snapshots\") pod \"insights-operator-5844b856db-6bmfj\" (UID: \"113738d6-eb6e-43ad-919c-53f9fd812a66\") " pod="openshift-insights/insights-operator-5844b856db-6bmfj"
Sep 10 20:57:41.968983 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.968864    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3d771666-1913-4566-ba69-a66a3b7b3c8d-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-jfjlv\" (UID: \"3d771666-1913-4566-ba69-a66a3b7b3c8d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-jfjlv"
Sep 10 20:57:41.968983 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.968910    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9572x\" (UniqueName: \"kubernetes.io/projected/3d771666-1913-4566-ba69-a66a3b7b3c8d-kube-api-access-9572x\") pod \"cluster-samples-operator-86499c89c4-jfjlv\" (UID: \"3d771666-1913-4566-ba69-a66a3b7b3c8d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-jfjlv"
Sep 10 20:57:41.968983 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.968931    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gfml\" (UniqueName: \"kubernetes.io/projected/113738d6-eb6e-43ad-919c-53f9fd812a66-kube-api-access-2gfml\") pod \"insights-operator-5844b856db-6bmfj\" (UID: \"113738d6-eb6e-43ad-919c-53f9fd812a66\") " pod="openshift-insights/insights-operator-5844b856db-6bmfj"
Sep 10 20:57:41.969124 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.968997    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/113738d6-eb6e-43ad-919c-53f9fd812a66-tmp\") pod \"insights-operator-5844b856db-6bmfj\" (UID: \"113738d6-eb6e-43ad-919c-53f9fd812a66\") " pod="openshift-insights/insights-operator-5844b856db-6bmfj"
Sep 10 20:57:41.969124 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.969034    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/113738d6-eb6e-43ad-919c-53f9fd812a66-trusted-ca-bundle\") pod \"insights-operator-5844b856db-6bmfj\" (UID: \"113738d6-eb6e-43ad-919c-53f9fd812a66\") " pod="openshift-insights/insights-operator-5844b856db-6bmfj"
Sep 10 20:57:41.969219 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:41.969004    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 10 20:57:41.969304 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:41.969218    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d771666-1913-4566-ba69-a66a3b7b3c8d-samples-operator-tls podName:3d771666-1913-4566-ba69-a66a3b7b3c8d nodeName:}" failed. No retries permitted until 2026-09-10 20:57:42.469186391 +0000 UTC m=+43.156253656 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3d771666-1913-4566-ba69-a66a3b7b3c8d-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-jfjlv" (UID: "3d771666-1913-4566-ba69-a66a3b7b3c8d") : secret "samples-operator-tls" not found
Sep 10 20:57:41.969362 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.969305    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/113738d6-eb6e-43ad-919c-53f9fd812a66-service-ca-bundle\") pod \"insights-operator-5844b856db-6bmfj\" (UID: \"113738d6-eb6e-43ad-919c-53f9fd812a66\") " pod="openshift-insights/insights-operator-5844b856db-6bmfj"
Sep 10 20:57:41.969409 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.969384    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/113738d6-eb6e-43ad-919c-53f9fd812a66-tmp\") pod \"insights-operator-5844b856db-6bmfj\" (UID: \"113738d6-eb6e-43ad-919c-53f9fd812a66\") " pod="openshift-insights/insights-operator-5844b856db-6bmfj"
Sep 10 20:57:41.969483 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.969465    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/113738d6-eb6e-43ad-919c-53f9fd812a66-snapshots\") pod \"insights-operator-5844b856db-6bmfj\" (UID: \"113738d6-eb6e-43ad-919c-53f9fd812a66\") " pod="openshift-insights/insights-operator-5844b856db-6bmfj"
Sep 10 20:57:41.970035 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.970014    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/113738d6-eb6e-43ad-919c-53f9fd812a66-trusted-ca-bundle\") pod \"insights-operator-5844b856db-6bmfj\" (UID: \"113738d6-eb6e-43ad-919c-53f9fd812a66\") " pod="openshift-insights/insights-operator-5844b856db-6bmfj"
Sep 10 20:57:41.971270 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.971254    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/113738d6-eb6e-43ad-919c-53f9fd812a66-serving-cert\") pod \"insights-operator-5844b856db-6bmfj\" (UID: \"113738d6-eb6e-43ad-919c-53f9fd812a66\") " pod="openshift-insights/insights-operator-5844b856db-6bmfj"
Sep 10 20:57:41.990754 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.990728    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gfml\" (UniqueName: \"kubernetes.io/projected/113738d6-eb6e-43ad-919c-53f9fd812a66-kube-api-access-2gfml\") pod \"insights-operator-5844b856db-6bmfj\" (UID: \"113738d6-eb6e-43ad-919c-53f9fd812a66\") " pod="openshift-insights/insights-operator-5844b856db-6bmfj"
Sep 10 20:57:41.991818 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:41.991801    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9572x\" (UniqueName: \"kubernetes.io/projected/3d771666-1913-4566-ba69-a66a3b7b3c8d-kube-api-access-9572x\") pod \"cluster-samples-operator-86499c89c4-jfjlv\" (UID: \"3d771666-1913-4566-ba69-a66a3b7b3c8d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-jfjlv"
Sep 10 20:57:42.029766 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:42.029740    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-6bmfj"
Sep 10 20:57:42.062808 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:42.062780    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-rc5g6"]
Sep 10 20:57:42.066316 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:57:42.066290    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f6537ae_5ab5_4877_a7a5_9ea4d42835df.slice/crio-50aa1d6ff175dba0ac64c976d2bd01d90cdc1fce611012c677fc5692a3425f7c WatchSource:0}: Error finding container 50aa1d6ff175dba0ac64c976d2bd01d90cdc1fce611012c677fc5692a3425f7c: Status 404 returned error can't find the container with id 50aa1d6ff175dba0ac64c976d2bd01d90cdc1fce611012c677fc5692a3425f7c
Sep 10 20:57:42.069772 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:42.069740    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xm6wc\" (UniqueName: \"kubernetes.io/projected/5e15b3b7-d93d-42fa-85a5-2a2f529e5649-kube-api-access-xm6wc\") pod \"kube-storage-version-migrator-operator-6c8f84f897-vhb8c\" (UID: \"5e15b3b7-d93d-42fa-85a5-2a2f529e5649\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-vhb8c"
Sep 10 20:57:42.069921 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:42.069904    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5e15b3b7-d93d-42fa-85a5-2a2f529e5649-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-vhb8c\" (UID: \"5e15b3b7-d93d-42fa-85a5-2a2f529e5649\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-vhb8c"
Sep 10 20:57:42.070009 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:42.069996    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5e15b3b7-d93d-42fa-85a5-2a2f529e5649-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-vhb8c\" (UID: \"5e15b3b7-d93d-42fa-85a5-2a2f529e5649\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-vhb8c"
Sep 10 20:57:42.108475 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:57:42.108442    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0432bad8_86f5_4b0e_a0d4_2fdb728223f2.slice/crio-14766b17b18d278a535bf94c6db3840291b442ee2d88aaa1e35e0e8b83eb5bcb WatchSource:0}: Error finding container 14766b17b18d278a535bf94c6db3840291b442ee2d88aaa1e35e0e8b83eb5bcb: Status 404 returned error can't find the container with id 14766b17b18d278a535bf94c6db3840291b442ee2d88aaa1e35e0e8b83eb5bcb
Sep 10 20:57:42.109946 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:42.109924    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-cd9hp"]
Sep 10 20:57:42.171007 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:42.170970    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5e15b3b7-d93d-42fa-85a5-2a2f529e5649-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-vhb8c\" (UID: \"5e15b3b7-d93d-42fa-85a5-2a2f529e5649\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-vhb8c"
Sep 10 20:57:42.171155 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:42.171063    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5e15b3b7-d93d-42fa-85a5-2a2f529e5649-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-vhb8c\" (UID: \"5e15b3b7-d93d-42fa-85a5-2a2f529e5649\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-vhb8c"
Sep 10 20:57:42.171155 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:42.171111    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xm6wc\" (UniqueName: \"kubernetes.io/projected/5e15b3b7-d93d-42fa-85a5-2a2f529e5649-kube-api-access-xm6wc\") pod \"kube-storage-version-migrator-operator-6c8f84f897-vhb8c\" (UID: \"5e15b3b7-d93d-42fa-85a5-2a2f529e5649\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-vhb8c"
Sep 10 20:57:42.171671 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:42.171645    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5e15b3b7-d93d-42fa-85a5-2a2f529e5649-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-vhb8c\" (UID: \"5e15b3b7-d93d-42fa-85a5-2a2f529e5649\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-vhb8c"
Sep 10 20:57:42.173196 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:42.173178    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5e15b3b7-d93d-42fa-85a5-2a2f529e5649-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-vhb8c\" (UID: \"5e15b3b7-d93d-42fa-85a5-2a2f529e5649\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-vhb8c"
Sep 10 20:57:42.191812 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:42.191786    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xm6wc\" (UniqueName: \"kubernetes.io/projected/5e15b3b7-d93d-42fa-85a5-2a2f529e5649-kube-api-access-xm6wc\") pod \"kube-storage-version-migrator-operator-6c8f84f897-vhb8c\" (UID: \"5e15b3b7-d93d-42fa-85a5-2a2f529e5649\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-vhb8c"
Sep 10 20:57:42.198733 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:42.198712    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-vhb8c"
Sep 10 20:57:42.318283 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:42.318260    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-6bmfj"]
Sep 10 20:57:42.320591 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:57:42.320566    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod113738d6_eb6e_43ad_919c_53f9fd812a66.slice/crio-7298a2d41ab3c2a5569425f7c24bfbf406fdf7713245a0f1ff3629a59e912399 WatchSource:0}: Error finding container 7298a2d41ab3c2a5569425f7c24bfbf406fdf7713245a0f1ff3629a59e912399: Status 404 returned error can't find the container with id 7298a2d41ab3c2a5569425f7c24bfbf406fdf7713245a0f1ff3629a59e912399
Sep 10 20:57:42.373453 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:42.373422    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1c5af58-1a57-4208-b8ac-0a37ef4efd70-service-ca-bundle\") pod \"router-default-6c999c4888-wrq4b\" (UID: \"c1c5af58-1a57-4208-b8ac-0a37ef4efd70\") " pod="openshift-ingress/router-default-6c999c4888-wrq4b"
Sep 10 20:57:42.373594 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:42.373473    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1c5af58-1a57-4208-b8ac-0a37ef4efd70-metrics-certs\") pod \"router-default-6c999c4888-wrq4b\" (UID: \"c1c5af58-1a57-4208-b8ac-0a37ef4efd70\") " pod="openshift-ingress/router-default-6c999c4888-wrq4b"
Sep 10 20:57:42.373594 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:42.373571    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 10 20:57:42.373656 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:42.373637    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1c5af58-1a57-4208-b8ac-0a37ef4efd70-metrics-certs podName:c1c5af58-1a57-4208-b8ac-0a37ef4efd70 nodeName:}" failed. No retries permitted until 2026-09-10 20:57:43.373617267 +0000 UTC m=+44.060684551 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c1c5af58-1a57-4208-b8ac-0a37ef4efd70-metrics-certs") pod "router-default-6c999c4888-wrq4b" (UID: "c1c5af58-1a57-4208-b8ac-0a37ef4efd70") : secret "router-metrics-certs-default" not found
Sep 10 20:57:42.373722 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:42.373697    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c1c5af58-1a57-4208-b8ac-0a37ef4efd70-service-ca-bundle podName:c1c5af58-1a57-4208-b8ac-0a37ef4efd70 nodeName:}" failed. No retries permitted until 2026-09-10 20:57:43.373682248 +0000 UTC m=+44.060749539 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c1c5af58-1a57-4208-b8ac-0a37ef4efd70-service-ca-bundle") pod "router-default-6c999c4888-wrq4b" (UID: "c1c5af58-1a57-4208-b8ac-0a37ef4efd70") : configmap references non-existent config key: service-ca.crt
Sep 10 20:57:42.474683 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:42.474648    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3d771666-1913-4566-ba69-a66a3b7b3c8d-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-jfjlv\" (UID: \"3d771666-1913-4566-ba69-a66a3b7b3c8d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-jfjlv"
Sep 10 20:57:42.475049 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:42.474799    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 10 20:57:42.475049 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:42.474894    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d771666-1913-4566-ba69-a66a3b7b3c8d-samples-operator-tls podName:3d771666-1913-4566-ba69-a66a3b7b3c8d nodeName:}" failed. No retries permitted until 2026-09-10 20:57:43.474871305 +0000 UTC m=+44.161938570 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3d771666-1913-4566-ba69-a66a3b7b3c8d-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-jfjlv" (UID: "3d771666-1913-4566-ba69-a66a3b7b3c8d") : secret "samples-operator-tls" not found
Sep 10 20:57:42.511357 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:42.511281    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-vhb8c"]
Sep 10 20:57:42.513962 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:57:42.513934    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e15b3b7_d93d_42fa_85a5_2a2f529e5649.slice/crio-3e956ef77c67d312497a66fb7cc1d909f63e0ded33a74e3ee154981768d00774 WatchSource:0}: Error finding container 3e956ef77c67d312497a66fb7cc1d909f63e0ded33a74e3ee154981768d00774: Status 404 returned error can't find the container with id 3e956ef77c67d312497a66fb7cc1d909f63e0ded33a74e3ee154981768d00774
Sep 10 20:57:43.070350 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:43.070313    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-vhb8c" event={"ID":"5e15b3b7-d93d-42fa-85a5-2a2f529e5649","Type":"ContainerStarted","Data":"3e956ef77c67d312497a66fb7cc1d909f63e0ded33a74e3ee154981768d00774"}
Sep 10 20:57:43.071974 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:43.071947    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-cd9hp" event={"ID":"0432bad8-86f5-4b0e-a0d4-2fdb728223f2","Type":"ContainerStarted","Data":"14766b17b18d278a535bf94c6db3840291b442ee2d88aaa1e35e0e8b83eb5bcb"}
Sep 10 20:57:43.074140 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:43.074026    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-6bmfj" event={"ID":"113738d6-eb6e-43ad-919c-53f9fd812a66","Type":"ContainerStarted","Data":"7298a2d41ab3c2a5569425f7c24bfbf406fdf7713245a0f1ff3629a59e912399"}
Sep 10 20:57:43.075492 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:43.075444    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-rc5g6" event={"ID":"0f6537ae-5ab5-4877-a7a5-9ea4d42835df","Type":"ContainerStarted","Data":"50aa1d6ff175dba0ac64c976d2bd01d90cdc1fce611012c677fc5692a3425f7c"}
Sep 10 20:57:43.383064 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:43.382978    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1c5af58-1a57-4208-b8ac-0a37ef4efd70-metrics-certs\") pod \"router-default-6c999c4888-wrq4b\" (UID: \"c1c5af58-1a57-4208-b8ac-0a37ef4efd70\") " pod="openshift-ingress/router-default-6c999c4888-wrq4b"
Sep 10 20:57:43.383251 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:43.383144    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1c5af58-1a57-4208-b8ac-0a37ef4efd70-service-ca-bundle\") pod \"router-default-6c999c4888-wrq4b\" (UID: \"c1c5af58-1a57-4208-b8ac-0a37ef4efd70\") " pod="openshift-ingress/router-default-6c999c4888-wrq4b"
Sep 10 20:57:43.383415 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:43.383398    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c1c5af58-1a57-4208-b8ac-0a37ef4efd70-service-ca-bundle podName:c1c5af58-1a57-4208-b8ac-0a37ef4efd70 nodeName:}" failed. No retries permitted until 2026-09-10 20:57:45.383377933 +0000 UTC m=+46.070445205 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c1c5af58-1a57-4208-b8ac-0a37ef4efd70-service-ca-bundle") pod "router-default-6c999c4888-wrq4b" (UID: "c1c5af58-1a57-4208-b8ac-0a37ef4efd70") : configmap references non-existent config key: service-ca.crt
Sep 10 20:57:43.383833 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:43.383810    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 10 20:57:43.383927 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:43.383870    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1c5af58-1a57-4208-b8ac-0a37ef4efd70-metrics-certs podName:c1c5af58-1a57-4208-b8ac-0a37ef4efd70 nodeName:}" failed. No retries permitted until 2026-09-10 20:57:45.383855091 +0000 UTC m=+46.070922365 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c1c5af58-1a57-4208-b8ac-0a37ef4efd70-metrics-certs") pod "router-default-6c999c4888-wrq4b" (UID: "c1c5af58-1a57-4208-b8ac-0a37ef4efd70") : secret "router-metrics-certs-default" not found
Sep 10 20:57:43.483718 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:43.483680    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3d771666-1913-4566-ba69-a66a3b7b3c8d-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-jfjlv\" (UID: \"3d771666-1913-4566-ba69-a66a3b7b3c8d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-jfjlv"
Sep 10 20:57:43.484381 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:43.483899    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 10 20:57:43.484381 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:43.483961    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d771666-1913-4566-ba69-a66a3b7b3c8d-samples-operator-tls podName:3d771666-1913-4566-ba69-a66a3b7b3c8d nodeName:}" failed. No retries permitted until 2026-09-10 20:57:45.483943139 +0000 UTC m=+46.171010402 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3d771666-1913-4566-ba69-a66a3b7b3c8d-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-jfjlv" (UID: "3d771666-1913-4566-ba69-a66a3b7b3c8d") : secret "samples-operator-tls" not found
Sep 10 20:57:45.401538 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:45.401499    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1c5af58-1a57-4208-b8ac-0a37ef4efd70-service-ca-bundle\") pod \"router-default-6c999c4888-wrq4b\" (UID: \"c1c5af58-1a57-4208-b8ac-0a37ef4efd70\") " pod="openshift-ingress/router-default-6c999c4888-wrq4b"
Sep 10 20:57:45.401973 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:45.401575    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1c5af58-1a57-4208-b8ac-0a37ef4efd70-metrics-certs\") pod \"router-default-6c999c4888-wrq4b\" (UID: \"c1c5af58-1a57-4208-b8ac-0a37ef4efd70\") " pod="openshift-ingress/router-default-6c999c4888-wrq4b"
Sep 10 20:57:45.401973 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:45.401730    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 10 20:57:45.401973 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:45.401735    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c1c5af58-1a57-4208-b8ac-0a37ef4efd70-service-ca-bundle podName:c1c5af58-1a57-4208-b8ac-0a37ef4efd70 nodeName:}" failed. No retries permitted until 2026-09-10 20:57:49.401715613 +0000 UTC m=+50.088782873 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c1c5af58-1a57-4208-b8ac-0a37ef4efd70-service-ca-bundle") pod "router-default-6c999c4888-wrq4b" (UID: "c1c5af58-1a57-4208-b8ac-0a37ef4efd70") : configmap references non-existent config key: service-ca.crt
Sep 10 20:57:45.401973 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:45.401805    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1c5af58-1a57-4208-b8ac-0a37ef4efd70-metrics-certs podName:c1c5af58-1a57-4208-b8ac-0a37ef4efd70 nodeName:}" failed. No retries permitted until 2026-09-10 20:57:49.401792829 +0000 UTC m=+50.088860089 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c1c5af58-1a57-4208-b8ac-0a37ef4efd70-metrics-certs") pod "router-default-6c999c4888-wrq4b" (UID: "c1c5af58-1a57-4208-b8ac-0a37ef4efd70") : secret "router-metrics-certs-default" not found
Sep 10 20:57:45.503039 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:45.502997    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3d771666-1913-4566-ba69-a66a3b7b3c8d-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-jfjlv\" (UID: \"3d771666-1913-4566-ba69-a66a3b7b3c8d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-jfjlv"
Sep 10 20:57:45.503219 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:45.503148    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 10 20:57:45.503219 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:45.503213    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d771666-1913-4566-ba69-a66a3b7b3c8d-samples-operator-tls podName:3d771666-1913-4566-ba69-a66a3b7b3c8d nodeName:}" failed. No retries permitted until 2026-09-10 20:57:49.503198543 +0000 UTC m=+50.190265799 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3d771666-1913-4566-ba69-a66a3b7b3c8d-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-jfjlv" (UID: "3d771666-1913-4566-ba69-a66a3b7b3c8d") : secret "samples-operator-tls" not found
Sep 10 20:57:48.091664 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:48.091625    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-6bmfj" event={"ID":"113738d6-eb6e-43ad-919c-53f9fd812a66","Type":"ContainerStarted","Data":"70ec31f13a94976a5e4f7ce3822401cf3f4dfc5494ac75cd316975345761443e"}
Sep 10 20:57:48.093345 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:48.093316    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-rc5g6" event={"ID":"0f6537ae-5ab5-4877-a7a5-9ea4d42835df","Type":"ContainerStarted","Data":"bc67460bd3098e33f623858e766ed9ba689df864f194a8bb5c73870fbf1b25c9"}
Sep 10 20:57:48.094928 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:48.094906    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-vhb8c" event={"ID":"5e15b3b7-d93d-42fa-85a5-2a2f529e5649","Type":"ContainerStarted","Data":"2fc758c9088a8246e6f040003f5a98d22cab3e051a1d94c4a116de46ed192bfd"}
Sep 10 20:57:48.096652 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:48.096634    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-cd9hp_0432bad8-86f5-4b0e-a0d4-2fdb728223f2/console-operator/0.log"
Sep 10 20:57:48.096755 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:48.096665    2564 generic.go:356] "Generic (PLEG): container finished" podID="0432bad8-86f5-4b0e-a0d4-2fdb728223f2" containerID="c8dfece890df35fa04fdb8118cd5c6e281375b85fc541a2ffaeb3425a3620693" exitCode=255
Sep 10 20:57:48.096755 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:48.096690    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-cd9hp" event={"ID":"0432bad8-86f5-4b0e-a0d4-2fdb728223f2","Type":"ContainerDied","Data":"c8dfece890df35fa04fdb8118cd5c6e281375b85fc541a2ffaeb3425a3620693"}
Sep 10 20:57:48.096915 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:48.096899    2564 scope.go:117] "RemoveContainer" containerID="c8dfece890df35fa04fdb8118cd5c6e281375b85fc541a2ffaeb3425a3620693"
Sep 10 20:57:48.121784 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:48.121737    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5844b856db-6bmfj" podStartSLOduration=1.882898642 podStartE2EDuration="7.121718657s" totalImagesPullingTime="5.238820015s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:57:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:57:48.121542103 +0000 UTC m=+48.808609388" watchObservedRunningTime="2026-09-10 20:57:48.121718657 +0000 UTC m=+48.808785936"
Sep 10 20:57:48.188394 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:48.188344    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f8b768455-rc5g6" podStartSLOduration=1.694895121 podStartE2EDuration="7.188328923s" totalImagesPullingTime="5.493433802s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:57:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:57:48.155955711 +0000 UTC m=+48.843022991" watchObservedRunningTime="2026-09-10 20:57:48.188328923 +0000 UTC m=+48.875396201"
Sep 10 20:57:48.216612 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:48.216549    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-vhb8c" podStartSLOduration=2.165534831 podStartE2EDuration="7.216528795s" totalImagesPullingTime="5.050993964s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:57:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:57:48.213709087 +0000 UTC m=+48.900776368" watchObservedRunningTime="2026-09-10 20:57:48.216528795 +0000 UTC m=+48.903596076"
Sep 10 20:57:48.530428 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:48.530341    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a3b44ac1-2723-46ab-92b2-c92e3512b2d7-metrics-tls\") pod \"dns-default-kr6rh\" (UID: \"a3b44ac1-2723-46ab-92b2-c92e3512b2d7\") " pod="openshift-dns/dns-default-kr6rh"
Sep 10 20:57:48.530591 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:48.530513    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 20:57:48.530649 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:48.530590    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3b44ac1-2723-46ab-92b2-c92e3512b2d7-metrics-tls podName:a3b44ac1-2723-46ab-92b2-c92e3512b2d7 nodeName:}" failed. No retries permitted until 2026-09-10 20:58:04.530568711 +0000 UTC m=+65.217635968 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a3b44ac1-2723-46ab-92b2-c92e3512b2d7-metrics-tls") pod "dns-default-kr6rh" (UID: "a3b44ac1-2723-46ab-92b2-c92e3512b2d7") : secret "dns-default-metrics-tls" not found
Sep 10 20:57:49.101350 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:49.101318    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-cd9hp_0432bad8-86f5-4b0e-a0d4-2fdb728223f2/console-operator/1.log"
Sep 10 20:57:49.101801 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:49.101717    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-cd9hp_0432bad8-86f5-4b0e-a0d4-2fdb728223f2/console-operator/0.log"
Sep 10 20:57:49.101801 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:49.101752    2564 generic.go:356] "Generic (PLEG): container finished" podID="0432bad8-86f5-4b0e-a0d4-2fdb728223f2" containerID="88734365e2598a91fc2c92ba6df1de5c67da15314530b37429b420a9f37269f3" exitCode=255
Sep 10 20:57:49.101910 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:49.101850    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-cd9hp" event={"ID":"0432bad8-86f5-4b0e-a0d4-2fdb728223f2","Type":"ContainerDied","Data":"88734365e2598a91fc2c92ba6df1de5c67da15314530b37429b420a9f37269f3"}
Sep 10 20:57:49.101961 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:49.101925    2564 scope.go:117] "RemoveContainer" containerID="c8dfece890df35fa04fdb8118cd5c6e281375b85fc541a2ffaeb3425a3620693"
Sep 10 20:57:49.102104 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:49.102067    2564 scope.go:117] "RemoveContainer" containerID="88734365e2598a91fc2c92ba6df1de5c67da15314530b37429b420a9f37269f3"
Sep 10 20:57:49.102434 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:49.102266    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-cd9hp_openshift-console-operator(0432bad8-86f5-4b0e-a0d4-2fdb728223f2)\"" pod="openshift-console-operator/console-operator-696884fb9c-cd9hp" podUID="0432bad8-86f5-4b0e-a0d4-2fdb728223f2"
Sep 10 20:57:49.439564 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:49.439474    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1c5af58-1a57-4208-b8ac-0a37ef4efd70-metrics-certs\") pod \"router-default-6c999c4888-wrq4b\" (UID: \"c1c5af58-1a57-4208-b8ac-0a37ef4efd70\") " pod="openshift-ingress/router-default-6c999c4888-wrq4b"
Sep 10 20:57:49.439824 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:49.439617    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1c5af58-1a57-4208-b8ac-0a37ef4efd70-service-ca-bundle\") pod \"router-default-6c999c4888-wrq4b\" (UID: \"c1c5af58-1a57-4208-b8ac-0a37ef4efd70\") " pod="openshift-ingress/router-default-6c999c4888-wrq4b"
Sep 10 20:57:49.439824 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:49.439625    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 10 20:57:49.439824 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:49.439688    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1c5af58-1a57-4208-b8ac-0a37ef4efd70-metrics-certs podName:c1c5af58-1a57-4208-b8ac-0a37ef4efd70 nodeName:}" failed. No retries permitted until 2026-09-10 20:57:57.439674296 +0000 UTC m=+58.126741553 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c1c5af58-1a57-4208-b8ac-0a37ef4efd70-metrics-certs") pod "router-default-6c999c4888-wrq4b" (UID: "c1c5af58-1a57-4208-b8ac-0a37ef4efd70") : secret "router-metrics-certs-default" not found
Sep 10 20:57:49.439824 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:49.439759    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c1c5af58-1a57-4208-b8ac-0a37ef4efd70-service-ca-bundle podName:c1c5af58-1a57-4208-b8ac-0a37ef4efd70 nodeName:}" failed. No retries permitted until 2026-09-10 20:57:57.43974333 +0000 UTC m=+58.126810603 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c1c5af58-1a57-4208-b8ac-0a37ef4efd70-service-ca-bundle") pod "router-default-6c999c4888-wrq4b" (UID: "c1c5af58-1a57-4208-b8ac-0a37ef4efd70") : configmap references non-existent config key: service-ca.crt
Sep 10 20:57:49.540305 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:49.540273    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3d771666-1913-4566-ba69-a66a3b7b3c8d-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-jfjlv\" (UID: \"3d771666-1913-4566-ba69-a66a3b7b3c8d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-jfjlv"
Sep 10 20:57:49.540461 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:49.540424    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 10 20:57:49.540501 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:49.540488    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d771666-1913-4566-ba69-a66a3b7b3c8d-samples-operator-tls podName:3d771666-1913-4566-ba69-a66a3b7b3c8d nodeName:}" failed. No retries permitted until 2026-09-10 20:57:57.540474804 +0000 UTC m=+58.227542060 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3d771666-1913-4566-ba69-a66a3b7b3c8d-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-jfjlv" (UID: "3d771666-1913-4566-ba69-a66a3b7b3c8d") : secret "samples-operator-tls" not found
Sep 10 20:57:49.766057 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:49.765984    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-sn6kv"]
Sep 10 20:57:49.768578 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:49.768556    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-sn6kv"
Sep 10 20:57:49.774519 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:49.774377    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-b4777\""
Sep 10 20:57:49.774639 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:49.774624    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 10 20:57:49.778286 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:49.778263    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 10 20:57:49.794896 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:49.794875    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-sn6kv"]
Sep 10 20:57:49.843247 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:49.843205    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sn6kv\" (UID: \"7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5\") " pod="openshift-insights/insights-runtime-extractor-sn6kv"
Sep 10 20:57:49.843351 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:49.843248    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sn6kv\" (UID: \"7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5\") " pod="openshift-insights/insights-runtime-extractor-sn6kv"
Sep 10 20:57:49.843395 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:49.843373    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6m95\" (UniqueName: \"kubernetes.io/projected/7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5-kube-api-access-j6m95\") pod \"insights-runtime-extractor-sn6kv\" (UID: \"7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5\") " pod="openshift-insights/insights-runtime-extractor-sn6kv"
Sep 10 20:57:49.843435 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:49.843423    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5-data-volume\") pod \"insights-runtime-extractor-sn6kv\" (UID: \"7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5\") " pod="openshift-insights/insights-runtime-extractor-sn6kv"
Sep 10 20:57:49.843538 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:49.843522    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5-crio-socket\") pod \"insights-runtime-extractor-sn6kv\" (UID: \"7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5\") " pod="openshift-insights/insights-runtime-extractor-sn6kv"
Sep 10 20:57:49.943903 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:49.943871    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5-data-volume\") pod \"insights-runtime-extractor-sn6kv\" (UID: \"7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5\") " pod="openshift-insights/insights-runtime-extractor-sn6kv"
Sep 10 20:57:49.944038 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:49.943974    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5-crio-socket\") pod \"insights-runtime-extractor-sn6kv\" (UID: \"7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5\") " pod="openshift-insights/insights-runtime-extractor-sn6kv"
Sep 10 20:57:49.944038 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:49.944007    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sn6kv\" (UID: \"7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5\") " pod="openshift-insights/insights-runtime-extractor-sn6kv"
Sep 10 20:57:49.944143 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:49.944034    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sn6kv\" (UID: \"7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5\") " pod="openshift-insights/insights-runtime-extractor-sn6kv"
Sep 10 20:57:49.944143 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:49.944089    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 20:57:49.944143 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:49.944096    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5-crio-socket\") pod \"insights-runtime-extractor-sn6kv\" (UID: \"7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5\") " pod="openshift-insights/insights-runtime-extractor-sn6kv"
Sep 10 20:57:49.944143 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:49.944124    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6m95\" (UniqueName: \"kubernetes.io/projected/7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5-kube-api-access-j6m95\") pod \"insights-runtime-extractor-sn6kv\" (UID: \"7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5\") " pod="openshift-insights/insights-runtime-extractor-sn6kv"
Sep 10 20:57:49.944143 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:49.944145    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5-kube-rbac-proxy-cm podName:7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5 nodeName:}" failed. No retries permitted until 2026-09-10 20:57:50.444125869 +0000 UTC m=+51.131193126 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-sn6kv" (UID: "7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5") : configmap "kube-rbac-proxy" not found
Sep 10 20:57:49.944382 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:49.944169    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5-data-volume\") pod \"insights-runtime-extractor-sn6kv\" (UID: \"7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5\") " pod="openshift-insights/insights-runtime-extractor-sn6kv"
Sep 10 20:57:49.944382 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:49.944221    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 20:57:49.944382 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:49.944299    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5-insights-runtime-extractor-tls podName:7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5 nodeName:}" failed. No retries permitted until 2026-09-10 20:57:50.444284024 +0000 UTC m=+51.131351281 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sn6kv" (UID: "7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5") : secret "insights-runtime-extractor-tls" not found
Sep 10 20:57:49.956529 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:49.956505    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6m95\" (UniqueName: \"kubernetes.io/projected/7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5-kube-api-access-j6m95\") pod \"insights-runtime-extractor-sn6kv\" (UID: \"7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5\") " pod="openshift-insights/insights-runtime-extractor-sn6kv"
Sep 10 20:57:50.107330 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:50.107307    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-cd9hp_0432bad8-86f5-4b0e-a0d4-2fdb728223f2/console-operator/1.log"
Sep 10 20:57:50.107757 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:50.107677    2564 scope.go:117] "RemoveContainer" containerID="88734365e2598a91fc2c92ba6df1de5c67da15314530b37429b420a9f37269f3"
Sep 10 20:57:50.107872 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:50.107850    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-cd9hp_openshift-console-operator(0432bad8-86f5-4b0e-a0d4-2fdb728223f2)\"" pod="openshift-console-operator/console-operator-696884fb9c-cd9hp" podUID="0432bad8-86f5-4b0e-a0d4-2fdb728223f2"
Sep 10 20:57:50.448843 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:50.448756    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sn6kv\" (UID: \"7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5\") " pod="openshift-insights/insights-runtime-extractor-sn6kv"
Sep 10 20:57:50.448843 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:50.448796    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sn6kv\" (UID: \"7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5\") " pod="openshift-insights/insights-runtime-extractor-sn6kv"
Sep 10 20:57:50.449053 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:50.448885    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 20:57:50.449053 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:50.448913    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 20:57:50.449053 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:50.448948    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5-kube-rbac-proxy-cm podName:7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5 nodeName:}" failed. No retries permitted until 2026-09-10 20:57:51.448934245 +0000 UTC m=+52.136001502 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-sn6kv" (UID: "7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5") : configmap "kube-rbac-proxy" not found
Sep 10 20:57:50.449053 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:50.449014    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5-insights-runtime-extractor-tls podName:7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5 nodeName:}" failed. No retries permitted until 2026-09-10 20:57:51.4489989 +0000 UTC m=+52.136066160 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sn6kv" (UID: "7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5") : secret "insights-runtime-extractor-tls" not found
Sep 10 20:57:51.457580 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:51.457547    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sn6kv\" (UID: \"7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5\") " pod="openshift-insights/insights-runtime-extractor-sn6kv"
Sep 10 20:57:51.457580 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:51.457583    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sn6kv\" (UID: \"7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5\") " pod="openshift-insights/insights-runtime-extractor-sn6kv"
Sep 10 20:57:51.458012 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:51.457680    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 20:57:51.458012 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:51.457719    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 20:57:51.458012 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:51.457744    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5-kube-rbac-proxy-cm podName:7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5 nodeName:}" failed. No retries permitted until 2026-09-10 20:57:53.457729407 +0000 UTC m=+54.144796670 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-sn6kv" (UID: "7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5") : configmap "kube-rbac-proxy" not found
Sep 10 20:57:51.458012 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:51.457759    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5-insights-runtime-extractor-tls podName:7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5 nodeName:}" failed. No retries permitted until 2026-09-10 20:57:53.45775267 +0000 UTC m=+54.144819928 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sn6kv" (UID: "7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5") : secret "insights-runtime-extractor-tls" not found
Sep 10 20:57:51.766333 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:51.766254    2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-696884fb9c-cd9hp"
Sep 10 20:57:51.766333 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:51.766306    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-cd9hp"
Sep 10 20:57:51.766616 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:51.766603    2564 scope.go:117] "RemoveContainer" containerID="88734365e2598a91fc2c92ba6df1de5c67da15314530b37429b420a9f37269f3"
Sep 10 20:57:51.766755 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:51.766737    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-cd9hp_openshift-console-operator(0432bad8-86f5-4b0e-a0d4-2fdb728223f2)\"" pod="openshift-console-operator/console-operator-696884fb9c-cd9hp" podUID="0432bad8-86f5-4b0e-a0d4-2fdb728223f2"
Sep 10 20:57:52.241194 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:52.241169    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-q7mfg_d9d4569d-ce78-4eaa-b2d1-22c69fb1f3bf/dns-node-resolver/0.log"
Sep 10 20:57:53.449179 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:53.449152    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nwx8r_5b37372b-e18e-4c13-abff-11909b3192fb/node-ca/0.log"
Sep 10 20:57:53.473617 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:53.473591    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sn6kv\" (UID: \"7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5\") " pod="openshift-insights/insights-runtime-extractor-sn6kv"
Sep 10 20:57:53.473724 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:53.473621    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sn6kv\" (UID: \"7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5\") " pod="openshift-insights/insights-runtime-extractor-sn6kv"
Sep 10 20:57:53.473724 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:53.473709    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 20:57:53.473811 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:53.473800    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5-kube-rbac-proxy-cm podName:7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5 nodeName:}" failed. No retries permitted until 2026-09-10 20:57:57.473786173 +0000 UTC m=+58.160853431 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-sn6kv" (UID: "7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5") : configmap "kube-rbac-proxy" not found
Sep 10 20:57:53.473854 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:53.473816    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 20:57:53.473886 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:53.473861    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5-insights-runtime-extractor-tls podName:7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5 nodeName:}" failed. No retries permitted until 2026-09-10 20:57:57.473851236 +0000 UTC m=+58.160918493 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sn6kv" (UID: "7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5") : secret "insights-runtime-extractor-tls" not found
Sep 10 20:57:54.051625 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:54.051594    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mv4zr_9d1aef14-c1f3-402c-8232-a212f2354624/serve-healthcheck-canary/0.log"
Sep 10 20:57:55.058574 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:55.058546    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-vhb8c_5e15b3b7-d93d-42fa-85a5-2a2f529e5649/kube-storage-version-migrator-operator/0.log"
Sep 10 20:57:57.503001 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:57.502969    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1c5af58-1a57-4208-b8ac-0a37ef4efd70-metrics-certs\") pod \"router-default-6c999c4888-wrq4b\" (UID: \"c1c5af58-1a57-4208-b8ac-0a37ef4efd70\") " pod="openshift-ingress/router-default-6c999c4888-wrq4b"
Sep 10 20:57:57.503380 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:57.503039    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1c5af58-1a57-4208-b8ac-0a37ef4efd70-service-ca-bundle\") pod \"router-default-6c999c4888-wrq4b\" (UID: \"c1c5af58-1a57-4208-b8ac-0a37ef4efd70\") " pod="openshift-ingress/router-default-6c999c4888-wrq4b"
Sep 10 20:57:57.503380 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:57.503067    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sn6kv\" (UID: \"7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5\") " pod="openshift-insights/insights-runtime-extractor-sn6kv"
Sep 10 20:57:57.503380 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:57.503085    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sn6kv\" (UID: \"7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5\") " pod="openshift-insights/insights-runtime-extractor-sn6kv"
Sep 10 20:57:57.503380 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:57.503142    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 20:57:57.503380 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:57.503170    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 20:57:57.503380 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:57.503186    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5-kube-rbac-proxy-cm podName:7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5 nodeName:}" failed. No retries permitted until 2026-09-10 20:58:05.50317308 +0000 UTC m=+66.190240336 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-sn6kv" (UID: "7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5") : configmap "kube-rbac-proxy" not found
Sep 10 20:57:57.503380 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:57.503217    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5-insights-runtime-extractor-tls podName:7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5 nodeName:}" failed. No retries permitted until 2026-09-10 20:58:05.503205147 +0000 UTC m=+66.190272404 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sn6kv" (UID: "7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5") : secret "insights-runtime-extractor-tls" not found
Sep 10 20:57:57.503380 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:57:57.503292    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c1c5af58-1a57-4208-b8ac-0a37ef4efd70-service-ca-bundle podName:c1c5af58-1a57-4208-b8ac-0a37ef4efd70 nodeName:}" failed. No retries permitted until 2026-09-10 20:58:13.503281511 +0000 UTC m=+74.190348769 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c1c5af58-1a57-4208-b8ac-0a37ef4efd70-service-ca-bundle") pod "router-default-6c999c4888-wrq4b" (UID: "c1c5af58-1a57-4208-b8ac-0a37ef4efd70") : configmap references non-existent config key: service-ca.crt
Sep 10 20:57:57.505485 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:57.505463    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1c5af58-1a57-4208-b8ac-0a37ef4efd70-metrics-certs\") pod \"router-default-6c999c4888-wrq4b\" (UID: \"c1c5af58-1a57-4208-b8ac-0a37ef4efd70\") " pod="openshift-ingress/router-default-6c999c4888-wrq4b"
Sep 10 20:57:57.604290 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:57.604261    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3d771666-1913-4566-ba69-a66a3b7b3c8d-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-jfjlv\" (UID: \"3d771666-1913-4566-ba69-a66a3b7b3c8d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-jfjlv"
Sep 10 20:57:57.606450 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:57.606434    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3d771666-1913-4566-ba69-a66a3b7b3c8d-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-jfjlv\" (UID: \"3d771666-1913-4566-ba69-a66a3b7b3c8d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-jfjlv"
Sep 10 20:57:57.646462 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:57.646442    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-jfjlv"
Sep 10 20:57:57.938108 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:57.938087    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-jfjlv"]
Sep 10 20:57:58.133791 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:58.133760    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-jfjlv" event={"ID":"3d771666-1913-4566-ba69-a66a3b7b3c8d","Type":"ContainerStarted","Data":"f0522ce8c19308ba43fc6b92cce5a1243d001d60ee83781cd842fd11ae6434ff"}
Sep 10 20:57:59.032921 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:57:59.032887    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wrbhk"
Sep 10 20:58:00.145302 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:00.145197    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-jfjlv" event={"ID":"3d771666-1913-4566-ba69-a66a3b7b3c8d","Type":"ContainerStarted","Data":"8aa236a6112837b2779111163aada6b1f183ebfa4674d548c2febbfa1f4f6b36"}
Sep 10 20:58:00.145302 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:00.145279    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-jfjlv" event={"ID":"3d771666-1913-4566-ba69-a66a3b7b3c8d","Type":"ContainerStarted","Data":"6d583330e38488380e7a01e236c14de85fef7442cab957a07a993a00fa1671c7"}
Sep 10 20:58:00.177437 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:00.177391    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-jfjlv" podStartSLOduration=17.353627979 podStartE2EDuration="19.177377376s" totalImagesPullingTime="1.823749397s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:57:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:58:00.176537829 +0000 UTC m=+60.863605107" watchObservedRunningTime="2026-09-10 20:58:00.177377376 +0000 UTC m=+60.864444646"
Sep 10 20:58:03.866857 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:03.866823    2564 scope.go:117] "RemoveContainer" containerID="88734365e2598a91fc2c92ba6df1de5c67da15314530b37429b420a9f37269f3"
Sep 10 20:58:04.162638 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:04.162567    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-cd9hp_0432bad8-86f5-4b0e-a0d4-2fdb728223f2/console-operator/2.log"
Sep 10 20:58:04.162991 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:04.162976    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-cd9hp_0432bad8-86f5-4b0e-a0d4-2fdb728223f2/console-operator/1.log"
Sep 10 20:58:04.163046 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:04.163011    2564 generic.go:356] "Generic (PLEG): container finished" podID="0432bad8-86f5-4b0e-a0d4-2fdb728223f2" containerID="9c6509e44e082bd0ea518c4a5f41aa24bf03fd82a4b23ebf0e816f76e188592e" exitCode=255
Sep 10 20:58:04.163085 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:04.163042    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-cd9hp" event={"ID":"0432bad8-86f5-4b0e-a0d4-2fdb728223f2","Type":"ContainerDied","Data":"9c6509e44e082bd0ea518c4a5f41aa24bf03fd82a4b23ebf0e816f76e188592e"}
Sep 10 20:58:04.163119 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:04.163084    2564 scope.go:117] "RemoveContainer" containerID="88734365e2598a91fc2c92ba6df1de5c67da15314530b37429b420a9f37269f3"
Sep 10 20:58:04.163410 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:04.163388    2564 scope.go:117] "RemoveContainer" containerID="9c6509e44e082bd0ea518c4a5f41aa24bf03fd82a4b23ebf0e816f76e188592e"
Sep 10 20:58:04.163563 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:58:04.163546    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-696884fb9c-cd9hp_openshift-console-operator(0432bad8-86f5-4b0e-a0d4-2fdb728223f2)\"" pod="openshift-console-operator/console-operator-696884fb9c-cd9hp" podUID="0432bad8-86f5-4b0e-a0d4-2fdb728223f2"
Sep 10 20:58:04.562723 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:04.562685    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a3b44ac1-2723-46ab-92b2-c92e3512b2d7-metrics-tls\") pod \"dns-default-kr6rh\" (UID: \"a3b44ac1-2723-46ab-92b2-c92e3512b2d7\") " pod="openshift-dns/dns-default-kr6rh"
Sep 10 20:58:04.565009 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:04.564979    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a3b44ac1-2723-46ab-92b2-c92e3512b2d7-metrics-tls\") pod \"dns-default-kr6rh\" (UID: \"a3b44ac1-2723-46ab-92b2-c92e3512b2d7\") " pod="openshift-dns/dns-default-kr6rh"
Sep 10 20:58:04.783262 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:04.783212    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jw26g\""
Sep 10 20:58:04.786673 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:04.786656    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kr6rh"
Sep 10 20:58:05.068066 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:05.068036    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kr6rh"]
Sep 10 20:58:05.071210 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:58:05.071182    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3b44ac1_2723_46ab_92b2_c92e3512b2d7.slice/crio-77ac93c817b3b7667703ba8c369cfb8aaa64b8822be0a6e1ee0cc5279478a456 WatchSource:0}: Error finding container 77ac93c817b3b7667703ba8c369cfb8aaa64b8822be0a6e1ee0cc5279478a456: Status 404 returned error can't find the container with id 77ac93c817b3b7667703ba8c369cfb8aaa64b8822be0a6e1ee0cc5279478a456
Sep 10 20:58:05.167631 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:05.167571    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-cd9hp_0432bad8-86f5-4b0e-a0d4-2fdb728223f2/console-operator/2.log"
Sep 10 20:58:05.168739 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:05.168711    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kr6rh" event={"ID":"a3b44ac1-2723-46ab-92b2-c92e3512b2d7","Type":"ContainerStarted","Data":"77ac93c817b3b7667703ba8c369cfb8aaa64b8822be0a6e1ee0cc5279478a456"}
Sep 10 20:58:05.469199 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:05.469123    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27227947-500c-4146-a89f-798ea3bce890-metrics-certs\") pod \"network-metrics-daemon-zbw7p\" (UID: \"27227947-500c-4146-a89f-798ea3bce890\") " pod="openshift-multus/network-metrics-daemon-zbw7p"
Sep 10 20:58:05.472517 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:05.472499    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 10 20:58:05.481628 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:05.481605    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27227947-500c-4146-a89f-798ea3bce890-metrics-certs\") pod \"network-metrics-daemon-zbw7p\" (UID: \"27227947-500c-4146-a89f-798ea3bce890\") " pod="openshift-multus/network-metrics-daemon-zbw7p"
Sep 10 20:58:05.569643 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:05.569596    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sn6kv\" (UID: \"7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5\") " pod="openshift-insights/insights-runtime-extractor-sn6kv"
Sep 10 20:58:05.569785 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:05.569648    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sn6kv\" (UID: \"7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5\") " pod="openshift-insights/insights-runtime-extractor-sn6kv"
Sep 10 20:58:05.569785 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:05.569726    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/170f8023-6b23-45c5-b7bf-6da8b42be3cd-original-pull-secret\") pod \"global-pull-secret-syncer-gzgtl\" (UID: \"170f8023-6b23-45c5-b7bf-6da8b42be3cd\") " pod="kube-system/global-pull-secret-syncer-gzgtl"
Sep 10 20:58:05.570199 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:05.570168    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sn6kv\" (UID: \"7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5\") " pod="openshift-insights/insights-runtime-extractor-sn6kv"
Sep 10 20:58:05.572122 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:05.572098    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sn6kv\" (UID: \"7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5\") " pod="openshift-insights/insights-runtime-extractor-sn6kv"
Sep 10 20:58:05.572768 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:05.572748    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 10 20:58:05.582963 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:05.582940    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/170f8023-6b23-45c5-b7bf-6da8b42be3cd-original-pull-secret\") pod \"global-pull-secret-syncer-gzgtl\" (UID: \"170f8023-6b23-45c5-b7bf-6da8b42be3cd\") " pod="kube-system/global-pull-secret-syncer-gzgtl"
Sep 10 20:58:05.670763 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:05.670729    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2678k\" (UniqueName: \"kubernetes.io/projected/8d6511c6-643b-4d56-9d77-4fd8d74b65fc-kube-api-access-2678k\") pod \"network-check-target-srfp2\" (UID: \"8d6511c6-643b-4d56-9d77-4fd8d74b65fc\") " pod="openshift-network-diagnostics/network-check-target-srfp2"
Sep 10 20:58:05.673564 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:05.673494    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2678k\" (UniqueName: \"kubernetes.io/projected/8d6511c6-643b-4d56-9d77-4fd8d74b65fc-kube-api-access-2678k\") pod \"network-check-target-srfp2\" (UID: \"8d6511c6-643b-4d56-9d77-4fd8d74b65fc\") " pod="openshift-network-diagnostics/network-check-target-srfp2"
Sep 10 20:58:05.682363 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:05.682342    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-b4777\""
Sep 10 20:58:05.683369 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:05.683347    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zr4bv\""
Sep 10 20:58:05.687250 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:05.687215    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gzgtl"
Sep 10 20:58:05.690008 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:05.689987    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-sn6kv"
Sep 10 20:58:05.691280 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:05.691246    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zbw7p"
Sep 10 20:58:05.696877 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:05.696861    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gncgs\""
Sep 10 20:58:05.704185 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:05.704161    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srfp2"
Sep 10 20:58:06.055851 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:06.055823    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zbw7p"]
Sep 10 20:58:06.058385 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:58:06.058354    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27227947_500c_4146_a89f_798ea3bce890.slice/crio-780ea8b641a8d67d3cb29fc99367f0919e2b6311e34431532f1f0709a14582e7 WatchSource:0}: Error finding container 780ea8b641a8d67d3cb29fc99367f0919e2b6311e34431532f1f0709a14582e7: Status 404 returned error can't find the container with id 780ea8b641a8d67d3cb29fc99367f0919e2b6311e34431532f1f0709a14582e7
Sep 10 20:58:06.059290 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:06.058700    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gzgtl"]
Sep 10 20:58:06.060708 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:06.060424    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-sn6kv"]
Sep 10 20:58:06.061816 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:06.061024    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-srfp2"]
Sep 10 20:58:06.062146 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:58:06.062075    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d6511c6_643b_4d56_9d77_4fd8d74b65fc.slice/crio-0d0994e82cf948f980ab3c326596c3cdc4a99239e2880f566954b23a9687a97e WatchSource:0}: Error finding container 0d0994e82cf948f980ab3c326596c3cdc4a99239e2880f566954b23a9687a97e: Status 404 returned error can't find the container with id 0d0994e82cf948f980ab3c326596c3cdc4a99239e2880f566954b23a9687a97e
Sep 10 20:58:06.062782 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:58:06.062755    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b37b5e7_c60d_48a5_bcb5_e6b92d804dd5.slice/crio-7cfeae72a4431ee169f288b88e5d35e710ea15b72751f0bccb41713ce00b92ea WatchSource:0}: Error finding container 7cfeae72a4431ee169f288b88e5d35e710ea15b72751f0bccb41713ce00b92ea: Status 404 returned error can't find the container with id 7cfeae72a4431ee169f288b88e5d35e710ea15b72751f0bccb41713ce00b92ea
Sep 10 20:58:06.178747 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:06.178719    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-srfp2" event={"ID":"8d6511c6-643b-4d56-9d77-4fd8d74b65fc","Type":"ContainerStarted","Data":"a61f40a2081e62d5fae3330129fa56223b1f467c198f4d341e0e27b6de6276c9"}
Sep 10 20:58:06.179361 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:06.179342    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-srfp2" event={"ID":"8d6511c6-643b-4d56-9d77-4fd8d74b65fc","Type":"ContainerStarted","Data":"0d0994e82cf948f980ab3c326596c3cdc4a99239e2880f566954b23a9687a97e"}
Sep 10 20:58:06.179491 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:06.179481    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-srfp2"
Sep 10 20:58:06.180844 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:06.180804    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gzgtl" event={"ID":"170f8023-6b23-45c5-b7bf-6da8b42be3cd","Type":"ContainerStarted","Data":"0680fda9cb9e8c4d6cc41128199d45ecb0e14a262f65ddfdb0175118ebe73b7a"}
Sep 10 20:58:06.182415 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:06.182391    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zbw7p" event={"ID":"27227947-500c-4146-a89f-798ea3bce890","Type":"ContainerStarted","Data":"780ea8b641a8d67d3cb29fc99367f0919e2b6311e34431532f1f0709a14582e7"}
Sep 10 20:58:06.184152 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:06.184108    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sn6kv" event={"ID":"7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5","Type":"ContainerStarted","Data":"356863fa336449b7459fc5267b836aeaf94295640d9c86a6038390b913a221b0"}
Sep 10 20:58:06.184286 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:06.184156    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sn6kv" event={"ID":"7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5","Type":"ContainerStarted","Data":"7cfeae72a4431ee169f288b88e5d35e710ea15b72751f0bccb41713ce00b92ea"}
Sep 10 20:58:06.215078 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:06.215028    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-srfp2" podStartSLOduration=66.215012459 podStartE2EDuration="1m6.215012459s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:57:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:58:06.214562963 +0000 UTC m=+66.901630234" watchObservedRunningTime="2026-09-10 20:58:06.215012459 +0000 UTC m=+66.902079738"
Sep 10 20:58:07.190433 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:07.190263    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kr6rh" event={"ID":"a3b44ac1-2723-46ab-92b2-c92e3512b2d7","Type":"ContainerStarted","Data":"a9881a393ca0e7cd2e741ff8b10fcb0063501e2a31b79d2bdabd35b1705f61b2"}
Sep 10 20:58:07.190433 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:07.190372    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-kr6rh"
Sep 10 20:58:07.190433 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:07.190401    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kr6rh" event={"ID":"a3b44ac1-2723-46ab-92b2-c92e3512b2d7","Type":"ContainerStarted","Data":"bb31d6ac4d3b494e032bc29d206285e65fb27efce9fdb72b025e583c5c47c48f"}
Sep 10 20:58:07.193188 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:07.193158    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sn6kv" event={"ID":"7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5","Type":"ContainerStarted","Data":"91ee7e9ae44deecdd5e27034fd6758dd563335011e58bee27f3547dd36f1b317"}
Sep 10 20:58:07.218854 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:07.218794    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-kr6rh" podStartSLOduration=33.570515408 podStartE2EDuration="35.218773505s" totalImagesPullingTime="1.648258097s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:57:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:58:07.21652796 +0000 UTC m=+67.903595243" watchObservedRunningTime="2026-09-10 20:58:07.218773505 +0000 UTC m=+67.905840785"
Sep 10 20:58:08.200222 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:08.199979    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zbw7p" event={"ID":"27227947-500c-4146-a89f-798ea3bce890","Type":"ContainerStarted","Data":"d24e45bad6dcfa2d5d03925189a9ae19bf85181a41ac7688a6c51ca09dc062fe"}
Sep 10 20:58:08.200222 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:08.200047    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zbw7p" event={"ID":"27227947-500c-4146-a89f-798ea3bce890","Type":"ContainerStarted","Data":"3db6e77696c5b8fbe2dbcb92f0ff312b322bf877dbf093ea9c0b179f3b64c3d6"}
Sep 10 20:58:08.294592 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:08.294539    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-zbw7p" podStartSLOduration=66.976091712 podStartE2EDuration="1m8.294512125s" totalImagesPullingTime="1.318420413s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:57:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:58:08.293271353 +0000 UTC m=+68.980338635" watchObservedRunningTime="2026-09-10 20:58:08.294512125 +0000 UTC m=+68.981579405"
Sep 10 20:58:09.205707 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:09.205669    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sn6kv" event={"ID":"7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5","Type":"ContainerStarted","Data":"873b7ddf17d02e3ffa193af05ab301f3bddccfee5d9f8a975c99338633b87b96"}
Sep 10 20:58:09.236983 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:09.236926    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-sn6kv" podStartSLOduration=17.963448156 podStartE2EDuration="20.236905792s" totalImagesPullingTime="2.273457636s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 20:57:49 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:58:09.235506271 +0000 UTC m=+69.922573553" watchObservedRunningTime="2026-09-10 20:58:09.236905792 +0000 UTC m=+69.923973071"
Sep 10 20:58:11.213512 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:11.213477    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gzgtl" event={"ID":"170f8023-6b23-45c5-b7bf-6da8b42be3cd","Type":"ContainerStarted","Data":"d7528f629422ad0af502ba22951f5b4e761d9804def0b3d9b113baee7600782d"}
Sep 10 20:58:11.766779 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:11.766746    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-cd9hp"
Sep 10 20:58:11.766940 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:11.766797    2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-696884fb9c-cd9hp"
Sep 10 20:58:11.767082 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:11.767069    2564 scope.go:117] "RemoveContainer" containerID="9c6509e44e082bd0ea518c4a5f41aa24bf03fd82a4b23ebf0e816f76e188592e"
Sep 10 20:58:11.767242 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:58:11.767206    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-696884fb9c-cd9hp_openshift-console-operator(0432bad8-86f5-4b0e-a0d4-2fdb728223f2)\"" pod="openshift-console-operator/console-operator-696884fb9c-cd9hp" podUID="0432bad8-86f5-4b0e-a0d4-2fdb728223f2"
Sep 10 20:58:11.795424 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:11.795380    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-gzgtl" podStartSLOduration=67.661745088 podStartE2EDuration="1m11.795364025s" totalImagesPullingTime="4.133618937s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 20:57:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:58:11.237557527 +0000 UTC m=+71.924624805" watchObservedRunningTime="2026-09-10 20:58:11.795364025 +0000 UTC m=+72.482431304"
Sep 10 20:58:13.527573 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:13.527535    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1c5af58-1a57-4208-b8ac-0a37ef4efd70-service-ca-bundle\") pod \"router-default-6c999c4888-wrq4b\" (UID: \"c1c5af58-1a57-4208-b8ac-0a37ef4efd70\") " pod="openshift-ingress/router-default-6c999c4888-wrq4b"
Sep 10 20:58:13.528121 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:13.528102    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c1c5af58-1a57-4208-b8ac-0a37ef4efd70-service-ca-bundle\") pod \"router-default-6c999c4888-wrq4b\" (UID: \"c1c5af58-1a57-4208-b8ac-0a37ef4efd70\") " pod="openshift-ingress/router-default-6c999c4888-wrq4b"
Sep 10 20:58:13.722031 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:13.722002    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-b4znc\""
Sep 10 20:58:13.729366 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:13.729344    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6c999c4888-wrq4b"
Sep 10 20:58:14.010317 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:14.010284    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6c999c4888-wrq4b"]
Sep 10 20:58:14.013486 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:58:14.013459    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1c5af58_1a57_4208_b8ac_0a37ef4efd70.slice/crio-21815b8f0916f4f63b005f1acabf82b21a7674c3a8dfdf374a6d92097bc4d793 WatchSource:0}: Error finding container 21815b8f0916f4f63b005f1acabf82b21a7674c3a8dfdf374a6d92097bc4d793: Status 404 returned error can't find the container with id 21815b8f0916f4f63b005f1acabf82b21a7674c3a8dfdf374a6d92097bc4d793
Sep 10 20:58:14.224911 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:14.224869    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6c999c4888-wrq4b" event={"ID":"c1c5af58-1a57-4208-b8ac-0a37ef4efd70","Type":"ContainerStarted","Data":"2cf1e497b1640b924a0bbae42b72d71f00f08a653ee0554d91098b09e3ce1e53"}
Sep 10 20:58:14.225101 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:14.224928    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6c999c4888-wrq4b" event={"ID":"c1c5af58-1a57-4208-b8ac-0a37ef4efd70","Type":"ContainerStarted","Data":"21815b8f0916f4f63b005f1acabf82b21a7674c3a8dfdf374a6d92097bc4d793"}
Sep 10 20:58:14.261411 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:14.261363    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6c999c4888-wrq4b" podStartSLOduration=33.261346799 podStartE2EDuration="33.261346799s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:57:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:58:14.260508334 +0000 UTC m=+74.947575612" watchObservedRunningTime="2026-09-10 20:58:14.261346799 +0000 UTC m=+74.948414077"
Sep 10 20:58:14.729962 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:14.729929    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6c999c4888-wrq4b"
Sep 10 20:58:14.732548 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:14.732524    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6c999c4888-wrq4b"
Sep 10 20:58:14.877431 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:14.877399    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-869465c844-vj5gc"]
Sep 10 20:58:14.883184 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:14.883163    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-869465c844-vj5gc"
Sep 10 20:58:14.893372 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:14.893348    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 10 20:58:14.894318 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:14.894300    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 10 20:58:14.894424 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:14.894406    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 10 20:58:14.894610 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:14.894594    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 10 20:58:14.895072 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:14.895058    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 10 20:58:14.907833 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:14.907814    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 10 20:58:14.914541 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:14.914511    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 10 20:58:14.920940 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:14.918660    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-869465c844-vj5gc"]
Sep 10 20:58:14.936773 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:14.936742    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/a57957a0-bfd7-4e07-936c-7eab2ad22be1-hub\") pod \"cluster-proxy-proxy-agent-869465c844-vj5gc\" (UID: \"a57957a0-bfd7-4e07-936c-7eab2ad22be1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-869465c844-vj5gc"
Sep 10 20:58:14.936871 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:14.936788    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/a57957a0-bfd7-4e07-936c-7eab2ad22be1-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-869465c844-vj5gc\" (UID: \"a57957a0-bfd7-4e07-936c-7eab2ad22be1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-869465c844-vj5gc"
Sep 10 20:58:14.936871 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:14.936825    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a57957a0-bfd7-4e07-936c-7eab2ad22be1-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-869465c844-vj5gc\" (UID: \"a57957a0-bfd7-4e07-936c-7eab2ad22be1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-869465c844-vj5gc"
Sep 10 20:58:14.936961 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:14.936872    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqztl\" (UniqueName: \"kubernetes.io/projected/a57957a0-bfd7-4e07-936c-7eab2ad22be1-kube-api-access-lqztl\") pod \"cluster-proxy-proxy-agent-869465c844-vj5gc\" (UID: \"a57957a0-bfd7-4e07-936c-7eab2ad22be1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-869465c844-vj5gc"
Sep 10 20:58:14.936961 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:14.936932    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/a57957a0-bfd7-4e07-936c-7eab2ad22be1-ca\") pod \"cluster-proxy-proxy-agent-869465c844-vj5gc\" (UID: \"a57957a0-bfd7-4e07-936c-7eab2ad22be1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-869465c844-vj5gc"
Sep 10 20:58:14.937036 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:14.936965    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/a57957a0-bfd7-4e07-936c-7eab2ad22be1-additional-service-ca\") pod \"cluster-proxy-proxy-agent-869465c844-vj5gc\" (UID: \"a57957a0-bfd7-4e07-936c-7eab2ad22be1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-869465c844-vj5gc"
Sep 10 20:58:15.038016 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:15.037959    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/a57957a0-bfd7-4e07-936c-7eab2ad22be1-ca\") pod \"cluster-proxy-proxy-agent-869465c844-vj5gc\" (UID: \"a57957a0-bfd7-4e07-936c-7eab2ad22be1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-869465c844-vj5gc"
Sep 10 20:58:15.038016 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:15.037993    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/a57957a0-bfd7-4e07-936c-7eab2ad22be1-additional-service-ca\") pod \"cluster-proxy-proxy-agent-869465c844-vj5gc\" (UID: \"a57957a0-bfd7-4e07-936c-7eab2ad22be1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-869465c844-vj5gc"
Sep 10 20:58:15.038016 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:15.038011    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/a57957a0-bfd7-4e07-936c-7eab2ad22be1-hub\") pod \"cluster-proxy-proxy-agent-869465c844-vj5gc\" (UID: \"a57957a0-bfd7-4e07-936c-7eab2ad22be1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-869465c844-vj5gc"
Sep 10 20:58:15.038220 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:15.038033    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/a57957a0-bfd7-4e07-936c-7eab2ad22be1-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-869465c844-vj5gc\" (UID: \"a57957a0-bfd7-4e07-936c-7eab2ad22be1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-869465c844-vj5gc"
Sep 10 20:58:15.038220 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:15.038055    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a57957a0-bfd7-4e07-936c-7eab2ad22be1-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-869465c844-vj5gc\" (UID: \"a57957a0-bfd7-4e07-936c-7eab2ad22be1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-869465c844-vj5gc"
Sep 10 20:58:15.038220 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:15.038091    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqztl\" (UniqueName: \"kubernetes.io/projected/a57957a0-bfd7-4e07-936c-7eab2ad22be1-kube-api-access-lqztl\") pod \"cluster-proxy-proxy-agent-869465c844-vj5gc\" (UID: \"a57957a0-bfd7-4e07-936c-7eab2ad22be1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-869465c844-vj5gc"
Sep 10 20:58:15.038793 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:15.038754    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/a57957a0-bfd7-4e07-936c-7eab2ad22be1-additional-service-ca\") pod \"cluster-proxy-proxy-agent-869465c844-vj5gc\" (UID: \"a57957a0-bfd7-4e07-936c-7eab2ad22be1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-869465c844-vj5gc"
Sep 10 20:58:15.040208 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:15.040182    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/a57957a0-bfd7-4e07-936c-7eab2ad22be1-ca\") pod \"cluster-proxy-proxy-agent-869465c844-vj5gc\" (UID: \"a57957a0-bfd7-4e07-936c-7eab2ad22be1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-869465c844-vj5gc"
Sep 10 20:58:15.040468 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:15.040446    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/a57957a0-bfd7-4e07-936c-7eab2ad22be1-hub\") pod \"cluster-proxy-proxy-agent-869465c844-vj5gc\" (UID: \"a57957a0-bfd7-4e07-936c-7eab2ad22be1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-869465c844-vj5gc"
Sep 10 20:58:15.040551 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:15.040526    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/a57957a0-bfd7-4e07-936c-7eab2ad22be1-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-869465c844-vj5gc\" (UID: \"a57957a0-bfd7-4e07-936c-7eab2ad22be1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-869465c844-vj5gc"
Sep 10 20:58:15.040772 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:15.040750    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a57957a0-bfd7-4e07-936c-7eab2ad22be1-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-869465c844-vj5gc\" (UID: \"a57957a0-bfd7-4e07-936c-7eab2ad22be1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-869465c844-vj5gc"
Sep 10 20:58:15.070375 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:15.070352    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqztl\" (UniqueName: \"kubernetes.io/projected/a57957a0-bfd7-4e07-936c-7eab2ad22be1-kube-api-access-lqztl\") pod \"cluster-proxy-proxy-agent-869465c844-vj5gc\" (UID: \"a57957a0-bfd7-4e07-936c-7eab2ad22be1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-869465c844-vj5gc"
Sep 10 20:58:15.206430 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:15.206402    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-869465c844-vj5gc"
Sep 10 20:58:15.228534 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:15.228509    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6c999c4888-wrq4b"
Sep 10 20:58:15.229961 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:15.229943    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6c999c4888-wrq4b"
Sep 10 20:58:15.524428 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:58:15.524401    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda57957a0_bfd7_4e07_936c_7eab2ad22be1.slice/crio-a4a661e8110ab99b4b0d1695e231fdf7d7b51a3a2042eeb1289ebdfec43e3047 WatchSource:0}: Error finding container a4a661e8110ab99b4b0d1695e231fdf7d7b51a3a2042eeb1289ebdfec43e3047: Status 404 returned error can't find the container with id a4a661e8110ab99b4b0d1695e231fdf7d7b51a3a2042eeb1289ebdfec43e3047
Sep 10 20:58:15.527077 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:15.527044    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-869465c844-vj5gc"]
Sep 10 20:58:16.235625 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:16.235587    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-869465c844-vj5gc" event={"ID":"a57957a0-bfd7-4e07-936c-7eab2ad22be1","Type":"ContainerStarted","Data":"a4a661e8110ab99b4b0d1695e231fdf7d7b51a3a2042eeb1289ebdfec43e3047"}
Sep 10 20:58:17.202498 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:17.202468    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-kr6rh"
Sep 10 20:58:20.253750 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:20.253706    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-869465c844-vj5gc" event={"ID":"a57957a0-bfd7-4e07-936c-7eab2ad22be1","Type":"ContainerStarted","Data":"ffc91d3c6ac4adf603de3b85105a2525a7737994c96ac40db8ea8e6d168cb218"}
Sep 10 20:58:20.253750 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:20.253758    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-869465c844-vj5gc" event={"ID":"a57957a0-bfd7-4e07-936c-7eab2ad22be1","Type":"ContainerStarted","Data":"2d9a7dcd40bf35e61ecf56824ddfcf3c86b7c6944cddb06b351b6547d30fac34"}
Sep 10 20:58:20.254311 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:20.253773    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-869465c844-vj5gc" event={"ID":"a57957a0-bfd7-4e07-936c-7eab2ad22be1","Type":"ContainerStarted","Data":"0f50be64df00a6d69b576a96506148487fe5039322df43b8c2e2e98dc678ff2f"}
Sep 10 20:58:20.293138 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:20.293088    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-869465c844-vj5gc" podStartSLOduration=2.328078689 podStartE2EDuration="6.29307351s" totalImagesPullingTime="3.964994821s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:58:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:58:20.291372783 +0000 UTC m=+80.978440063" watchObservedRunningTime="2026-09-10 20:58:20.29307351 +0000 UTC m=+80.980140789"
Sep 10 20:58:23.866967 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:23.866858    2564 scope.go:117] "RemoveContainer" containerID="9c6509e44e082bd0ea518c4a5f41aa24bf03fd82a4b23ebf0e816f76e188592e"
Sep 10 20:58:23.867446 ip-10-0-129-100 kubenswrapper[2564]: E0910 20:58:23.867061    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-696884fb9c-cd9hp_openshift-console-operator(0432bad8-86f5-4b0e-a0d4-2fdb728223f2)\"" pod="openshift-console-operator/console-operator-696884fb9c-cd9hp" podUID="0432bad8-86f5-4b0e-a0d4-2fdb728223f2"
Sep 10 20:58:27.985327 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:27.985290    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5nr82"]
Sep 10 20:58:27.987617 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:27.987596    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5nr82"
Sep 10 20:58:27.998677 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:27.998656    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 10 20:58:28.000004 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:27.999986    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 10 20:58:28.005443 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:28.005424    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 10 20:58:28.005825 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:28.005810    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 10 20:58:28.006122 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:28.006105    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 10 20:58:28.006192 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:28.006107    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 10 20:58:28.006289 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:28.006214    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-tgnsq\""
Sep 10 20:58:28.134943 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:28.134912    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/06642a12-af0d-4d45-889b-42e99b721de9-sys\") pod \"node-exporter-5nr82\" (UID: \"06642a12-af0d-4d45-889b-42e99b721de9\") " pod="openshift-monitoring/node-exporter-5nr82"
Sep 10 20:58:28.135107 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:28.134952    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/06642a12-af0d-4d45-889b-42e99b721de9-node-exporter-textfile\") pod \"node-exporter-5nr82\" (UID: \"06642a12-af0d-4d45-889b-42e99b721de9\") " pod="openshift-monitoring/node-exporter-5nr82"
Sep 10 20:58:28.135107 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:28.134973    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/06642a12-af0d-4d45-889b-42e99b721de9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5nr82\" (UID: \"06642a12-af0d-4d45-889b-42e99b721de9\") " pod="openshift-monitoring/node-exporter-5nr82"
Sep 10 20:58:28.135107 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:28.134999    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5zc4\" (UniqueName: \"kubernetes.io/projected/06642a12-af0d-4d45-889b-42e99b721de9-kube-api-access-d5zc4\") pod \"node-exporter-5nr82\" (UID: \"06642a12-af0d-4d45-889b-42e99b721de9\") " pod="openshift-monitoring/node-exporter-5nr82"
Sep 10 20:58:28.135107 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:28.135082    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/06642a12-af0d-4d45-889b-42e99b721de9-metrics-client-ca\") pod \"node-exporter-5nr82\" (UID: \"06642a12-af0d-4d45-889b-42e99b721de9\") " pod="openshift-monitoring/node-exporter-5nr82"
Sep 10 20:58:28.135282 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:28.135109    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/06642a12-af0d-4d45-889b-42e99b721de9-node-exporter-accelerators-collector-config\") pod \"node-exporter-5nr82\" (UID: \"06642a12-af0d-4d45-889b-42e99b721de9\") " pod="openshift-monitoring/node-exporter-5nr82"
Sep 10 20:58:28.135282 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:28.135136    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/06642a12-af0d-4d45-889b-42e99b721de9-root\") pod \"node-exporter-5nr82\" (UID: \"06642a12-af0d-4d45-889b-42e99b721de9\") " pod="openshift-monitoring/node-exporter-5nr82"
Sep 10 20:58:28.135282 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:28.135151    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/06642a12-af0d-4d45-889b-42e99b721de9-node-exporter-tls\") pod \"node-exporter-5nr82\" (UID: \"06642a12-af0d-4d45-889b-42e99b721de9\") " pod="openshift-monitoring/node-exporter-5nr82"
Sep 10 20:58:28.135282 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:28.135186    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/06642a12-af0d-4d45-889b-42e99b721de9-node-exporter-wtmp\") pod \"node-exporter-5nr82\" (UID: \"06642a12-af0d-4d45-889b-42e99b721de9\") " pod="openshift-monitoring/node-exporter-5nr82"
Sep 10 20:58:28.236199 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:28.236121    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/06642a12-af0d-4d45-889b-42e99b721de9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5nr82\" (UID: \"06642a12-af0d-4d45-889b-42e99b721de9\") " pod="openshift-monitoring/node-exporter-5nr82"
Sep 10 20:58:28.236199 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:28.236157    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5zc4\" (UniqueName: \"kubernetes.io/projected/06642a12-af0d-4d45-889b-42e99b721de9-kube-api-access-d5zc4\") pod \"node-exporter-5nr82\" (UID: \"06642a12-af0d-4d45-889b-42e99b721de9\") " pod="openshift-monitoring/node-exporter-5nr82"
Sep 10 20:58:28.236199 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:28.236181    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/06642a12-af0d-4d45-889b-42e99b721de9-metrics-client-ca\") pod \"node-exporter-5nr82\" (UID: \"06642a12-af0d-4d45-889b-42e99b721de9\") " pod="openshift-monitoring/node-exporter-5nr82"
Sep 10 20:58:28.236476 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:28.236206    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/06642a12-af0d-4d45-889b-42e99b721de9-node-exporter-accelerators-collector-config\") pod \"node-exporter-5nr82\" (UID: \"06642a12-af0d-4d45-889b-42e99b721de9\") " pod="openshift-monitoring/node-exporter-5nr82"
Sep 10 20:58:28.236476 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:28.236254    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/06642a12-af0d-4d45-889b-42e99b721de9-root\") pod \"node-exporter-5nr82\" (UID: \"06642a12-af0d-4d45-889b-42e99b721de9\") " pod="openshift-monitoring/node-exporter-5nr82"
Sep 10 20:58:28.236476 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:28.236278    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/06642a12-af0d-4d45-889b-42e99b721de9-node-exporter-tls\") pod \"node-exporter-5nr82\" (UID: \"06642a12-af0d-4d45-889b-42e99b721de9\") " pod="openshift-monitoring/node-exporter-5nr82"
Sep 10 20:58:28.236476 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:28.236312    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/06642a12-af0d-4d45-889b-42e99b721de9-node-exporter-wtmp\") pod \"node-exporter-5nr82\" (UID: \"06642a12-af0d-4d45-889b-42e99b721de9\") " pod="openshift-monitoring/node-exporter-5nr82"
Sep 10 20:58:28.236476 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:28.236359    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/06642a12-af0d-4d45-889b-42e99b721de9-sys\") pod \"node-exporter-5nr82\" (UID: \"06642a12-af0d-4d45-889b-42e99b721de9\") " pod="openshift-monitoring/node-exporter-5nr82"
Sep 10 20:58:28.236476 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:28.236395    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/06642a12-af0d-4d45-889b-42e99b721de9-node-exporter-textfile\") pod \"node-exporter-5nr82\" (UID: \"06642a12-af0d-4d45-889b-42e99b721de9\") " pod="openshift-monitoring/node-exporter-5nr82"
Sep 10 20:58:28.236766 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:28.236625    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/06642a12-af0d-4d45-889b-42e99b721de9-root\") pod \"node-exporter-5nr82\" (UID: \"06642a12-af0d-4d45-889b-42e99b721de9\") " pod="openshift-monitoring/node-exporter-5nr82"
Sep 10 20:58:28.236854 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:28.236761    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/06642a12-af0d-4d45-889b-42e99b721de9-node-exporter-textfile\") pod \"node-exporter-5nr82\" (UID: \"06642a12-af0d-4d45-889b-42e99b721de9\") " pod="openshift-monitoring/node-exporter-5nr82"
Sep 10 20:58:28.236854 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:28.236774    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/06642a12-af0d-4d45-889b-42e99b721de9-node-exporter-wtmp\") pod \"node-exporter-5nr82\" (UID: \"06642a12-af0d-4d45-889b-42e99b721de9\") " pod="openshift-monitoring/node-exporter-5nr82"
Sep 10 20:58:28.236854 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:28.236831    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/06642a12-af0d-4d45-889b-42e99b721de9-sys\") pod \"node-exporter-5nr82\" (UID: \"06642a12-af0d-4d45-889b-42e99b721de9\") " pod="openshift-monitoring/node-exporter-5nr82"
Sep 10 20:58:28.237015 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:28.236922    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/06642a12-af0d-4d45-889b-42e99b721de9-node-exporter-accelerators-collector-config\") pod \"node-exporter-5nr82\" (UID: \"06642a12-af0d-4d45-889b-42e99b721de9\") " pod="openshift-monitoring/node-exporter-5nr82"
Sep 10 20:58:28.237015 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:28.236933    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/06642a12-af0d-4d45-889b-42e99b721de9-metrics-client-ca\") pod \"node-exporter-5nr82\" (UID: \"06642a12-af0d-4d45-889b-42e99b721de9\") " pod="openshift-monitoring/node-exporter-5nr82"
Sep 10 20:58:28.238495 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:28.238477    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/06642a12-af0d-4d45-889b-42e99b721de9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5nr82\" (UID: \"06642a12-af0d-4d45-889b-42e99b721de9\") " pod="openshift-monitoring/node-exporter-5nr82"
Sep 10 20:58:28.238646 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:28.238627    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/06642a12-af0d-4d45-889b-42e99b721de9-node-exporter-tls\") pod \"node-exporter-5nr82\" (UID: \"06642a12-af0d-4d45-889b-42e99b721de9\") " pod="openshift-monitoring/node-exporter-5nr82"
Sep 10 20:58:28.246663 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:28.246634    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5zc4\" (UniqueName: \"kubernetes.io/projected/06642a12-af0d-4d45-889b-42e99b721de9-kube-api-access-d5zc4\") pod \"node-exporter-5nr82\" (UID: \"06642a12-af0d-4d45-889b-42e99b721de9\") " pod="openshift-monitoring/node-exporter-5nr82"
Sep 10 20:58:28.296392 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:28.296362    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5nr82"
Sep 10 20:58:28.306292 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:58:28.306272    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06642a12_af0d_4d45_889b_42e99b721de9.slice/crio-a6921dcb4a0672f1e11e83d55d3b5d87b9e61fc89df662057d35de9e5183c2cd WatchSource:0}: Error finding container a6921dcb4a0672f1e11e83d55d3b5d87b9e61fc89df662057d35de9e5183c2cd: Status 404 returned error can't find the container with id a6921dcb4a0672f1e11e83d55d3b5d87b9e61fc89df662057d35de9e5183c2cd
Sep 10 20:58:29.284919 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:29.284873    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5nr82" event={"ID":"06642a12-af0d-4d45-889b-42e99b721de9","Type":"ContainerStarted","Data":"a6921dcb4a0672f1e11e83d55d3b5d87b9e61fc89df662057d35de9e5183c2cd"}
Sep 10 20:58:30.290468 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:30.290430    2564 generic.go:356] "Generic (PLEG): container finished" podID="06642a12-af0d-4d45-889b-42e99b721de9" containerID="1ead32e5cf099fb2cf0f20181059833bafe4762a60189007b05168ec5e442aa1" exitCode=0
Sep 10 20:58:30.290844 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:30.290498    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5nr82" event={"ID":"06642a12-af0d-4d45-889b-42e99b721de9","Type":"ContainerDied","Data":"1ead32e5cf099fb2cf0f20181059833bafe4762a60189007b05168ec5e442aa1"}
Sep 10 20:58:31.295876 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:31.295838    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5nr82" event={"ID":"06642a12-af0d-4d45-889b-42e99b721de9","Type":"ContainerStarted","Data":"0747944b1bf4187f57861e523f225931e9455897d2c300c9f553801a653a2f4e"}
Sep 10 20:58:31.296254 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:31.295892    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5nr82" event={"ID":"06642a12-af0d-4d45-889b-42e99b721de9","Type":"ContainerStarted","Data":"c1edcc451fc5b08517663c14e892db34467d666ce04c7b4bcf00db7ce62c32e0"}
Sep 10 20:58:31.336139 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:31.336087    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5nr82" podStartSLOduration=3.18715913 podStartE2EDuration="4.336066505s" totalImagesPullingTime="1.086287946s" totalInitContainerRuntime="62.619429ms" isStatefulPod=true podCreationTimestamp="2026-09-10 20:58:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:58:31.334536359 +0000 UTC m=+92.021603638" watchObservedRunningTime="2026-09-10 20:58:31.336066505 +0000 UTC m=+92.023133809"
Sep 10 20:58:35.867612 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:35.867579    2564 scope.go:117] "RemoveContainer" containerID="9c6509e44e082bd0ea518c4a5f41aa24bf03fd82a4b23ebf0e816f76e188592e"
Sep 10 20:58:36.315359 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:36.315329    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-cd9hp_0432bad8-86f5-4b0e-a0d4-2fdb728223f2/console-operator/2.log"
Sep 10 20:58:36.315527 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:36.315407    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-cd9hp" event={"ID":"0432bad8-86f5-4b0e-a0d4-2fdb728223f2","Type":"ContainerStarted","Data":"067523de23934b1363a332309e1f483a4b567db875ddcbdc3cadd4f9325e0b3c"}
Sep 10 20:58:36.315713 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:36.315685    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-cd9hp"
Sep 10 20:58:36.320400 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:36.320379    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-696884fb9c-cd9hp"
Sep 10 20:58:36.340810 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:36.340761    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-696884fb9c-cd9hp" podStartSLOduration=49.889974551 podStartE2EDuration="55.340743776s" totalImagesPullingTime="5.450769225s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:57:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:58:36.340343087 +0000 UTC m=+97.027410377" watchObservedRunningTime="2026-09-10 20:58:36.340743776 +0000 UTC m=+97.027811056"
Sep 10 20:58:38.202150 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:38.202113    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-srfp2"
Sep 10 20:58:52.949991 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:52.949960    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-799d64d696-4ml7m"]
Sep 10 20:58:52.953078 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:52.953058    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-799d64d696-4ml7m"
Sep 10 20:58:52.959584 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:52.959564    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 10 20:58:52.959853 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:52.959835    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 10 20:58:52.959917 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:52.959835    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 10 20:58:52.960764 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:52.960724    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 10 20:58:52.960764 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:52.960756    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 10 20:58:52.960928 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:52.960820    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 10 20:58:52.961004 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:52.960963    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 10 20:58:52.961063 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:52.961009    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-kb4m6\""
Sep 10 20:58:52.968501 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:52.968480    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 10 20:58:52.985604 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:52.985584    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-799d64d696-4ml7m"]
Sep 10 20:58:53.121515 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:53.121486    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/820e02fe-83b4-41a6-9357-81a3de0acfc2-console-serving-cert\") pod \"console-799d64d696-4ml7m\" (UID: \"820e02fe-83b4-41a6-9357-81a3de0acfc2\") " pod="openshift-console/console-799d64d696-4ml7m"
Sep 10 20:58:53.121515 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:53.121519    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/820e02fe-83b4-41a6-9357-81a3de0acfc2-console-oauth-config\") pod \"console-799d64d696-4ml7m\" (UID: \"820e02fe-83b4-41a6-9357-81a3de0acfc2\") " pod="openshift-console/console-799d64d696-4ml7m"
Sep 10 20:58:53.121702 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:53.121544    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/820e02fe-83b4-41a6-9357-81a3de0acfc2-console-config\") pod \"console-799d64d696-4ml7m\" (UID: \"820e02fe-83b4-41a6-9357-81a3de0acfc2\") " pod="openshift-console/console-799d64d696-4ml7m"
Sep 10 20:58:53.121702 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:53.121627    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pm62\" (UniqueName: \"kubernetes.io/projected/820e02fe-83b4-41a6-9357-81a3de0acfc2-kube-api-access-5pm62\") pod \"console-799d64d696-4ml7m\" (UID: \"820e02fe-83b4-41a6-9357-81a3de0acfc2\") " pod="openshift-console/console-799d64d696-4ml7m"
Sep 10 20:58:53.121702 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:53.121667    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/820e02fe-83b4-41a6-9357-81a3de0acfc2-trusted-ca-bundle\") pod \"console-799d64d696-4ml7m\" (UID: \"820e02fe-83b4-41a6-9357-81a3de0acfc2\") " pod="openshift-console/console-799d64d696-4ml7m"
Sep 10 20:58:53.121702 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:53.121698    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/820e02fe-83b4-41a6-9357-81a3de0acfc2-oauth-serving-cert\") pod \"console-799d64d696-4ml7m\" (UID: \"820e02fe-83b4-41a6-9357-81a3de0acfc2\") " pod="openshift-console/console-799d64d696-4ml7m"
Sep 10 20:58:53.121825 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:53.121744    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/820e02fe-83b4-41a6-9357-81a3de0acfc2-service-ca\") pod \"console-799d64d696-4ml7m\" (UID: \"820e02fe-83b4-41a6-9357-81a3de0acfc2\") " pod="openshift-console/console-799d64d696-4ml7m"
Sep 10 20:58:53.222753 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:53.222676    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/820e02fe-83b4-41a6-9357-81a3de0acfc2-console-config\") pod \"console-799d64d696-4ml7m\" (UID: \"820e02fe-83b4-41a6-9357-81a3de0acfc2\") " pod="openshift-console/console-799d64d696-4ml7m"
Sep 10 20:58:53.222753 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:53.222719    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pm62\" (UniqueName: \"kubernetes.io/projected/820e02fe-83b4-41a6-9357-81a3de0acfc2-kube-api-access-5pm62\") pod \"console-799d64d696-4ml7m\" (UID: \"820e02fe-83b4-41a6-9357-81a3de0acfc2\") " pod="openshift-console/console-799d64d696-4ml7m"
Sep 10 20:58:53.222753 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:53.222743    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/820e02fe-83b4-41a6-9357-81a3de0acfc2-trusted-ca-bundle\") pod \"console-799d64d696-4ml7m\" (UID: \"820e02fe-83b4-41a6-9357-81a3de0acfc2\") " pod="openshift-console/console-799d64d696-4ml7m"
Sep 10 20:58:53.222953 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:53.222862    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/820e02fe-83b4-41a6-9357-81a3de0acfc2-oauth-serving-cert\") pod \"console-799d64d696-4ml7m\" (UID: \"820e02fe-83b4-41a6-9357-81a3de0acfc2\") " pod="openshift-console/console-799d64d696-4ml7m"
Sep 10 20:58:53.222953 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:53.222911    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/820e02fe-83b4-41a6-9357-81a3de0acfc2-service-ca\") pod \"console-799d64d696-4ml7m\" (UID: \"820e02fe-83b4-41a6-9357-81a3de0acfc2\") " pod="openshift-console/console-799d64d696-4ml7m"
Sep 10 20:58:53.223037 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:53.222955    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/820e02fe-83b4-41a6-9357-81a3de0acfc2-console-serving-cert\") pod \"console-799d64d696-4ml7m\" (UID: \"820e02fe-83b4-41a6-9357-81a3de0acfc2\") " pod="openshift-console/console-799d64d696-4ml7m"
Sep 10 20:58:53.223037 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:53.222992    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/820e02fe-83b4-41a6-9357-81a3de0acfc2-console-oauth-config\") pod \"console-799d64d696-4ml7m\" (UID: \"820e02fe-83b4-41a6-9357-81a3de0acfc2\") " pod="openshift-console/console-799d64d696-4ml7m"
Sep 10 20:58:53.223552 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:53.223530    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/820e02fe-83b4-41a6-9357-81a3de0acfc2-oauth-serving-cert\") pod \"console-799d64d696-4ml7m\" (UID: \"820e02fe-83b4-41a6-9357-81a3de0acfc2\") " pod="openshift-console/console-799d64d696-4ml7m"
Sep 10 20:58:53.223679 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:53.223531    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/820e02fe-83b4-41a6-9357-81a3de0acfc2-console-config\") pod \"console-799d64d696-4ml7m\" (UID: \"820e02fe-83b4-41a6-9357-81a3de0acfc2\") " pod="openshift-console/console-799d64d696-4ml7m"
Sep 10 20:58:53.223679 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:53.223635    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/820e02fe-83b4-41a6-9357-81a3de0acfc2-trusted-ca-bundle\") pod \"console-799d64d696-4ml7m\" (UID: \"820e02fe-83b4-41a6-9357-81a3de0acfc2\") " pod="openshift-console/console-799d64d696-4ml7m"
Sep 10 20:58:53.223679 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:53.223663    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/820e02fe-83b4-41a6-9357-81a3de0acfc2-service-ca\") pod \"console-799d64d696-4ml7m\" (UID: \"820e02fe-83b4-41a6-9357-81a3de0acfc2\") " pod="openshift-console/console-799d64d696-4ml7m"
Sep 10 20:58:53.225810 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:53.225787    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/820e02fe-83b4-41a6-9357-81a3de0acfc2-console-oauth-config\") pod \"console-799d64d696-4ml7m\" (UID: \"820e02fe-83b4-41a6-9357-81a3de0acfc2\") " pod="openshift-console/console-799d64d696-4ml7m"
Sep 10 20:58:53.225933 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:53.225917    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/820e02fe-83b4-41a6-9357-81a3de0acfc2-console-serving-cert\") pod \"console-799d64d696-4ml7m\" (UID: \"820e02fe-83b4-41a6-9357-81a3de0acfc2\") " pod="openshift-console/console-799d64d696-4ml7m"
Sep 10 20:58:53.233798 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:53.233777    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pm62\" (UniqueName: \"kubernetes.io/projected/820e02fe-83b4-41a6-9357-81a3de0acfc2-kube-api-access-5pm62\") pod \"console-799d64d696-4ml7m\" (UID: \"820e02fe-83b4-41a6-9357-81a3de0acfc2\") " pod="openshift-console/console-799d64d696-4ml7m"
Sep 10 20:58:53.261660 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:53.261635    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-799d64d696-4ml7m"
Sep 10 20:58:53.545474 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:53.545450    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-799d64d696-4ml7m"]
Sep 10 20:58:53.547022 ip-10-0-129-100 kubenswrapper[2564]: W0910 20:58:53.546994    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod820e02fe_83b4_41a6_9357_81a3de0acfc2.slice/crio-371bbd334a733646143b7b6af63d8b8239a364b5e074b0a90cd19cdd275e34cb WatchSource:0}: Error finding container 371bbd334a733646143b7b6af63d8b8239a364b5e074b0a90cd19cdd275e34cb: Status 404 returned error can't find the container with id 371bbd334a733646143b7b6af63d8b8239a364b5e074b0a90cd19cdd275e34cb
Sep 10 20:58:54.382529 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:54.382476    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-799d64d696-4ml7m" event={"ID":"820e02fe-83b4-41a6-9357-81a3de0acfc2","Type":"ContainerStarted","Data":"371bbd334a733646143b7b6af63d8b8239a364b5e074b0a90cd19cdd275e34cb"}
Sep 10 20:58:57.397540 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:58:57.397502    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-799d64d696-4ml7m" event={"ID":"820e02fe-83b4-41a6-9357-81a3de0acfc2","Type":"ContainerStarted","Data":"510a0e4d1d2bd8c5019142a154380a9ebd4ecd84fc4b9b12ea02bebdd833755f"}
Sep 10 20:59:03.261924 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:59:03.261886    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-799d64d696-4ml7m"
Sep 10 20:59:03.262454 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:59:03.261962    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-799d64d696-4ml7m"
Sep 10 20:59:03.266745 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:59:03.266721    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-799d64d696-4ml7m"
Sep 10 20:59:03.298659 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:59:03.298599    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-799d64d696-4ml7m" podStartSLOduration=8.40452842 podStartE2EDuration="11.298584791s" totalImagesPullingTime="2.894056371s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 20:58:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 20:58:57.444750711 +0000 UTC m=+118.131817994" watchObservedRunningTime="2026-09-10 20:59:03.298584791 +0000 UTC m=+123.985652070"
Sep 10 20:59:03.421412 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:59:03.421385    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-799d64d696-4ml7m"
Sep 10 20:59:09.438329 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:59:09.438279    2564 generic.go:356] "Generic (PLEG): container finished" podID="113738d6-eb6e-43ad-919c-53f9fd812a66" containerID="70ec31f13a94976a5e4f7ce3822401cf3f4dfc5494ac75cd316975345761443e" exitCode=0
Sep 10 20:59:09.438710 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:59:09.438353    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-6bmfj" event={"ID":"113738d6-eb6e-43ad-919c-53f9fd812a66","Type":"ContainerDied","Data":"70ec31f13a94976a5e4f7ce3822401cf3f4dfc5494ac75cd316975345761443e"}
Sep 10 20:59:09.438788 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:59:09.438767    2564 scope.go:117] "RemoveContainer" containerID="70ec31f13a94976a5e4f7ce3822401cf3f4dfc5494ac75cd316975345761443e"
Sep 10 20:59:10.015034 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:59:10.015008    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6c999c4888-wrq4b_c1c5af58-1a57-4208-b8ac-0a37ef4efd70/router/0.log"
Sep 10 20:59:10.026706 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:59:10.026683    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mv4zr_9d1aef14-c1f3-402c-8232-a212f2354624/serve-healthcheck-canary/0.log"
Sep 10 20:59:10.443512 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:59:10.443480    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-6bmfj" event={"ID":"113738d6-eb6e-43ad-919c-53f9fd812a66","Type":"ContainerStarted","Data":"f3fdee4a55f43589ab0d4e1be11a446487c7468dfc2e7cbd144d060ea3112e49"}
Sep 10 20:59:18.470848 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:59:18.470811    2564 generic.go:356] "Generic (PLEG): container finished" podID="5e15b3b7-d93d-42fa-85a5-2a2f529e5649" containerID="2fc758c9088a8246e6f040003f5a98d22cab3e051a1d94c4a116de46ed192bfd" exitCode=0
Sep 10 20:59:18.471198 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:59:18.470884    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-vhb8c" event={"ID":"5e15b3b7-d93d-42fa-85a5-2a2f529e5649","Type":"ContainerDied","Data":"2fc758c9088a8246e6f040003f5a98d22cab3e051a1d94c4a116de46ed192bfd"}
Sep 10 20:59:18.471198 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:59:18.471191    2564 scope.go:117] "RemoveContainer" containerID="2fc758c9088a8246e6f040003f5a98d22cab3e051a1d94c4a116de46ed192bfd"
Sep 10 20:59:19.479055 ip-10-0-129-100 kubenswrapper[2564]: I0910 20:59:19.479022    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-vhb8c" event={"ID":"5e15b3b7-d93d-42fa-85a5-2a2f529e5649","Type":"ContainerStarted","Data":"4070fc754358c5a4be79e644f5c80c59a2a3a0d5cd4147806649377a60fb0db5"}
Sep 10 21:00:07.573858 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:00:07.573778    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-799d64d696-4ml7m"]
Sep 10 21:00:32.592565 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:00:32.592502    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-799d64d696-4ml7m" podUID="820e02fe-83b4-41a6-9357-81a3de0acfc2" containerName="console" containerID="cri-o://510a0e4d1d2bd8c5019142a154380a9ebd4ecd84fc4b9b12ea02bebdd833755f" gracePeriod=15
Sep 10 21:00:32.750129 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:00:32.750093    2564 generic.go:356] "Generic (PLEG): container finished" podID="820e02fe-83b4-41a6-9357-81a3de0acfc2" containerID="510a0e4d1d2bd8c5019142a154380a9ebd4ecd84fc4b9b12ea02bebdd833755f" exitCode=0
Sep 10 21:00:32.750288 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:00:32.750160    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-799d64d696-4ml7m" event={"ID":"820e02fe-83b4-41a6-9357-81a3de0acfc2","Type":"ContainerDied","Data":"510a0e4d1d2bd8c5019142a154380a9ebd4ecd84fc4b9b12ea02bebdd833755f"}
Sep 10 21:00:32.830975 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:00:32.830953    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-799d64d696-4ml7m"
Sep 10 21:00:32.926000 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:00:32.925937    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/820e02fe-83b4-41a6-9357-81a3de0acfc2-console-config\") pod \"820e02fe-83b4-41a6-9357-81a3de0acfc2\" (UID: \"820e02fe-83b4-41a6-9357-81a3de0acfc2\") "
Sep 10 21:00:32.926000 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:00:32.925986    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/820e02fe-83b4-41a6-9357-81a3de0acfc2-console-serving-cert\") pod \"820e02fe-83b4-41a6-9357-81a3de0acfc2\" (UID: \"820e02fe-83b4-41a6-9357-81a3de0acfc2\") "
Sep 10 21:00:32.926151 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:00:32.926009    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/820e02fe-83b4-41a6-9357-81a3de0acfc2-console-oauth-config\") pod \"820e02fe-83b4-41a6-9357-81a3de0acfc2\" (UID: \"820e02fe-83b4-41a6-9357-81a3de0acfc2\") "
Sep 10 21:00:32.926151 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:00:32.926117    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/820e02fe-83b4-41a6-9357-81a3de0acfc2-oauth-serving-cert\") pod \"820e02fe-83b4-41a6-9357-81a3de0acfc2\" (UID: \"820e02fe-83b4-41a6-9357-81a3de0acfc2\") "
Sep 10 21:00:32.926262 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:00:32.926161    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/820e02fe-83b4-41a6-9357-81a3de0acfc2-trusted-ca-bundle\") pod \"820e02fe-83b4-41a6-9357-81a3de0acfc2\" (UID: \"820e02fe-83b4-41a6-9357-81a3de0acfc2\") "
Sep 10 21:00:32.926262 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:00:32.926206    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/820e02fe-83b4-41a6-9357-81a3de0acfc2-service-ca\") pod \"820e02fe-83b4-41a6-9357-81a3de0acfc2\" (UID: \"820e02fe-83b4-41a6-9357-81a3de0acfc2\") "
Sep 10 21:00:32.926379 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:00:32.926275    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5pm62\" (UniqueName: \"kubernetes.io/projected/820e02fe-83b4-41a6-9357-81a3de0acfc2-kube-api-access-5pm62\") pod \"820e02fe-83b4-41a6-9357-81a3de0acfc2\" (UID: \"820e02fe-83b4-41a6-9357-81a3de0acfc2\") "
Sep 10 21:00:32.926594 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:00:32.926562    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/820e02fe-83b4-41a6-9357-81a3de0acfc2-console-config" (OuterVolumeSpecName: "console-config") pod "820e02fe-83b4-41a6-9357-81a3de0acfc2" (UID: "820e02fe-83b4-41a6-9357-81a3de0acfc2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:00:32.926727 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:00:32.926627    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/820e02fe-83b4-41a6-9357-81a3de0acfc2-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "820e02fe-83b4-41a6-9357-81a3de0acfc2" (UID: "820e02fe-83b4-41a6-9357-81a3de0acfc2"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:00:32.926727 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:00:32.926634    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/820e02fe-83b4-41a6-9357-81a3de0acfc2-service-ca" (OuterVolumeSpecName: "service-ca") pod "820e02fe-83b4-41a6-9357-81a3de0acfc2" (UID: "820e02fe-83b4-41a6-9357-81a3de0acfc2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:00:32.926727 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:00:32.926639    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/820e02fe-83b4-41a6-9357-81a3de0acfc2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "820e02fe-83b4-41a6-9357-81a3de0acfc2" (UID: "820e02fe-83b4-41a6-9357-81a3de0acfc2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:00:32.928208 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:00:32.928181    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/820e02fe-83b4-41a6-9357-81a3de0acfc2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "820e02fe-83b4-41a6-9357-81a3de0acfc2" (UID: "820e02fe-83b4-41a6-9357-81a3de0acfc2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:00:32.928307 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:00:32.928273    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/820e02fe-83b4-41a6-9357-81a3de0acfc2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "820e02fe-83b4-41a6-9357-81a3de0acfc2" (UID: "820e02fe-83b4-41a6-9357-81a3de0acfc2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:00:32.928387 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:00:32.928367    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/820e02fe-83b4-41a6-9357-81a3de0acfc2-kube-api-access-5pm62" (OuterVolumeSpecName: "kube-api-access-5pm62") pod "820e02fe-83b4-41a6-9357-81a3de0acfc2" (UID: "820e02fe-83b4-41a6-9357-81a3de0acfc2"). InnerVolumeSpecName "kube-api-access-5pm62". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:00:33.027059 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:00:33.027034    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5pm62\" (UniqueName: \"kubernetes.io/projected/820e02fe-83b4-41a6-9357-81a3de0acfc2-kube-api-access-5pm62\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:00:33.027059 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:00:33.027055    2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/820e02fe-83b4-41a6-9357-81a3de0acfc2-console-config\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:00:33.027059 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:00:33.027065    2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/820e02fe-83b4-41a6-9357-81a3de0acfc2-console-serving-cert\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:00:33.027262 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:00:33.027073    2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/820e02fe-83b4-41a6-9357-81a3de0acfc2-console-oauth-config\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:00:33.027262 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:00:33.027082    2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/820e02fe-83b4-41a6-9357-81a3de0acfc2-oauth-serving-cert\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:00:33.027262 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:00:33.027090    2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/820e02fe-83b4-41a6-9357-81a3de0acfc2-trusted-ca-bundle\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:00:33.027262 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:00:33.027098    2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/820e02fe-83b4-41a6-9357-81a3de0acfc2-service-ca\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:00:33.755425 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:00:33.755394    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-799d64d696-4ml7m" event={"ID":"820e02fe-83b4-41a6-9357-81a3de0acfc2","Type":"ContainerDied","Data":"371bbd334a733646143b7b6af63d8b8239a364b5e074b0a90cd19cdd275e34cb"}
Sep 10 21:00:33.755843 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:00:33.755448    2564 scope.go:117] "RemoveContainer" containerID="510a0e4d1d2bd8c5019142a154380a9ebd4ecd84fc4b9b12ea02bebdd833755f"
Sep 10 21:00:33.755843 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:00:33.755404    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-799d64d696-4ml7m"
Sep 10 21:00:33.779151 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:00:33.779132    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-799d64d696-4ml7m"]
Sep 10 21:00:33.792071 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:00:33.792049    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-799d64d696-4ml7m"]
Sep 10 21:00:33.871454 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:00:33.871431    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="820e02fe-83b4-41a6-9357-81a3de0acfc2" path="/var/lib/kubelet/pods/820e02fe-83b4-41a6-9357-81a3de0acfc2/volumes"
Sep 10 21:01:46.210996 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:01:46.210961    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wc248"]
Sep 10 21:01:46.211532 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:01:46.211391    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="820e02fe-83b4-41a6-9357-81a3de0acfc2" containerName="console"
Sep 10 21:01:46.211532 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:01:46.211409    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="820e02fe-83b4-41a6-9357-81a3de0acfc2" containerName="console"
Sep 10 21:01:46.211532 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:01:46.211474    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="820e02fe-83b4-41a6-9357-81a3de0acfc2" containerName="console"
Sep 10 21:01:46.214468 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:01:46.214447    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wc248"
Sep 10 21:01:46.217183 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:01:46.217151    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-tz9tv\""
Sep 10 21:01:46.217301 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:01:46.217151    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 21:01:46.218146 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:01:46.218126    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 21:01:46.227826 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:01:46.227801    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wc248"]
Sep 10 21:01:46.330694 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:01:46.330658    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/70feb50d-f5ab-4b8f-9a6e-3e7b028da80e-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wc248\" (UID: \"70feb50d-f5ab-4b8f-9a6e-3e7b028da80e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wc248"
Sep 10 21:01:46.330868 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:01:46.330705    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/70feb50d-f5ab-4b8f-9a6e-3e7b028da80e-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wc248\" (UID: \"70feb50d-f5ab-4b8f-9a6e-3e7b028da80e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wc248"
Sep 10 21:01:46.330868 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:01:46.330755    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zfvz\" (UniqueName: \"kubernetes.io/projected/70feb50d-f5ab-4b8f-9a6e-3e7b028da80e-kube-api-access-8zfvz\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wc248\" (UID: \"70feb50d-f5ab-4b8f-9a6e-3e7b028da80e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wc248"
Sep 10 21:01:46.431499 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:01:46.431467    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/70feb50d-f5ab-4b8f-9a6e-3e7b028da80e-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wc248\" (UID: \"70feb50d-f5ab-4b8f-9a6e-3e7b028da80e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wc248"
Sep 10 21:01:46.431615 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:01:46.431511    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zfvz\" (UniqueName: \"kubernetes.io/projected/70feb50d-f5ab-4b8f-9a6e-3e7b028da80e-kube-api-access-8zfvz\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wc248\" (UID: \"70feb50d-f5ab-4b8f-9a6e-3e7b028da80e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wc248"
Sep 10 21:01:46.431615 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:01:46.431544    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/70feb50d-f5ab-4b8f-9a6e-3e7b028da80e-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wc248\" (UID: \"70feb50d-f5ab-4b8f-9a6e-3e7b028da80e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wc248"
Sep 10 21:01:46.431862 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:01:46.431844    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/70feb50d-f5ab-4b8f-9a6e-3e7b028da80e-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wc248\" (UID: \"70feb50d-f5ab-4b8f-9a6e-3e7b028da80e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wc248"
Sep 10 21:01:46.431903 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:01:46.431875    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/70feb50d-f5ab-4b8f-9a6e-3e7b028da80e-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wc248\" (UID: \"70feb50d-f5ab-4b8f-9a6e-3e7b028da80e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wc248"
Sep 10 21:01:46.440746 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:01:46.440723    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zfvz\" (UniqueName: \"kubernetes.io/projected/70feb50d-f5ab-4b8f-9a6e-3e7b028da80e-kube-api-access-8zfvz\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wc248\" (UID: \"70feb50d-f5ab-4b8f-9a6e-3e7b028da80e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wc248"
Sep 10 21:01:46.523806 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:01:46.523730    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wc248"
Sep 10 21:01:46.793167 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:01:46.793091    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wc248"]
Sep 10 21:01:46.795824 ip-10-0-129-100 kubenswrapper[2564]: W0910 21:01:46.795797    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70feb50d_f5ab_4b8f_9a6e_3e7b028da80e.slice/crio-9787ceb08c90fd123de5e1a79bbaa6f4d48a5033f3e85aa0373cb8aa8fa6f3c7 WatchSource:0}: Error finding container 9787ceb08c90fd123de5e1a79bbaa6f4d48a5033f3e85aa0373cb8aa8fa6f3c7: Status 404 returned error can't find the container with id 9787ceb08c90fd123de5e1a79bbaa6f4d48a5033f3e85aa0373cb8aa8fa6f3c7
Sep 10 21:01:46.999430 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:01:46.999393    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wc248" event={"ID":"70feb50d-f5ab-4b8f-9a6e-3e7b028da80e","Type":"ContainerStarted","Data":"9787ceb08c90fd123de5e1a79bbaa6f4d48a5033f3e85aa0373cb8aa8fa6f3c7"}
Sep 10 21:01:52.021216 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:01:52.021180    2564 generic.go:356] "Generic (PLEG): container finished" podID="70feb50d-f5ab-4b8f-9a6e-3e7b028da80e" containerID="cab77a4ca52193a4501764cfdf344c2d88e35469c925d04694605e81accfbdab" exitCode=0
Sep 10 21:01:52.021600 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:01:52.021270    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wc248" event={"ID":"70feb50d-f5ab-4b8f-9a6e-3e7b028da80e","Type":"ContainerDied","Data":"cab77a4ca52193a4501764cfdf344c2d88e35469c925d04694605e81accfbdab"}
Sep 10 21:01:55.034173 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:01:55.034142    2564 generic.go:356] "Generic (PLEG): container finished" podID="70feb50d-f5ab-4b8f-9a6e-3e7b028da80e" containerID="63627fa1b7b3f3fe2e9965de95302ed7446e53555a3f0b0cbec617c2cf5a2886" exitCode=0
Sep 10 21:01:55.034646 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:01:55.034222    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wc248" event={"ID":"70feb50d-f5ab-4b8f-9a6e-3e7b028da80e","Type":"ContainerDied","Data":"63627fa1b7b3f3fe2e9965de95302ed7446e53555a3f0b0cbec617c2cf5a2886"}
Sep 10 21:02:01.077290 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:01.077254    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-cd9hp_0432bad8-86f5-4b0e-a0d4-2fdb728223f2/console-operator/2.log"
Sep 10 21:02:01.079580 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:01.077324    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-cd9hp_0432bad8-86f5-4b0e-a0d4-2fdb728223f2/console-operator/2.log"
Sep 10 21:02:01.083881 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:01.083861    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wrbhk_279e54f7-0db1-4e2d-a998-4b3ecdf992cd/ovn-acl-logging/0.log"
Sep 10 21:02:01.084201 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:01.084185    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wrbhk_279e54f7-0db1-4e2d-a998-4b3ecdf992cd/ovn-acl-logging/0.log"
Sep 10 21:02:01.086848 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:01.086831    2564 kubelet.go:1648] "Image garbage collection succeeded"
Sep 10 21:02:02.064997 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:02.064965    2564 generic.go:356] "Generic (PLEG): container finished" podID="70feb50d-f5ab-4b8f-9a6e-3e7b028da80e" containerID="cfd2555a610e4fd260a1afc6aca132eed78635df59b42d19c3b97e44f092c64f" exitCode=0
Sep 10 21:02:02.065168 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:02.065029    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wc248" event={"ID":"70feb50d-f5ab-4b8f-9a6e-3e7b028da80e","Type":"ContainerDied","Data":"cfd2555a610e4fd260a1afc6aca132eed78635df59b42d19c3b97e44f092c64f"}
Sep 10 21:02:03.189651 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:03.189627    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wc248"
Sep 10 21:02:03.362998 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:03.362917    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8zfvz\" (UniqueName: \"kubernetes.io/projected/70feb50d-f5ab-4b8f-9a6e-3e7b028da80e-kube-api-access-8zfvz\") pod \"70feb50d-f5ab-4b8f-9a6e-3e7b028da80e\" (UID: \"70feb50d-f5ab-4b8f-9a6e-3e7b028da80e\") "
Sep 10 21:02:03.362998 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:03.362961    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/70feb50d-f5ab-4b8f-9a6e-3e7b028da80e-util\") pod \"70feb50d-f5ab-4b8f-9a6e-3e7b028da80e\" (UID: \"70feb50d-f5ab-4b8f-9a6e-3e7b028da80e\") "
Sep 10 21:02:03.362998 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:03.362979    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/70feb50d-f5ab-4b8f-9a6e-3e7b028da80e-bundle\") pod \"70feb50d-f5ab-4b8f-9a6e-3e7b028da80e\" (UID: \"70feb50d-f5ab-4b8f-9a6e-3e7b028da80e\") "
Sep 10 21:02:03.363714 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:03.363687    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70feb50d-f5ab-4b8f-9a6e-3e7b028da80e-bundle" (OuterVolumeSpecName: "bundle") pod "70feb50d-f5ab-4b8f-9a6e-3e7b028da80e" (UID: "70feb50d-f5ab-4b8f-9a6e-3e7b028da80e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:02:03.365116 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:03.365081    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70feb50d-f5ab-4b8f-9a6e-3e7b028da80e-kube-api-access-8zfvz" (OuterVolumeSpecName: "kube-api-access-8zfvz") pod "70feb50d-f5ab-4b8f-9a6e-3e7b028da80e" (UID: "70feb50d-f5ab-4b8f-9a6e-3e7b028da80e"). InnerVolumeSpecName "kube-api-access-8zfvz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:02:03.367626 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:03.367598    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70feb50d-f5ab-4b8f-9a6e-3e7b028da80e-util" (OuterVolumeSpecName: "util") pod "70feb50d-f5ab-4b8f-9a6e-3e7b028da80e" (UID: "70feb50d-f5ab-4b8f-9a6e-3e7b028da80e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:02:03.463523 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:03.463484    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8zfvz\" (UniqueName: \"kubernetes.io/projected/70feb50d-f5ab-4b8f-9a6e-3e7b028da80e-kube-api-access-8zfvz\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:02:03.463523 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:03.463516    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/70feb50d-f5ab-4b8f-9a6e-3e7b028da80e-util\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:02:03.463523 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:03.463526    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/70feb50d-f5ab-4b8f-9a6e-3e7b028da80e-bundle\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:02:04.074135 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:04.074100    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wc248" event={"ID":"70feb50d-f5ab-4b8f-9a6e-3e7b028da80e","Type":"ContainerDied","Data":"9787ceb08c90fd123de5e1a79bbaa6f4d48a5033f3e85aa0373cb8aa8fa6f3c7"}
Sep 10 21:02:04.074304 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:04.074147    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9787ceb08c90fd123de5e1a79bbaa6f4d48a5033f3e85aa0373cb8aa8fa6f3c7"
Sep 10 21:02:04.074304 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:04.074148    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wc248"
Sep 10 21:02:09.752637 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:09.752602    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8z27t"]
Sep 10 21:02:09.753160 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:09.752860    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70feb50d-f5ab-4b8f-9a6e-3e7b028da80e" containerName="util"
Sep 10 21:02:09.753160 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:09.752871    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="70feb50d-f5ab-4b8f-9a6e-3e7b028da80e" containerName="util"
Sep 10 21:02:09.753160 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:09.752883    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70feb50d-f5ab-4b8f-9a6e-3e7b028da80e" containerName="pull"
Sep 10 21:02:09.753160 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:09.752888    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="70feb50d-f5ab-4b8f-9a6e-3e7b028da80e" containerName="pull"
Sep 10 21:02:09.753160 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:09.752903    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70feb50d-f5ab-4b8f-9a6e-3e7b028da80e" containerName="extract"
Sep 10 21:02:09.753160 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:09.752910    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="70feb50d-f5ab-4b8f-9a6e-3e7b028da80e" containerName="extract"
Sep 10 21:02:09.753160 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:09.752947    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="70feb50d-f5ab-4b8f-9a6e-3e7b028da80e" containerName="extract"
Sep 10 21:02:09.795522 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:09.795496    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8z27t"]
Sep 10 21:02:09.795664 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:09.795614    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8z27t"
Sep 10 21:02:09.801776 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:09.801669    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 10 21:02:09.801922 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:09.801907    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-pj4p7\""
Sep 10 21:02:09.802143 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:09.802128    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 10 21:02:09.907848 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:09.907806    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1876d623-ec61-4f97-8fda-59b1a1f83547-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-8z27t\" (UID: \"1876d623-ec61-4f97-8fda-59b1a1f83547\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8z27t"
Sep 10 21:02:09.907848 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:09.907850    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zljml\" (UniqueName: \"kubernetes.io/projected/1876d623-ec61-4f97-8fda-59b1a1f83547-kube-api-access-zljml\") pod \"cert-manager-operator-controller-manager-55c444bf86-8z27t\" (UID: \"1876d623-ec61-4f97-8fda-59b1a1f83547\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8z27t"
Sep 10 21:02:10.008598 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:10.008504    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1876d623-ec61-4f97-8fda-59b1a1f83547-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-8z27t\" (UID: \"1876d623-ec61-4f97-8fda-59b1a1f83547\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8z27t"
Sep 10 21:02:10.008598 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:10.008552    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zljml\" (UniqueName: \"kubernetes.io/projected/1876d623-ec61-4f97-8fda-59b1a1f83547-kube-api-access-zljml\") pod \"cert-manager-operator-controller-manager-55c444bf86-8z27t\" (UID: \"1876d623-ec61-4f97-8fda-59b1a1f83547\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8z27t"
Sep 10 21:02:10.008891 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:10.008870    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1876d623-ec61-4f97-8fda-59b1a1f83547-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-8z27t\" (UID: \"1876d623-ec61-4f97-8fda-59b1a1f83547\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8z27t"
Sep 10 21:02:10.018350 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:10.018325    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zljml\" (UniqueName: \"kubernetes.io/projected/1876d623-ec61-4f97-8fda-59b1a1f83547-kube-api-access-zljml\") pod \"cert-manager-operator-controller-manager-55c444bf86-8z27t\" (UID: \"1876d623-ec61-4f97-8fda-59b1a1f83547\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8z27t"
Sep 10 21:02:10.104330 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:10.104297    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8z27t"
Sep 10 21:02:10.412414 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:10.412382    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8z27t"]
Sep 10 21:02:10.415052 ip-10-0-129-100 kubenswrapper[2564]: W0910 21:02:10.415016    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1876d623_ec61_4f97_8fda_59b1a1f83547.slice/crio-0c0c5e8f92d62b1e0f62959c82b3db8ae803936da6319a77ff1a5f5a509713e3 WatchSource:0}: Error finding container 0c0c5e8f92d62b1e0f62959c82b3db8ae803936da6319a77ff1a5f5a509713e3: Status 404 returned error can't find the container with id 0c0c5e8f92d62b1e0f62959c82b3db8ae803936da6319a77ff1a5f5a509713e3
Sep 10 21:02:10.417712 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:10.417694    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 21:02:11.103112 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:11.103073    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8z27t" event={"ID":"1876d623-ec61-4f97-8fda-59b1a1f83547","Type":"ContainerStarted","Data":"0c0c5e8f92d62b1e0f62959c82b3db8ae803936da6319a77ff1a5f5a509713e3"}
Sep 10 21:02:13.113368 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:13.113331    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8z27t" event={"ID":"1876d623-ec61-4f97-8fda-59b1a1f83547","Type":"ContainerStarted","Data":"33ad61742db57e68c2bda79afc03fc35b82d620bcd3150de2bb05b2ad3a4047c"}
Sep 10 21:02:13.140310 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:13.140255    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8z27t" podStartSLOduration=2.050657431 podStartE2EDuration="4.140239849s" totalImagesPullingTime="2.089582418s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:02:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:02:13.138146049 +0000 UTC m=+313.825213328" watchObservedRunningTime="2026-09-10 21:02:13.140239849 +0000 UTC m=+313.827307119"
Sep 10 21:02:13.825490 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:13.825437    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7b8kz"]
Sep 10 21:02:13.848171 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:13.848137    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7b8kz"
Sep 10 21:02:13.851385 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:13.851363    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 21:02:13.852239 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:13.852207    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 21:02:13.852785 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:13.852770    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-tz9tv\""
Sep 10 21:02:13.871960 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:13.871930    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7b8kz"]
Sep 10 21:02:13.939116 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:13.939081    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/87657d2f-ff9b-43aa-964f-e874ae4c3efc-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7b8kz\" (UID: \"87657d2f-ff9b-43aa-964f-e874ae4c3efc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7b8kz"
Sep 10 21:02:13.939308 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:13.939130    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/87657d2f-ff9b-43aa-964f-e874ae4c3efc-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7b8kz\" (UID: \"87657d2f-ff9b-43aa-964f-e874ae4c3efc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7b8kz"
Sep 10 21:02:13.939308 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:13.939158    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9md74\" (UniqueName: \"kubernetes.io/projected/87657d2f-ff9b-43aa-964f-e874ae4c3efc-kube-api-access-9md74\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7b8kz\" (UID: \"87657d2f-ff9b-43aa-964f-e874ae4c3efc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7b8kz"
Sep 10 21:02:14.040542 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:14.040505    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/87657d2f-ff9b-43aa-964f-e874ae4c3efc-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7b8kz\" (UID: \"87657d2f-ff9b-43aa-964f-e874ae4c3efc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7b8kz"
Sep 10 21:02:14.040542 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:14.040545    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9md74\" (UniqueName: \"kubernetes.io/projected/87657d2f-ff9b-43aa-964f-e874ae4c3efc-kube-api-access-9md74\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7b8kz\" (UID: \"87657d2f-ff9b-43aa-964f-e874ae4c3efc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7b8kz"
Sep 10 21:02:14.040746 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:14.040589    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/87657d2f-ff9b-43aa-964f-e874ae4c3efc-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7b8kz\" (UID: \"87657d2f-ff9b-43aa-964f-e874ae4c3efc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7b8kz"
Sep 10 21:02:14.040915 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:14.040898    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/87657d2f-ff9b-43aa-964f-e874ae4c3efc-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7b8kz\" (UID: \"87657d2f-ff9b-43aa-964f-e874ae4c3efc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7b8kz"
Sep 10 21:02:14.040982 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:14.040958    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/87657d2f-ff9b-43aa-964f-e874ae4c3efc-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7b8kz\" (UID: \"87657d2f-ff9b-43aa-964f-e874ae4c3efc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7b8kz"
Sep 10 21:02:14.063456 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:14.063429    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9md74\" (UniqueName: \"kubernetes.io/projected/87657d2f-ff9b-43aa-964f-e874ae4c3efc-kube-api-access-9md74\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7b8kz\" (UID: \"87657d2f-ff9b-43aa-964f-e874ae4c3efc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7b8kz"
Sep 10 21:02:14.157710 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:14.157622    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7b8kz"
Sep 10 21:02:14.442403 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:14.442351    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7b8kz"]
Sep 10 21:02:14.444568 ip-10-0-129-100 kubenswrapper[2564]: W0910 21:02:14.444537    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87657d2f_ff9b_43aa_964f_e874ae4c3efc.slice/crio-49b1f05a88a2f6e870b46f4afaa4bbd4a76f1be9853b6df4e7d44d40d6efa1fb WatchSource:0}: Error finding container 49b1f05a88a2f6e870b46f4afaa4bbd4a76f1be9853b6df4e7d44d40d6efa1fb: Status 404 returned error can't find the container with id 49b1f05a88a2f6e870b46f4afaa4bbd4a76f1be9853b6df4e7d44d40d6efa1fb
Sep 10 21:02:15.122423 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:15.122388    2564 generic.go:356] "Generic (PLEG): container finished" podID="87657d2f-ff9b-43aa-964f-e874ae4c3efc" containerID="582e6e3b40df02afce71d4f8447da5925c1fe5e93cd061d3255cb0b48258199e" exitCode=0
Sep 10 21:02:15.122594 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:15.122445    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7b8kz" event={"ID":"87657d2f-ff9b-43aa-964f-e874ae4c3efc","Type":"ContainerDied","Data":"582e6e3b40df02afce71d4f8447da5925c1fe5e93cd061d3255cb0b48258199e"}
Sep 10 21:02:15.122594 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:15.122481    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7b8kz" event={"ID":"87657d2f-ff9b-43aa-964f-e874ae4c3efc","Type":"ContainerStarted","Data":"49b1f05a88a2f6e870b46f4afaa4bbd4a76f1be9853b6df4e7d44d40d6efa1fb"}
Sep 10 21:02:17.133741 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:17.133710    2564 generic.go:356] "Generic (PLEG): container finished" podID="87657d2f-ff9b-43aa-964f-e874ae4c3efc" containerID="c1fd5b57ab91a4afa2f0dfe5d376d3e7784ecbe6d07366dfa7e3e66143b97ff6" exitCode=0
Sep 10 21:02:17.134130 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:17.133762    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7b8kz" event={"ID":"87657d2f-ff9b-43aa-964f-e874ae4c3efc","Type":"ContainerDied","Data":"c1fd5b57ab91a4afa2f0dfe5d376d3e7784ecbe6d07366dfa7e3e66143b97ff6"}
Sep 10 21:02:18.139713 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:18.139676    2564 generic.go:356] "Generic (PLEG): container finished" podID="87657d2f-ff9b-43aa-964f-e874ae4c3efc" containerID="6f4c9fcdcd93000e55e035594edb160fd28b5dd364fcbc8009098959a41ced81" exitCode=0
Sep 10 21:02:18.140073 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:18.139720    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7b8kz" event={"ID":"87657d2f-ff9b-43aa-964f-e874ae4c3efc","Type":"ContainerDied","Data":"6f4c9fcdcd93000e55e035594edb160fd28b5dd364fcbc8009098959a41ced81"}
Sep 10 21:02:19.268529 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:19.268498    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7b8kz"
Sep 10 21:02:19.380831 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:19.380800    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/87657d2f-ff9b-43aa-964f-e874ae4c3efc-bundle\") pod \"87657d2f-ff9b-43aa-964f-e874ae4c3efc\" (UID: \"87657d2f-ff9b-43aa-964f-e874ae4c3efc\") "
Sep 10 21:02:19.380831 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:19.380839    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9md74\" (UniqueName: \"kubernetes.io/projected/87657d2f-ff9b-43aa-964f-e874ae4c3efc-kube-api-access-9md74\") pod \"87657d2f-ff9b-43aa-964f-e874ae4c3efc\" (UID: \"87657d2f-ff9b-43aa-964f-e874ae4c3efc\") "
Sep 10 21:02:19.381024 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:19.380892    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/87657d2f-ff9b-43aa-964f-e874ae4c3efc-util\") pod \"87657d2f-ff9b-43aa-964f-e874ae4c3efc\" (UID: \"87657d2f-ff9b-43aa-964f-e874ae4c3efc\") "
Sep 10 21:02:19.381258 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:19.381210    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87657d2f-ff9b-43aa-964f-e874ae4c3efc-bundle" (OuterVolumeSpecName: "bundle") pod "87657d2f-ff9b-43aa-964f-e874ae4c3efc" (UID: "87657d2f-ff9b-43aa-964f-e874ae4c3efc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:02:19.382882 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:19.382853    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87657d2f-ff9b-43aa-964f-e874ae4c3efc-kube-api-access-9md74" (OuterVolumeSpecName: "kube-api-access-9md74") pod "87657d2f-ff9b-43aa-964f-e874ae4c3efc" (UID: "87657d2f-ff9b-43aa-964f-e874ae4c3efc"). InnerVolumeSpecName "kube-api-access-9md74". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:02:19.386214 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:19.386195    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87657d2f-ff9b-43aa-964f-e874ae4c3efc-util" (OuterVolumeSpecName: "util") pod "87657d2f-ff9b-43aa-964f-e874ae4c3efc" (UID: "87657d2f-ff9b-43aa-964f-e874ae4c3efc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:02:19.482163 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:19.482089    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/87657d2f-ff9b-43aa-964f-e874ae4c3efc-bundle\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:02:19.482163 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:19.482117    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9md74\" (UniqueName: \"kubernetes.io/projected/87657d2f-ff9b-43aa-964f-e874ae4c3efc-kube-api-access-9md74\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:02:19.482163 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:19.482126    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/87657d2f-ff9b-43aa-964f-e874ae4c3efc-util\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:02:20.148972 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:20.148898    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7b8kz"
Sep 10 21:02:20.149121 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:20.148895    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7b8kz" event={"ID":"87657d2f-ff9b-43aa-964f-e874ae4c3efc","Type":"ContainerDied","Data":"49b1f05a88a2f6e870b46f4afaa4bbd4a76f1be9853b6df4e7d44d40d6efa1fb"}
Sep 10 21:02:20.149121 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:20.149021    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="49b1f05a88a2f6e870b46f4afaa4bbd4a76f1be9853b6df4e7d44d40d6efa1fb"
Sep 10 21:02:20.405600 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:20.405524    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-jttwj"]
Sep 10 21:02:20.405965 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:20.405778    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87657d2f-ff9b-43aa-964f-e874ae4c3efc" containerName="pull"
Sep 10 21:02:20.405965 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:20.405792    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="87657d2f-ff9b-43aa-964f-e874ae4c3efc" containerName="pull"
Sep 10 21:02:20.405965 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:20.405804    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87657d2f-ff9b-43aa-964f-e874ae4c3efc" containerName="extract"
Sep 10 21:02:20.405965 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:20.405809    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="87657d2f-ff9b-43aa-964f-e874ae4c3efc" containerName="extract"
Sep 10 21:02:20.405965 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:20.405819    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87657d2f-ff9b-43aa-964f-e874ae4c3efc" containerName="util"
Sep 10 21:02:20.405965 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:20.405824    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="87657d2f-ff9b-43aa-964f-e874ae4c3efc" containerName="util"
Sep 10 21:02:20.405965 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:20.405890    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="87657d2f-ff9b-43aa-964f-e874ae4c3efc" containerName="extract"
Sep 10 21:02:20.407724 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:20.407706    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jttwj"
Sep 10 21:02:20.410033 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:20.410010    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-rhktp\""
Sep 10 21:02:20.410145 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:20.410127    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 10 21:02:20.410196 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:20.410165    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 10 21:02:20.418730 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:20.418708    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-jttwj"]
Sep 10 21:02:20.589970 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:20.589941    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7b0def18-5901-40b5-ae33-febf1e07126d-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-jttwj\" (UID: \"7b0def18-5901-40b5-ae33-febf1e07126d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jttwj"
Sep 10 21:02:20.590138 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:20.589987    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sm926\" (UniqueName: \"kubernetes.io/projected/7b0def18-5901-40b5-ae33-febf1e07126d-kube-api-access-sm926\") pod \"cert-manager-cainjector-559cdd8c87-jttwj\" (UID: \"7b0def18-5901-40b5-ae33-febf1e07126d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jttwj"
Sep 10 21:02:20.690646 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:20.690570    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sm926\" (UniqueName: \"kubernetes.io/projected/7b0def18-5901-40b5-ae33-febf1e07126d-kube-api-access-sm926\") pod \"cert-manager-cainjector-559cdd8c87-jttwj\" (UID: \"7b0def18-5901-40b5-ae33-febf1e07126d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jttwj"
Sep 10 21:02:20.690646 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:20.690635    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7b0def18-5901-40b5-ae33-febf1e07126d-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-jttwj\" (UID: \"7b0def18-5901-40b5-ae33-febf1e07126d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jttwj"
Sep 10 21:02:20.700125 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:20.700087    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7b0def18-5901-40b5-ae33-febf1e07126d-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-jttwj\" (UID: \"7b0def18-5901-40b5-ae33-febf1e07126d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jttwj"
Sep 10 21:02:20.700224 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:20.700210    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sm926\" (UniqueName: \"kubernetes.io/projected/7b0def18-5901-40b5-ae33-febf1e07126d-kube-api-access-sm926\") pod \"cert-manager-cainjector-559cdd8c87-jttwj\" (UID: \"7b0def18-5901-40b5-ae33-febf1e07126d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jttwj"
Sep 10 21:02:20.715972 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:20.715952    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jttwj"
Sep 10 21:02:20.985157 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:20.985127    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-jttwj"]
Sep 10 21:02:20.987540 ip-10-0-129-100 kubenswrapper[2564]: W0910 21:02:20.987507    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7b0def18_5901_40b5_ae33_febf1e07126d.slice/crio-e14a1d97e0593d534babef1bc0029b99ebd644e3dbff505a38ac6f1362286b00 WatchSource:0}: Error finding container e14a1d97e0593d534babef1bc0029b99ebd644e3dbff505a38ac6f1362286b00: Status 404 returned error can't find the container with id e14a1d97e0593d534babef1bc0029b99ebd644e3dbff505a38ac6f1362286b00
Sep 10 21:02:21.154592 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:21.154550    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jttwj" event={"ID":"7b0def18-5901-40b5-ae33-febf1e07126d","Type":"ContainerStarted","Data":"e14a1d97e0593d534babef1bc0029b99ebd644e3dbff505a38ac6f1362286b00"}
Sep 10 21:02:24.171858 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:24.171818    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jttwj" event={"ID":"7b0def18-5901-40b5-ae33-febf1e07126d","Type":"ContainerStarted","Data":"22fa299c9f04bbcf38ddfef1bae0420da8b619b225a72fe1ac0e89ce3bdcce4a"}
Sep 10 21:02:24.195736 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:24.195681    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jttwj" podStartSLOduration=1.831186238 podStartE2EDuration="4.195663575s" totalImagesPullingTime="2.364477337s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:02:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:02:24.19536141 +0000 UTC m=+324.882428690" watchObservedRunningTime="2026-09-10 21:02:24.195663575 +0000 UTC m=+324.882730857"
Sep 10 21:02:37.382665 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:37.382629    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn2clz"]
Sep 10 21:02:37.384902 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:37.384885    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn2clz"
Sep 10 21:02:37.387468 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:37.387440    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 21:02:37.387592 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:37.387482    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 21:02:37.388413 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:37.388377    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-tz9tv\""
Sep 10 21:02:37.399087 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:37.399062    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn2clz"]
Sep 10 21:02:37.403532 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:37.403511    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/67dfc171-15e8-4365-a3e0-78b6f1a0c893-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn2clz\" (UID: \"67dfc171-15e8-4365-a3e0-78b6f1a0c893\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn2clz"
Sep 10 21:02:37.403629 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:37.403554    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/67dfc171-15e8-4365-a3e0-78b6f1a0c893-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn2clz\" (UID: \"67dfc171-15e8-4365-a3e0-78b6f1a0c893\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn2clz"
Sep 10 21:02:37.403629 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:37.403580    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twgs7\" (UniqueName: \"kubernetes.io/projected/67dfc171-15e8-4365-a3e0-78b6f1a0c893-kube-api-access-twgs7\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn2clz\" (UID: \"67dfc171-15e8-4365-a3e0-78b6f1a0c893\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn2clz"
Sep 10 21:02:37.504631 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:37.504589    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/67dfc171-15e8-4365-a3e0-78b6f1a0c893-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn2clz\" (UID: \"67dfc171-15e8-4365-a3e0-78b6f1a0c893\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn2clz"
Sep 10 21:02:37.504826 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:37.504649    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/67dfc171-15e8-4365-a3e0-78b6f1a0c893-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn2clz\" (UID: \"67dfc171-15e8-4365-a3e0-78b6f1a0c893\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn2clz"
Sep 10 21:02:37.504826 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:37.504675    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twgs7\" (UniqueName: \"kubernetes.io/projected/67dfc171-15e8-4365-a3e0-78b6f1a0c893-kube-api-access-twgs7\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn2clz\" (UID: \"67dfc171-15e8-4365-a3e0-78b6f1a0c893\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn2clz"
Sep 10 21:02:37.505064 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:37.505040    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/67dfc171-15e8-4365-a3e0-78b6f1a0c893-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn2clz\" (UID: \"67dfc171-15e8-4365-a3e0-78b6f1a0c893\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn2clz"
Sep 10 21:02:37.505130 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:37.505072    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/67dfc171-15e8-4365-a3e0-78b6f1a0c893-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn2clz\" (UID: \"67dfc171-15e8-4365-a3e0-78b6f1a0c893\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn2clz"
Sep 10 21:02:37.514738 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:37.514711    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-twgs7\" (UniqueName: \"kubernetes.io/projected/67dfc171-15e8-4365-a3e0-78b6f1a0c893-kube-api-access-twgs7\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn2clz\" (UID: \"67dfc171-15e8-4365-a3e0-78b6f1a0c893\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn2clz"
Sep 10 21:02:37.693750 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:37.693660    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn2clz"
Sep 10 21:02:37.962787 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:37.962745    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn2clz"]
Sep 10 21:02:37.964983 ip-10-0-129-100 kubenswrapper[2564]: W0910 21:02:37.964950    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67dfc171_15e8_4365_a3e0_78b6f1a0c893.slice/crio-e3367f2f182859340f207fe9c4c717c23a2aff8097d80262aef54af8dd4f1bf6 WatchSource:0}: Error finding container e3367f2f182859340f207fe9c4c717c23a2aff8097d80262aef54af8dd4f1bf6: Status 404 returned error can't find the container with id e3367f2f182859340f207fe9c4c717c23a2aff8097d80262aef54af8dd4f1bf6
Sep 10 21:02:38.227268 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:38.227171    2564 generic.go:356] "Generic (PLEG): container finished" podID="67dfc171-15e8-4365-a3e0-78b6f1a0c893" containerID="146db1cf3e711adb974c21e15b14a1bb21bdcd548c137ec8edd25c8d95d170d1" exitCode=0
Sep 10 21:02:38.227432 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:38.227264    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn2clz" event={"ID":"67dfc171-15e8-4365-a3e0-78b6f1a0c893","Type":"ContainerDied","Data":"146db1cf3e711adb974c21e15b14a1bb21bdcd548c137ec8edd25c8d95d170d1"}
Sep 10 21:02:38.227432 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:38.227324    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn2clz" event={"ID":"67dfc171-15e8-4365-a3e0-78b6f1a0c893","Type":"ContainerStarted","Data":"e3367f2f182859340f207fe9c4c717c23a2aff8097d80262aef54af8dd4f1bf6"}
Sep 10 21:02:39.233623 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:39.233594    2564 generic.go:356] "Generic (PLEG): container finished" podID="67dfc171-15e8-4365-a3e0-78b6f1a0c893" containerID="9c5cacb72bb9547ad85721a247a91e69ba09b7993b753dd8c7c56c87e4485900" exitCode=0
Sep 10 21:02:39.234008 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:39.233663    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn2clz" event={"ID":"67dfc171-15e8-4365-a3e0-78b6f1a0c893","Type":"ContainerDied","Data":"9c5cacb72bb9547ad85721a247a91e69ba09b7993b753dd8c7c56c87e4485900"}
Sep 10 21:02:40.239321 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:40.239285    2564 generic.go:356] "Generic (PLEG): container finished" podID="67dfc171-15e8-4365-a3e0-78b6f1a0c893" containerID="d312bd88229bfacea5277b8bd92c27e5aa064c8352c2f277051a1c4696234662" exitCode=0
Sep 10 21:02:40.239703 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:40.239365    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn2clz" event={"ID":"67dfc171-15e8-4365-a3e0-78b6f1a0c893","Type":"ContainerDied","Data":"d312bd88229bfacea5277b8bd92c27e5aa064c8352c2f277051a1c4696234662"}
Sep 10 21:02:41.368594 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:41.368570    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn2clz"
Sep 10 21:02:41.434413 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:41.434385    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-twgs7\" (UniqueName: \"kubernetes.io/projected/67dfc171-15e8-4365-a3e0-78b6f1a0c893-kube-api-access-twgs7\") pod \"67dfc171-15e8-4365-a3e0-78b6f1a0c893\" (UID: \"67dfc171-15e8-4365-a3e0-78b6f1a0c893\") "
Sep 10 21:02:41.434413 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:41.434419    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/67dfc171-15e8-4365-a3e0-78b6f1a0c893-util\") pod \"67dfc171-15e8-4365-a3e0-78b6f1a0c893\" (UID: \"67dfc171-15e8-4365-a3e0-78b6f1a0c893\") "
Sep 10 21:02:41.434614 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:41.434457    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/67dfc171-15e8-4365-a3e0-78b6f1a0c893-bundle\") pod \"67dfc171-15e8-4365-a3e0-78b6f1a0c893\" (UID: \"67dfc171-15e8-4365-a3e0-78b6f1a0c893\") "
Sep 10 21:02:41.435218 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:41.435180    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67dfc171-15e8-4365-a3e0-78b6f1a0c893-bundle" (OuterVolumeSpecName: "bundle") pod "67dfc171-15e8-4365-a3e0-78b6f1a0c893" (UID: "67dfc171-15e8-4365-a3e0-78b6f1a0c893"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:02:41.436477 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:41.436451    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67dfc171-15e8-4365-a3e0-78b6f1a0c893-kube-api-access-twgs7" (OuterVolumeSpecName: "kube-api-access-twgs7") pod "67dfc171-15e8-4365-a3e0-78b6f1a0c893" (UID: "67dfc171-15e8-4365-a3e0-78b6f1a0c893"). InnerVolumeSpecName "kube-api-access-twgs7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:02:41.441691 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:41.441668    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67dfc171-15e8-4365-a3e0-78b6f1a0c893-util" (OuterVolumeSpecName: "util") pod "67dfc171-15e8-4365-a3e0-78b6f1a0c893" (UID: "67dfc171-15e8-4365-a3e0-78b6f1a0c893"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:02:41.535545 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:41.535476    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-twgs7\" (UniqueName: \"kubernetes.io/projected/67dfc171-15e8-4365-a3e0-78b6f1a0c893-kube-api-access-twgs7\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:02:41.535545 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:41.535501    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/67dfc171-15e8-4365-a3e0-78b6f1a0c893-util\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:02:41.535545 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:41.535510    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/67dfc171-15e8-4365-a3e0-78b6f1a0c893-bundle\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:02:42.248761 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:42.248680    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn2clz" event={"ID":"67dfc171-15e8-4365-a3e0-78b6f1a0c893","Type":"ContainerDied","Data":"e3367f2f182859340f207fe9c4c717c23a2aff8097d80262aef54af8dd4f1bf6"}
Sep 10 21:02:42.248761 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:42.248707    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn2clz"
Sep 10 21:02:42.248761 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:42.248725    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e3367f2f182859340f207fe9c4c717c23a2aff8097d80262aef54af8dd4f1bf6"
Sep 10 21:02:46.935361 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:46.935322    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rp5vk"]
Sep 10 21:02:46.935819 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:46.935629    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67dfc171-15e8-4365-a3e0-78b6f1a0c893" containerName="extract"
Sep 10 21:02:46.935819 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:46.935641    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="67dfc171-15e8-4365-a3e0-78b6f1a0c893" containerName="extract"
Sep 10 21:02:46.935819 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:46.935649    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67dfc171-15e8-4365-a3e0-78b6f1a0c893" containerName="pull"
Sep 10 21:02:46.935819 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:46.935655    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="67dfc171-15e8-4365-a3e0-78b6f1a0c893" containerName="pull"
Sep 10 21:02:46.935819 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:46.935664    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67dfc171-15e8-4365-a3e0-78b6f1a0c893" containerName="util"
Sep 10 21:02:46.935819 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:46.935668    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="67dfc171-15e8-4365-a3e0-78b6f1a0c893" containerName="util"
Sep 10 21:02:46.935819 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:46.935718    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="67dfc171-15e8-4365-a3e0-78b6f1a0c893" containerName="extract"
Sep 10 21:02:46.940184 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:46.940167    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rp5vk"
Sep 10 21:02:46.946458 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:46.946437    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 21:02:46.947459 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:46.947440    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-tz9tv\""
Sep 10 21:02:46.947550 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:46.947528    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 21:02:46.955890 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:46.955860    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rp5vk"]
Sep 10 21:02:46.976335 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:46.976298    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/34fb3472-760f-496b-b37a-579891b93b81-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rp5vk\" (UID: \"34fb3472-760f-496b-b37a-579891b93b81\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rp5vk"
Sep 10 21:02:46.976478 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:46.976339    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrkhs\" (UniqueName: \"kubernetes.io/projected/34fb3472-760f-496b-b37a-579891b93b81-kube-api-access-qrkhs\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rp5vk\" (UID: \"34fb3472-760f-496b-b37a-579891b93b81\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rp5vk"
Sep 10 21:02:46.976478 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:46.976382    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/34fb3472-760f-496b-b37a-579891b93b81-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rp5vk\" (UID: \"34fb3472-760f-496b-b37a-579891b93b81\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rp5vk"
Sep 10 21:02:47.077108 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:47.077071    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrkhs\" (UniqueName: \"kubernetes.io/projected/34fb3472-760f-496b-b37a-579891b93b81-kube-api-access-qrkhs\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rp5vk\" (UID: \"34fb3472-760f-496b-b37a-579891b93b81\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rp5vk"
Sep 10 21:02:47.077315 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:47.077125    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/34fb3472-760f-496b-b37a-579891b93b81-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rp5vk\" (UID: \"34fb3472-760f-496b-b37a-579891b93b81\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rp5vk"
Sep 10 21:02:47.077315 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:47.077191    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/34fb3472-760f-496b-b37a-579891b93b81-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rp5vk\" (UID: \"34fb3472-760f-496b-b37a-579891b93b81\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rp5vk"
Sep 10 21:02:47.077544 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:47.077523    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/34fb3472-760f-496b-b37a-579891b93b81-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rp5vk\" (UID: \"34fb3472-760f-496b-b37a-579891b93b81\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rp5vk"
Sep 10 21:02:47.077638 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:47.077618    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/34fb3472-760f-496b-b37a-579891b93b81-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rp5vk\" (UID: \"34fb3472-760f-496b-b37a-579891b93b81\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rp5vk"
Sep 10 21:02:47.095634 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:47.095601    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrkhs\" (UniqueName: \"kubernetes.io/projected/34fb3472-760f-496b-b37a-579891b93b81-kube-api-access-qrkhs\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rp5vk\" (UID: \"34fb3472-760f-496b-b37a-579891b93b81\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rp5vk"
Sep 10 21:02:47.249157 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:47.249072    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rp5vk"
Sep 10 21:02:47.527019 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:47.526951    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rp5vk"]
Sep 10 21:02:47.529938 ip-10-0-129-100 kubenswrapper[2564]: W0910 21:02:47.529896    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34fb3472_760f_496b_b37a_579891b93b81.slice/crio-8c9d520ab24a3b30614b88410e74349312de5b226c953eb18ce3ed6ddc8e0757 WatchSource:0}: Error finding container 8c9d520ab24a3b30614b88410e74349312de5b226c953eb18ce3ed6ddc8e0757: Status 404 returned error can't find the container with id 8c9d520ab24a3b30614b88410e74349312de5b226c953eb18ce3ed6ddc8e0757
Sep 10 21:02:48.274118 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:48.274079    2564 generic.go:356] "Generic (PLEG): container finished" podID="34fb3472-760f-496b-b37a-579891b93b81" containerID="caeef2c24887fbb0f58bd2c18ad4cb4e228c70879fab3721c58825ec8d133b9f" exitCode=0
Sep 10 21:02:48.274542 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:48.274138    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rp5vk" event={"ID":"34fb3472-760f-496b-b37a-579891b93b81","Type":"ContainerDied","Data":"caeef2c24887fbb0f58bd2c18ad4cb4e228c70879fab3721c58825ec8d133b9f"}
Sep 10 21:02:48.274542 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:48.274177    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rp5vk" event={"ID":"34fb3472-760f-496b-b37a-579891b93b81","Type":"ContainerStarted","Data":"8c9d520ab24a3b30614b88410e74349312de5b226c953eb18ce3ed6ddc8e0757"}
Sep 10 21:02:48.832805 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:48.832768    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-769bdd6b4-4w25p"]
Sep 10 21:02:48.834879 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:48.834859    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-769bdd6b4-4w25p"
Sep 10 21:02:48.839607 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:48.839581    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 10 21:02:48.844099 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:48.844085    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 10 21:02:48.844426 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:48.844411    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 10 21:02:48.845373 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:48.845357    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-wgnwx\""
Sep 10 21:02:48.845416 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:48.845379    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 10 21:02:48.866674 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:48.866652    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-769bdd6b4-4w25p"]
Sep 10 21:02:48.889953 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:48.889916    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/32a7c0c7-3e70-46c0-a59f-68a66599268d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-769bdd6b4-4w25p\" (UID: \"32a7c0c7-3e70-46c0-a59f-68a66599268d\") " pod="opendatahub/opendatahub-operator-controller-manager-769bdd6b4-4w25p"
Sep 10 21:02:48.889953 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:48.889961    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sl7xg\" (UniqueName: \"kubernetes.io/projected/32a7c0c7-3e70-46c0-a59f-68a66599268d-kube-api-access-sl7xg\") pod \"opendatahub-operator-controller-manager-769bdd6b4-4w25p\" (UID: \"32a7c0c7-3e70-46c0-a59f-68a66599268d\") " pod="opendatahub/opendatahub-operator-controller-manager-769bdd6b4-4w25p"
Sep 10 21:02:48.890132 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:48.889983    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32a7c0c7-3e70-46c0-a59f-68a66599268d-tmp\") pod \"opendatahub-operator-controller-manager-769bdd6b4-4w25p\" (UID: \"32a7c0c7-3e70-46c0-a59f-68a66599268d\") " pod="opendatahub/opendatahub-operator-controller-manager-769bdd6b4-4w25p"
Sep 10 21:02:48.890132 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:48.890043    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/32a7c0c7-3e70-46c0-a59f-68a66599268d-manifests\") pod \"opendatahub-operator-controller-manager-769bdd6b4-4w25p\" (UID: \"32a7c0c7-3e70-46c0-a59f-68a66599268d\") " pod="opendatahub/opendatahub-operator-controller-manager-769bdd6b4-4w25p"
Sep 10 21:02:48.890132 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:48.890078    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/32a7c0c7-3e70-46c0-a59f-68a66599268d-webhook-cert\") pod \"opendatahub-operator-controller-manager-769bdd6b4-4w25p\" (UID: \"32a7c0c7-3e70-46c0-a59f-68a66599268d\") " pod="opendatahub/opendatahub-operator-controller-manager-769bdd6b4-4w25p"
Sep 10 21:02:48.991344 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:48.991248    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/32a7c0c7-3e70-46c0-a59f-68a66599268d-webhook-cert\") pod \"opendatahub-operator-controller-manager-769bdd6b4-4w25p\" (UID: \"32a7c0c7-3e70-46c0-a59f-68a66599268d\") " pod="opendatahub/opendatahub-operator-controller-manager-769bdd6b4-4w25p"
Sep 10 21:02:48.991504 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:48.991354    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/32a7c0c7-3e70-46c0-a59f-68a66599268d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-769bdd6b4-4w25p\" (UID: \"32a7c0c7-3e70-46c0-a59f-68a66599268d\") " pod="opendatahub/opendatahub-operator-controller-manager-769bdd6b4-4w25p"
Sep 10 21:02:48.991504 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:48.991388    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sl7xg\" (UniqueName: \"kubernetes.io/projected/32a7c0c7-3e70-46c0-a59f-68a66599268d-kube-api-access-sl7xg\") pod \"opendatahub-operator-controller-manager-769bdd6b4-4w25p\" (UID: \"32a7c0c7-3e70-46c0-a59f-68a66599268d\") " pod="opendatahub/opendatahub-operator-controller-manager-769bdd6b4-4w25p"
Sep 10 21:02:48.991504 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:48.991419    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32a7c0c7-3e70-46c0-a59f-68a66599268d-tmp\") pod \"opendatahub-operator-controller-manager-769bdd6b4-4w25p\" (UID: \"32a7c0c7-3e70-46c0-a59f-68a66599268d\") " pod="opendatahub/opendatahub-operator-controller-manager-769bdd6b4-4w25p"
Sep 10 21:02:48.991504 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:48.991452    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/32a7c0c7-3e70-46c0-a59f-68a66599268d-manifests\") pod \"opendatahub-operator-controller-manager-769bdd6b4-4w25p\" (UID: \"32a7c0c7-3e70-46c0-a59f-68a66599268d\") " pod="opendatahub/opendatahub-operator-controller-manager-769bdd6b4-4w25p"
Sep 10 21:02:48.991843 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:48.991809    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/32a7c0c7-3e70-46c0-a59f-68a66599268d-manifests\") pod \"opendatahub-operator-controller-manager-769bdd6b4-4w25p\" (UID: \"32a7c0c7-3e70-46c0-a59f-68a66599268d\") " pod="opendatahub/opendatahub-operator-controller-manager-769bdd6b4-4w25p"
Sep 10 21:02:48.993754 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:48.993725    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32a7c0c7-3e70-46c0-a59f-68a66599268d-tmp\") pod \"opendatahub-operator-controller-manager-769bdd6b4-4w25p\" (UID: \"32a7c0c7-3e70-46c0-a59f-68a66599268d\") " pod="opendatahub/opendatahub-operator-controller-manager-769bdd6b4-4w25p"
Sep 10 21:02:48.993867 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:48.993783    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/32a7c0c7-3e70-46c0-a59f-68a66599268d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-769bdd6b4-4w25p\" (UID: \"32a7c0c7-3e70-46c0-a59f-68a66599268d\") " pod="opendatahub/opendatahub-operator-controller-manager-769bdd6b4-4w25p"
Sep 10 21:02:48.993924 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:48.993874    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/32a7c0c7-3e70-46c0-a59f-68a66599268d-webhook-cert\") pod \"opendatahub-operator-controller-manager-769bdd6b4-4w25p\" (UID: \"32a7c0c7-3e70-46c0-a59f-68a66599268d\") " pod="opendatahub/opendatahub-operator-controller-manager-769bdd6b4-4w25p"
Sep 10 21:02:49.003470 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:49.003447    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sl7xg\" (UniqueName: \"kubernetes.io/projected/32a7c0c7-3e70-46c0-a59f-68a66599268d-kube-api-access-sl7xg\") pod \"opendatahub-operator-controller-manager-769bdd6b4-4w25p\" (UID: \"32a7c0c7-3e70-46c0-a59f-68a66599268d\") " pod="opendatahub/opendatahub-operator-controller-manager-769bdd6b4-4w25p"
Sep 10 21:02:49.166485 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:49.166441    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-769bdd6b4-4w25p"
Sep 10 21:02:49.280172 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:49.280083    2564 generic.go:356] "Generic (PLEG): container finished" podID="34fb3472-760f-496b-b37a-579891b93b81" containerID="b1af02f67d382c2dcbec2101eb2c4ba25cf601b77e924be6d8eae04210a1ecac" exitCode=0
Sep 10 21:02:49.280172 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:49.280121    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rp5vk" event={"ID":"34fb3472-760f-496b-b37a-579891b93b81","Type":"ContainerDied","Data":"b1af02f67d382c2dcbec2101eb2c4ba25cf601b77e924be6d8eae04210a1ecac"}
Sep 10 21:02:49.452165 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:49.452143    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-769bdd6b4-4w25p"]
Sep 10 21:02:49.470979 ip-10-0-129-100 kubenswrapper[2564]: W0910 21:02:49.470948    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32a7c0c7_3e70_46c0_a59f_68a66599268d.slice/crio-81c233ad35421988169a955d3d46b786c33bfe8e0e0b0fdb5731eb12e60bceac WatchSource:0}: Error finding container 81c233ad35421988169a955d3d46b786c33bfe8e0e0b0fdb5731eb12e60bceac: Status 404 returned error can't find the container with id 81c233ad35421988169a955d3d46b786c33bfe8e0e0b0fdb5731eb12e60bceac
Sep 10 21:02:50.288725 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:50.288689    2564 generic.go:356] "Generic (PLEG): container finished" podID="34fb3472-760f-496b-b37a-579891b93b81" containerID="86d1ff0385cd3ba3129aa82d3e6a7ee4995692c7fadee6c8a457cc63b4087cfe" exitCode=0
Sep 10 21:02:50.289184 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:50.288724    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rp5vk" event={"ID":"34fb3472-760f-496b-b37a-579891b93b81","Type":"ContainerDied","Data":"86d1ff0385cd3ba3129aa82d3e6a7ee4995692c7fadee6c8a457cc63b4087cfe"}
Sep 10 21:02:50.290534 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:50.290494    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-769bdd6b4-4w25p" event={"ID":"32a7c0c7-3e70-46c0-a59f-68a66599268d","Type":"ContainerStarted","Data":"81c233ad35421988169a955d3d46b786c33bfe8e0e0b0fdb5731eb12e60bceac"}
Sep 10 21:02:52.246976 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:52.246952    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rp5vk"
Sep 10 21:02:52.303357 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:52.303331    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rp5vk" event={"ID":"34fb3472-760f-496b-b37a-579891b93b81","Type":"ContainerDied","Data":"8c9d520ab24a3b30614b88410e74349312de5b226c953eb18ce3ed6ddc8e0757"}
Sep 10 21:02:52.303357 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:52.303350    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0rp5vk"
Sep 10 21:02:52.303493 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:52.303377    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8c9d520ab24a3b30614b88410e74349312de5b226c953eb18ce3ed6ddc8e0757"
Sep 10 21:02:52.318672 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:52.318651    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/34fb3472-760f-496b-b37a-579891b93b81-util\") pod \"34fb3472-760f-496b-b37a-579891b93b81\" (UID: \"34fb3472-760f-496b-b37a-579891b93b81\") "
Sep 10 21:02:52.318791 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:52.318699    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qrkhs\" (UniqueName: \"kubernetes.io/projected/34fb3472-760f-496b-b37a-579891b93b81-kube-api-access-qrkhs\") pod \"34fb3472-760f-496b-b37a-579891b93b81\" (UID: \"34fb3472-760f-496b-b37a-579891b93b81\") "
Sep 10 21:02:52.318791 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:52.318742    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/34fb3472-760f-496b-b37a-579891b93b81-bundle\") pod \"34fb3472-760f-496b-b37a-579891b93b81\" (UID: \"34fb3472-760f-496b-b37a-579891b93b81\") "
Sep 10 21:02:52.319684 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:52.319659    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34fb3472-760f-496b-b37a-579891b93b81-bundle" (OuterVolumeSpecName: "bundle") pod "34fb3472-760f-496b-b37a-579891b93b81" (UID: "34fb3472-760f-496b-b37a-579891b93b81"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:02:52.320793 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:52.320766    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34fb3472-760f-496b-b37a-579891b93b81-kube-api-access-qrkhs" (OuterVolumeSpecName: "kube-api-access-qrkhs") pod "34fb3472-760f-496b-b37a-579891b93b81" (UID: "34fb3472-760f-496b-b37a-579891b93b81"). InnerVolumeSpecName "kube-api-access-qrkhs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:02:52.323907 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:52.323875    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34fb3472-760f-496b-b37a-579891b93b81-util" (OuterVolumeSpecName: "util") pod "34fb3472-760f-496b-b37a-579891b93b81" (UID: "34fb3472-760f-496b-b37a-579891b93b81"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:02:52.419633 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:52.419595    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qrkhs\" (UniqueName: \"kubernetes.io/projected/34fb3472-760f-496b-b37a-579891b93b81-kube-api-access-qrkhs\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:02:52.419633 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:52.419626    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/34fb3472-760f-496b-b37a-579891b93b81-bundle\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:02:52.419633 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:52.419636    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/34fb3472-760f-496b-b37a-579891b93b81-util\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:02:53.310257 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:53.310210    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-769bdd6b4-4w25p" event={"ID":"32a7c0c7-3e70-46c0-a59f-68a66599268d","Type":"ContainerStarted","Data":"860e26f039151a53a49cdead41fb51fb20a69c5dfd3b77115e120ea61c43edb8"}
Sep 10 21:02:54.315727 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:54.315690    2564 generic.go:356] "Generic (PLEG): container finished" podID="32a7c0c7-3e70-46c0-a59f-68a66599268d" containerID="860e26f039151a53a49cdead41fb51fb20a69c5dfd3b77115e120ea61c43edb8" exitCode=0
Sep 10 21:02:54.316149 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:54.315783    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-769bdd6b4-4w25p" event={"ID":"32a7c0c7-3e70-46c0-a59f-68a66599268d","Type":"ContainerDied","Data":"860e26f039151a53a49cdead41fb51fb20a69c5dfd3b77115e120ea61c43edb8"}
Sep 10 21:02:55.321992 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:55.321953    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-769bdd6b4-4w25p" event={"ID":"32a7c0c7-3e70-46c0-a59f-68a66599268d","Type":"ContainerStarted","Data":"761dc18f8126d682c6c886c93857260523faeb8a65a0e1fd250dc134a682e00d"}
Sep 10 21:02:55.322388 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:55.322036    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-769bdd6b4-4w25p"
Sep 10 21:02:55.356902 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:02:55.356839    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-769bdd6b4-4w25p" podStartSLOduration=3.110856619 podStartE2EDuration="7.356824692s" totalImagesPullingTime="3.198767631s" totalInitContainerRuntime="1.047200442s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:02:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:02:55.356569201 +0000 UTC m=+356.043636478" watchObservedRunningTime="2026-09-10 21:02:55.356824692 +0000 UTC m=+356.043891972"
Sep 10 21:03:06.328382 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:06.328352    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-769bdd6b4-4w25p"
Sep 10 21:03:08.388882 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:08.388849    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-98c4dbc44-cqktq"]
Sep 10 21:03:08.389284 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:08.389118    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34fb3472-760f-496b-b37a-579891b93b81" containerName="extract"
Sep 10 21:03:08.389284 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:08.389128    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="34fb3472-760f-496b-b37a-579891b93b81" containerName="extract"
Sep 10 21:03:08.389284 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:08.389137    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34fb3472-760f-496b-b37a-579891b93b81" containerName="pull"
Sep 10 21:03:08.389284 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:08.389143    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="34fb3472-760f-496b-b37a-579891b93b81" containerName="pull"
Sep 10 21:03:08.389284 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:08.389149    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34fb3472-760f-496b-b37a-579891b93b81" containerName="util"
Sep 10 21:03:08.389284 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:08.389155    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="34fb3472-760f-496b-b37a-579891b93b81" containerName="util"
Sep 10 21:03:08.389284 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:08.389208    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="34fb3472-760f-496b-b37a-579891b93b81" containerName="extract"
Sep 10 21:03:08.394633 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:08.394611    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-98c4dbc44-cqktq"
Sep 10 21:03:08.398835 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:08.398812    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-fh2kc\""
Sep 10 21:03:08.398969 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:08.398888    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 10 21:03:08.399128 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:08.399105    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 10 21:03:08.410044 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:08.410017    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-98c4dbc44-cqktq"]
Sep 10 21:03:08.435715 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:08.435663    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a116643c-dd31-4836-9d92-20875ee44512-tls-certs\") pod \"kube-auth-proxy-98c4dbc44-cqktq\" (UID: \"a116643c-dd31-4836-9d92-20875ee44512\") " pod="openshift-ingress/kube-auth-proxy-98c4dbc44-cqktq"
Sep 10 21:03:08.435715 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:08.435707    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a116643c-dd31-4836-9d92-20875ee44512-tmp\") pod \"kube-auth-proxy-98c4dbc44-cqktq\" (UID: \"a116643c-dd31-4836-9d92-20875ee44512\") " pod="openshift-ingress/kube-auth-proxy-98c4dbc44-cqktq"
Sep 10 21:03:08.436100 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:08.435765    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9t2bp\" (UniqueName: \"kubernetes.io/projected/a116643c-dd31-4836-9d92-20875ee44512-kube-api-access-9t2bp\") pod \"kube-auth-proxy-98c4dbc44-cqktq\" (UID: \"a116643c-dd31-4836-9d92-20875ee44512\") " pod="openshift-ingress/kube-auth-proxy-98c4dbc44-cqktq"
Sep 10 21:03:08.536861 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:08.536823    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9t2bp\" (UniqueName: \"kubernetes.io/projected/a116643c-dd31-4836-9d92-20875ee44512-kube-api-access-9t2bp\") pod \"kube-auth-proxy-98c4dbc44-cqktq\" (UID: \"a116643c-dd31-4836-9d92-20875ee44512\") " pod="openshift-ingress/kube-auth-proxy-98c4dbc44-cqktq"
Sep 10 21:03:08.537027 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:08.536887    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a116643c-dd31-4836-9d92-20875ee44512-tls-certs\") pod \"kube-auth-proxy-98c4dbc44-cqktq\" (UID: \"a116643c-dd31-4836-9d92-20875ee44512\") " pod="openshift-ingress/kube-auth-proxy-98c4dbc44-cqktq"
Sep 10 21:03:08.537027 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:08.536911    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a116643c-dd31-4836-9d92-20875ee44512-tmp\") pod \"kube-auth-proxy-98c4dbc44-cqktq\" (UID: \"a116643c-dd31-4836-9d92-20875ee44512\") " pod="openshift-ingress/kube-auth-proxy-98c4dbc44-cqktq"
Sep 10 21:03:08.537101 ip-10-0-129-100 kubenswrapper[2564]: E0910 21:03:08.537044    2564 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Sep 10 21:03:08.537142 ip-10-0-129-100 kubenswrapper[2564]: E0910 21:03:08.537124    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a116643c-dd31-4836-9d92-20875ee44512-tls-certs podName:a116643c-dd31-4836-9d92-20875ee44512 nodeName:}" failed. No retries permitted until 2026-09-10 21:03:09.037102412 +0000 UTC m=+369.724169685 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/a116643c-dd31-4836-9d92-20875ee44512-tls-certs") pod "kube-auth-proxy-98c4dbc44-cqktq" (UID: "a116643c-dd31-4836-9d92-20875ee44512") : secret "kube-auth-proxy-tls" not found
Sep 10 21:03:08.539259 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:08.539216    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a116643c-dd31-4836-9d92-20875ee44512-tmp\") pod \"kube-auth-proxy-98c4dbc44-cqktq\" (UID: \"a116643c-dd31-4836-9d92-20875ee44512\") " pod="openshift-ingress/kube-auth-proxy-98c4dbc44-cqktq"
Sep 10 21:03:08.554421 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:08.554393    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9t2bp\" (UniqueName: \"kubernetes.io/projected/a116643c-dd31-4836-9d92-20875ee44512-kube-api-access-9t2bp\") pod \"kube-auth-proxy-98c4dbc44-cqktq\" (UID: \"a116643c-dd31-4836-9d92-20875ee44512\") " pod="openshift-ingress/kube-auth-proxy-98c4dbc44-cqktq"
Sep 10 21:03:09.040991 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:09.040945    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a116643c-dd31-4836-9d92-20875ee44512-tls-certs\") pod \"kube-auth-proxy-98c4dbc44-cqktq\" (UID: \"a116643c-dd31-4836-9d92-20875ee44512\") " pod="openshift-ingress/kube-auth-proxy-98c4dbc44-cqktq"
Sep 10 21:03:09.043445 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:09.043421    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a116643c-dd31-4836-9d92-20875ee44512-tls-certs\") pod \"kube-auth-proxy-98c4dbc44-cqktq\" (UID: \"a116643c-dd31-4836-9d92-20875ee44512\") " pod="openshift-ingress/kube-auth-proxy-98c4dbc44-cqktq"
Sep 10 21:03:09.303935 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:09.303905    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-98c4dbc44-cqktq"
Sep 10 21:03:09.581215 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:09.581123    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-98c4dbc44-cqktq"]
Sep 10 21:03:09.583996 ip-10-0-129-100 kubenswrapper[2564]: W0910 21:03:09.583969    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda116643c_dd31_4836_9d92_20875ee44512.slice/crio-46b42a0355f633c9d41cc1c54653e6dba16a21bf4790ead3322e7419f10ecccc WatchSource:0}: Error finding container 46b42a0355f633c9d41cc1c54653e6dba16a21bf4790ead3322e7419f10ecccc: Status 404 returned error can't find the container with id 46b42a0355f633c9d41cc1c54653e6dba16a21bf4790ead3322e7419f10ecccc
Sep 10 21:03:10.398109 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:10.398068    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-98c4dbc44-cqktq" event={"ID":"a116643c-dd31-4836-9d92-20875ee44512","Type":"ContainerStarted","Data":"46b42a0355f633c9d41cc1c54653e6dba16a21bf4790ead3322e7419f10ecccc"}
Sep 10 21:03:10.398354 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:10.398259    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-96vj2"]
Sep 10 21:03:10.400814 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:10.400791    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-96vj2"
Sep 10 21:03:10.403721 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:10.403495    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-vkmxc\""
Sep 10 21:03:10.403721 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:10.403531    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 10 21:03:10.404262 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:10.404146    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 10 21:03:10.404262 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:10.404206    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 10 21:03:10.404262 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:10.404209    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 10 21:03:10.416204 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:10.416176    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-96vj2"]
Sep 10 21:03:10.453147 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:10.453112    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f1027efb-edf7-4d92-b05c-a2f285ae81db-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-96vj2\" (UID: \"f1027efb-edf7-4d92-b05c-a2f285ae81db\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-96vj2"
Sep 10 21:03:10.453399 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:10.453164    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f1027efb-edf7-4d92-b05c-a2f285ae81db-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-96vj2\" (UID: \"f1027efb-edf7-4d92-b05c-a2f285ae81db\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-96vj2"
Sep 10 21:03:10.453399 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:10.453217    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f1027efb-edf7-4d92-b05c-a2f285ae81db-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-96vj2\" (UID: \"f1027efb-edf7-4d92-b05c-a2f285ae81db\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-96vj2"
Sep 10 21:03:10.453399 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:10.453280    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f1027efb-edf7-4d92-b05c-a2f285ae81db-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-96vj2\" (UID: \"f1027efb-edf7-4d92-b05c-a2f285ae81db\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-96vj2"
Sep 10 21:03:10.453399 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:10.453319    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gl6lk\" (UniqueName: \"kubernetes.io/projected/f1027efb-edf7-4d92-b05c-a2f285ae81db-kube-api-access-gl6lk\") pod \"istiod-openshift-gateway-7b7995d5cd-96vj2\" (UID: \"f1027efb-edf7-4d92-b05c-a2f285ae81db\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-96vj2"
Sep 10 21:03:10.453399 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:10.453352    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f1027efb-edf7-4d92-b05c-a2f285ae81db-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-96vj2\" (UID: \"f1027efb-edf7-4d92-b05c-a2f285ae81db\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-96vj2"
Sep 10 21:03:10.453725 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:10.453449    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f1027efb-edf7-4d92-b05c-a2f285ae81db-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-96vj2\" (UID: \"f1027efb-edf7-4d92-b05c-a2f285ae81db\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-96vj2"
Sep 10 21:03:10.554902 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:10.554862    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f1027efb-edf7-4d92-b05c-a2f285ae81db-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-96vj2\" (UID: \"f1027efb-edf7-4d92-b05c-a2f285ae81db\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-96vj2"
Sep 10 21:03:10.555075 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:10.554939    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f1027efb-edf7-4d92-b05c-a2f285ae81db-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-96vj2\" (UID: \"f1027efb-edf7-4d92-b05c-a2f285ae81db\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-96vj2"
Sep 10 21:03:10.555075 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:10.554967    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f1027efb-edf7-4d92-b05c-a2f285ae81db-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-96vj2\" (UID: \"f1027efb-edf7-4d92-b05c-a2f285ae81db\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-96vj2"
Sep 10 21:03:10.555075 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:10.555000    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gl6lk\" (UniqueName: \"kubernetes.io/projected/f1027efb-edf7-4d92-b05c-a2f285ae81db-kube-api-access-gl6lk\") pod \"istiod-openshift-gateway-7b7995d5cd-96vj2\" (UID: \"f1027efb-edf7-4d92-b05c-a2f285ae81db\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-96vj2"
Sep 10 21:03:10.555075 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:10.555027    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f1027efb-edf7-4d92-b05c-a2f285ae81db-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-96vj2\" (UID: \"f1027efb-edf7-4d92-b05c-a2f285ae81db\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-96vj2"
Sep 10 21:03:10.555664 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:10.555063    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f1027efb-edf7-4d92-b05c-a2f285ae81db-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-96vj2\" (UID: \"f1027efb-edf7-4d92-b05c-a2f285ae81db\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-96vj2"
Sep 10 21:03:10.555664 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:10.555647    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f1027efb-edf7-4d92-b05c-a2f285ae81db-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-96vj2\" (UID: \"f1027efb-edf7-4d92-b05c-a2f285ae81db\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-96vj2"
Sep 10 21:03:10.555968 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:10.555919    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f1027efb-edf7-4d92-b05c-a2f285ae81db-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-96vj2\" (UID: \"f1027efb-edf7-4d92-b05c-a2f285ae81db\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-96vj2"
Sep 10 21:03:10.558310 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:10.558160    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f1027efb-edf7-4d92-b05c-a2f285ae81db-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-96vj2\" (UID: \"f1027efb-edf7-4d92-b05c-a2f285ae81db\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-96vj2"
Sep 10 21:03:10.558427 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:10.558309    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f1027efb-edf7-4d92-b05c-a2f285ae81db-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-96vj2\" (UID: \"f1027efb-edf7-4d92-b05c-a2f285ae81db\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-96vj2"
Sep 10 21:03:10.558504 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:10.558417    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f1027efb-edf7-4d92-b05c-a2f285ae81db-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-96vj2\" (UID: \"f1027efb-edf7-4d92-b05c-a2f285ae81db\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-96vj2"
Sep 10 21:03:10.559628 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:10.559577    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f1027efb-edf7-4d92-b05c-a2f285ae81db-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-96vj2\" (UID: \"f1027efb-edf7-4d92-b05c-a2f285ae81db\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-96vj2"
Sep 10 21:03:10.564862 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:10.564837    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f1027efb-edf7-4d92-b05c-a2f285ae81db-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-96vj2\" (UID: \"f1027efb-edf7-4d92-b05c-a2f285ae81db\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-96vj2"
Sep 10 21:03:10.565064 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:10.565042    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gl6lk\" (UniqueName: \"kubernetes.io/projected/f1027efb-edf7-4d92-b05c-a2f285ae81db-kube-api-access-gl6lk\") pod \"istiod-openshift-gateway-7b7995d5cd-96vj2\" (UID: \"f1027efb-edf7-4d92-b05c-a2f285ae81db\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-96vj2"
Sep 10 21:03:10.715466 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:10.715386    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-96vj2"
Sep 10 21:03:12.222726 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:12.222697    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-96vj2"]
Sep 10 21:03:12.225074 ip-10-0-129-100 kubenswrapper[2564]: W0910 21:03:12.225041    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1027efb_edf7_4d92_b05c_a2f285ae81db.slice/crio-8987da4fd76942e1b47447910b8294aea25e2b463153fbb9176f7be05aca8119 WatchSource:0}: Error finding container 8987da4fd76942e1b47447910b8294aea25e2b463153fbb9176f7be05aca8119: Status 404 returned error can't find the container with id 8987da4fd76942e1b47447910b8294aea25e2b463153fbb9176f7be05aca8119
Sep 10 21:03:12.409298 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:12.409261    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-98c4dbc44-cqktq" event={"ID":"a116643c-dd31-4836-9d92-20875ee44512","Type":"ContainerStarted","Data":"951a865b76c353de9a8df76dde7a110ed1927ed70da02caa124985d4cec00187"}
Sep 10 21:03:12.410542 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:12.410516    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-96vj2" event={"ID":"f1027efb-edf7-4d92-b05c-a2f285ae81db","Type":"ContainerStarted","Data":"8987da4fd76942e1b47447910b8294aea25e2b463153fbb9176f7be05aca8119"}
Sep 10 21:03:12.428336 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:12.428278    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-98c4dbc44-cqktq" podStartSLOduration=2.039338854 podStartE2EDuration="4.428261456s" totalImagesPullingTime="2.388922602s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:03:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:03:12.427066918 +0000 UTC m=+373.114134199" watchObservedRunningTime="2026-09-10 21:03:12.428261456 +0000 UTC m=+373.115328734"
Sep 10 21:03:14.640609 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:14.640568    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 10 21:03:14.640914 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:14.640637    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 10 21:03:15.426746 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:15.426712    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-96vj2" event={"ID":"f1027efb-edf7-4d92-b05c-a2f285ae81db","Type":"ContainerStarted","Data":"bc40e1bca38ee972581a597806b7578157a9f741753a7b1a604ca1d64dbcb964"}
Sep 10 21:03:15.426946 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:15.426895    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-96vj2"
Sep 10 21:03:15.428642 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:15.428612    2564 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-96vj2 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 21:03:15.428748 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:15.428663    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-96vj2" podUID="f1027efb-edf7-4d92-b05c-a2f285ae81db" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 21:03:15.451112 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:15.451065    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-96vj2" podStartSLOduration=3.037876691 podStartE2EDuration="5.451052921s" totalImagesPullingTime="2.41317623s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:03:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:03:15.449804667 +0000 UTC m=+376.136871945" watchObservedRunningTime="2026-09-10 21:03:15.451052921 +0000 UTC m=+376.138120200"
Sep 10 21:03:16.431312 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:16.431284    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-96vj2"
Sep 10 21:03:27.998086 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:27.998054    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-tb9xl"]
Sep 10 21:03:28.008716 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:28.008688    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tb9xl"
Sep 10 21:03:28.019594 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:28.019569    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-tb9xl"]
Sep 10 21:03:28.095828 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:28.095792    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e68a64c9-ede8-4fd8-9ca6-c5a498436133-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-tb9xl\" (UID: \"e68a64c9-ede8-4fd8-9ca6-c5a498436133\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tb9xl"
Sep 10 21:03:28.096014 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:28.095838    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e68a64c9-ede8-4fd8-9ca6-c5a498436133-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-tb9xl\" (UID: \"e68a64c9-ede8-4fd8-9ca6-c5a498436133\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tb9xl"
Sep 10 21:03:28.096014 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:28.095860    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e68a64c9-ede8-4fd8-9ca6-c5a498436133-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-tb9xl\" (UID: \"e68a64c9-ede8-4fd8-9ca6-c5a498436133\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tb9xl"
Sep 10 21:03:28.096014 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:28.095909    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e68a64c9-ede8-4fd8-9ca6-c5a498436133-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-tb9xl\" (UID: \"e68a64c9-ede8-4fd8-9ca6-c5a498436133\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tb9xl"
Sep 10 21:03:28.096196 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:28.096035    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e68a64c9-ede8-4fd8-9ca6-c5a498436133-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-tb9xl\" (UID: \"e68a64c9-ede8-4fd8-9ca6-c5a498436133\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tb9xl"
Sep 10 21:03:28.096196 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:28.096080    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wsqs\" (UniqueName: \"kubernetes.io/projected/e68a64c9-ede8-4fd8-9ca6-c5a498436133-kube-api-access-8wsqs\") pod \"istiod-openshift-gateway-5677ccb49b-tb9xl\" (UID: \"e68a64c9-ede8-4fd8-9ca6-c5a498436133\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tb9xl"
Sep 10 21:03:28.096196 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:28.096147    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e68a64c9-ede8-4fd8-9ca6-c5a498436133-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-tb9xl\" (UID: \"e68a64c9-ede8-4fd8-9ca6-c5a498436133\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tb9xl"
Sep 10 21:03:28.196630 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:28.196593    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e68a64c9-ede8-4fd8-9ca6-c5a498436133-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-tb9xl\" (UID: \"e68a64c9-ede8-4fd8-9ca6-c5a498436133\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tb9xl"
Sep 10 21:03:28.196815 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:28.196643    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e68a64c9-ede8-4fd8-9ca6-c5a498436133-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-tb9xl\" (UID: \"e68a64c9-ede8-4fd8-9ca6-c5a498436133\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tb9xl"
Sep 10 21:03:28.196815 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:28.196686    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e68a64c9-ede8-4fd8-9ca6-c5a498436133-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-tb9xl\" (UID: \"e68a64c9-ede8-4fd8-9ca6-c5a498436133\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tb9xl"
Sep 10 21:03:28.196815 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:28.196714    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e68a64c9-ede8-4fd8-9ca6-c5a498436133-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-tb9xl\" (UID: \"e68a64c9-ede8-4fd8-9ca6-c5a498436133\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tb9xl"
Sep 10 21:03:28.196815 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:28.196739    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e68a64c9-ede8-4fd8-9ca6-c5a498436133-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-tb9xl\" (UID: \"e68a64c9-ede8-4fd8-9ca6-c5a498436133\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tb9xl"
Sep 10 21:03:28.196815 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:28.196783    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e68a64c9-ede8-4fd8-9ca6-c5a498436133-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-tb9xl\" (UID: \"e68a64c9-ede8-4fd8-9ca6-c5a498436133\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tb9xl"
Sep 10 21:03:28.196815 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:28.196805    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wsqs\" (UniqueName: \"kubernetes.io/projected/e68a64c9-ede8-4fd8-9ca6-c5a498436133-kube-api-access-8wsqs\") pod \"istiod-openshift-gateway-5677ccb49b-tb9xl\" (UID: \"e68a64c9-ede8-4fd8-9ca6-c5a498436133\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tb9xl"
Sep 10 21:03:28.197612 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:28.197578    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e68a64c9-ede8-4fd8-9ca6-c5a498436133-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-tb9xl\" (UID: \"e68a64c9-ede8-4fd8-9ca6-c5a498436133\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tb9xl"
Sep 10 21:03:28.199256 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:28.199183    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e68a64c9-ede8-4fd8-9ca6-c5a498436133-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-tb9xl\" (UID: \"e68a64c9-ede8-4fd8-9ca6-c5a498436133\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tb9xl"
Sep 10 21:03:28.199365 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:28.199263    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e68a64c9-ede8-4fd8-9ca6-c5a498436133-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-tb9xl\" (UID: \"e68a64c9-ede8-4fd8-9ca6-c5a498436133\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tb9xl"
Sep 10 21:03:28.199426 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:28.199389    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e68a64c9-ede8-4fd8-9ca6-c5a498436133-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-tb9xl\" (UID: \"e68a64c9-ede8-4fd8-9ca6-c5a498436133\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tb9xl"
Sep 10 21:03:28.199543 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:28.199524    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e68a64c9-ede8-4fd8-9ca6-c5a498436133-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-tb9xl\" (UID: \"e68a64c9-ede8-4fd8-9ca6-c5a498436133\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tb9xl"
Sep 10 21:03:28.206657 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:28.206632    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e68a64c9-ede8-4fd8-9ca6-c5a498436133-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-tb9xl\" (UID: \"e68a64c9-ede8-4fd8-9ca6-c5a498436133\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tb9xl"
Sep 10 21:03:28.206932 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:28.206905    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wsqs\" (UniqueName: \"kubernetes.io/projected/e68a64c9-ede8-4fd8-9ca6-c5a498436133-kube-api-access-8wsqs\") pod \"istiod-openshift-gateway-5677ccb49b-tb9xl\" (UID: \"e68a64c9-ede8-4fd8-9ca6-c5a498436133\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tb9xl"
Sep 10 21:03:28.317403 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:28.317380    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tb9xl"
Sep 10 21:03:28.620279 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:28.620251    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-tb9xl"]
Sep 10 21:03:28.622712 ip-10-0-129-100 kubenswrapper[2564]: W0910 21:03:28.622682    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode68a64c9_ede8_4fd8_9ca6_c5a498436133.slice/crio-cdae4a4035ece4addc13d4d5e038b66d29231b5ab652152b738d8222759c832a WatchSource:0}: Error finding container cdae4a4035ece4addc13d4d5e038b66d29231b5ab652152b738d8222759c832a: Status 404 returned error can't find the container with id cdae4a4035ece4addc13d4d5e038b66d29231b5ab652152b738d8222759c832a
Sep 10 21:03:28.625712 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:28.625677    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 10 21:03:28.625785 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:28.625740    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 10 21:03:29.492490 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:29.492440    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tb9xl" event={"ID":"e68a64c9-ede8-4fd8-9ca6-c5a498436133","Type":"ContainerStarted","Data":"a3dafcbc1bf6372518cc176b9ebafdcf977e0ee90caf433464811af9cc739206"}
Sep 10 21:03:29.492947 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:29.492501    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tb9xl" event={"ID":"e68a64c9-ede8-4fd8-9ca6-c5a498436133","Type":"ContainerStarted","Data":"cdae4a4035ece4addc13d4d5e038b66d29231b5ab652152b738d8222759c832a"}
Sep 10 21:03:29.492947 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:29.492538    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tb9xl"
Sep 10 21:03:29.494419 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:29.494383    2564 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-tb9xl container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 21:03:29.494563 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:29.494451    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tb9xl" podUID="e68a64c9-ede8-4fd8-9ca6-c5a498436133" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 21:03:29.523821 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:29.523757    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tb9xl" podStartSLOduration=2.523736409 podStartE2EDuration="2.523736409s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:03:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:03:29.521996122 +0000 UTC m=+390.209063414" watchObservedRunningTime="2026-09-10 21:03:29.523736409 +0000 UTC m=+390.210803689"
Sep 10 21:03:30.497942 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:30.497908    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tb9xl"
Sep 10 21:03:30.592330 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:30.592299    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-96vj2"]
Sep 10 21:03:30.592505 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:30.592479    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-96vj2" podUID="f1027efb-edf7-4d92-b05c-a2f285ae81db" containerName="discovery" containerID="cri-o://bc40e1bca38ee972581a597806b7578157a9f741753a7b1a604ca1d64dbcb964" gracePeriod=30
Sep 10 21:03:30.842360 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:30.842338    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-96vj2"
Sep 10 21:03:30.920598 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:30.920572    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f1027efb-edf7-4d92-b05c-a2f285ae81db-istio-kubeconfig\") pod \"f1027efb-edf7-4d92-b05c-a2f285ae81db\" (UID: \"f1027efb-edf7-4d92-b05c-a2f285ae81db\") "
Sep 10 21:03:30.920751 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:30.920608    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f1027efb-edf7-4d92-b05c-a2f285ae81db-cacerts\") pod \"f1027efb-edf7-4d92-b05c-a2f285ae81db\" (UID: \"f1027efb-edf7-4d92-b05c-a2f285ae81db\") "
Sep 10 21:03:30.920751 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:30.920631    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f1027efb-edf7-4d92-b05c-a2f285ae81db-istio-csr-dns-cert\") pod \"f1027efb-edf7-4d92-b05c-a2f285ae81db\" (UID: \"f1027efb-edf7-4d92-b05c-a2f285ae81db\") "
Sep 10 21:03:30.920751 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:30.920670    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f1027efb-edf7-4d92-b05c-a2f285ae81db-istio-csr-ca-configmap\") pod \"f1027efb-edf7-4d92-b05c-a2f285ae81db\" (UID: \"f1027efb-edf7-4d92-b05c-a2f285ae81db\") "
Sep 10 21:03:30.920751 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:30.920690    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f1027efb-edf7-4d92-b05c-a2f285ae81db-istio-token\") pod \"f1027efb-edf7-4d92-b05c-a2f285ae81db\" (UID: \"f1027efb-edf7-4d92-b05c-a2f285ae81db\") "
Sep 10 21:03:30.920751 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:30.920735    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gl6lk\" (UniqueName: \"kubernetes.io/projected/f1027efb-edf7-4d92-b05c-a2f285ae81db-kube-api-access-gl6lk\") pod \"f1027efb-edf7-4d92-b05c-a2f285ae81db\" (UID: \"f1027efb-edf7-4d92-b05c-a2f285ae81db\") "
Sep 10 21:03:30.921015 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:30.920786    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f1027efb-edf7-4d92-b05c-a2f285ae81db-local-certs\") pod \"f1027efb-edf7-4d92-b05c-a2f285ae81db\" (UID: \"f1027efb-edf7-4d92-b05c-a2f285ae81db\") "
Sep 10 21:03:30.921147 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:30.921115    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1027efb-edf7-4d92-b05c-a2f285ae81db-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "f1027efb-edf7-4d92-b05c-a2f285ae81db" (UID: "f1027efb-edf7-4d92-b05c-a2f285ae81db"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:03:30.923181 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:30.923147    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1027efb-edf7-4d92-b05c-a2f285ae81db-kube-api-access-gl6lk" (OuterVolumeSpecName: "kube-api-access-gl6lk") pod "f1027efb-edf7-4d92-b05c-a2f285ae81db" (UID: "f1027efb-edf7-4d92-b05c-a2f285ae81db"). InnerVolumeSpecName "kube-api-access-gl6lk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:03:30.923314 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:30.923200    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1027efb-edf7-4d92-b05c-a2f285ae81db-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "f1027efb-edf7-4d92-b05c-a2f285ae81db" (UID: "f1027efb-edf7-4d92-b05c-a2f285ae81db"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:03:30.923314 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:30.923251    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1027efb-edf7-4d92-b05c-a2f285ae81db-cacerts" (OuterVolumeSpecName: "cacerts") pod "f1027efb-edf7-4d92-b05c-a2f285ae81db" (UID: "f1027efb-edf7-4d92-b05c-a2f285ae81db"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:03:30.923403 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:30.923323    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1027efb-edf7-4d92-b05c-a2f285ae81db-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "f1027efb-edf7-4d92-b05c-a2f285ae81db" (UID: "f1027efb-edf7-4d92-b05c-a2f285ae81db"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:03:30.923438 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:30.923418    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1027efb-edf7-4d92-b05c-a2f285ae81db-istio-token" (OuterVolumeSpecName: "istio-token") pod "f1027efb-edf7-4d92-b05c-a2f285ae81db" (UID: "f1027efb-edf7-4d92-b05c-a2f285ae81db"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:03:30.923490 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:30.923473    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1027efb-edf7-4d92-b05c-a2f285ae81db-local-certs" (OuterVolumeSpecName: "local-certs") pod "f1027efb-edf7-4d92-b05c-a2f285ae81db" (UID: "f1027efb-edf7-4d92-b05c-a2f285ae81db"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:03:31.026991 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:31.022542    2564 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f1027efb-edf7-4d92-b05c-a2f285ae81db-istio-csr-ca-configmap\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:03:31.026991 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:31.026971    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f1027efb-edf7-4d92-b05c-a2f285ae81db-istio-token\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:03:31.027192 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:31.027003    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gl6lk\" (UniqueName: \"kubernetes.io/projected/f1027efb-edf7-4d92-b05c-a2f285ae81db-kube-api-access-gl6lk\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:03:31.027192 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:31.027022    2564 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f1027efb-edf7-4d92-b05c-a2f285ae81db-local-certs\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:03:31.027192 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:31.027042    2564 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f1027efb-edf7-4d92-b05c-a2f285ae81db-istio-kubeconfig\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:03:31.027192 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:31.027056    2564 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f1027efb-edf7-4d92-b05c-a2f285ae81db-cacerts\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:03:31.027192 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:31.027096    2564 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f1027efb-edf7-4d92-b05c-a2f285ae81db-istio-csr-dns-cert\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:03:31.503174 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:31.503142    2564 generic.go:356] "Generic (PLEG): container finished" podID="f1027efb-edf7-4d92-b05c-a2f285ae81db" containerID="bc40e1bca38ee972581a597806b7578157a9f741753a7b1a604ca1d64dbcb964" exitCode=0
Sep 10 21:03:31.503623 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:31.503202    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-96vj2"
Sep 10 21:03:31.503623 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:31.503240    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-96vj2" event={"ID":"f1027efb-edf7-4d92-b05c-a2f285ae81db","Type":"ContainerDied","Data":"bc40e1bca38ee972581a597806b7578157a9f741753a7b1a604ca1d64dbcb964"}
Sep 10 21:03:31.503623 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:31.503321    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-96vj2" event={"ID":"f1027efb-edf7-4d92-b05c-a2f285ae81db","Type":"ContainerDied","Data":"8987da4fd76942e1b47447910b8294aea25e2b463153fbb9176f7be05aca8119"}
Sep 10 21:03:31.503623 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:31.503342    2564 scope.go:117] "RemoveContainer" containerID="bc40e1bca38ee972581a597806b7578157a9f741753a7b1a604ca1d64dbcb964"
Sep 10 21:03:31.512393 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:31.512378    2564 scope.go:117] "RemoveContainer" containerID="bc40e1bca38ee972581a597806b7578157a9f741753a7b1a604ca1d64dbcb964"
Sep 10 21:03:31.512668 ip-10-0-129-100 kubenswrapper[2564]: E0910 21:03:31.512647    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc40e1bca38ee972581a597806b7578157a9f741753a7b1a604ca1d64dbcb964\": container with ID starting with bc40e1bca38ee972581a597806b7578157a9f741753a7b1a604ca1d64dbcb964 not found: ID does not exist" containerID="bc40e1bca38ee972581a597806b7578157a9f741753a7b1a604ca1d64dbcb964"
Sep 10 21:03:31.512729 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:31.512676    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc40e1bca38ee972581a597806b7578157a9f741753a7b1a604ca1d64dbcb964"} err="failed to get container status \"bc40e1bca38ee972581a597806b7578157a9f741753a7b1a604ca1d64dbcb964\": rpc error: code = NotFound desc = could not find container \"bc40e1bca38ee972581a597806b7578157a9f741753a7b1a604ca1d64dbcb964\": container with ID starting with bc40e1bca38ee972581a597806b7578157a9f741753a7b1a604ca1d64dbcb964 not found: ID does not exist"
Sep 10 21:03:31.534954 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:31.534924    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-96vj2"]
Sep 10 21:03:31.546468 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:31.546443    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-96vj2"]
Sep 10 21:03:31.872779 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:31.872738    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1027efb-edf7-4d92-b05c-a2f285ae81db" path="/var/lib/kubelet/pods/f1027efb-edf7-4d92-b05c-a2f285ae81db/volumes"
Sep 10 21:03:54.714731 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:54.714697    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5d956c944c-2h59z"]
Sep 10 21:03:54.715190 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:54.715054    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1027efb-edf7-4d92-b05c-a2f285ae81db" containerName="discovery"
Sep 10 21:03:54.715190 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:54.715072    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1027efb-edf7-4d92-b05c-a2f285ae81db" containerName="discovery"
Sep 10 21:03:54.715190 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:54.715157    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1027efb-edf7-4d92-b05c-a2f285ae81db" containerName="discovery"
Sep 10 21:03:54.717044 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:54.717023    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d956c944c-2h59z"
Sep 10 21:03:54.721251 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:54.721210    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 10 21:03:54.721416 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:54.721381    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 10 21:03:54.721507 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:54.721388    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-kb4m6\""
Sep 10 21:03:54.722084 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:54.722062    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 10 21:03:54.722206 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:54.722093    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 10 21:03:54.722307 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:54.722100    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 10 21:03:54.722307 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:54.722111    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 10 21:03:54.722490 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:54.722471    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 10 21:03:54.726897 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:54.726876    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 10 21:03:54.728590 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:54.728571    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d956c944c-2h59z"]
Sep 10 21:03:54.826772 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:54.826730    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3c5b12bf-34c9-4e32-bad4-7d4d9ab44ab1-oauth-serving-cert\") pod \"console-5d956c944c-2h59z\" (UID: \"3c5b12bf-34c9-4e32-bad4-7d4d9ab44ab1\") " pod="openshift-console/console-5d956c944c-2h59z"
Sep 10 21:03:54.826952 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:54.826794    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3c5b12bf-34c9-4e32-bad4-7d4d9ab44ab1-console-oauth-config\") pod \"console-5d956c944c-2h59z\" (UID: \"3c5b12bf-34c9-4e32-bad4-7d4d9ab44ab1\") " pod="openshift-console/console-5d956c944c-2h59z"
Sep 10 21:03:54.826952 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:54.826811    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnj4p\" (UniqueName: \"kubernetes.io/projected/3c5b12bf-34c9-4e32-bad4-7d4d9ab44ab1-kube-api-access-pnj4p\") pod \"console-5d956c944c-2h59z\" (UID: \"3c5b12bf-34c9-4e32-bad4-7d4d9ab44ab1\") " pod="openshift-console/console-5d956c944c-2h59z"
Sep 10 21:03:54.826952 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:54.826828    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3c5b12bf-34c9-4e32-bad4-7d4d9ab44ab1-console-serving-cert\") pod \"console-5d956c944c-2h59z\" (UID: \"3c5b12bf-34c9-4e32-bad4-7d4d9ab44ab1\") " pod="openshift-console/console-5d956c944c-2h59z"
Sep 10 21:03:54.826952 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:54.826843    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3c5b12bf-34c9-4e32-bad4-7d4d9ab44ab1-console-config\") pod \"console-5d956c944c-2h59z\" (UID: \"3c5b12bf-34c9-4e32-bad4-7d4d9ab44ab1\") " pod="openshift-console/console-5d956c944c-2h59z"
Sep 10 21:03:54.826952 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:54.826871    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3c5b12bf-34c9-4e32-bad4-7d4d9ab44ab1-service-ca\") pod \"console-5d956c944c-2h59z\" (UID: \"3c5b12bf-34c9-4e32-bad4-7d4d9ab44ab1\") " pod="openshift-console/console-5d956c944c-2h59z"
Sep 10 21:03:54.826952 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:54.826943    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c5b12bf-34c9-4e32-bad4-7d4d9ab44ab1-trusted-ca-bundle\") pod \"console-5d956c944c-2h59z\" (UID: \"3c5b12bf-34c9-4e32-bad4-7d4d9ab44ab1\") " pod="openshift-console/console-5d956c944c-2h59z"
Sep 10 21:03:54.927737 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:54.927684    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c5b12bf-34c9-4e32-bad4-7d4d9ab44ab1-trusted-ca-bundle\") pod \"console-5d956c944c-2h59z\" (UID: \"3c5b12bf-34c9-4e32-bad4-7d4d9ab44ab1\") " pod="openshift-console/console-5d956c944c-2h59z"
Sep 10 21:03:54.927934 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:54.927752    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3c5b12bf-34c9-4e32-bad4-7d4d9ab44ab1-oauth-serving-cert\") pod \"console-5d956c944c-2h59z\" (UID: \"3c5b12bf-34c9-4e32-bad4-7d4d9ab44ab1\") " pod="openshift-console/console-5d956c944c-2h59z"
Sep 10 21:03:54.927934 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:54.927808    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3c5b12bf-34c9-4e32-bad4-7d4d9ab44ab1-console-oauth-config\") pod \"console-5d956c944c-2h59z\" (UID: \"3c5b12bf-34c9-4e32-bad4-7d4d9ab44ab1\") " pod="openshift-console/console-5d956c944c-2h59z"
Sep 10 21:03:54.927934 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:54.927830    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnj4p\" (UniqueName: \"kubernetes.io/projected/3c5b12bf-34c9-4e32-bad4-7d4d9ab44ab1-kube-api-access-pnj4p\") pod \"console-5d956c944c-2h59z\" (UID: \"3c5b12bf-34c9-4e32-bad4-7d4d9ab44ab1\") " pod="openshift-console/console-5d956c944c-2h59z"
Sep 10 21:03:54.927934 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:54.927855    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3c5b12bf-34c9-4e32-bad4-7d4d9ab44ab1-console-serving-cert\") pod \"console-5d956c944c-2h59z\" (UID: \"3c5b12bf-34c9-4e32-bad4-7d4d9ab44ab1\") " pod="openshift-console/console-5d956c944c-2h59z"
Sep 10 21:03:54.927934 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:54.927878    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3c5b12bf-34c9-4e32-bad4-7d4d9ab44ab1-console-config\") pod \"console-5d956c944c-2h59z\" (UID: \"3c5b12bf-34c9-4e32-bad4-7d4d9ab44ab1\") " pod="openshift-console/console-5d956c944c-2h59z"
Sep 10 21:03:54.927934 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:54.927919    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3c5b12bf-34c9-4e32-bad4-7d4d9ab44ab1-service-ca\") pod \"console-5d956c944c-2h59z\" (UID: \"3c5b12bf-34c9-4e32-bad4-7d4d9ab44ab1\") " pod="openshift-console/console-5d956c944c-2h59z"
Sep 10 21:03:54.928597 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:54.928571    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3c5b12bf-34c9-4e32-bad4-7d4d9ab44ab1-service-ca\") pod \"console-5d956c944c-2h59z\" (UID: \"3c5b12bf-34c9-4e32-bad4-7d4d9ab44ab1\") " pod="openshift-console/console-5d956c944c-2h59z"
Sep 10 21:03:54.928701 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:54.928602    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3c5b12bf-34c9-4e32-bad4-7d4d9ab44ab1-oauth-serving-cert\") pod \"console-5d956c944c-2h59z\" (UID: \"3c5b12bf-34c9-4e32-bad4-7d4d9ab44ab1\") " pod="openshift-console/console-5d956c944c-2h59z"
Sep 10 21:03:54.928762 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:54.928696    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c5b12bf-34c9-4e32-bad4-7d4d9ab44ab1-trusted-ca-bundle\") pod \"console-5d956c944c-2h59z\" (UID: \"3c5b12bf-34c9-4e32-bad4-7d4d9ab44ab1\") " pod="openshift-console/console-5d956c944c-2h59z"
Sep 10 21:03:54.928762 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:54.928696    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3c5b12bf-34c9-4e32-bad4-7d4d9ab44ab1-console-config\") pod \"console-5d956c944c-2h59z\" (UID: \"3c5b12bf-34c9-4e32-bad4-7d4d9ab44ab1\") " pod="openshift-console/console-5d956c944c-2h59z"
Sep 10 21:03:54.930388 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:54.930359    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3c5b12bf-34c9-4e32-bad4-7d4d9ab44ab1-console-serving-cert\") pod \"console-5d956c944c-2h59z\" (UID: \"3c5b12bf-34c9-4e32-bad4-7d4d9ab44ab1\") " pod="openshift-console/console-5d956c944c-2h59z"
Sep 10 21:03:54.930388 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:54.930379    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3c5b12bf-34c9-4e32-bad4-7d4d9ab44ab1-console-oauth-config\") pod \"console-5d956c944c-2h59z\" (UID: \"3c5b12bf-34c9-4e32-bad4-7d4d9ab44ab1\") " pod="openshift-console/console-5d956c944c-2h59z"
Sep 10 21:03:54.940927 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:54.940902    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnj4p\" (UniqueName: \"kubernetes.io/projected/3c5b12bf-34c9-4e32-bad4-7d4d9ab44ab1-kube-api-access-pnj4p\") pod \"console-5d956c944c-2h59z\" (UID: \"3c5b12bf-34c9-4e32-bad4-7d4d9ab44ab1\") " pod="openshift-console/console-5d956c944c-2h59z"
Sep 10 21:03:55.028618 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:55.028537    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d956c944c-2h59z"
Sep 10 21:03:55.324266 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:55.324239    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d956c944c-2h59z"]
Sep 10 21:03:55.325697 ip-10-0-129-100 kubenswrapper[2564]: W0910 21:03:55.325673    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c5b12bf_34c9_4e32_bad4_7d4d9ab44ab1.slice/crio-393a4592aa93cef57414f5004ef04287dc68683a6c8d5b48ead421136ee0c13d WatchSource:0}: Error finding container 393a4592aa93cef57414f5004ef04287dc68683a6c8d5b48ead421136ee0c13d: Status 404 returned error can't find the container with id 393a4592aa93cef57414f5004ef04287dc68683a6c8d5b48ead421136ee0c13d
Sep 10 21:03:55.606698 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:55.606611    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d956c944c-2h59z" event={"ID":"3c5b12bf-34c9-4e32-bad4-7d4d9ab44ab1","Type":"ContainerStarted","Data":"6751c94abd9171c2679dd6480693027e518cb079281f05ed82fd3d66b3102665"}
Sep 10 21:03:55.606698 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:55.606661    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d956c944c-2h59z" event={"ID":"3c5b12bf-34c9-4e32-bad4-7d4d9ab44ab1","Type":"ContainerStarted","Data":"393a4592aa93cef57414f5004ef04287dc68683a6c8d5b48ead421136ee0c13d"}
Sep 10 21:03:55.642784 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:03:55.642729    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5d956c944c-2h59z" podStartSLOduration=1.642713481 podStartE2EDuration="1.642713481s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:03:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:03:55.641448843 +0000 UTC m=+416.328516121" watchObservedRunningTime="2026-09-10 21:03:55.642713481 +0000 UTC m=+416.329780759"
Sep 10 21:04:05.028745 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:05.028709    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5d956c944c-2h59z"
Sep 10 21:04:05.029130 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:05.028783    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5d956c944c-2h59z"
Sep 10 21:04:05.033616 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:05.033593    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5d956c944c-2h59z"
Sep 10 21:04:05.653661 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:05.653634    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5d956c944c-2h59z"
Sep 10 21:04:24.473075 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:24.473000    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6dw9dx"]
Sep 10 21:04:24.476243 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:24.476211    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6dw9dx"
Sep 10 21:04:24.478584 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:24.478549    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 21:04:24.478697 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:24.478603    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-tz9tv\""
Sep 10 21:04:24.478697 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:24.478622    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 21:04:24.498316 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:24.498284    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6dw9dx"]
Sep 10 21:04:24.573571 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:24.573533    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjb9l\" (UniqueName: \"kubernetes.io/projected/9cc2f746-400d-4382-92eb-1ed376af7d14-kube-api-access-pjb9l\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6dw9dx\" (UID: \"9cc2f746-400d-4382-92eb-1ed376af7d14\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6dw9dx"
Sep 10 21:04:24.573751 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:24.573589    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9cc2f746-400d-4382-92eb-1ed376af7d14-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6dw9dx\" (UID: \"9cc2f746-400d-4382-92eb-1ed376af7d14\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6dw9dx"
Sep 10 21:04:24.573751 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:24.573643    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9cc2f746-400d-4382-92eb-1ed376af7d14-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6dw9dx\" (UID: \"9cc2f746-400d-4382-92eb-1ed376af7d14\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6dw9dx"
Sep 10 21:04:24.580535 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:24.580504    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mprjp"]
Sep 10 21:04:24.583769 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:24.583754    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mprjp"
Sep 10 21:04:24.595897 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:24.595872    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mprjp"]
Sep 10 21:04:24.674117 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:24.674083    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9lk7\" (UniqueName: \"kubernetes.io/projected/2bd493c5-6ba2-4d3c-bdd2-f47eaecfa0f3-kube-api-access-c9lk7\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mprjp\" (UID: \"2bd493c5-6ba2-4d3c-bdd2-f47eaecfa0f3\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mprjp"
Sep 10 21:04:24.674331 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:24.674134    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9cc2f746-400d-4382-92eb-1ed376af7d14-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6dw9dx\" (UID: \"9cc2f746-400d-4382-92eb-1ed376af7d14\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6dw9dx"
Sep 10 21:04:24.674331 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:24.674164    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2bd493c5-6ba2-4d3c-bdd2-f47eaecfa0f3-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mprjp\" (UID: \"2bd493c5-6ba2-4d3c-bdd2-f47eaecfa0f3\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mprjp"
Sep 10 21:04:24.674331 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:24.674190    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjb9l\" (UniqueName: \"kubernetes.io/projected/9cc2f746-400d-4382-92eb-1ed376af7d14-kube-api-access-pjb9l\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6dw9dx\" (UID: \"9cc2f746-400d-4382-92eb-1ed376af7d14\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6dw9dx"
Sep 10 21:04:24.674331 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:24.674283    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2bd493c5-6ba2-4d3c-bdd2-f47eaecfa0f3-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mprjp\" (UID: \"2bd493c5-6ba2-4d3c-bdd2-f47eaecfa0f3\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mprjp"
Sep 10 21:04:24.674559 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:24.674339    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9cc2f746-400d-4382-92eb-1ed376af7d14-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6dw9dx\" (UID: \"9cc2f746-400d-4382-92eb-1ed376af7d14\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6dw9dx"
Sep 10 21:04:24.674722 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:24.674701    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9cc2f746-400d-4382-92eb-1ed376af7d14-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6dw9dx\" (UID: \"9cc2f746-400d-4382-92eb-1ed376af7d14\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6dw9dx"
Sep 10 21:04:24.674794 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:24.674740    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9cc2f746-400d-4382-92eb-1ed376af7d14-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6dw9dx\" (UID: \"9cc2f746-400d-4382-92eb-1ed376af7d14\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6dw9dx"
Sep 10 21:04:24.675829 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:24.675808    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afcfq7"]
Sep 10 21:04:24.679283 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:24.679268    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afcfq7"
Sep 10 21:04:24.682646 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:24.682623    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjb9l\" (UniqueName: \"kubernetes.io/projected/9cc2f746-400d-4382-92eb-1ed376af7d14-kube-api-access-pjb9l\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6dw9dx\" (UID: \"9cc2f746-400d-4382-92eb-1ed376af7d14\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6dw9dx"
Sep 10 21:04:24.695430 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:24.695406    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afcfq7"]
Sep 10 21:04:24.775148 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:24.775066    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2bd493c5-6ba2-4d3c-bdd2-f47eaecfa0f3-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mprjp\" (UID: \"2bd493c5-6ba2-4d3c-bdd2-f47eaecfa0f3\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mprjp"
Sep 10 21:04:24.775148 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:24.775114    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f2b3a4bb-9f0e-488f-9e99-28fd18286770-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afcfq7\" (UID: \"f2b3a4bb-9f0e-488f-9e99-28fd18286770\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afcfq7"
Sep 10 21:04:24.775148 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:24.775142    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9lk7\" (UniqueName: \"kubernetes.io/projected/2bd493c5-6ba2-4d3c-bdd2-f47eaecfa0f3-kube-api-access-c9lk7\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mprjp\" (UID: \"2bd493c5-6ba2-4d3c-bdd2-f47eaecfa0f3\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mprjp"
Sep 10 21:04:24.775450 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:24.775159    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f2b3a4bb-9f0e-488f-9e99-28fd18286770-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afcfq7\" (UID: \"f2b3a4bb-9f0e-488f-9e99-28fd18286770\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afcfq7"
Sep 10 21:04:24.775450 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:24.775179    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58sd4\" (UniqueName: \"kubernetes.io/projected/f2b3a4bb-9f0e-488f-9e99-28fd18286770-kube-api-access-58sd4\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afcfq7\" (UID: \"f2b3a4bb-9f0e-488f-9e99-28fd18286770\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afcfq7"
Sep 10 21:04:24.775450 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:24.775209    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2bd493c5-6ba2-4d3c-bdd2-f47eaecfa0f3-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mprjp\" (UID: \"2bd493c5-6ba2-4d3c-bdd2-f47eaecfa0f3\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mprjp"
Sep 10 21:04:24.775559 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:24.775520    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2bd493c5-6ba2-4d3c-bdd2-f47eaecfa0f3-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mprjp\" (UID: \"2bd493c5-6ba2-4d3c-bdd2-f47eaecfa0f3\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mprjp"
Sep 10 21:04:24.775559 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:24.775543    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2bd493c5-6ba2-4d3c-bdd2-f47eaecfa0f3-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mprjp\" (UID: \"2bd493c5-6ba2-4d3c-bdd2-f47eaecfa0f3\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mprjp"
Sep 10 21:04:24.785014 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:24.784989    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6dw9dx"
Sep 10 21:04:24.789197 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:24.789178    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cqrqcd"]
Sep 10 21:04:24.792484 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:24.792467    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cqrqcd"
Sep 10 21:04:24.797117 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:24.797096    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9lk7\" (UniqueName: \"kubernetes.io/projected/2bd493c5-6ba2-4d3c-bdd2-f47eaecfa0f3-kube-api-access-c9lk7\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mprjp\" (UID: \"2bd493c5-6ba2-4d3c-bdd2-f47eaecfa0f3\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mprjp"
Sep 10 21:04:24.813457 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:24.813435    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cqrqcd"]
Sep 10 21:04:24.875847 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:24.875819    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f2b3a4bb-9f0e-488f-9e99-28fd18286770-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afcfq7\" (UID: \"f2b3a4bb-9f0e-488f-9e99-28fd18286770\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afcfq7"
Sep 10 21:04:24.875968 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:24.875852    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58sd4\" (UniqueName: \"kubernetes.io/projected/f2b3a4bb-9f0e-488f-9e99-28fd18286770-kube-api-access-58sd4\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afcfq7\" (UID: \"f2b3a4bb-9f0e-488f-9e99-28fd18286770\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afcfq7"
Sep 10 21:04:24.875968 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:24.875887    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0a79fb35-ace6-48c0-88ad-75deaf3305dc-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cqrqcd\" (UID: \"0a79fb35-ace6-48c0-88ad-75deaf3305dc\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cqrqcd"
Sep 10 21:04:24.875968 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:24.875927    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0a79fb35-ace6-48c0-88ad-75deaf3305dc-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cqrqcd\" (UID: \"0a79fb35-ace6-48c0-88ad-75deaf3305dc\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cqrqcd"
Sep 10 21:04:24.876096 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:24.875973    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmblc\" (UniqueName: \"kubernetes.io/projected/0a79fb35-ace6-48c0-88ad-75deaf3305dc-kube-api-access-nmblc\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cqrqcd\" (UID: \"0a79fb35-ace6-48c0-88ad-75deaf3305dc\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cqrqcd"
Sep 10 21:04:24.876096 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:24.876038    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f2b3a4bb-9f0e-488f-9e99-28fd18286770-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afcfq7\" (UID: \"f2b3a4bb-9f0e-488f-9e99-28fd18286770\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afcfq7"
Sep 10 21:04:24.876379 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:24.876363    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f2b3a4bb-9f0e-488f-9e99-28fd18286770-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afcfq7\" (UID: \"f2b3a4bb-9f0e-488f-9e99-28fd18286770\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afcfq7"
Sep 10 21:04:24.876422 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:24.876359    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f2b3a4bb-9f0e-488f-9e99-28fd18286770-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afcfq7\" (UID: \"f2b3a4bb-9f0e-488f-9e99-28fd18286770\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afcfq7"
Sep 10 21:04:24.888568 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:24.888544    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58sd4\" (UniqueName: \"kubernetes.io/projected/f2b3a4bb-9f0e-488f-9e99-28fd18286770-kube-api-access-58sd4\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afcfq7\" (UID: \"f2b3a4bb-9f0e-488f-9e99-28fd18286770\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afcfq7"
Sep 10 21:04:24.892421 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:24.892394    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mprjp"
Sep 10 21:04:24.976901 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:24.976872    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0a79fb35-ace6-48c0-88ad-75deaf3305dc-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cqrqcd\" (UID: \"0a79fb35-ace6-48c0-88ad-75deaf3305dc\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cqrqcd"
Sep 10 21:04:24.977027 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:24.976906    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0a79fb35-ace6-48c0-88ad-75deaf3305dc-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cqrqcd\" (UID: \"0a79fb35-ace6-48c0-88ad-75deaf3305dc\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cqrqcd"
Sep 10 21:04:24.977074 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:24.977052    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmblc\" (UniqueName: \"kubernetes.io/projected/0a79fb35-ace6-48c0-88ad-75deaf3305dc-kube-api-access-nmblc\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cqrqcd\" (UID: \"0a79fb35-ace6-48c0-88ad-75deaf3305dc\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cqrqcd"
Sep 10 21:04:24.977241 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:24.977215    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0a79fb35-ace6-48c0-88ad-75deaf3305dc-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cqrqcd\" (UID: \"0a79fb35-ace6-48c0-88ad-75deaf3305dc\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cqrqcd"
Sep 10 21:04:24.977325 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:24.977256    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0a79fb35-ace6-48c0-88ad-75deaf3305dc-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cqrqcd\" (UID: \"0a79fb35-ace6-48c0-88ad-75deaf3305dc\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cqrqcd"
Sep 10 21:04:24.988068 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:24.988049    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmblc\" (UniqueName: \"kubernetes.io/projected/0a79fb35-ace6-48c0-88ad-75deaf3305dc-kube-api-access-nmblc\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cqrqcd\" (UID: \"0a79fb35-ace6-48c0-88ad-75deaf3305dc\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cqrqcd"
Sep 10 21:04:24.994885 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:24.994869    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afcfq7"
Sep 10 21:04:25.064791 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:25.064762    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6dw9dx"]
Sep 10 21:04:25.067483 ip-10-0-129-100 kubenswrapper[2564]: W0910 21:04:25.067456    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cc2f746_400d_4382_92eb_1ed376af7d14.slice/crio-6c50ce93bfcba866a2a0b428a05d9bda3526ba4497d614e269b2b915010d8ca4 WatchSource:0}: Error finding container 6c50ce93bfcba866a2a0b428a05d9bda3526ba4497d614e269b2b915010d8ca4: Status 404 returned error can't find the container with id 6c50ce93bfcba866a2a0b428a05d9bda3526ba4497d614e269b2b915010d8ca4
Sep 10 21:04:25.116017 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:25.115997    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cqrqcd"
Sep 10 21:04:25.172353 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:25.172272    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mprjp"]
Sep 10 21:04:25.212974 ip-10-0-129-100 kubenswrapper[2564]: W0910 21:04:25.212944    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bd493c5_6ba2_4d3c_bdd2_f47eaecfa0f3.slice/crio-f83d52d771009d29b9d72683b99239ff5e16d4e3398e9f92acae88419610fb63 WatchSource:0}: Error finding container f83d52d771009d29b9d72683b99239ff5e16d4e3398e9f92acae88419610fb63: Status 404 returned error can't find the container with id f83d52d771009d29b9d72683b99239ff5e16d4e3398e9f92acae88419610fb63
Sep 10 21:04:25.267991 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:25.267958    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afcfq7"]
Sep 10 21:04:25.270557 ip-10-0-129-100 kubenswrapper[2564]: W0910 21:04:25.270532    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2b3a4bb_9f0e_488f_9e99_28fd18286770.slice/crio-3f4e9ad0467cb8cd73113fa5cc93913e08ca3e68cb35ba70737831974a6c73f9 WatchSource:0}: Error finding container 3f4e9ad0467cb8cd73113fa5cc93913e08ca3e68cb35ba70737831974a6c73f9: Status 404 returned error can't find the container with id 3f4e9ad0467cb8cd73113fa5cc93913e08ca3e68cb35ba70737831974a6c73f9
Sep 10 21:04:25.394670 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:25.394646    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cqrqcd"]
Sep 10 21:04:25.438124 ip-10-0-129-100 kubenswrapper[2564]: W0910 21:04:25.438091    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a79fb35_ace6_48c0_88ad_75deaf3305dc.slice/crio-fa1582a894fc5c81c6ff5c0bb0af44d9dd63a9f9d9d4e792c0f20e36d0b3e50d WatchSource:0}: Error finding container fa1582a894fc5c81c6ff5c0bb0af44d9dd63a9f9d9d4e792c0f20e36d0b3e50d: Status 404 returned error can't find the container with id fa1582a894fc5c81c6ff5c0bb0af44d9dd63a9f9d9d4e792c0f20e36d0b3e50d
Sep 10 21:04:25.736628 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:25.736543    2564 generic.go:356] "Generic (PLEG): container finished" podID="0a79fb35-ace6-48c0-88ad-75deaf3305dc" containerID="acb876c698226bd0a0bae93b3bd1522c1abb47b31c15b0edc6cbb74547e2c9aa" exitCode=0
Sep 10 21:04:25.737041 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:25.736626    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cqrqcd" event={"ID":"0a79fb35-ace6-48c0-88ad-75deaf3305dc","Type":"ContainerDied","Data":"acb876c698226bd0a0bae93b3bd1522c1abb47b31c15b0edc6cbb74547e2c9aa"}
Sep 10 21:04:25.737041 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:25.736679    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cqrqcd" event={"ID":"0a79fb35-ace6-48c0-88ad-75deaf3305dc","Type":"ContainerStarted","Data":"fa1582a894fc5c81c6ff5c0bb0af44d9dd63a9f9d9d4e792c0f20e36d0b3e50d"}
Sep 10 21:04:25.738222 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:25.738205    2564 generic.go:356] "Generic (PLEG): container finished" podID="f2b3a4bb-9f0e-488f-9e99-28fd18286770" containerID="6468d7c6382a4cbb4429d51f77a8abfd45a03109a072eadde5b7e4579a983a96" exitCode=0
Sep 10 21:04:25.738311 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:25.738265    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afcfq7" event={"ID":"f2b3a4bb-9f0e-488f-9e99-28fd18286770","Type":"ContainerDied","Data":"6468d7c6382a4cbb4429d51f77a8abfd45a03109a072eadde5b7e4579a983a96"}
Sep 10 21:04:25.738358 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:25.738308    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afcfq7" event={"ID":"f2b3a4bb-9f0e-488f-9e99-28fd18286770","Type":"ContainerStarted","Data":"3f4e9ad0467cb8cd73113fa5cc93913e08ca3e68cb35ba70737831974a6c73f9"}
Sep 10 21:04:25.740010 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:25.739992    2564 generic.go:356] "Generic (PLEG): container finished" podID="2bd493c5-6ba2-4d3c-bdd2-f47eaecfa0f3" containerID="cd372cf6f9f48655fd3e8341ec356589e14cda546339218baad6d81d36dd218c" exitCode=0
Sep 10 21:04:25.740112 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:25.740046    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mprjp" event={"ID":"2bd493c5-6ba2-4d3c-bdd2-f47eaecfa0f3","Type":"ContainerDied","Data":"cd372cf6f9f48655fd3e8341ec356589e14cda546339218baad6d81d36dd218c"}
Sep 10 21:04:25.740112 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:25.740098    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mprjp" event={"ID":"2bd493c5-6ba2-4d3c-bdd2-f47eaecfa0f3","Type":"ContainerStarted","Data":"f83d52d771009d29b9d72683b99239ff5e16d4e3398e9f92acae88419610fb63"}
Sep 10 21:04:25.742084 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:25.742067    2564 generic.go:356] "Generic (PLEG): container finished" podID="9cc2f746-400d-4382-92eb-1ed376af7d14" containerID="b94738a5711898e78409062a9806a623b2e248d8a17634aff95b5c428877da26" exitCode=0
Sep 10 21:04:25.742165 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:25.742096    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6dw9dx" event={"ID":"9cc2f746-400d-4382-92eb-1ed376af7d14","Type":"ContainerDied","Data":"b94738a5711898e78409062a9806a623b2e248d8a17634aff95b5c428877da26"}
Sep 10 21:04:25.742165 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:25.742125    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6dw9dx" event={"ID":"9cc2f746-400d-4382-92eb-1ed376af7d14","Type":"ContainerStarted","Data":"6c50ce93bfcba866a2a0b428a05d9bda3526ba4497d614e269b2b915010d8ca4"}
Sep 10 21:04:26.748693 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:26.748656    2564 generic.go:356] "Generic (PLEG): container finished" podID="f2b3a4bb-9f0e-488f-9e99-28fd18286770" containerID="595cca0da58c37fc78ca2c4aebb55c55349f3eea053468c03411d10e7eb8b282" exitCode=0
Sep 10 21:04:26.749127 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:26.748735    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afcfq7" event={"ID":"f2b3a4bb-9f0e-488f-9e99-28fd18286770","Type":"ContainerDied","Data":"595cca0da58c37fc78ca2c4aebb55c55349f3eea053468c03411d10e7eb8b282"}
Sep 10 21:04:26.750722 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:26.750695    2564 generic.go:356] "Generic (PLEG): container finished" podID="2bd493c5-6ba2-4d3c-bdd2-f47eaecfa0f3" containerID="f6d50f584eb6e8d4d91215a510a529b79dac6a240edc47b5ddd977182da31bdf" exitCode=0
Sep 10 21:04:26.750799 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:26.750774    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mprjp" event={"ID":"2bd493c5-6ba2-4d3c-bdd2-f47eaecfa0f3","Type":"ContainerDied","Data":"f6d50f584eb6e8d4d91215a510a529b79dac6a240edc47b5ddd977182da31bdf"}
Sep 10 21:04:26.752807 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:26.752785    2564 generic.go:356] "Generic (PLEG): container finished" podID="9cc2f746-400d-4382-92eb-1ed376af7d14" containerID="8197ea681d0be8410bbf4fdcade80cb2730a4a4b882d425679c66d011d15301f" exitCode=0
Sep 10 21:04:26.752896 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:26.752861    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6dw9dx" event={"ID":"9cc2f746-400d-4382-92eb-1ed376af7d14","Type":"ContainerDied","Data":"8197ea681d0be8410bbf4fdcade80cb2730a4a4b882d425679c66d011d15301f"}
Sep 10 21:04:26.754866 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:26.754844    2564 generic.go:356] "Generic (PLEG): container finished" podID="0a79fb35-ace6-48c0-88ad-75deaf3305dc" containerID="f6b573a821ce28bae4728b3f100a11a33085d7cbbe60bd027fc18e4603ea1a2b" exitCode=0
Sep 10 21:04:26.754948 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:26.754922    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cqrqcd" event={"ID":"0a79fb35-ace6-48c0-88ad-75deaf3305dc","Type":"ContainerDied","Data":"f6b573a821ce28bae4728b3f100a11a33085d7cbbe60bd027fc18e4603ea1a2b"}
Sep 10 21:04:27.761743 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:27.761707    2564 generic.go:356] "Generic (PLEG): container finished" podID="2bd493c5-6ba2-4d3c-bdd2-f47eaecfa0f3" containerID="b560bede21e517b71a6e5b14ff4927a5fb52f9e3ae08ec23f9614048cf12d17d" exitCode=0
Sep 10 21:04:27.762152 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:27.761789    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mprjp" event={"ID":"2bd493c5-6ba2-4d3c-bdd2-f47eaecfa0f3","Type":"ContainerDied","Data":"b560bede21e517b71a6e5b14ff4927a5fb52f9e3ae08ec23f9614048cf12d17d"}
Sep 10 21:04:27.763904 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:27.763881    2564 generic.go:356] "Generic (PLEG): container finished" podID="9cc2f746-400d-4382-92eb-1ed376af7d14" containerID="31b9d4e288d2e1454398276d63d5b89ab904f679d7ce34813bf3d92527c24169" exitCode=0
Sep 10 21:04:27.764015 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:27.763963    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6dw9dx" event={"ID":"9cc2f746-400d-4382-92eb-1ed376af7d14","Type":"ContainerDied","Data":"31b9d4e288d2e1454398276d63d5b89ab904f679d7ce34813bf3d92527c24169"}
Sep 10 21:04:27.765853 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:27.765833    2564 generic.go:356] "Generic (PLEG): container finished" podID="0a79fb35-ace6-48c0-88ad-75deaf3305dc" containerID="27861f34e6d9869ed981e3c991cb0615ffbaf0ebe41cb1487bf8f3bef292b947" exitCode=0
Sep 10 21:04:27.765937 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:27.765911    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cqrqcd" event={"ID":"0a79fb35-ace6-48c0-88ad-75deaf3305dc","Type":"ContainerDied","Data":"27861f34e6d9869ed981e3c991cb0615ffbaf0ebe41cb1487bf8f3bef292b947"}
Sep 10 21:04:27.767760 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:27.767739    2564 generic.go:356] "Generic (PLEG): container finished" podID="f2b3a4bb-9f0e-488f-9e99-28fd18286770" containerID="8058e2fbaf88559da7f41eebfc2e7c230dd1456858783b22bec682a37518f8fb" exitCode=0
Sep 10 21:04:27.767843 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:27.767789    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afcfq7" event={"ID":"f2b3a4bb-9f0e-488f-9e99-28fd18286770","Type":"ContainerDied","Data":"8058e2fbaf88559da7f41eebfc2e7c230dd1456858783b22bec682a37518f8fb"}
Sep 10 21:04:28.908077 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:28.908042    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afcfq7"
Sep 10 21:04:28.969688 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:28.969662    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mprjp"
Sep 10 21:04:28.972601 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:28.972578    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6dw9dx"
Sep 10 21:04:28.975746 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:28.975728    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cqrqcd"
Sep 10 21:04:29.008572 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:29.008544    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-58sd4\" (UniqueName: \"kubernetes.io/projected/f2b3a4bb-9f0e-488f-9e99-28fd18286770-kube-api-access-58sd4\") pod \"f2b3a4bb-9f0e-488f-9e99-28fd18286770\" (UID: \"f2b3a4bb-9f0e-488f-9e99-28fd18286770\") "
Sep 10 21:04:29.008712 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:29.008580    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f2b3a4bb-9f0e-488f-9e99-28fd18286770-util\") pod \"f2b3a4bb-9f0e-488f-9e99-28fd18286770\" (UID: \"f2b3a4bb-9f0e-488f-9e99-28fd18286770\") "
Sep 10 21:04:29.008753 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:29.008714    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f2b3a4bb-9f0e-488f-9e99-28fd18286770-bundle\") pod \"f2b3a4bb-9f0e-488f-9e99-28fd18286770\" (UID: \"f2b3a4bb-9f0e-488f-9e99-28fd18286770\") "
Sep 10 21:04:29.009452 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:29.009423    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2b3a4bb-9f0e-488f-9e99-28fd18286770-bundle" (OuterVolumeSpecName: "bundle") pod "f2b3a4bb-9f0e-488f-9e99-28fd18286770" (UID: "f2b3a4bb-9f0e-488f-9e99-28fd18286770"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:04:29.010643 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:29.010619    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2b3a4bb-9f0e-488f-9e99-28fd18286770-kube-api-access-58sd4" (OuterVolumeSpecName: "kube-api-access-58sd4") pod "f2b3a4bb-9f0e-488f-9e99-28fd18286770" (UID: "f2b3a4bb-9f0e-488f-9e99-28fd18286770"). InnerVolumeSpecName "kube-api-access-58sd4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:04:29.017548 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:29.017514    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2b3a4bb-9f0e-488f-9e99-28fd18286770-util" (OuterVolumeSpecName: "util") pod "f2b3a4bb-9f0e-488f-9e99-28fd18286770" (UID: "f2b3a4bb-9f0e-488f-9e99-28fd18286770"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:04:29.109552 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:29.109514    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c9lk7\" (UniqueName: \"kubernetes.io/projected/2bd493c5-6ba2-4d3c-bdd2-f47eaecfa0f3-kube-api-access-c9lk7\") pod \"2bd493c5-6ba2-4d3c-bdd2-f47eaecfa0f3\" (UID: \"2bd493c5-6ba2-4d3c-bdd2-f47eaecfa0f3\") "
Sep 10 21:04:29.109552 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:29.109555    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2bd493c5-6ba2-4d3c-bdd2-f47eaecfa0f3-bundle\") pod \"2bd493c5-6ba2-4d3c-bdd2-f47eaecfa0f3\" (UID: \"2bd493c5-6ba2-4d3c-bdd2-f47eaecfa0f3\") "
Sep 10 21:04:29.109774 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:29.109598    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2bd493c5-6ba2-4d3c-bdd2-f47eaecfa0f3-util\") pod \"2bd493c5-6ba2-4d3c-bdd2-f47eaecfa0f3\" (UID: \"2bd493c5-6ba2-4d3c-bdd2-f47eaecfa0f3\") "
Sep 10 21:04:29.109774 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:29.109630    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0a79fb35-ace6-48c0-88ad-75deaf3305dc-bundle\") pod \"0a79fb35-ace6-48c0-88ad-75deaf3305dc\" (UID: \"0a79fb35-ace6-48c0-88ad-75deaf3305dc\") "
Sep 10 21:04:29.109774 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:29.109660    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9cc2f746-400d-4382-92eb-1ed376af7d14-util\") pod \"9cc2f746-400d-4382-92eb-1ed376af7d14\" (UID: \"9cc2f746-400d-4382-92eb-1ed376af7d14\") "
Sep 10 21:04:29.109774 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:29.109701    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pjb9l\" (UniqueName: \"kubernetes.io/projected/9cc2f746-400d-4382-92eb-1ed376af7d14-kube-api-access-pjb9l\") pod \"9cc2f746-400d-4382-92eb-1ed376af7d14\" (UID: \"9cc2f746-400d-4382-92eb-1ed376af7d14\") "
Sep 10 21:04:29.109774 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:29.109737    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0a79fb35-ace6-48c0-88ad-75deaf3305dc-util\") pod \"0a79fb35-ace6-48c0-88ad-75deaf3305dc\" (UID: \"0a79fb35-ace6-48c0-88ad-75deaf3305dc\") "
Sep 10 21:04:29.109774 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:29.109764    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nmblc\" (UniqueName: \"kubernetes.io/projected/0a79fb35-ace6-48c0-88ad-75deaf3305dc-kube-api-access-nmblc\") pod \"0a79fb35-ace6-48c0-88ad-75deaf3305dc\" (UID: \"0a79fb35-ace6-48c0-88ad-75deaf3305dc\") "
Sep 10 21:04:29.110069 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:29.109800    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9cc2f746-400d-4382-92eb-1ed376af7d14-bundle\") pod \"9cc2f746-400d-4382-92eb-1ed376af7d14\" (UID: \"9cc2f746-400d-4382-92eb-1ed376af7d14\") "
Sep 10 21:04:29.110069 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:29.110033    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f2b3a4bb-9f0e-488f-9e99-28fd18286770-bundle\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:04:29.110069 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:29.110050    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-58sd4\" (UniqueName: \"kubernetes.io/projected/f2b3a4bb-9f0e-488f-9e99-28fd18286770-kube-api-access-58sd4\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:04:29.110069 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:29.110064    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f2b3a4bb-9f0e-488f-9e99-28fd18286770-util\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:04:29.110449 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:29.110424    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a79fb35-ace6-48c0-88ad-75deaf3305dc-bundle" (OuterVolumeSpecName: "bundle") pod "0a79fb35-ace6-48c0-88ad-75deaf3305dc" (UID: "0a79fb35-ace6-48c0-88ad-75deaf3305dc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:04:29.110591 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:29.110521    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cc2f746-400d-4382-92eb-1ed376af7d14-bundle" (OuterVolumeSpecName: "bundle") pod "9cc2f746-400d-4382-92eb-1ed376af7d14" (UID: "9cc2f746-400d-4382-92eb-1ed376af7d14"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:04:29.111126 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:29.111099    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bd493c5-6ba2-4d3c-bdd2-f47eaecfa0f3-bundle" (OuterVolumeSpecName: "bundle") pod "2bd493c5-6ba2-4d3c-bdd2-f47eaecfa0f3" (UID: "2bd493c5-6ba2-4d3c-bdd2-f47eaecfa0f3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:04:29.112056 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:29.112033    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bd493c5-6ba2-4d3c-bdd2-f47eaecfa0f3-kube-api-access-c9lk7" (OuterVolumeSpecName: "kube-api-access-c9lk7") pod "2bd493c5-6ba2-4d3c-bdd2-f47eaecfa0f3" (UID: "2bd493c5-6ba2-4d3c-bdd2-f47eaecfa0f3"). InnerVolumeSpecName "kube-api-access-c9lk7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:04:29.112205 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:29.112171    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cc2f746-400d-4382-92eb-1ed376af7d14-kube-api-access-pjb9l" (OuterVolumeSpecName: "kube-api-access-pjb9l") pod "9cc2f746-400d-4382-92eb-1ed376af7d14" (UID: "9cc2f746-400d-4382-92eb-1ed376af7d14"). InnerVolumeSpecName "kube-api-access-pjb9l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:04:29.112411 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:29.112395    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a79fb35-ace6-48c0-88ad-75deaf3305dc-kube-api-access-nmblc" (OuterVolumeSpecName: "kube-api-access-nmblc") pod "0a79fb35-ace6-48c0-88ad-75deaf3305dc" (UID: "0a79fb35-ace6-48c0-88ad-75deaf3305dc"). InnerVolumeSpecName "kube-api-access-nmblc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:04:29.116334 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:29.116311    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a79fb35-ace6-48c0-88ad-75deaf3305dc-util" (OuterVolumeSpecName: "util") pod "0a79fb35-ace6-48c0-88ad-75deaf3305dc" (UID: "0a79fb35-ace6-48c0-88ad-75deaf3305dc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:04:29.118738 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:29.118711    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bd493c5-6ba2-4d3c-bdd2-f47eaecfa0f3-util" (OuterVolumeSpecName: "util") pod "2bd493c5-6ba2-4d3c-bdd2-f47eaecfa0f3" (UID: "2bd493c5-6ba2-4d3c-bdd2-f47eaecfa0f3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:04:29.118884 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:29.118862    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cc2f746-400d-4382-92eb-1ed376af7d14-util" (OuterVolumeSpecName: "util") pod "9cc2f746-400d-4382-92eb-1ed376af7d14" (UID: "9cc2f746-400d-4382-92eb-1ed376af7d14"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:04:29.211094 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:29.211062    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nmblc\" (UniqueName: \"kubernetes.io/projected/0a79fb35-ace6-48c0-88ad-75deaf3305dc-kube-api-access-nmblc\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:04:29.211094 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:29.211088    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9cc2f746-400d-4382-92eb-1ed376af7d14-bundle\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:04:29.211094 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:29.211099    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c9lk7\" (UniqueName: \"kubernetes.io/projected/2bd493c5-6ba2-4d3c-bdd2-f47eaecfa0f3-kube-api-access-c9lk7\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:04:29.211346 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:29.211109    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2bd493c5-6ba2-4d3c-bdd2-f47eaecfa0f3-bundle\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:04:29.211346 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:29.211117    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2bd493c5-6ba2-4d3c-bdd2-f47eaecfa0f3-util\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:04:29.211346 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:29.211125    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0a79fb35-ace6-48c0-88ad-75deaf3305dc-bundle\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:04:29.211346 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:29.211144    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9cc2f746-400d-4382-92eb-1ed376af7d14-util\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:04:29.211346 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:29.211152    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pjb9l\" (UniqueName: \"kubernetes.io/projected/9cc2f746-400d-4382-92eb-1ed376af7d14-kube-api-access-pjb9l\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:04:29.211346 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:29.211159    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0a79fb35-ace6-48c0-88ad-75deaf3305dc-util\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:04:29.780104 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:29.780069    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mprjp"
Sep 10 21:04:29.780104 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:29.780082    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mprjp" event={"ID":"2bd493c5-6ba2-4d3c-bdd2-f47eaecfa0f3","Type":"ContainerDied","Data":"f83d52d771009d29b9d72683b99239ff5e16d4e3398e9f92acae88419610fb63"}
Sep 10 21:04:29.780439 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:29.780159    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f83d52d771009d29b9d72683b99239ff5e16d4e3398e9f92acae88419610fb63"
Sep 10 21:04:29.781979 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:29.781959    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6dw9dx"
Sep 10 21:04:29.781979 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:29.781965    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6dw9dx" event={"ID":"9cc2f746-400d-4382-92eb-1ed376af7d14","Type":"ContainerDied","Data":"6c50ce93bfcba866a2a0b428a05d9bda3526ba4497d614e269b2b915010d8ca4"}
Sep 10 21:04:29.782141 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:29.782002    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6c50ce93bfcba866a2a0b428a05d9bda3526ba4497d614e269b2b915010d8ca4"
Sep 10 21:04:29.784001 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:29.783963    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cqrqcd"
Sep 10 21:04:29.784001 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:29.783986    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cqrqcd" event={"ID":"0a79fb35-ace6-48c0-88ad-75deaf3305dc","Type":"ContainerDied","Data":"fa1582a894fc5c81c6ff5c0bb0af44d9dd63a9f9d9d4e792c0f20e36d0b3e50d"}
Sep 10 21:04:29.784188 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:29.784024    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fa1582a894fc5c81c6ff5c0bb0af44d9dd63a9f9d9d4e792c0f20e36d0b3e50d"
Sep 10 21:04:29.786065 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:29.786046    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afcfq7" event={"ID":"f2b3a4bb-9f0e-488f-9e99-28fd18286770","Type":"ContainerDied","Data":"3f4e9ad0467cb8cd73113fa5cc93913e08ca3e68cb35ba70737831974a6c73f9"}
Sep 10 21:04:29.786170 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:29.786070    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847afcfq7"
Sep 10 21:04:29.786170 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:29.786078    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3f4e9ad0467cb8cd73113fa5cc93913e08ca3e68cb35ba70737831974a6c73f9"
Sep 10 21:04:35.912568 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:35.912534    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-kf794"]
Sep 10 21:04:35.912942 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:35.912800    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a79fb35-ace6-48c0-88ad-75deaf3305dc" containerName="util"
Sep 10 21:04:35.912942 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:35.912811    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a79fb35-ace6-48c0-88ad-75deaf3305dc" containerName="util"
Sep 10 21:04:35.912942 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:35.912819    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cc2f746-400d-4382-92eb-1ed376af7d14" containerName="util"
Sep 10 21:04:35.912942 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:35.912825    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cc2f746-400d-4382-92eb-1ed376af7d14" containerName="util"
Sep 10 21:04:35.912942 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:35.912831    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a79fb35-ace6-48c0-88ad-75deaf3305dc" containerName="pull"
Sep 10 21:04:35.912942 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:35.912836    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a79fb35-ace6-48c0-88ad-75deaf3305dc" containerName="pull"
Sep 10 21:04:35.912942 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:35.912841    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cc2f746-400d-4382-92eb-1ed376af7d14" containerName="extract"
Sep 10 21:04:35.912942 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:35.912846    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cc2f746-400d-4382-92eb-1ed376af7d14" containerName="extract"
Sep 10 21:04:35.912942 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:35.912854    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2b3a4bb-9f0e-488f-9e99-28fd18286770" containerName="pull"
Sep 10 21:04:35.912942 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:35.912859    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2b3a4bb-9f0e-488f-9e99-28fd18286770" containerName="pull"
Sep 10 21:04:35.912942 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:35.912865    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bd493c5-6ba2-4d3c-bdd2-f47eaecfa0f3" containerName="pull"
Sep 10 21:04:35.912942 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:35.912871    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bd493c5-6ba2-4d3c-bdd2-f47eaecfa0f3" containerName="pull"
Sep 10 21:04:35.912942 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:35.912880    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a79fb35-ace6-48c0-88ad-75deaf3305dc" containerName="extract"
Sep 10 21:04:35.912942 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:35.912885    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a79fb35-ace6-48c0-88ad-75deaf3305dc" containerName="extract"
Sep 10 21:04:35.912942 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:35.912892    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bd493c5-6ba2-4d3c-bdd2-f47eaecfa0f3" containerName="extract"
Sep 10 21:04:35.912942 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:35.912897    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bd493c5-6ba2-4d3c-bdd2-f47eaecfa0f3" containerName="extract"
Sep 10 21:04:35.912942 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:35.912904    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2b3a4bb-9f0e-488f-9e99-28fd18286770" containerName="util"
Sep 10 21:04:35.912942 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:35.912909    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2b3a4bb-9f0e-488f-9e99-28fd18286770" containerName="util"
Sep 10 21:04:35.912942 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:35.912916    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cc2f746-400d-4382-92eb-1ed376af7d14" containerName="pull"
Sep 10 21:04:35.912942 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:35.912920    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cc2f746-400d-4382-92eb-1ed376af7d14" containerName="pull"
Sep 10 21:04:35.912942 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:35.912929    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bd493c5-6ba2-4d3c-bdd2-f47eaecfa0f3" containerName="util"
Sep 10 21:04:35.912942 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:35.912934    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bd493c5-6ba2-4d3c-bdd2-f47eaecfa0f3" containerName="util"
Sep 10 21:04:35.912942 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:35.912942    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2b3a4bb-9f0e-488f-9e99-28fd18286770" containerName="extract"
Sep 10 21:04:35.912942 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:35.912948    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2b3a4bb-9f0e-488f-9e99-28fd18286770" containerName="extract"
Sep 10 21:04:35.913687 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:35.912996    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a79fb35-ace6-48c0-88ad-75deaf3305dc" containerName="extract"
Sep 10 21:04:35.913687 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:35.913003    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2b3a4bb-9f0e-488f-9e99-28fd18286770" containerName="extract"
Sep 10 21:04:35.913687 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:35.913009    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="9cc2f746-400d-4382-92eb-1ed376af7d14" containerName="extract"
Sep 10 21:04:35.913687 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:35.913014    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="2bd493c5-6ba2-4d3c-bdd2-f47eaecfa0f3" containerName="extract"
Sep 10 21:04:35.917153 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:35.917136    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-kf794"
Sep 10 21:04:35.923857 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:35.923833    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 10 21:04:35.924403 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:35.924380    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-9qpzk\""
Sep 10 21:04:35.924473 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:35.924450    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 10 21:04:35.933306 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:35.933283    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-kf794"]
Sep 10 21:04:36.066251 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:36.066211    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tp6tl\" (UniqueName: \"kubernetes.io/projected/f6ce88a4-29a8-4cb2-96ac-c0bda5cf5d28-kube-api-access-tp6tl\") pod \"authorino-operator-76b478bd78-kf794\" (UID: \"f6ce88a4-29a8-4cb2-96ac-c0bda5cf5d28\") " pod="kuadrant-system/authorino-operator-76b478bd78-kf794"
Sep 10 21:04:36.167141 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:36.167043    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tp6tl\" (UniqueName: \"kubernetes.io/projected/f6ce88a4-29a8-4cb2-96ac-c0bda5cf5d28-kube-api-access-tp6tl\") pod \"authorino-operator-76b478bd78-kf794\" (UID: \"f6ce88a4-29a8-4cb2-96ac-c0bda5cf5d28\") " pod="kuadrant-system/authorino-operator-76b478bd78-kf794"
Sep 10 21:04:36.177427 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:36.177400    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tp6tl\" (UniqueName: \"kubernetes.io/projected/f6ce88a4-29a8-4cb2-96ac-c0bda5cf5d28-kube-api-access-tp6tl\") pod \"authorino-operator-76b478bd78-kf794\" (UID: \"f6ce88a4-29a8-4cb2-96ac-c0bda5cf5d28\") " pod="kuadrant-system/authorino-operator-76b478bd78-kf794"
Sep 10 21:04:36.227111 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:36.227073    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-kf794"
Sep 10 21:04:36.498193 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:36.498166    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-kf794"]
Sep 10 21:04:36.500395 ip-10-0-129-100 kubenswrapper[2564]: W0910 21:04:36.500360    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6ce88a4_29a8_4cb2_96ac_c0bda5cf5d28.slice/crio-2d9bd964cd3090ae70e8a0c7c750bb10c784f51120f3d532c2f0a80c0fcd7757 WatchSource:0}: Error finding container 2d9bd964cd3090ae70e8a0c7c750bb10c784f51120f3d532c2f0a80c0fcd7757: Status 404 returned error can't find the container with id 2d9bd964cd3090ae70e8a0c7c750bb10c784f51120f3d532c2f0a80c0fcd7757
Sep 10 21:04:36.821370 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:36.821336    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-kf794" event={"ID":"f6ce88a4-29a8-4cb2-96ac-c0bda5cf5d28","Type":"ContainerStarted","Data":"2d9bd964cd3090ae70e8a0c7c750bb10c784f51120f3d532c2f0a80c0fcd7757"}
Sep 10 21:04:39.844259 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:39.844207    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-kf794" event={"ID":"f6ce88a4-29a8-4cb2-96ac-c0bda5cf5d28","Type":"ContainerStarted","Data":"1cc0a44e9e9c201acf567fd8049f244c5dc963a134ecf1bfca6893d7f43e04b8"}
Sep 10 21:04:39.844668 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:39.844346    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-kf794"
Sep 10 21:04:39.866265 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:39.866194    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-kf794" podStartSLOduration=2.433070951 podStartE2EDuration="4.866177892s" totalImagesPullingTime="2.433106941s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:04:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:04:39.865924265 +0000 UTC m=+460.552991544" watchObservedRunningTime="2026-09-10 21:04:39.866177892 +0000 UTC m=+460.553245171"
Sep 10 21:04:45.543417 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:45.543380    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-snsrs"]
Sep 10 21:04:45.546602 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:45.546585    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-snsrs"
Sep 10 21:04:45.549694 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:45.549673    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-vlnlh\""
Sep 10 21:04:45.564270 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:45.564222    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-snsrs"]
Sep 10 21:04:45.656763 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:45.656727    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mpxn\" (UniqueName: \"kubernetes.io/projected/599b32a1-75cc-43d7-bd55-8591f64656cd-kube-api-access-2mpxn\") pod \"kuadrant-operator-controller-manager-76f8f686bf-snsrs\" (UID: \"599b32a1-75cc-43d7-bd55-8591f64656cd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-snsrs"
Sep 10 21:04:45.656918 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:45.656849    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/599b32a1-75cc-43d7-bd55-8591f64656cd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-snsrs\" (UID: \"599b32a1-75cc-43d7-bd55-8591f64656cd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-snsrs"
Sep 10 21:04:45.758193 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:45.758151    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/599b32a1-75cc-43d7-bd55-8591f64656cd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-snsrs\" (UID: \"599b32a1-75cc-43d7-bd55-8591f64656cd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-snsrs"
Sep 10 21:04:45.758382 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:45.758202    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mpxn\" (UniqueName: \"kubernetes.io/projected/599b32a1-75cc-43d7-bd55-8591f64656cd-kube-api-access-2mpxn\") pod \"kuadrant-operator-controller-manager-76f8f686bf-snsrs\" (UID: \"599b32a1-75cc-43d7-bd55-8591f64656cd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-snsrs"
Sep 10 21:04:45.758547 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:45.758525    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/599b32a1-75cc-43d7-bd55-8591f64656cd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-snsrs\" (UID: \"599b32a1-75cc-43d7-bd55-8591f64656cd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-snsrs"
Sep 10 21:04:45.766900 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:45.766876    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mpxn\" (UniqueName: \"kubernetes.io/projected/599b32a1-75cc-43d7-bd55-8591f64656cd-kube-api-access-2mpxn\") pod \"kuadrant-operator-controller-manager-76f8f686bf-snsrs\" (UID: \"599b32a1-75cc-43d7-bd55-8591f64656cd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-snsrs"
Sep 10 21:04:45.856197 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:45.856162    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-snsrs"
Sep 10 21:04:46.139108 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:46.139081    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-snsrs"]
Sep 10 21:04:46.140739 ip-10-0-129-100 kubenswrapper[2564]: W0910 21:04:46.140716    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod599b32a1_75cc_43d7_bd55_8591f64656cd.slice/crio-9ecb57c3e08f57e91836b6d6f18739a34ebd42fc8e457effde3210521d2cc544 WatchSource:0}: Error finding container 9ecb57c3e08f57e91836b6d6f18739a34ebd42fc8e457effde3210521d2cc544: Status 404 returned error can't find the container with id 9ecb57c3e08f57e91836b6d6f18739a34ebd42fc8e457effde3210521d2cc544
Sep 10 21:04:46.881885 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:46.881822    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-snsrs" event={"ID":"599b32a1-75cc-43d7-bd55-8591f64656cd","Type":"ContainerStarted","Data":"9ecb57c3e08f57e91836b6d6f18739a34ebd42fc8e457effde3210521d2cc544"}
Sep 10 21:04:49.901314 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:49.901278    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-snsrs" event={"ID":"599b32a1-75cc-43d7-bd55-8591f64656cd","Type":"ContainerStarted","Data":"8dce6eae678c34d52cb614cd93549954714c722cf08f485e488371317e98c13e"}
Sep 10 21:04:49.952821 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:49.952768    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-snsrs" podStartSLOduration=1.551885068 podStartE2EDuration="4.95275439s" totalImagesPullingTime="3.400869322s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:04:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:04:49.951595947 +0000 UTC m=+470.638663226" watchObservedRunningTime="2026-09-10 21:04:49.95275439 +0000 UTC m=+470.639821668"
Sep 10 21:04:50.852394 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:50.852363    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-kf794"
Sep 10 21:04:50.905776 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:04:50.905742    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-snsrs"
Sep 10 21:05:01.912564 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:01.912533    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-snsrs"
Sep 10 21:05:03.205462 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:03.205427    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-b85kq"]
Sep 10 21:05:03.210066 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:03.210048    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-b85kq"
Sep 10 21:05:03.244954 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:03.244918    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-b85kq"]
Sep 10 21:05:03.290891 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:03.290855    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/139bdcc0-4e63-469f-8bef-b4dbd30ee632-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-b85kq\" (UID: \"139bdcc0-4e63-469f-8bef-b4dbd30ee632\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-b85kq"
Sep 10 21:05:03.291053 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:03.290911    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhq7g\" (UniqueName: \"kubernetes.io/projected/139bdcc0-4e63-469f-8bef-b4dbd30ee632-kube-api-access-fhq7g\") pod \"kuadrant-operator-controller-manager-5f685c496f-b85kq\" (UID: \"139bdcc0-4e63-469f-8bef-b4dbd30ee632\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-b85kq"
Sep 10 21:05:03.392316 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:03.392279    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhq7g\" (UniqueName: \"kubernetes.io/projected/139bdcc0-4e63-469f-8bef-b4dbd30ee632-kube-api-access-fhq7g\") pod \"kuadrant-operator-controller-manager-5f685c496f-b85kq\" (UID: \"139bdcc0-4e63-469f-8bef-b4dbd30ee632\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-b85kq"
Sep 10 21:05:03.392527 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:03.392374    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/139bdcc0-4e63-469f-8bef-b4dbd30ee632-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-b85kq\" (UID: \"139bdcc0-4e63-469f-8bef-b4dbd30ee632\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-b85kq"
Sep 10 21:05:03.392787 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:03.392765    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/139bdcc0-4e63-469f-8bef-b4dbd30ee632-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-b85kq\" (UID: \"139bdcc0-4e63-469f-8bef-b4dbd30ee632\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-b85kq"
Sep 10 21:05:03.402348 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:03.402320    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhq7g\" (UniqueName: \"kubernetes.io/projected/139bdcc0-4e63-469f-8bef-b4dbd30ee632-kube-api-access-fhq7g\") pod \"kuadrant-operator-controller-manager-5f685c496f-b85kq\" (UID: \"139bdcc0-4e63-469f-8bef-b4dbd30ee632\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-b85kq"
Sep 10 21:05:03.519693 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:03.519601    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-b85kq"
Sep 10 21:05:03.812468 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:03.812440    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-b85kq"]
Sep 10 21:05:03.813160 ip-10-0-129-100 kubenswrapper[2564]: W0910 21:05:03.813136    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod139bdcc0_4e63_469f_8bef_b4dbd30ee632.slice/crio-573dda87c428afcd0c920ce87f16ec7c1c788c16c152e8d905fd414658653ea5 WatchSource:0}: Error finding container 573dda87c428afcd0c920ce87f16ec7c1c788c16c152e8d905fd414658653ea5: Status 404 returned error can't find the container with id 573dda87c428afcd0c920ce87f16ec7c1c788c16c152e8d905fd414658653ea5
Sep 10 21:05:03.969391 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:03.969358    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-b85kq" event={"ID":"139bdcc0-4e63-469f-8bef-b4dbd30ee632","Type":"ContainerStarted","Data":"4db60c794ba587c0e2db8f1fbfb2794f1fad8fc107e99bda7ee89210476c2c79"}
Sep 10 21:05:03.969391 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:03.969407    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-b85kq" event={"ID":"139bdcc0-4e63-469f-8bef-b4dbd30ee632","Type":"ContainerStarted","Data":"573dda87c428afcd0c920ce87f16ec7c1c788c16c152e8d905fd414658653ea5"}
Sep 10 21:05:03.969617 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:03.969494    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-b85kq"
Sep 10 21:05:04.006403 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:04.006341    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-b85kq" podStartSLOduration=1.006323761 podStartE2EDuration="1.006323761s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:05:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:05:04.004620954 +0000 UTC m=+484.691688236" watchObservedRunningTime="2026-09-10 21:05:04.006323761 +0000 UTC m=+484.693391039"
Sep 10 21:05:04.093120 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:04.093044    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-b85kq"]
Sep 10 21:05:04.097376 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:04.097350    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-b85kq"]
Sep 10 21:05:04.112262 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:04.112210    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-snsrs"]
Sep 10 21:05:04.112454 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:04.112429    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-snsrs" podUID="599b32a1-75cc-43d7-bd55-8591f64656cd" containerName="manager" containerID="cri-o://8dce6eae678c34d52cb614cd93549954714c722cf08f485e488371317e98c13e" gracePeriod=2
Sep 10 21:05:04.126513 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:04.126484    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-snsrs"]
Sep 10 21:05:04.133334 ip-10-0-129-100 kubenswrapper[2564]: E0910 21:05:04.133303    2564 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"599b32a1-75cc-43d7-bd55-8591f64656cd\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-76f8f686bf-snsrs\": pods \"kuadrant-operator-controller-manager-76f8f686bf-snsrs\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-snsrs"
Sep 10 21:05:04.140917 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:04.140887    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gdxtp"]
Sep 10 21:05:04.141351 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:04.141333    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="599b32a1-75cc-43d7-bd55-8591f64656cd" containerName="manager"
Sep 10 21:05:04.141426 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:04.141354    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="599b32a1-75cc-43d7-bd55-8591f64656cd" containerName="manager"
Sep 10 21:05:04.141426 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:04.141377    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="139bdcc0-4e63-469f-8bef-b4dbd30ee632" containerName="manager"
Sep 10 21:05:04.141426 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:04.141386    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="139bdcc0-4e63-469f-8bef-b4dbd30ee632" containerName="manager"
Sep 10 21:05:04.141579 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:04.141468    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="139bdcc0-4e63-469f-8bef-b4dbd30ee632" containerName="manager"
Sep 10 21:05:04.141579 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:04.141480    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="599b32a1-75cc-43d7-bd55-8591f64656cd" containerName="manager"
Sep 10 21:05:04.144672 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:04.144653    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gdxtp"
Sep 10 21:05:04.148372 ip-10-0-129-100 kubenswrapper[2564]: E0910 21:05:04.148343    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-snsrs\" is forbidden: User \"system:node:ip-10-0-129-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-100.ec2.internal' and this object" podUID="599b32a1-75cc-43d7-bd55-8591f64656cd" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-snsrs"
Sep 10 21:05:04.186839 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:04.186814    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gdxtp"]
Sep 10 21:05:04.188568 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:04.188544    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-t5p2c"]
Sep 10 21:05:04.191716 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:04.191694    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-t5p2c"
Sep 10 21:05:04.194505 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:04.194483    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-xnlw7\""
Sep 10 21:05:04.200182 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:04.200158    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2sd5\" (UniqueName: \"kubernetes.io/projected/15a07900-8998-491e-944f-d77570d934b3-kube-api-access-t2sd5\") pod \"kuadrant-operator-controller-manager-76f8f686bf-gdxtp\" (UID: \"15a07900-8998-491e-944f-d77570d934b3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gdxtp"
Sep 10 21:05:04.200302 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:04.200213    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/15a07900-8998-491e-944f-d77570d934b3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-gdxtp\" (UID: \"15a07900-8998-491e-944f-d77570d934b3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gdxtp"
Sep 10 21:05:04.215929 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:04.215902    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-t5p2c"]
Sep 10 21:05:04.264093 ip-10-0-129-100 kubenswrapper[2564]: E0910 21:05:04.264055    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-snsrs\" is forbidden: User \"system:node:ip-10-0-129-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-100.ec2.internal' and this object" podUID="599b32a1-75cc-43d7-bd55-8591f64656cd" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-snsrs"
Sep 10 21:05:04.300749 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:04.300717    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2sd5\" (UniqueName: \"kubernetes.io/projected/15a07900-8998-491e-944f-d77570d934b3-kube-api-access-t2sd5\") pod \"kuadrant-operator-controller-manager-76f8f686bf-gdxtp\" (UID: \"15a07900-8998-491e-944f-d77570d934b3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gdxtp"
Sep 10 21:05:04.300894 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:04.300773    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/15a07900-8998-491e-944f-d77570d934b3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-gdxtp\" (UID: \"15a07900-8998-491e-944f-d77570d934b3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gdxtp"
Sep 10 21:05:04.300894 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:04.300817    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rhlh\" (UniqueName: \"kubernetes.io/projected/f8ad85fd-15fe-474f-bceb-c40d90f9eeba-kube-api-access-2rhlh\") pod \"limitador-operator-controller-manager-74495c69f8-t5p2c\" (UID: \"f8ad85fd-15fe-474f-bceb-c40d90f9eeba\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-t5p2c"
Sep 10 21:05:04.301170 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:04.301150    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/15a07900-8998-491e-944f-d77570d934b3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-gdxtp\" (UID: \"15a07900-8998-491e-944f-d77570d934b3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gdxtp"
Sep 10 21:05:04.312044 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:04.312018    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2sd5\" (UniqueName: \"kubernetes.io/projected/15a07900-8998-491e-944f-d77570d934b3-kube-api-access-t2sd5\") pod \"kuadrant-operator-controller-manager-76f8f686bf-gdxtp\" (UID: \"15a07900-8998-491e-944f-d77570d934b3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gdxtp"
Sep 10 21:05:04.345050 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:04.345001    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-snsrs"
Sep 10 21:05:04.349245 ip-10-0-129-100 kubenswrapper[2564]: E0910 21:05:04.348001    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-snsrs\" is forbidden: User \"system:node:ip-10-0-129-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-100.ec2.internal' and this object" podUID="599b32a1-75cc-43d7-bd55-8591f64656cd" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-snsrs"
Sep 10 21:05:04.401438 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:04.401404    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2mpxn\" (UniqueName: \"kubernetes.io/projected/599b32a1-75cc-43d7-bd55-8591f64656cd-kube-api-access-2mpxn\") pod \"599b32a1-75cc-43d7-bd55-8591f64656cd\" (UID: \"599b32a1-75cc-43d7-bd55-8591f64656cd\") "
Sep 10 21:05:04.401438 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:04.401445    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/599b32a1-75cc-43d7-bd55-8591f64656cd-extensions-socket-volume\") pod \"599b32a1-75cc-43d7-bd55-8591f64656cd\" (UID: \"599b32a1-75cc-43d7-bd55-8591f64656cd\") "
Sep 10 21:05:04.401673 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:04.401590    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rhlh\" (UniqueName: \"kubernetes.io/projected/f8ad85fd-15fe-474f-bceb-c40d90f9eeba-kube-api-access-2rhlh\") pod \"limitador-operator-controller-manager-74495c69f8-t5p2c\" (UID: \"f8ad85fd-15fe-474f-bceb-c40d90f9eeba\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-t5p2c"
Sep 10 21:05:04.401877 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:04.401851    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/599b32a1-75cc-43d7-bd55-8591f64656cd-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "599b32a1-75cc-43d7-bd55-8591f64656cd" (UID: "599b32a1-75cc-43d7-bd55-8591f64656cd"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:05:04.403671 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:04.403647    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/599b32a1-75cc-43d7-bd55-8591f64656cd-kube-api-access-2mpxn" (OuterVolumeSpecName: "kube-api-access-2mpxn") pod "599b32a1-75cc-43d7-bd55-8591f64656cd" (UID: "599b32a1-75cc-43d7-bd55-8591f64656cd"). InnerVolumeSpecName "kube-api-access-2mpxn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:05:04.417565 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:04.417541    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rhlh\" (UniqueName: \"kubernetes.io/projected/f8ad85fd-15fe-474f-bceb-c40d90f9eeba-kube-api-access-2rhlh\") pod \"limitador-operator-controller-manager-74495c69f8-t5p2c\" (UID: \"f8ad85fd-15fe-474f-bceb-c40d90f9eeba\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-t5p2c"
Sep 10 21:05:04.480187 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:04.480154    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gdxtp"
Sep 10 21:05:04.502451 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:04.502416    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-t5p2c"
Sep 10 21:05:04.502579 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:04.502558    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2mpxn\" (UniqueName: \"kubernetes.io/projected/599b32a1-75cc-43d7-bd55-8591f64656cd-kube-api-access-2mpxn\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:05:04.502621 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:04.502583    2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/599b32a1-75cc-43d7-bd55-8591f64656cd-extensions-socket-volume\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:05:04.800190 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:04.799863    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-t5p2c"]
Sep 10 21:05:04.801697 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:04.801676    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gdxtp"]
Sep 10 21:05:04.802512 ip-10-0-129-100 kubenswrapper[2564]: W0910 21:05:04.802486    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8ad85fd_15fe_474f_bceb_c40d90f9eeba.slice/crio-a4b6884aeb4a1006a2c58bbd18510718d2842a642af791cdb6bf09caf473084b WatchSource:0}: Error finding container a4b6884aeb4a1006a2c58bbd18510718d2842a642af791cdb6bf09caf473084b: Status 404 returned error can't find the container with id a4b6884aeb4a1006a2c58bbd18510718d2842a642af791cdb6bf09caf473084b
Sep 10 21:05:04.803128 ip-10-0-129-100 kubenswrapper[2564]: W0910 21:05:04.803107    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15a07900_8998_491e_944f_d77570d934b3.slice/crio-04bcce45f84a09a410cd7f6c83f749694cc3fe021fa94911f179f5876efe0509 WatchSource:0}: Error finding container 04bcce45f84a09a410cd7f6c83f749694cc3fe021fa94911f179f5876efe0509: Status 404 returned error can't find the container with id 04bcce45f84a09a410cd7f6c83f749694cc3fe021fa94911f179f5876efe0509
Sep 10 21:05:04.976644 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:04.976609    2564 generic.go:356] "Generic (PLEG): container finished" podID="599b32a1-75cc-43d7-bd55-8591f64656cd" containerID="8dce6eae678c34d52cb614cd93549954714c722cf08f485e488371317e98c13e" exitCode=0
Sep 10 21:05:04.976818 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:04.976665    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-snsrs"
Sep 10 21:05:04.976818 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:04.976713    2564 scope.go:117] "RemoveContainer" containerID="8dce6eae678c34d52cb614cd93549954714c722cf08f485e488371317e98c13e"
Sep 10 21:05:04.978677 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:04.978649    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gdxtp" event={"ID":"15a07900-8998-491e-944f-d77570d934b3","Type":"ContainerStarted","Data":"e867530040122f2919d2668db8e9a38181ccfcfc433f6dce815fd1a92c559518"}
Sep 10 21:05:04.978804 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:04.978703    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gdxtp" event={"ID":"15a07900-8998-491e-944f-d77570d934b3","Type":"ContainerStarted","Data":"04bcce45f84a09a410cd7f6c83f749694cc3fe021fa94911f179f5876efe0509"}
Sep 10 21:05:04.978804 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:04.978734    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gdxtp"
Sep 10 21:05:04.980139 ip-10-0-129-100 kubenswrapper[2564]: E0910 21:05:04.980096    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-snsrs\" is forbidden: User \"system:node:ip-10-0-129-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-100.ec2.internal' and this object" podUID="599b32a1-75cc-43d7-bd55-8591f64656cd" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-snsrs"
Sep 10 21:05:04.980278 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:04.980151    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-t5p2c" event={"ID":"f8ad85fd-15fe-474f-bceb-c40d90f9eeba","Type":"ContainerStarted","Data":"a4b6884aeb4a1006a2c58bbd18510718d2842a642af791cdb6bf09caf473084b"}
Sep 10 21:05:04.980403 ip-10-0-129-100 kubenswrapper[2564]: E0910 21:05:04.980387    2564 kuberuntime_manager.go:649] "Missing actuated resource record" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-b85kq" container="manager"
Sep 10 21:05:04.982545 ip-10-0-129-100 kubenswrapper[2564]: E0910 21:05:04.982512    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-snsrs\" is forbidden: User \"system:node:ip-10-0-129-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-100.ec2.internal' and this object" podUID="599b32a1-75cc-43d7-bd55-8591f64656cd" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-snsrs"
Sep 10 21:05:04.986106 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:04.986090    2564 scope.go:117] "RemoveContainer" containerID="8dce6eae678c34d52cb614cd93549954714c722cf08f485e488371317e98c13e"
Sep 10 21:05:04.986403 ip-10-0-129-100 kubenswrapper[2564]: E0910 21:05:04.986384    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8dce6eae678c34d52cb614cd93549954714c722cf08f485e488371317e98c13e\": container with ID starting with 8dce6eae678c34d52cb614cd93549954714c722cf08f485e488371317e98c13e not found: ID does not exist" containerID="8dce6eae678c34d52cb614cd93549954714c722cf08f485e488371317e98c13e"
Sep 10 21:05:04.986462 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:04.986410    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8dce6eae678c34d52cb614cd93549954714c722cf08f485e488371317e98c13e"} err="failed to get container status \"8dce6eae678c34d52cb614cd93549954714c722cf08f485e488371317e98c13e\": rpc error: code = NotFound desc = could not find container \"8dce6eae678c34d52cb614cd93549954714c722cf08f485e488371317e98c13e\": container with ID starting with 8dce6eae678c34d52cb614cd93549954714c722cf08f485e488371317e98c13e not found: ID does not exist"
Sep 10 21:05:05.037907 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:05.037856    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gdxtp" podStartSLOduration=1.037841072 podStartE2EDuration="1.037841072s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:05:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:05:05.036354408 +0000 UTC m=+485.723421687" watchObservedRunningTime="2026-09-10 21:05:05.037841072 +0000 UTC m=+485.724908351"
Sep 10 21:05:05.039740 ip-10-0-129-100 kubenswrapper[2564]: E0910 21:05:05.039714    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5f685c496f-b85kq\" is forbidden: User \"system:node:ip-10-0-129-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-100.ec2.internal' and this object" podUID="139bdcc0-4e63-469f-8bef-b4dbd30ee632" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-b85kq"
Sep 10 21:05:05.042194 ip-10-0-129-100 kubenswrapper[2564]: E0910 21:05:05.042174    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-snsrs\" is forbidden: User \"system:node:ip-10-0-129-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-100.ec2.internal' and this object" podUID="599b32a1-75cc-43d7-bd55-8591f64656cd" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-snsrs"
Sep 10 21:05:05.875280 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:05.875244    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="599b32a1-75cc-43d7-bd55-8591f64656cd" path="/var/lib/kubelet/pods/599b32a1-75cc-43d7-bd55-8591f64656cd/volumes"
Sep 10 21:05:05.990519 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:05.990453    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-b85kq" podUID="139bdcc0-4e63-469f-8bef-b4dbd30ee632" containerName="manager" containerID="cri-o://4db60c794ba587c0e2db8f1fbfb2794f1fad8fc107e99bda7ee89210476c2c79" gracePeriod=2
Sep 10 21:05:06.377129 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:06.377104    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-b85kq"
Sep 10 21:05:06.418193 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:06.418157    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/139bdcc0-4e63-469f-8bef-b4dbd30ee632-extensions-socket-volume\") pod \"139bdcc0-4e63-469f-8bef-b4dbd30ee632\" (UID: \"139bdcc0-4e63-469f-8bef-b4dbd30ee632\") "
Sep 10 21:05:06.418360 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:06.418246    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fhq7g\" (UniqueName: \"kubernetes.io/projected/139bdcc0-4e63-469f-8bef-b4dbd30ee632-kube-api-access-fhq7g\") pod \"139bdcc0-4e63-469f-8bef-b4dbd30ee632\" (UID: \"139bdcc0-4e63-469f-8bef-b4dbd30ee632\") "
Sep 10 21:05:06.418568 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:06.418545    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/139bdcc0-4e63-469f-8bef-b4dbd30ee632-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "139bdcc0-4e63-469f-8bef-b4dbd30ee632" (UID: "139bdcc0-4e63-469f-8bef-b4dbd30ee632"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:05:06.420153 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:06.420132    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/139bdcc0-4e63-469f-8bef-b4dbd30ee632-kube-api-access-fhq7g" (OuterVolumeSpecName: "kube-api-access-fhq7g") pod "139bdcc0-4e63-469f-8bef-b4dbd30ee632" (UID: "139bdcc0-4e63-469f-8bef-b4dbd30ee632"). InnerVolumeSpecName "kube-api-access-fhq7g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:05:06.519647 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:06.519571    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fhq7g\" (UniqueName: \"kubernetes.io/projected/139bdcc0-4e63-469f-8bef-b4dbd30ee632-kube-api-access-fhq7g\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:05:06.519647 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:06.519597    2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/139bdcc0-4e63-469f-8bef-b4dbd30ee632-extensions-socket-volume\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:05:06.997086 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:06.997047    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-t5p2c" event={"ID":"f8ad85fd-15fe-474f-bceb-c40d90f9eeba","Type":"ContainerStarted","Data":"0796f302bf92555f272f776a177f94e503b9457d76442ccafaddc971f9f9b584"}
Sep 10 21:05:06.997573 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:06.997152    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-t5p2c"
Sep 10 21:05:06.998534 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:06.998513    2564 generic.go:356] "Generic (PLEG): container finished" podID="139bdcc0-4e63-469f-8bef-b4dbd30ee632" containerID="4db60c794ba587c0e2db8f1fbfb2794f1fad8fc107e99bda7ee89210476c2c79" exitCode=0
Sep 10 21:05:06.998621 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:06.998547    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-b85kq"
Sep 10 21:05:06.998621 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:06.998596    2564 scope.go:117] "RemoveContainer" containerID="4db60c794ba587c0e2db8f1fbfb2794f1fad8fc107e99bda7ee89210476c2c79"
Sep 10 21:05:07.007006 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:07.006992    2564 scope.go:117] "RemoveContainer" containerID="4db60c794ba587c0e2db8f1fbfb2794f1fad8fc107e99bda7ee89210476c2c79"
Sep 10 21:05:07.007272 ip-10-0-129-100 kubenswrapper[2564]: E0910 21:05:07.007254    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4db60c794ba587c0e2db8f1fbfb2794f1fad8fc107e99bda7ee89210476c2c79\": container with ID starting with 4db60c794ba587c0e2db8f1fbfb2794f1fad8fc107e99bda7ee89210476c2c79 not found: ID does not exist" containerID="4db60c794ba587c0e2db8f1fbfb2794f1fad8fc107e99bda7ee89210476c2c79"
Sep 10 21:05:07.007310 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:07.007279    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4db60c794ba587c0e2db8f1fbfb2794f1fad8fc107e99bda7ee89210476c2c79"} err="failed to get container status \"4db60c794ba587c0e2db8f1fbfb2794f1fad8fc107e99bda7ee89210476c2c79\": rpc error: code = NotFound desc = could not find container \"4db60c794ba587c0e2db8f1fbfb2794f1fad8fc107e99bda7ee89210476c2c79\": container with ID starting with 4db60c794ba587c0e2db8f1fbfb2794f1fad8fc107e99bda7ee89210476c2c79 not found: ID does not exist"
Sep 10 21:05:07.049212 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:07.049167    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-t5p2c" podStartSLOduration=1.563440648 podStartE2EDuration="3.049155362s" totalImagesPullingTime="1.485714714s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:05:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:05:07.046584166 +0000 UTC m=+487.733651445" watchObservedRunningTime="2026-09-10 21:05:07.049155362 +0000 UTC m=+487.736222641"
Sep 10 21:05:07.052298 ip-10-0-129-100 kubenswrapper[2564]: E0910 21:05:07.052278    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5f685c496f-b85kq\" is forbidden: User \"system:node:ip-10-0-129-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-100.ec2.internal' and this object" podUID="139bdcc0-4e63-469f-8bef-b4dbd30ee632" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-b85kq"
Sep 10 21:05:07.872908 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:07.872874    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="139bdcc0-4e63-469f-8bef-b4dbd30ee632" path="/var/lib/kubelet/pods/139bdcc0-4e63-469f-8bef-b4dbd30ee632/volumes"
Sep 10 21:05:15.992600 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:15.992566    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gdxtp"
Sep 10 21:05:18.006975 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:18.006943    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-t5p2c"
Sep 10 21:05:20.055753 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:20.055712    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gdxtp"]
Sep 10 21:05:20.056195 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:20.055929    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gdxtp" podUID="15a07900-8998-491e-944f-d77570d934b3" containerName="manager" containerID="cri-o://e867530040122f2919d2668db8e9a38181ccfcfc433f6dce815fd1a92c559518" gracePeriod=10
Sep 10 21:05:20.301034 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:20.301004    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gdxtp"
Sep 10 21:05:20.425513 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:20.425412    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t2sd5\" (UniqueName: \"kubernetes.io/projected/15a07900-8998-491e-944f-d77570d934b3-kube-api-access-t2sd5\") pod \"15a07900-8998-491e-944f-d77570d934b3\" (UID: \"15a07900-8998-491e-944f-d77570d934b3\") "
Sep 10 21:05:20.425513 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:20.425475    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/15a07900-8998-491e-944f-d77570d934b3-extensions-socket-volume\") pod \"15a07900-8998-491e-944f-d77570d934b3\" (UID: \"15a07900-8998-491e-944f-d77570d934b3\") "
Sep 10 21:05:20.425915 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:20.425890    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15a07900-8998-491e-944f-d77570d934b3-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "15a07900-8998-491e-944f-d77570d934b3" (UID: "15a07900-8998-491e-944f-d77570d934b3"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:05:20.427694 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:20.427669    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15a07900-8998-491e-944f-d77570d934b3-kube-api-access-t2sd5" (OuterVolumeSpecName: "kube-api-access-t2sd5") pod "15a07900-8998-491e-944f-d77570d934b3" (UID: "15a07900-8998-491e-944f-d77570d934b3"). InnerVolumeSpecName "kube-api-access-t2sd5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:05:20.526406 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:20.526364    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t2sd5\" (UniqueName: \"kubernetes.io/projected/15a07900-8998-491e-944f-d77570d934b3-kube-api-access-t2sd5\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:05:20.526406 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:20.526403    2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/15a07900-8998-491e-944f-d77570d934b3-extensions-socket-volume\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:05:20.595168 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:20.595133    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5xz89"]
Sep 10 21:05:20.595474 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:20.595462    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15a07900-8998-491e-944f-d77570d934b3" containerName="manager"
Sep 10 21:05:20.595523 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:20.595476    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="15a07900-8998-491e-944f-d77570d934b3" containerName="manager"
Sep 10 21:05:20.595556 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:20.595537    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="15a07900-8998-491e-944f-d77570d934b3" containerName="manager"
Sep 10 21:05:20.598507 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:20.598491    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5xz89"
Sep 10 21:05:20.619280 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:20.619219    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5xz89"]
Sep 10 21:05:20.735848 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:20.735749    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vg85l\" (UniqueName: \"kubernetes.io/projected/f04fe38d-a7a2-486f-9042-755d80c46efe-kube-api-access-vg85l\") pod \"kuadrant-operator-controller-manager-5769f99d9f-5xz89\" (UID: \"f04fe38d-a7a2-486f-9042-755d80c46efe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5xz89"
Sep 10 21:05:20.735848 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:20.735824    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f04fe38d-a7a2-486f-9042-755d80c46efe-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-5xz89\" (UID: \"f04fe38d-a7a2-486f-9042-755d80c46efe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5xz89"
Sep 10 21:05:20.836661 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:20.836626    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f04fe38d-a7a2-486f-9042-755d80c46efe-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-5xz89\" (UID: \"f04fe38d-a7a2-486f-9042-755d80c46efe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5xz89"
Sep 10 21:05:20.836819 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:20.836696    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vg85l\" (UniqueName: \"kubernetes.io/projected/f04fe38d-a7a2-486f-9042-755d80c46efe-kube-api-access-vg85l\") pod \"kuadrant-operator-controller-manager-5769f99d9f-5xz89\" (UID: \"f04fe38d-a7a2-486f-9042-755d80c46efe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5xz89"
Sep 10 21:05:20.837051 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:20.837026    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f04fe38d-a7a2-486f-9042-755d80c46efe-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-5xz89\" (UID: \"f04fe38d-a7a2-486f-9042-755d80c46efe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5xz89"
Sep 10 21:05:20.846968 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:20.846942    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vg85l\" (UniqueName: \"kubernetes.io/projected/f04fe38d-a7a2-486f-9042-755d80c46efe-kube-api-access-vg85l\") pod \"kuadrant-operator-controller-manager-5769f99d9f-5xz89\" (UID: \"f04fe38d-a7a2-486f-9042-755d80c46efe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5xz89"
Sep 10 21:05:20.907546 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:20.907513    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5xz89"
Sep 10 21:05:21.068818 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:21.068787    2564 generic.go:356] "Generic (PLEG): container finished" podID="15a07900-8998-491e-944f-d77570d934b3" containerID="e867530040122f2919d2668db8e9a38181ccfcfc433f6dce815fd1a92c559518" exitCode=0
Sep 10 21:05:21.069169 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:21.068847    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gdxtp"
Sep 10 21:05:21.069169 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:21.068857    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gdxtp" event={"ID":"15a07900-8998-491e-944f-d77570d934b3","Type":"ContainerDied","Data":"e867530040122f2919d2668db8e9a38181ccfcfc433f6dce815fd1a92c559518"}
Sep 10 21:05:21.069169 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:21.068920    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gdxtp" event={"ID":"15a07900-8998-491e-944f-d77570d934b3","Type":"ContainerDied","Data":"04bcce45f84a09a410cd7f6c83f749694cc3fe021fa94911f179f5876efe0509"}
Sep 10 21:05:21.069169 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:21.068941    2564 scope.go:117] "RemoveContainer" containerID="e867530040122f2919d2668db8e9a38181ccfcfc433f6dce815fd1a92c559518"
Sep 10 21:05:21.099841 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:21.097360    2564 scope.go:117] "RemoveContainer" containerID="e867530040122f2919d2668db8e9a38181ccfcfc433f6dce815fd1a92c559518"
Sep 10 21:05:21.099841 ip-10-0-129-100 kubenswrapper[2564]: E0910 21:05:21.097678    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e867530040122f2919d2668db8e9a38181ccfcfc433f6dce815fd1a92c559518\": container with ID starting with e867530040122f2919d2668db8e9a38181ccfcfc433f6dce815fd1a92c559518 not found: ID does not exist" containerID="e867530040122f2919d2668db8e9a38181ccfcfc433f6dce815fd1a92c559518"
Sep 10 21:05:21.099841 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:21.097712    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e867530040122f2919d2668db8e9a38181ccfcfc433f6dce815fd1a92c559518"} err="failed to get container status \"e867530040122f2919d2668db8e9a38181ccfcfc433f6dce815fd1a92c559518\": rpc error: code = NotFound desc = could not find container \"e867530040122f2919d2668db8e9a38181ccfcfc433f6dce815fd1a92c559518\": container with ID starting with e867530040122f2919d2668db8e9a38181ccfcfc433f6dce815fd1a92c559518 not found: ID does not exist"
Sep 10 21:05:21.122681 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:21.122655    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gdxtp"]
Sep 10 21:05:21.140333 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:21.140311    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gdxtp"]
Sep 10 21:05:21.214721 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:21.214702    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5xz89"]
Sep 10 21:05:21.216030 ip-10-0-129-100 kubenswrapper[2564]: W0910 21:05:21.216012    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf04fe38d_a7a2_486f_9042_755d80c46efe.slice/crio-acb3932e2785ff8179abbfbc49aa01d0d4a9a480dfee4074e95591cb0529db98 WatchSource:0}: Error finding container acb3932e2785ff8179abbfbc49aa01d0d4a9a480dfee4074e95591cb0529db98: Status 404 returned error can't find the container with id acb3932e2785ff8179abbfbc49aa01d0d4a9a480dfee4074e95591cb0529db98
Sep 10 21:05:21.873141 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:21.873108    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15a07900-8998-491e-944f-d77570d934b3" path="/var/lib/kubelet/pods/15a07900-8998-491e-944f-d77570d934b3/volumes"
Sep 10 21:05:22.077521 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:22.077481    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5xz89" event={"ID":"f04fe38d-a7a2-486f-9042-755d80c46efe","Type":"ContainerStarted","Data":"e274fd40f58b1c3f0c484e7d636b60726750e5f2d3dceb2ededfe3b55d8730c7"}
Sep 10 21:05:22.077901 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:22.077547    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5xz89" event={"ID":"f04fe38d-a7a2-486f-9042-755d80c46efe","Type":"ContainerStarted","Data":"acb3932e2785ff8179abbfbc49aa01d0d4a9a480dfee4074e95591cb0529db98"}
Sep 10 21:05:22.077901 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:22.077602    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5xz89"
Sep 10 21:05:22.114493 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:22.114425    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5xz89" podStartSLOduration=2.114408639 podStartE2EDuration="2.114408639s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:05:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:05:22.112450954 +0000 UTC m=+502.799518233" watchObservedRunningTime="2026-09-10 21:05:22.114408639 +0000 UTC m=+502.801475918"
Sep 10 21:05:33.085541 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:05:33.085512    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5xz89"
Sep 10 21:07:01.112969 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:07:01.112855    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-cd9hp_0432bad8-86f5-4b0e-a0d4-2fdb728223f2/console-operator/2.log"
Sep 10 21:07:01.115058 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:07:01.113747    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-cd9hp_0432bad8-86f5-4b0e-a0d4-2fdb728223f2/console-operator/2.log"
Sep 10 21:07:01.119764 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:07:01.119742    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wrbhk_279e54f7-0db1-4e2d-a998-4b3ecdf992cd/ovn-acl-logging/0.log"
Sep 10 21:07:01.120585 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:07:01.120565    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wrbhk_279e54f7-0db1-4e2d-a998-4b3ecdf992cd/ovn-acl-logging/0.log"
Sep 10 21:07:42.624638 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:07:42.624592    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-87zd7"]
Sep 10 21:07:42.626842 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:07:42.626825    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-87zd7"
Sep 10 21:07:42.629623 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:07:42.629600    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 10 21:07:42.629965 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:07:42.629948    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-822jm\""
Sep 10 21:07:42.630540 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:07:42.630526    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 10 21:07:42.630753 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:07:42.630736    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Sep 10 21:07:42.645317 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:07:42.645294    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-87zd7"]
Sep 10 21:07:42.811548 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:07:42.811513    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2d3046f2-199e-4540-84e6-212ff2c21614-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-87zd7\" (UID: \"2d3046f2-199e-4540-84e6-212ff2c21614\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-87zd7"
Sep 10 21:07:42.811548 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:07:42.811550    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2d3046f2-199e-4540-84e6-212ff2c21614-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-87zd7\" (UID: \"2d3046f2-199e-4540-84e6-212ff2c21614\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-87zd7"
Sep 10 21:07:42.811784 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:07:42.811579    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rltb2\" (UniqueName: \"kubernetes.io/projected/2d3046f2-199e-4540-84e6-212ff2c21614-kube-api-access-rltb2\") pod \"e2e-distinct-simulated-kserve-59975d69f9-87zd7\" (UID: \"2d3046f2-199e-4540-84e6-212ff2c21614\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-87zd7"
Sep 10 21:07:42.811784 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:07:42.811658    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2d3046f2-199e-4540-84e6-212ff2c21614-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-87zd7\" (UID: \"2d3046f2-199e-4540-84e6-212ff2c21614\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-87zd7"
Sep 10 21:07:42.811784 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:07:42.811699    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d3046f2-199e-4540-84e6-212ff2c21614-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-87zd7\" (UID: \"2d3046f2-199e-4540-84e6-212ff2c21614\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-87zd7"
Sep 10 21:07:42.811784 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:07:42.811719    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d3046f2-199e-4540-84e6-212ff2c21614-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-87zd7\" (UID: \"2d3046f2-199e-4540-84e6-212ff2c21614\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-87zd7"
Sep 10 21:07:42.912661 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:07:42.912581    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rltb2\" (UniqueName: \"kubernetes.io/projected/2d3046f2-199e-4540-84e6-212ff2c21614-kube-api-access-rltb2\") pod \"e2e-distinct-simulated-kserve-59975d69f9-87zd7\" (UID: \"2d3046f2-199e-4540-84e6-212ff2c21614\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-87zd7"
Sep 10 21:07:42.912661 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:07:42.912624    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2d3046f2-199e-4540-84e6-212ff2c21614-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-87zd7\" (UID: \"2d3046f2-199e-4540-84e6-212ff2c21614\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-87zd7"
Sep 10 21:07:42.912661 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:07:42.912654    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d3046f2-199e-4540-84e6-212ff2c21614-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-87zd7\" (UID: \"2d3046f2-199e-4540-84e6-212ff2c21614\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-87zd7"
Sep 10 21:07:42.912948 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:07:42.912767    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d3046f2-199e-4540-84e6-212ff2c21614-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-87zd7\" (UID: \"2d3046f2-199e-4540-84e6-212ff2c21614\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-87zd7"
Sep 10 21:07:42.912948 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:07:42.912835    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2d3046f2-199e-4540-84e6-212ff2c21614-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-87zd7\" (UID: \"2d3046f2-199e-4540-84e6-212ff2c21614\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-87zd7"
Sep 10 21:07:42.912948 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:07:42.912863    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2d3046f2-199e-4540-84e6-212ff2c21614-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-87zd7\" (UID: \"2d3046f2-199e-4540-84e6-212ff2c21614\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-87zd7"
Sep 10 21:07:42.913101 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:07:42.912998    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d3046f2-199e-4540-84e6-212ff2c21614-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-87zd7\" (UID: \"2d3046f2-199e-4540-84e6-212ff2c21614\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-87zd7"
Sep 10 21:07:42.913101 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:07:42.913046    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2d3046f2-199e-4540-84e6-212ff2c21614-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-87zd7\" (UID: \"2d3046f2-199e-4540-84e6-212ff2c21614\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-87zd7"
Sep 10 21:07:42.913168 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:07:42.913102    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2d3046f2-199e-4540-84e6-212ff2c21614-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-87zd7\" (UID: \"2d3046f2-199e-4540-84e6-212ff2c21614\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-87zd7"
Sep 10 21:07:42.915063 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:07:42.915033    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2d3046f2-199e-4540-84e6-212ff2c21614-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-87zd7\" (UID: \"2d3046f2-199e-4540-84e6-212ff2c21614\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-87zd7"
Sep 10 21:07:42.915295 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:07:42.915217    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d3046f2-199e-4540-84e6-212ff2c21614-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-87zd7\" (UID: \"2d3046f2-199e-4540-84e6-212ff2c21614\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-87zd7"
Sep 10 21:07:42.921177 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:07:42.921154    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rltb2\" (UniqueName: \"kubernetes.io/projected/2d3046f2-199e-4540-84e6-212ff2c21614-kube-api-access-rltb2\") pod \"e2e-distinct-simulated-kserve-59975d69f9-87zd7\" (UID: \"2d3046f2-199e-4540-84e6-212ff2c21614\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-87zd7"
Sep 10 21:07:42.937088 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:07:42.937061    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-87zd7"
Sep 10 21:07:43.209948 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:07:43.209861    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-87zd7"]
Sep 10 21:07:43.214210 ip-10-0-129-100 kubenswrapper[2564]: W0910 21:07:43.214180    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d3046f2_199e_4540_84e6_212ff2c21614.slice/crio-2924c29fc45f8ed8ce87feba3a275375be0c6954ea433e2710c5a2541e56e323 WatchSource:0}: Error finding container 2924c29fc45f8ed8ce87feba3a275375be0c6954ea433e2710c5a2541e56e323: Status 404 returned error can't find the container with id 2924c29fc45f8ed8ce87feba3a275375be0c6954ea433e2710c5a2541e56e323
Sep 10 21:07:43.215876 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:07:43.215855    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 21:07:43.790962 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:07:43.790929    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-87zd7" event={"ID":"2d3046f2-199e-4540-84e6-212ff2c21614","Type":"ContainerStarted","Data":"2924c29fc45f8ed8ce87feba3a275375be0c6954ea433e2710c5a2541e56e323"}
Sep 10 21:07:44.798239 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:07:44.798203    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-87zd7" event={"ID":"2d3046f2-199e-4540-84e6-212ff2c21614","Type":"ContainerStarted","Data":"f3dd7b1d3fad6a92fcf43795f67de62ad6dea448c4b2adbab13158b67e7818c9"}
Sep 10 21:07:52.937565 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:07:52.937519    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-87zd7"
Sep 10 21:07:52.938063 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:07:52.937602    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-87zd7"
Sep 10 21:07:52.950196 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:07:52.950164    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-87zd7"
Sep 10 21:07:52.981130 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:07:52.981077    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-87zd7" podStartSLOduration=10.035398384 podStartE2EDuration="10.981059085s" totalImagesPullingTime="945.660701ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:07:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:07:44.832514706 +0000 UTC m=+645.519581984" watchObservedRunningTime="2026-09-10 21:07:52.981059085 +0000 UTC m=+653.668126364"
Sep 10 21:07:53.859624 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:07:53.859593    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-87zd7"
Sep 10 21:08:23.809952 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:08:23.809918    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-zbnnd"]
Sep 10 21:08:23.813559 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:08:23.813537    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zbnnd"
Sep 10 21:08:23.816282 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:08:23.816264    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Sep 10 21:08:23.827932 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:08:23.827911    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-zbnnd"]
Sep 10 21:08:23.943923 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:08:23.943893    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/abb3b426-5dca-4c3d-8cfb-774ceaed77f0-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zbnnd\" (UID: \"abb3b426-5dca-4c3d-8cfb-774ceaed77f0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zbnnd"
Sep 10 21:08:23.944065 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:08:23.943939    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/abb3b426-5dca-4c3d-8cfb-774ceaed77f0-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zbnnd\" (UID: \"abb3b426-5dca-4c3d-8cfb-774ceaed77f0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zbnnd"
Sep 10 21:08:23.944065 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:08:23.943965    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/abb3b426-5dca-4c3d-8cfb-774ceaed77f0-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zbnnd\" (UID: \"abb3b426-5dca-4c3d-8cfb-774ceaed77f0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zbnnd"
Sep 10 21:08:23.944065 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:08:23.944013    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hlpt\" (UniqueName: \"kubernetes.io/projected/abb3b426-5dca-4c3d-8cfb-774ceaed77f0-kube-api-access-2hlpt\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zbnnd\" (UID: \"abb3b426-5dca-4c3d-8cfb-774ceaed77f0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zbnnd"
Sep 10 21:08:23.944065 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:08:23.944054    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/abb3b426-5dca-4c3d-8cfb-774ceaed77f0-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zbnnd\" (UID: \"abb3b426-5dca-4c3d-8cfb-774ceaed77f0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zbnnd"
Sep 10 21:08:23.944218 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:08:23.944092    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/abb3b426-5dca-4c3d-8cfb-774ceaed77f0-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zbnnd\" (UID: \"abb3b426-5dca-4c3d-8cfb-774ceaed77f0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zbnnd"
Sep 10 21:08:24.045102 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:08:24.045076    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/abb3b426-5dca-4c3d-8cfb-774ceaed77f0-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zbnnd\" (UID: \"abb3b426-5dca-4c3d-8cfb-774ceaed77f0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zbnnd"
Sep 10 21:08:24.045268 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:08:24.045116    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/abb3b426-5dca-4c3d-8cfb-774ceaed77f0-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zbnnd\" (UID: \"abb3b426-5dca-4c3d-8cfb-774ceaed77f0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zbnnd"
Sep 10 21:08:24.045268 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:08:24.045140    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hlpt\" (UniqueName: \"kubernetes.io/projected/abb3b426-5dca-4c3d-8cfb-774ceaed77f0-kube-api-access-2hlpt\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zbnnd\" (UID: \"abb3b426-5dca-4c3d-8cfb-774ceaed77f0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zbnnd"
Sep 10 21:08:24.045268 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:08:24.045174    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/abb3b426-5dca-4c3d-8cfb-774ceaed77f0-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zbnnd\" (UID: \"abb3b426-5dca-4c3d-8cfb-774ceaed77f0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zbnnd"
Sep 10 21:08:24.045268 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:08:24.045222    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/abb3b426-5dca-4c3d-8cfb-774ceaed77f0-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zbnnd\" (UID: \"abb3b426-5dca-4c3d-8cfb-774ceaed77f0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zbnnd"
Sep 10 21:08:24.045500 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:08:24.045288    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/abb3b426-5dca-4c3d-8cfb-774ceaed77f0-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zbnnd\" (UID: \"abb3b426-5dca-4c3d-8cfb-774ceaed77f0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zbnnd"
Sep 10 21:08:24.045682 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:08:24.045633    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/abb3b426-5dca-4c3d-8cfb-774ceaed77f0-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zbnnd\" (UID: \"abb3b426-5dca-4c3d-8cfb-774ceaed77f0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zbnnd"
Sep 10 21:08:24.045779 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:08:24.045736    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/abb3b426-5dca-4c3d-8cfb-774ceaed77f0-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zbnnd\" (UID: \"abb3b426-5dca-4c3d-8cfb-774ceaed77f0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zbnnd"
Sep 10 21:08:24.045986 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:08:24.045965    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/abb3b426-5dca-4c3d-8cfb-774ceaed77f0-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zbnnd\" (UID: \"abb3b426-5dca-4c3d-8cfb-774ceaed77f0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zbnnd"
Sep 10 21:08:24.047775 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:08:24.047753    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/abb3b426-5dca-4c3d-8cfb-774ceaed77f0-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zbnnd\" (UID: \"abb3b426-5dca-4c3d-8cfb-774ceaed77f0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zbnnd"
Sep 10 21:08:24.047836 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:08:24.047783    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/abb3b426-5dca-4c3d-8cfb-774ceaed77f0-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zbnnd\" (UID: \"abb3b426-5dca-4c3d-8cfb-774ceaed77f0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zbnnd"
Sep 10 21:08:24.053305 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:08:24.053287    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hlpt\" (UniqueName: \"kubernetes.io/projected/abb3b426-5dca-4c3d-8cfb-774ceaed77f0-kube-api-access-2hlpt\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zbnnd\" (UID: \"abb3b426-5dca-4c3d-8cfb-774ceaed77f0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zbnnd"
Sep 10 21:08:24.123192 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:08:24.123135    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zbnnd"
Sep 10 21:08:24.398614 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:08:24.398527    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-zbnnd"]
Sep 10 21:08:24.402357 ip-10-0-129-100 kubenswrapper[2564]: W0910 21:08:24.402332    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabb3b426_5dca_4c3d_8cfb_774ceaed77f0.slice/crio-9e1b3bf1cf4810fc9566c6ac986bc813c60641262ba36fb8231e628e334b057c WatchSource:0}: Error finding container 9e1b3bf1cf4810fc9566c6ac986bc813c60641262ba36fb8231e628e334b057c: Status 404 returned error can't find the container with id 9e1b3bf1cf4810fc9566c6ac986bc813c60641262ba36fb8231e628e334b057c
Sep 10 21:08:25.005721 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:08:25.005683    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zbnnd" event={"ID":"abb3b426-5dca-4c3d-8cfb-774ceaed77f0","Type":"ContainerStarted","Data":"04f3acb9293aabc40a3edc0a60a387ccfe1c7c5b40250d16a533892f38ee56a1"}
Sep 10 21:08:25.006080 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:08:25.005744    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zbnnd" event={"ID":"abb3b426-5dca-4c3d-8cfb-774ceaed77f0","Type":"ContainerStarted","Data":"9e1b3bf1cf4810fc9566c6ac986bc813c60641262ba36fb8231e628e334b057c"}
Sep 10 21:08:25.027696 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:08:25.027652    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zbnnd" podStartSLOduration=1.8530320169999999 podStartE2EDuration="2.02763688s" totalImagesPullingTime="174.604863ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:08:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:08:25.026077514 +0000 UTC m=+685.713144795" watchObservedRunningTime="2026-09-10 21:08:25.02763688 +0000 UTC m=+685.714704185"
Sep 10 21:08:34.124200 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:08:34.124162    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zbnnd"
Sep 10 21:08:34.124706 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:08:34.124260    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zbnnd"
Sep 10 21:08:34.136698 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:08:34.136674    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zbnnd"
Sep 10 21:08:35.065213 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:08:35.065184    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zbnnd"
Sep 10 21:08:37.506652 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:08:37.506621    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh4bgf"]
Sep 10 21:08:37.509859 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:08:37.509842    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh4bgf"
Sep 10 21:08:37.512473 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:08:37.512453    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Sep 10 21:08:37.521804 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:08:37.521785    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh4bgf"]
Sep 10 21:08:37.656804 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:08:37.656770    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkppb\" (UniqueName: \"kubernetes.io/projected/3d508514-a070-4b5c-bca5-b0fd59b66893-kube-api-access-jkppb\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh4bgf\" (UID: \"3d508514-a070-4b5c-bca5-b0fd59b66893\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh4bgf"
Sep 10 21:08:37.656964 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:08:37.656813    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3d508514-a070-4b5c-bca5-b0fd59b66893-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh4bgf\" (UID: \"3d508514-a070-4b5c-bca5-b0fd59b66893\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh4bgf"
Sep 10 21:08:37.656964 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:08:37.656875    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3d508514-a070-4b5c-bca5-b0fd59b66893-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh4bgf\" (UID: \"3d508514-a070-4b5c-bca5-b0fd59b66893\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh4bgf"
Sep 10 21:08:37.657057 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:08:37.656989    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d508514-a070-4b5c-bca5-b0fd59b66893-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh4bgf\" (UID: \"3d508514-a070-4b5c-bca5-b0fd59b66893\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh4bgf"
Sep 10 21:08:37.657057 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:08:37.657022    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3d508514-a070-4b5c-bca5-b0fd59b66893-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh4bgf\" (UID: \"3d508514-a070-4b5c-bca5-b0fd59b66893\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh4bgf"
Sep 10 21:08:37.657057 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:08:37.657040    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3d508514-a070-4b5c-bca5-b0fd59b66893-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh4bgf\" (UID: \"3d508514-a070-4b5c-bca5-b0fd59b66893\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh4bgf"
Sep 10 21:08:37.758253 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:08:37.758171    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3d508514-a070-4b5c-bca5-b0fd59b66893-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh4bgf\" (UID: \"3d508514-a070-4b5c-bca5-b0fd59b66893\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh4bgf"
Sep 10 21:08:37.758253 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:08:37.758217    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkppb\" (UniqueName: \"kubernetes.io/projected/3d508514-a070-4b5c-bca5-b0fd59b66893-kube-api-access-jkppb\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh4bgf\" (UID: \"3d508514-a070-4b5c-bca5-b0fd59b66893\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh4bgf"
Sep 10 21:08:37.758450 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:08:37.758261    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3d508514-a070-4b5c-bca5-b0fd59b66893-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh4bgf\" (UID: \"3d508514-a070-4b5c-bca5-b0fd59b66893\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh4bgf"
Sep 10 21:08:37.758450 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:08:37.758292    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3d508514-a070-4b5c-bca5-b0fd59b66893-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh4bgf\" (UID: \"3d508514-a070-4b5c-bca5-b0fd59b66893\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh4bgf"
Sep 10 21:08:37.758450 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:08:37.758313    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d508514-a070-4b5c-bca5-b0fd59b66893-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh4bgf\" (UID: \"3d508514-a070-4b5c-bca5-b0fd59b66893\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh4bgf"
Sep 10 21:08:37.758450 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:08:37.758332    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3d508514-a070-4b5c-bca5-b0fd59b66893-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh4bgf\" (UID: \"3d508514-a070-4b5c-bca5-b0fd59b66893\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh4bgf"
Sep 10 21:08:37.758656 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:08:37.758610    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3d508514-a070-4b5c-bca5-b0fd59b66893-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh4bgf\" (UID: \"3d508514-a070-4b5c-bca5-b0fd59b66893\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh4bgf"
Sep 10 21:08:37.758656 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:08:37.758640    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d508514-a070-4b5c-bca5-b0fd59b66893-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh4bgf\" (UID: \"3d508514-a070-4b5c-bca5-b0fd59b66893\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh4bgf"
Sep 10 21:08:37.758768 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:08:37.758747    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3d508514-a070-4b5c-bca5-b0fd59b66893-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh4bgf\" (UID: \"3d508514-a070-4b5c-bca5-b0fd59b66893\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh4bgf"
Sep 10 21:08:37.760604 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:08:37.760581    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3d508514-a070-4b5c-bca5-b0fd59b66893-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh4bgf\" (UID: \"3d508514-a070-4b5c-bca5-b0fd59b66893\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh4bgf"
Sep 10 21:08:37.760703 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:08:37.760686    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3d508514-a070-4b5c-bca5-b0fd59b66893-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh4bgf\" (UID: \"3d508514-a070-4b5c-bca5-b0fd59b66893\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh4bgf"
Sep 10 21:08:37.766153 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:08:37.766132    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkppb\" (UniqueName: \"kubernetes.io/projected/3d508514-a070-4b5c-bca5-b0fd59b66893-kube-api-access-jkppb\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh4bgf\" (UID: \"3d508514-a070-4b5c-bca5-b0fd59b66893\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh4bgf"
Sep 10 21:08:37.820000 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:08:37.819975    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh4bgf"
Sep 10 21:08:38.090912 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:08:38.090887    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh4bgf"]
Sep 10 21:08:38.092490 ip-10-0-129-100 kubenswrapper[2564]: W0910 21:08:38.092463    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d508514_a070_4b5c_bca5_b0fd59b66893.slice/crio-721497d6184184ea3c097fac43cde43c89d5edd7c3c1388d64bb6bcbd80eada0 WatchSource:0}: Error finding container 721497d6184184ea3c097fac43cde43c89d5edd7c3c1388d64bb6bcbd80eada0: Status 404 returned error can't find the container with id 721497d6184184ea3c097fac43cde43c89d5edd7c3c1388d64bb6bcbd80eada0
Sep 10 21:08:39.076382 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:08:39.076344    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh4bgf" event={"ID":"3d508514-a070-4b5c-bca5-b0fd59b66893","Type":"ContainerStarted","Data":"e3c49e81fb9055b978c9083c41912ef2d6afbcfa89dad2a11a4a03c58bb8dc50"}
Sep 10 21:08:39.076864 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:08:39.076404    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh4bgf" event={"ID":"3d508514-a070-4b5c-bca5-b0fd59b66893","Type":"ContainerStarted","Data":"721497d6184184ea3c097fac43cde43c89d5edd7c3c1388d64bb6bcbd80eada0"}
Sep 10 21:08:39.132493 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:08:39.132436    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh4bgf" podStartSLOduration=1.95772587 podStartE2EDuration="2.132419966s" totalImagesPullingTime="174.694096ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:08:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:08:39.13083888 +0000 UTC m=+699.817906159" watchObservedRunningTime="2026-09-10 21:08:39.132419966 +0000 UTC m=+699.819487246"
Sep 10 21:08:47.820270 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:08:47.820202    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh4bgf"
Sep 10 21:08:47.820669 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:08:47.820293    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh4bgf"
Sep 10 21:08:47.832804 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:08:47.832774    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh4bgf"
Sep 10 21:08:48.136822 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:08:48.136740    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh4bgf"
Sep 10 21:10:57.608753 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:10:57.608711    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-04db70-6797ddc6d6-lsr7z"]
Sep 10 21:10:57.612282 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:10:57.612260    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-04db70-6797ddc6d6-lsr7z"
Sep 10 21:10:57.622218 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:10:57.622199    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-04db70-dockercfg-tld6r\""
Sep 10 21:10:57.622509 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:10:57.622494    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-04db70\""
Sep 10 21:10:57.647685 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:10:57.647653    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-04db70-6797ddc6d6-lsr7z"]
Sep 10 21:10:57.715634 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:10:57.715594    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f4a09a7-a0c5-4e2b-bbc5-d6d29131b16f-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-04db70-6797ddc6d6-lsr7z\" (UID: \"9f4a09a7-a0c5-4e2b-bbc5-d6d29131b16f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-04db70-6797ddc6d6-lsr7z"
Sep 10 21:10:57.715816 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:10:57.715677    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whwmm\" (UniqueName: \"kubernetes.io/projected/9f4a09a7-a0c5-4e2b-bbc5-d6d29131b16f-kube-api-access-whwmm\") pod \"payload-pre-processing-e2e-inf-a-04db70-6797ddc6d6-lsr7z\" (UID: \"9f4a09a7-a0c5-4e2b-bbc5-d6d29131b16f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-04db70-6797ddc6d6-lsr7z"
Sep 10 21:10:57.816883 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:10:57.816852    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f4a09a7-a0c5-4e2b-bbc5-d6d29131b16f-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-04db70-6797ddc6d6-lsr7z\" (UID: \"9f4a09a7-a0c5-4e2b-bbc5-d6d29131b16f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-04db70-6797ddc6d6-lsr7z"
Sep 10 21:10:57.817062 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:10:57.816936    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whwmm\" (UniqueName: \"kubernetes.io/projected/9f4a09a7-a0c5-4e2b-bbc5-d6d29131b16f-kube-api-access-whwmm\") pod \"payload-pre-processing-e2e-inf-a-04db70-6797ddc6d6-lsr7z\" (UID: \"9f4a09a7-a0c5-4e2b-bbc5-d6d29131b16f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-04db70-6797ddc6d6-lsr7z"
Sep 10 21:10:57.817589 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:10:57.817570    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f4a09a7-a0c5-4e2b-bbc5-d6d29131b16f-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-04db70-6797ddc6d6-lsr7z\" (UID: \"9f4a09a7-a0c5-4e2b-bbc5-d6d29131b16f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-04db70-6797ddc6d6-lsr7z"
Sep 10 21:10:57.832307 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:10:57.832276    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whwmm\" (UniqueName: \"kubernetes.io/projected/9f4a09a7-a0c5-4e2b-bbc5-d6d29131b16f-kube-api-access-whwmm\") pod \"payload-pre-processing-e2e-inf-a-04db70-6797ddc6d6-lsr7z\" (UID: \"9f4a09a7-a0c5-4e2b-bbc5-d6d29131b16f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-04db70-6797ddc6d6-lsr7z"
Sep 10 21:10:57.922321 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:10:57.922212    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-04db70-6797ddc6d6-lsr7z"
Sep 10 21:10:58.090462 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:10:58.090420    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-autores-c2de43-openshift-default-65fc6484d-qts6j"]
Sep 10 21:10:58.093964 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:10:58.093942    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-c2de43-openshift-default-65fc6484d-qts6j"
Sep 10 21:10:58.096879 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:10:58.096861    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-autores-c2de43-openshift-default-dockercfg-rfs6g\""
Sep 10 21:10:58.117651 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:10:58.117627    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-c2de43-openshift-default-65fc6484d-qts6j"]
Sep 10 21:10:58.219047 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:10:58.219021    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-04db70-6797ddc6d6-lsr7z"]
Sep 10 21:10:58.220641 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:10:58.220595    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d-istio-envoy\") pod \"e2e-autores-c2de43-openshift-default-65fc6484d-qts6j\" (UID: \"65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d\") " pod="openshift-ingress/e2e-autores-c2de43-openshift-default-65fc6484d-qts6j"
Sep 10 21:10:58.220843 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:10:58.220817    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d-istiod-ca-cert\") pod \"e2e-autores-c2de43-openshift-default-65fc6484d-qts6j\" (UID: \"65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d\") " pod="openshift-ingress/e2e-autores-c2de43-openshift-default-65fc6484d-qts6j"
Sep 10 21:10:58.220975 ip-10-0-129-100 kubenswrapper[2564]: W0910 21:10:58.220847    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f4a09a7_a0c5_4e2b_bbc5_d6d29131b16f.slice/crio-5a83f6ca1194f6015753657bd1262ed981eae8c62bd480afa71b5681def55cdd WatchSource:0}: Error finding container 5a83f6ca1194f6015753657bd1262ed981eae8c62bd480afa71b5681def55cdd: Status 404 returned error can't find the container with id 5a83f6ca1194f6015753657bd1262ed981eae8c62bd480afa71b5681def55cdd
Sep 10 21:10:58.220975 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:10:58.220868    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d-workload-socket\") pod \"e2e-autores-c2de43-openshift-default-65fc6484d-qts6j\" (UID: \"65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d\") " pod="openshift-ingress/e2e-autores-c2de43-openshift-default-65fc6484d-qts6j"
Sep 10 21:10:58.220975 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:10:58.220950    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d-istio-data\") pod \"e2e-autores-c2de43-openshift-default-65fc6484d-qts6j\" (UID: \"65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d\") " pod="openshift-ingress/e2e-autores-c2de43-openshift-default-65fc6484d-qts6j"
Sep 10 21:10:58.221140 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:10:58.220985    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d-istio-podinfo\") pod \"e2e-autores-c2de43-openshift-default-65fc6484d-qts6j\" (UID: \"65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d\") " pod="openshift-ingress/e2e-autores-c2de43-openshift-default-65fc6484d-qts6j"
Sep 10 21:10:58.221140 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:10:58.221014    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d-credential-socket\") pod \"e2e-autores-c2de43-openshift-default-65fc6484d-qts6j\" (UID: \"65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d\") " pod="openshift-ingress/e2e-autores-c2de43-openshift-default-65fc6484d-qts6j"
Sep 10 21:10:58.221140 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:10:58.221106    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d-workload-certs\") pod \"e2e-autores-c2de43-openshift-default-65fc6484d-qts6j\" (UID: \"65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d\") " pod="openshift-ingress/e2e-autores-c2de43-openshift-default-65fc6484d-qts6j"
Sep 10 21:10:58.221310 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:10:58.221140    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d-istio-token\") pod \"e2e-autores-c2de43-openshift-default-65fc6484d-qts6j\" (UID: \"65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d\") " pod="openshift-ingress/e2e-autores-c2de43-openshift-default-65fc6484d-qts6j"
Sep 10 21:10:58.221310 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:10:58.221169    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-272dn\" (UniqueName: \"kubernetes.io/projected/65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d-kube-api-access-272dn\") pod \"e2e-autores-c2de43-openshift-default-65fc6484d-qts6j\" (UID: \"65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d\") " pod="openshift-ingress/e2e-autores-c2de43-openshift-default-65fc6484d-qts6j"
Sep 10 21:10:58.322117 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:10:58.322080    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d-workload-certs\") pod \"e2e-autores-c2de43-openshift-default-65fc6484d-qts6j\" (UID: \"65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d\") " pod="openshift-ingress/e2e-autores-c2de43-openshift-default-65fc6484d-qts6j"
Sep 10 21:10:58.322117 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:10:58.322121    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d-istio-token\") pod \"e2e-autores-c2de43-openshift-default-65fc6484d-qts6j\" (UID: \"65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d\") " pod="openshift-ingress/e2e-autores-c2de43-openshift-default-65fc6484d-qts6j"
Sep 10 21:10:58.322407 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:10:58.322141    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-272dn\" (UniqueName: \"kubernetes.io/projected/65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d-kube-api-access-272dn\") pod \"e2e-autores-c2de43-openshift-default-65fc6484d-qts6j\" (UID: \"65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d\") " pod="openshift-ingress/e2e-autores-c2de43-openshift-default-65fc6484d-qts6j"
Sep 10 21:10:58.322407 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:10:58.322171    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d-istio-envoy\") pod \"e2e-autores-c2de43-openshift-default-65fc6484d-qts6j\" (UID: \"65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d\") " pod="openshift-ingress/e2e-autores-c2de43-openshift-default-65fc6484d-qts6j"
Sep 10 21:10:58.322407 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:10:58.322186    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d-istiod-ca-cert\") pod \"e2e-autores-c2de43-openshift-default-65fc6484d-qts6j\" (UID: \"65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d\") " pod="openshift-ingress/e2e-autores-c2de43-openshift-default-65fc6484d-qts6j"
Sep 10 21:10:58.322407 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:10:58.322206    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d-workload-socket\") pod \"e2e-autores-c2de43-openshift-default-65fc6484d-qts6j\" (UID: \"65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d\") " pod="openshift-ingress/e2e-autores-c2de43-openshift-default-65fc6484d-qts6j"
Sep 10 21:10:58.322407 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:10:58.322266    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d-istio-data\") pod \"e2e-autores-c2de43-openshift-default-65fc6484d-qts6j\" (UID: \"65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d\") " pod="openshift-ingress/e2e-autores-c2de43-openshift-default-65fc6484d-qts6j"
Sep 10 21:10:58.322407 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:10:58.322293    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d-istio-podinfo\") pod \"e2e-autores-c2de43-openshift-default-65fc6484d-qts6j\" (UID: \"65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d\") " pod="openshift-ingress/e2e-autores-c2de43-openshift-default-65fc6484d-qts6j"
Sep 10 21:10:58.322660 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:10:58.322469    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d-credential-socket\") pod \"e2e-autores-c2de43-openshift-default-65fc6484d-qts6j\" (UID: \"65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d\") " pod="openshift-ingress/e2e-autores-c2de43-openshift-default-65fc6484d-qts6j"
Sep 10 21:10:58.322716 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:10:58.322693    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d-workload-certs\") pod \"e2e-autores-c2de43-openshift-default-65fc6484d-qts6j\" (UID: \"65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d\") " pod="openshift-ingress/e2e-autores-c2de43-openshift-default-65fc6484d-qts6j"
Sep 10 21:10:58.322754 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:10:58.322742    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d-workload-socket\") pod \"e2e-autores-c2de43-openshift-default-65fc6484d-qts6j\" (UID: \"65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d\") " pod="openshift-ingress/e2e-autores-c2de43-openshift-default-65fc6484d-qts6j"
Sep 10 21:10:58.322811 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:10:58.322790    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d-istio-data\") pod \"e2e-autores-c2de43-openshift-default-65fc6484d-qts6j\" (UID: \"65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d\") " pod="openshift-ingress/e2e-autores-c2de43-openshift-default-65fc6484d-qts6j"
Sep 10 21:10:58.322856 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:10:58.322805    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d-credential-socket\") pod \"e2e-autores-c2de43-openshift-default-65fc6484d-qts6j\" (UID: \"65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d\") " pod="openshift-ingress/e2e-autores-c2de43-openshift-default-65fc6484d-qts6j"
Sep 10 21:10:58.323251 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:10:58.323204    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d-istiod-ca-cert\") pod \"e2e-autores-c2de43-openshift-default-65fc6484d-qts6j\" (UID: \"65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d\") " pod="openshift-ingress/e2e-autores-c2de43-openshift-default-65fc6484d-qts6j"
Sep 10 21:10:58.324669 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:10:58.324646    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d-istio-envoy\") pod \"e2e-autores-c2de43-openshift-default-65fc6484d-qts6j\" (UID: \"65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d\") " pod="openshift-ingress/e2e-autores-c2de43-openshift-default-65fc6484d-qts6j"
Sep 10 21:10:58.325010 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:10:58.324985    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d-istio-podinfo\") pod \"e2e-autores-c2de43-openshift-default-65fc6484d-qts6j\" (UID: \"65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d\") " pod="openshift-ingress/e2e-autores-c2de43-openshift-default-65fc6484d-qts6j"
Sep 10 21:10:58.347571 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:10:58.347537    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d-istio-token\") pod \"e2e-autores-c2de43-openshift-default-65fc6484d-qts6j\" (UID: \"65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d\") " pod="openshift-ingress/e2e-autores-c2de43-openshift-default-65fc6484d-qts6j"
Sep 10 21:10:58.347687 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:10:58.347589    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-272dn\" (UniqueName: \"kubernetes.io/projected/65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d-kube-api-access-272dn\") pod \"e2e-autores-c2de43-openshift-default-65fc6484d-qts6j\" (UID: \"65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d\") " pod="openshift-ingress/e2e-autores-c2de43-openshift-default-65fc6484d-qts6j"
Sep 10 21:10:58.404380 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:10:58.404342    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-c2de43-openshift-default-65fc6484d-qts6j"
Sep 10 21:10:58.686743 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:10:58.686717    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-c2de43-openshift-default-65fc6484d-qts6j"]
Sep 10 21:10:58.690372 ip-10-0-129-100 kubenswrapper[2564]: W0910 21:10:58.690334    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65d71fdc_0f1f_4934_8b7e_a31bbb20cb3d.slice/crio-5e79bd67bd2a3704afa39f52f2c5f5503d94fbf4af020416af47a70a9a25663d WatchSource:0}: Error finding container 5e79bd67bd2a3704afa39f52f2c5f5503d94fbf4af020416af47a70a9a25663d: Status 404 returned error can't find the container with id 5e79bd67bd2a3704afa39f52f2c5f5503d94fbf4af020416af47a70a9a25663d
Sep 10 21:10:58.806933 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:10:58.806898    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-c2de43-openshift-default-65fc6484d-qts6j" event={"ID":"65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d","Type":"ContainerStarted","Data":"5e79bd67bd2a3704afa39f52f2c5f5503d94fbf4af020416af47a70a9a25663d"}
Sep 10 21:10:58.808515 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:10:58.808479    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-04db70-6797ddc6d6-lsr7z" event={"ID":"9f4a09a7-a0c5-4e2b-bbc5-d6d29131b16f","Type":"ContainerStarted","Data":"5a83f6ca1194f6015753657bd1262ed981eae8c62bd480afa71b5681def55cdd"}
Sep 10 21:11:00.824288 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:00.824224    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-04db70-6797ddc6d6-lsr7z" event={"ID":"9f4a09a7-a0c5-4e2b-bbc5-d6d29131b16f","Type":"ContainerStarted","Data":"5c070c96b8309da4557f7571e3edb231e92d2e5dbe9ad3005122c17fa7a2e6c5"}
Sep 10 21:11:00.824767 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:00.824313    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-04db70-6797ddc6d6-lsr7z"
Sep 10 21:11:00.852343 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:00.852294    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-04db70-6797ddc6d6-lsr7z" podStartSLOduration=2.088705742 podStartE2EDuration="3.852278828s" totalImagesPullingTime="1.763573086s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:10:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:11:00.848397385 +0000 UTC m=+841.535464663" watchObservedRunningTime="2026-09-10 21:11:00.852278828 +0000 UTC m=+841.539346107"
Sep 10 21:11:01.360877 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:01.360843    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 10 21:11:01.360948 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:01.360911    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 10 21:11:01.360993 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:01.360948    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 10 21:11:01.831365 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:01.831323    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-c2de43-openshift-default-65fc6484d-qts6j" event={"ID":"65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d","Type":"ContainerStarted","Data":"5de2bf6ac5704f7bb73ddb0a23d15c510894553e37e20f166f58693756012610"}
Sep 10 21:11:01.870358 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:01.870292    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-autores-c2de43-openshift-default-65fc6484d-qts6j" podStartSLOduration=1.203301336 podStartE2EDuration="3.87027206s" totalImagesPullingTime="2.666970724s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:10:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:11:01.869420372 +0000 UTC m=+842.556487651" watchObservedRunningTime="2026-09-10 21:11:01.87027206 +0000 UTC m=+842.557339340"
Sep 10 21:11:02.405400 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:02.405362    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-c2de43-openshift-default-65fc6484d-qts6j"
Sep 10 21:11:02.410307 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:02.410277    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-c2de43-openshift-default-65fc6484d-qts6j"
Sep 10 21:11:02.839730 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:02.839698    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-c2de43-openshift-default-65fc6484d-qts6j"
Sep 10 21:11:02.842670 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:02.842637    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-c2de43-openshift-default-65fc6484d-qts6j"
Sep 10 21:11:05.627818 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:05.627780    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4fafd099-75787dc846-9zf75"]
Sep 10 21:11:05.631217 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:05.631200    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-4fafd099-75787dc846-9zf75"
Sep 10 21:11:05.635482 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:05.635452    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-4fafd099\""
Sep 10 21:11:05.635606 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:05.635514    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-4fafd099-dockercfg-79dkw\""
Sep 10 21:11:05.644565 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:05.644538    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4fafd099-75787dc846-9zf75"]
Sep 10 21:11:05.680781 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:05.680746    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-4fafd099-57f9b8b54f-vgtqr"]
Sep 10 21:11:05.681200 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:05.681175    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cllsd\" (UniqueName: \"kubernetes.io/projected/0bdb7174-83a2-4569-aa43-80f4601b8a94-kube-api-access-cllsd\") pod \"payload-pre-processing-e2e-ait-4fafd099-75787dc846-9zf75\" (UID: \"0bdb7174-83a2-4569-aa43-80f4601b8a94\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4fafd099-75787dc846-9zf75"
Sep 10 21:11:05.681314 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:05.681222    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0bdb7174-83a2-4569-aa43-80f4601b8a94-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-4fafd099-75787dc846-9zf75\" (UID: \"0bdb7174-83a2-4569-aa43-80f4601b8a94\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4fafd099-75787dc846-9zf75"
Sep 10 21:11:05.684265 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:05.684247    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-4fafd099-57f9b8b54f-vgtqr"
Sep 10 21:11:05.699193 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:05.699166    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-4fafd099-57f9b8b54f-vgtqr"]
Sep 10 21:11:05.782554 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:05.782519    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cllsd\" (UniqueName: \"kubernetes.io/projected/0bdb7174-83a2-4569-aa43-80f4601b8a94-kube-api-access-cllsd\") pod \"payload-pre-processing-e2e-ait-4fafd099-75787dc846-9zf75\" (UID: \"0bdb7174-83a2-4569-aa43-80f4601b8a94\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4fafd099-75787dc846-9zf75"
Sep 10 21:11:05.782554 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:05.782558    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2lpg\" (UniqueName: \"kubernetes.io/projected/6cf86c07-c2d5-4241-94cd-34f752827b47-kube-api-access-j2lpg\") pod \"payload-processing-e2e-ait-4fafd099-57f9b8b54f-vgtqr\" (UID: \"6cf86c07-c2d5-4241-94cd-34f752827b47\") " pod="openshift-ingress/payload-processing-e2e-ait-4fafd099-57f9b8b54f-vgtqr"
Sep 10 21:11:05.782798 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:05.782584    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0bdb7174-83a2-4569-aa43-80f4601b8a94-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-4fafd099-75787dc846-9zf75\" (UID: \"0bdb7174-83a2-4569-aa43-80f4601b8a94\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4fafd099-75787dc846-9zf75"
Sep 10 21:11:05.782798 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:05.782608    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6cf86c07-c2d5-4241-94cd-34f752827b47-plugins-config-volume\") pod \"payload-processing-e2e-ait-4fafd099-57f9b8b54f-vgtqr\" (UID: \"6cf86c07-c2d5-4241-94cd-34f752827b47\") " pod="openshift-ingress/payload-processing-e2e-ait-4fafd099-57f9b8b54f-vgtqr"
Sep 10 21:11:05.783261 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:05.783225    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0bdb7174-83a2-4569-aa43-80f4601b8a94-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-4fafd099-75787dc846-9zf75\" (UID: \"0bdb7174-83a2-4569-aa43-80f4601b8a94\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4fafd099-75787dc846-9zf75"
Sep 10 21:11:05.794417 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:05.794387    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cllsd\" (UniqueName: \"kubernetes.io/projected/0bdb7174-83a2-4569-aa43-80f4601b8a94-kube-api-access-cllsd\") pod \"payload-pre-processing-e2e-ait-4fafd099-75787dc846-9zf75\" (UID: \"0bdb7174-83a2-4569-aa43-80f4601b8a94\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4fafd099-75787dc846-9zf75"
Sep 10 21:11:05.883199 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:05.883120    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6cf86c07-c2d5-4241-94cd-34f752827b47-plugins-config-volume\") pod \"payload-processing-e2e-ait-4fafd099-57f9b8b54f-vgtqr\" (UID: \"6cf86c07-c2d5-4241-94cd-34f752827b47\") " pod="openshift-ingress/payload-processing-e2e-ait-4fafd099-57f9b8b54f-vgtqr"
Sep 10 21:11:05.883385 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:05.883240    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2lpg\" (UniqueName: \"kubernetes.io/projected/6cf86c07-c2d5-4241-94cd-34f752827b47-kube-api-access-j2lpg\") pod \"payload-processing-e2e-ait-4fafd099-57f9b8b54f-vgtqr\" (UID: \"6cf86c07-c2d5-4241-94cd-34f752827b47\") " pod="openshift-ingress/payload-processing-e2e-ait-4fafd099-57f9b8b54f-vgtqr"
Sep 10 21:11:05.883866 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:05.883845    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6cf86c07-c2d5-4241-94cd-34f752827b47-plugins-config-volume\") pod \"payload-processing-e2e-ait-4fafd099-57f9b8b54f-vgtqr\" (UID: \"6cf86c07-c2d5-4241-94cd-34f752827b47\") " pod="openshift-ingress/payload-processing-e2e-ait-4fafd099-57f9b8b54f-vgtqr"
Sep 10 21:11:05.892747 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:05.892714    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2lpg\" (UniqueName: \"kubernetes.io/projected/6cf86c07-c2d5-4241-94cd-34f752827b47-kube-api-access-j2lpg\") pod \"payload-processing-e2e-ait-4fafd099-57f9b8b54f-vgtqr\" (UID: \"6cf86c07-c2d5-4241-94cd-34f752827b47\") " pod="openshift-ingress/payload-processing-e2e-ait-4fafd099-57f9b8b54f-vgtqr"
Sep 10 21:11:05.942616 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:05.942575    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-4fafd099-75787dc846-9zf75"
Sep 10 21:11:05.994534 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:05.994498    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-4fafd099-57f9b8b54f-vgtqr"
Sep 10 21:11:06.245470 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:06.245432    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4fafd099-75787dc846-9zf75"]
Sep 10 21:11:06.247020 ip-10-0-129-100 kubenswrapper[2564]: W0910 21:11:06.246984    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bdb7174_83a2_4569_aa43_80f4601b8a94.slice/crio-81d07bc0438e1d5334a2a52dbda6fa062e8fe312e44ddd7104aba8f1a727ca96 WatchSource:0}: Error finding container 81d07bc0438e1d5334a2a52dbda6fa062e8fe312e44ddd7104aba8f1a727ca96: Status 404 returned error can't find the container with id 81d07bc0438e1d5334a2a52dbda6fa062e8fe312e44ddd7104aba8f1a727ca96
Sep 10 21:11:06.306507 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:06.306479    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-4fafd099-57f9b8b54f-vgtqr"]
Sep 10 21:11:06.307387 ip-10-0-129-100 kubenswrapper[2564]: W0910 21:11:06.307363    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cf86c07_c2d5_4241_94cd_34f752827b47.slice/crio-d35cceeb06ec2530a7a1f513e7ea4d7cfbd03314593f64de5429c1f9d3ba3654 WatchSource:0}: Error finding container d35cceeb06ec2530a7a1f513e7ea4d7cfbd03314593f64de5429c1f9d3ba3654: Status 404 returned error can't find the container with id d35cceeb06ec2530a7a1f513e7ea4d7cfbd03314593f64de5429c1f9d3ba3654
Sep 10 21:11:06.860546 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:06.860503    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-4fafd099-75787dc846-9zf75" event={"ID":"0bdb7174-83a2-4569-aa43-80f4601b8a94","Type":"ContainerStarted","Data":"f55ef3d6a8d1e4114f792482448399da91ed54df1ca248c7ccab2c1e1292d7ff"}
Sep 10 21:11:06.861027 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:06.860581    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-4fafd099-75787dc846-9zf75"
Sep 10 21:11:06.861027 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:06.860612    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-4fafd099-75787dc846-9zf75" event={"ID":"0bdb7174-83a2-4569-aa43-80f4601b8a94","Type":"ContainerStarted","Data":"81d07bc0438e1d5334a2a52dbda6fa062e8fe312e44ddd7104aba8f1a727ca96"}
Sep 10 21:11:06.862299 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:06.862272    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-4fafd099-57f9b8b54f-vgtqr" event={"ID":"6cf86c07-c2d5-4241-94cd-34f752827b47","Type":"ContainerStarted","Data":"74cb192274153f1883c85c7ea026892108104cc5297e1f5f7741596548b36a3e"}
Sep 10 21:11:06.862415 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:06.862325    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-4fafd099-57f9b8b54f-vgtqr" event={"ID":"6cf86c07-c2d5-4241-94cd-34f752827b47","Type":"ContainerStarted","Data":"d35cceeb06ec2530a7a1f513e7ea4d7cfbd03314593f64de5429c1f9d3ba3654"}
Sep 10 21:11:06.862415 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:06.862356    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-4fafd099-57f9b8b54f-vgtqr"
Sep 10 21:11:06.911654 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:06.911597    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-4fafd099-75787dc846-9zf75" podStartSLOduration=1.9115796710000001 podStartE2EDuration="1.911579671s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:11:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:11:06.909028925 +0000 UTC m=+847.596096205" watchObservedRunningTime="2026-09-10 21:11:06.911579671 +0000 UTC m=+847.598647003"
Sep 10 21:11:06.961823 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:06.961769    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-4fafd099-57f9b8b54f-vgtqr" podStartSLOduration=1.961755439 podStartE2EDuration="1.961755439s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:11:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:11:06.961057111 +0000 UTC m=+847.648124402" watchObservedRunningTime="2026-09-10 21:11:06.961755439 +0000 UTC m=+847.648822717"
Sep 10 21:11:11.833599 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:11.833567    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-04db70-6797ddc6d6-lsr7z"
Sep 10 21:11:17.877055 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:17.877017    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-4fafd099-57f9b8b54f-vgtqr"
Sep 10 21:11:17.877578 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:17.877113    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-4fafd099-75787dc846-9zf75"
Sep 10 21:11:24.975606 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:24.975572    2564 generic.go:356] "Generic (PLEG): container finished" podID="65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d" containerID="5de2bf6ac5704f7bb73ddb0a23d15c510894553e37e20f166f58693756012610" exitCode=0
Sep 10 21:11:24.976102 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:24.975646    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-c2de43-openshift-default-65fc6484d-qts6j" event={"ID":"65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d","Type":"ContainerDied","Data":"5de2bf6ac5704f7bb73ddb0a23d15c510894553e37e20f166f58693756012610"}
Sep 10 21:11:24.976102 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:24.976058    2564 scope.go:117] "RemoveContainer" containerID="5de2bf6ac5704f7bb73ddb0a23d15c510894553e37e20f166f58693756012610"
Sep 10 21:11:24.977133 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:24.977104    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 10 21:11:24.977199 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:24.977186    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 10 21:11:24.977249 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:24.977219    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 10 21:11:25.984307 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:25.984263    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-c2de43-openshift-default-65fc6484d-qts6j" event={"ID":"65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d","Type":"ContainerStarted","Data":"1a13fba55c96e5411e4fa58b30e831b4506d85ba19c7aaee3794c3d9a3e0c862"}
Sep 10 21:11:26.404730 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:26.404688    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-c2de43-openshift-default-65fc6484d-qts6j"
Sep 10 21:11:26.404968 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:26.404937    2564 patch_prober.go:28] interesting pod/e2e-autores-c2de43-openshift-default-65fc6484d-qts6j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 10 21:11:26.405061 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:26.405017    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-c2de43-openshift-default-65fc6484d-qts6j" podUID="65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 10 21:11:27.232352 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:27.232317    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-7eaf1f-74b7584db-t4n7g"]
Sep 10 21:11:27.235214 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:27.235193    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-7eaf1f-74b7584db-t4n7g"
Sep 10 21:11:27.238043 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:27.238024    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-7eaf1f-dockercfg-lmzpt\""
Sep 10 21:11:27.238774 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:27.238760    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-7eaf1f\""
Sep 10 21:11:27.249237 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:27.249201    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-7eaf1f-7b5598797f-2ktm8"]
Sep 10 21:11:27.252740 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:27.252718    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-7eaf1f-7b5598797f-2ktm8"
Sep 10 21:11:27.254832 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:27.254810    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-7eaf1f-74b7584db-t4n7g"]
Sep 10 21:11:27.284260 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:27.282291    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-7eaf1f-7b5598797f-2ktm8"]
Sep 10 21:11:27.291252 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:27.288744    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5njg\" (UniqueName: \"kubernetes.io/projected/c2d80fed-c2c1-423a-8f72-8bf3d31686e2-kube-api-access-q5njg\") pod \"payload-processing-e2e-inf-b-7eaf1f-7b5598797f-2ktm8\" (UID: \"c2d80fed-c2c1-423a-8f72-8bf3d31686e2\") " pod="openshift-ingress/payload-processing-e2e-inf-b-7eaf1f-7b5598797f-2ktm8"
Sep 10 21:11:27.291252 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:27.288813    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/54c3e9a7-ee07-4f39-9d7e-dbb93a23d89e-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-7eaf1f-74b7584db-t4n7g\" (UID: \"54c3e9a7-ee07-4f39-9d7e-dbb93a23d89e\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-7eaf1f-74b7584db-t4n7g"
Sep 10 21:11:27.291252 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:27.288855    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c2d80fed-c2c1-423a-8f72-8bf3d31686e2-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-7eaf1f-7b5598797f-2ktm8\" (UID: \"c2d80fed-c2c1-423a-8f72-8bf3d31686e2\") " pod="openshift-ingress/payload-processing-e2e-inf-b-7eaf1f-7b5598797f-2ktm8"
Sep 10 21:11:27.291252 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:27.288879    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmc7w\" (UniqueName: \"kubernetes.io/projected/54c3e9a7-ee07-4f39-9d7e-dbb93a23d89e-kube-api-access-cmc7w\") pod \"payload-pre-processing-e2e-inf-b-7eaf1f-74b7584db-t4n7g\" (UID: \"54c3e9a7-ee07-4f39-9d7e-dbb93a23d89e\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-7eaf1f-74b7584db-t4n7g"
Sep 10 21:11:27.391087 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:27.391044    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/54c3e9a7-ee07-4f39-9d7e-dbb93a23d89e-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-7eaf1f-74b7584db-t4n7g\" (UID: \"54c3e9a7-ee07-4f39-9d7e-dbb93a23d89e\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-7eaf1f-74b7584db-t4n7g"
Sep 10 21:11:27.391405 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:27.391380    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c2d80fed-c2c1-423a-8f72-8bf3d31686e2-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-7eaf1f-7b5598797f-2ktm8\" (UID: \"c2d80fed-c2c1-423a-8f72-8bf3d31686e2\") " pod="openshift-ingress/payload-processing-e2e-inf-b-7eaf1f-7b5598797f-2ktm8"
Sep 10 21:11:27.392024 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:27.392000    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmc7w\" (UniqueName: \"kubernetes.io/projected/54c3e9a7-ee07-4f39-9d7e-dbb93a23d89e-kube-api-access-cmc7w\") pod \"payload-pre-processing-e2e-inf-b-7eaf1f-74b7584db-t4n7g\" (UID: \"54c3e9a7-ee07-4f39-9d7e-dbb93a23d89e\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-7eaf1f-74b7584db-t4n7g"
Sep 10 21:11:27.392119 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:27.391936    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/54c3e9a7-ee07-4f39-9d7e-dbb93a23d89e-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-7eaf1f-74b7584db-t4n7g\" (UID: \"54c3e9a7-ee07-4f39-9d7e-dbb93a23d89e\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-7eaf1f-74b7584db-t4n7g"
Sep 10 21:11:27.392196 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:27.392178    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5njg\" (UniqueName: \"kubernetes.io/projected/c2d80fed-c2c1-423a-8f72-8bf3d31686e2-kube-api-access-q5njg\") pod \"payload-processing-e2e-inf-b-7eaf1f-7b5598797f-2ktm8\" (UID: \"c2d80fed-c2c1-423a-8f72-8bf3d31686e2\") " pod="openshift-ingress/payload-processing-e2e-inf-b-7eaf1f-7b5598797f-2ktm8"
Sep 10 21:11:27.392620 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:27.392596    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c2d80fed-c2c1-423a-8f72-8bf3d31686e2-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-7eaf1f-7b5598797f-2ktm8\" (UID: \"c2d80fed-c2c1-423a-8f72-8bf3d31686e2\") " pod="openshift-ingress/payload-processing-e2e-inf-b-7eaf1f-7b5598797f-2ktm8"
Sep 10 21:11:27.403365 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:27.403337    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmc7w\" (UniqueName: \"kubernetes.io/projected/54c3e9a7-ee07-4f39-9d7e-dbb93a23d89e-kube-api-access-cmc7w\") pod \"payload-pre-processing-e2e-inf-b-7eaf1f-74b7584db-t4n7g\" (UID: \"54c3e9a7-ee07-4f39-9d7e-dbb93a23d89e\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-7eaf1f-74b7584db-t4n7g"
Sep 10 21:11:27.404322 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:27.404303    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5njg\" (UniqueName: \"kubernetes.io/projected/c2d80fed-c2c1-423a-8f72-8bf3d31686e2-kube-api-access-q5njg\") pod \"payload-processing-e2e-inf-b-7eaf1f-7b5598797f-2ktm8\" (UID: \"c2d80fed-c2c1-423a-8f72-8bf3d31686e2\") " pod="openshift-ingress/payload-processing-e2e-inf-b-7eaf1f-7b5598797f-2ktm8"
Sep 10 21:11:27.405187 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:27.405164    2564 patch_prober.go:28] interesting pod/e2e-autores-c2de43-openshift-default-65fc6484d-qts6j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 10 21:11:27.405280 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:27.405216    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-c2de43-openshift-default-65fc6484d-qts6j" podUID="65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 10 21:11:27.546083 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:27.546051    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-7eaf1f-74b7584db-t4n7g"
Sep 10 21:11:27.563891 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:27.563857    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-7eaf1f-7b5598797f-2ktm8"
Sep 10 21:11:27.858130 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:27.858106    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-7eaf1f-74b7584db-t4n7g"]
Sep 10 21:11:27.860335 ip-10-0-129-100 kubenswrapper[2564]: W0910 21:11:27.860308    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54c3e9a7_ee07_4f39_9d7e_dbb93a23d89e.slice/crio-bbdebdc20039baa9365e8619e6e19f66b97cd63583176e1b58f4013eb08fd112 WatchSource:0}: Error finding container bbdebdc20039baa9365e8619e6e19f66b97cd63583176e1b58f4013eb08fd112: Status 404 returned error can't find the container with id bbdebdc20039baa9365e8619e6e19f66b97cd63583176e1b58f4013eb08fd112
Sep 10 21:11:27.881582 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:27.881533    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-7eaf1f-7b5598797f-2ktm8"]
Sep 10 21:11:27.897012 ip-10-0-129-100 kubenswrapper[2564]: W0910 21:11:27.896980    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2d80fed_c2c1_423a_8f72_8bf3d31686e2.slice/crio-d1039dedb3a5d788ae3764af7554ed728399d56f09b6cc54d53024560abe946a WatchSource:0}: Error finding container d1039dedb3a5d788ae3764af7554ed728399d56f09b6cc54d53024560abe946a: Status 404 returned error can't find the container with id d1039dedb3a5d788ae3764af7554ed728399d56f09b6cc54d53024560abe946a
Sep 10 21:11:28.005571 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:28.005463    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-7eaf1f-74b7584db-t4n7g" event={"ID":"54c3e9a7-ee07-4f39-9d7e-dbb93a23d89e","Type":"ContainerStarted","Data":"c8844492ba0cc272b438ab609ac70cf91e351adb25879b6d4ef48a27fa2588df"}
Sep 10 21:11:28.005571 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:28.005527    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-7eaf1f-74b7584db-t4n7g" event={"ID":"54c3e9a7-ee07-4f39-9d7e-dbb93a23d89e","Type":"ContainerStarted","Data":"bbdebdc20039baa9365e8619e6e19f66b97cd63583176e1b58f4013eb08fd112"}
Sep 10 21:11:28.006079 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:28.005697    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-7eaf1f-74b7584db-t4n7g"
Sep 10 21:11:28.007425 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:28.007399    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-7eaf1f-7b5598797f-2ktm8" event={"ID":"c2d80fed-c2c1-423a-8f72-8bf3d31686e2","Type":"ContainerStarted","Data":"ceffb9e1cf43aa76906f23bf30a07fb01577f78579fc287ed7e12d8c51d4876c"}
Sep 10 21:11:28.007562 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:28.007445    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-7eaf1f-7b5598797f-2ktm8" event={"ID":"c2d80fed-c2c1-423a-8f72-8bf3d31686e2","Type":"ContainerStarted","Data":"d1039dedb3a5d788ae3764af7554ed728399d56f09b6cc54d53024560abe946a"}
Sep 10 21:11:28.007562 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:28.007557    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-7eaf1f-7b5598797f-2ktm8"
Sep 10 21:11:28.040100 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:28.040044    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-7eaf1f-74b7584db-t4n7g" podStartSLOduration=1.040028287 podStartE2EDuration="1.040028287s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:11:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:11:28.039743464 +0000 UTC m=+868.726810743" watchObservedRunningTime="2026-09-10 21:11:28.040028287 +0000 UTC m=+868.727095565"
Sep 10 21:11:28.405827 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:28.405780    2564 patch_prober.go:28] interesting pod/e2e-autores-c2de43-openshift-default-65fc6484d-qts6j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 10 21:11:28.406305 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:28.405860    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-c2de43-openshift-default-65fc6484d-qts6j" podUID="65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 10 21:11:29.404997 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:29.404961    2564 patch_prober.go:28] interesting pod/e2e-autores-c2de43-openshift-default-65fc6484d-qts6j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 10 21:11:29.405344 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:29.405013    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-c2de43-openshift-default-65fc6484d-qts6j" podUID="65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 10 21:11:30.405775 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:30.405731    2564 patch_prober.go:28] interesting pod/e2e-autores-c2de43-openshift-default-65fc6484d-qts6j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 10 21:11:30.406162 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:30.405801    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-c2de43-openshift-default-65fc6484d-qts6j" podUID="65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 10 21:11:31.405690 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:31.405646    2564 patch_prober.go:28] interesting pod/e2e-autores-c2de43-openshift-default-65fc6484d-qts6j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 10 21:11:31.405876 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:31.405710    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-c2de43-openshift-default-65fc6484d-qts6j" podUID="65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 10 21:11:32.409249 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:32.409203    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-c2de43-openshift-default-65fc6484d-qts6j"
Sep 10 21:11:32.409606 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:32.409562    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-c2de43-openshift-default-65fc6484d-qts6j"
Sep 10 21:11:32.410394 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:32.410373    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-c2de43-openshift-default-65fc6484d-qts6j"
Sep 10 21:11:32.440938 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:32.440891    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-7eaf1f-7b5598797f-2ktm8" podStartSLOduration=5.440877288 podStartE2EDuration="5.440877288s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:11:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:11:28.082277485 +0000 UTC m=+868.769344760" watchObservedRunningTime="2026-09-10 21:11:32.440877288 +0000 UTC m=+873.127944568"
Sep 10 21:11:33.982768 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:33.982733    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4fafd099-kcknt"]
Sep 10 21:11:33.988727 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:33.988699    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4fafd099-kcknt"
Sep 10 21:11:33.993566 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:33.993539    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-m5c7x\""
Sep 10 21:11:33.993737 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:33.993696    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 21:11:34.011654 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:34.011620    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4fafd099-kcknt"]
Sep 10 21:11:34.054487 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:34.054268    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a76e0c7b-2a52-4bec-9146-28ae9f461d50-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4fafd099-kcknt\" (UID: \"a76e0c7b-2a52-4bec-9146-28ae9f461d50\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4fafd099-kcknt"
Sep 10 21:11:34.155752 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:34.155708    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a76e0c7b-2a52-4bec-9146-28ae9f461d50-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4fafd099-kcknt\" (UID: \"a76e0c7b-2a52-4bec-9146-28ae9f461d50\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4fafd099-kcknt"
Sep 10 21:11:34.156403 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:34.156380    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a76e0c7b-2a52-4bec-9146-28ae9f461d50-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4fafd099-kcknt\" (UID: \"a76e0c7b-2a52-4bec-9146-28ae9f461d50\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4fafd099-kcknt"
Sep 10 21:11:34.305899 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:34.305869    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4fafd099-kcknt"
Sep 10 21:11:34.597491 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:34.597412    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4fafd099-kcknt"]
Sep 10 21:11:34.604448 ip-10-0-129-100 kubenswrapper[2564]: W0910 21:11:34.604419    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda76e0c7b_2a52_4bec_9146_28ae9f461d50.slice/crio-d6349eb7fe57337de3ab28c0a0656697873600be284a865bc81397139641cfb4 WatchSource:0}: Error finding container d6349eb7fe57337de3ab28c0a0656697873600be284a865bc81397139641cfb4: Status 404 returned error can't find the container with id d6349eb7fe57337de3ab28c0a0656697873600be284a865bc81397139641cfb4
Sep 10 21:11:35.048038 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:35.048003    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4fafd099-kcknt" event={"ID":"a76e0c7b-2a52-4bec-9146-28ae9f461d50","Type":"ContainerStarted","Data":"d6349eb7fe57337de3ab28c0a0656697873600be284a865bc81397139641cfb4"}
Sep 10 21:11:38.068771 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:38.068738    2564 generic.go:356] "Generic (PLEG): container finished" podID="a76e0c7b-2a52-4bec-9146-28ae9f461d50" containerID="090b0b26f1bb6f21725f713483ab205f7402790086eea0900eff443eaf5d32f8" exitCode=0
Sep 10 21:11:38.069346 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:38.068785    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4fafd099-kcknt" event={"ID":"a76e0c7b-2a52-4bec-9146-28ae9f461d50","Type":"ContainerDied","Data":"090b0b26f1bb6f21725f713483ab205f7402790086eea0900eff443eaf5d32f8"}
Sep 10 21:11:39.015760 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:39.015722    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-7eaf1f-74b7584db-t4n7g"
Sep 10 21:11:39.015961 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:39.015942    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-7eaf1f-7b5598797f-2ktm8"
Sep 10 21:11:39.215593 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:39.215564    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4fafd099-kcknt"
Sep 10 21:11:39.303044 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:39.303005    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a76e0c7b-2a52-4bec-9146-28ae9f461d50-maas-api-service-ca\") pod \"a76e0c7b-2a52-4bec-9146-28ae9f461d50\" (UID: \"a76e0c7b-2a52-4bec-9146-28ae9f461d50\") "
Sep 10 21:11:39.308173 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:39.303775    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a76e0c7b-2a52-4bec-9146-28ae9f461d50-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a76e0c7b-2a52-4bec-9146-28ae9f461d50" (UID: "a76e0c7b-2a52-4bec-9146-28ae9f461d50"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:11:39.404012 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:39.403973    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a76e0c7b-2a52-4bec-9146-28ae9f461d50-maas-api-service-ca\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:11:40.083960 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:40.083934    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4fafd099-kcknt"
Sep 10 21:11:40.084125 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:40.083935    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4fafd099-kcknt" event={"ID":"a76e0c7b-2a52-4bec-9146-28ae9f461d50","Type":"ContainerDied","Data":"d6349eb7fe57337de3ab28c0a0656697873600be284a865bc81397139641cfb4"}
Sep 10 21:11:40.084125 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:40.084055    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d6349eb7fe57337de3ab28c0a0656697873600be284a865bc81397139641cfb4"
Sep 10 21:11:45.257984 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:45.257942    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-4fafd099-57f9b8b54f-vgtqr"]
Sep 10 21:11:45.258514 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:45.258256    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-4fafd099-57f9b8b54f-vgtqr" podUID="6cf86c07-c2d5-4241-94cd-34f752827b47" containerName="payload-processing" containerID="cri-o://74cb192274153f1883c85c7ea026892108104cc5297e1f5f7741596548b36a3e" gracePeriod=30
Sep 10 21:11:45.264756 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:45.264725    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4fafd099-75787dc846-9zf75"]
Sep 10 21:11:45.266951 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:45.266034    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-4fafd099-75787dc846-9zf75" podUID="0bdb7174-83a2-4569-aa43-80f4601b8a94" containerName="payload-pre-processing" containerID="cri-o://f55ef3d6a8d1e4114f792482448399da91ed54df1ca248c7ccab2c1e1292d7ff" gracePeriod=30
Sep 10 21:11:45.498056 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:45.498019    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4fafd099-kcknt"]
Sep 10 21:11:45.504590 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:45.504513    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4fafd099-kcknt"]
Sep 10 21:11:45.526557 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:45.526530    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-4fafd099-57f9b8b54f-vgtqr"
Sep 10 21:11:45.560107 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:45.560080    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-4fafd099-75787dc846-9zf75"
Sep 10 21:11:45.664011 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:45.663976    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j2lpg\" (UniqueName: \"kubernetes.io/projected/6cf86c07-c2d5-4241-94cd-34f752827b47-kube-api-access-j2lpg\") pod \"6cf86c07-c2d5-4241-94cd-34f752827b47\" (UID: \"6cf86c07-c2d5-4241-94cd-34f752827b47\") "
Sep 10 21:11:45.664183 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:45.664053    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6cf86c07-c2d5-4241-94cd-34f752827b47-plugins-config-volume\") pod \"6cf86c07-c2d5-4241-94cd-34f752827b47\" (UID: \"6cf86c07-c2d5-4241-94cd-34f752827b47\") "
Sep 10 21:11:45.664183 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:45.664091    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cllsd\" (UniqueName: \"kubernetes.io/projected/0bdb7174-83a2-4569-aa43-80f4601b8a94-kube-api-access-cllsd\") pod \"0bdb7174-83a2-4569-aa43-80f4601b8a94\" (UID: \"0bdb7174-83a2-4569-aa43-80f4601b8a94\") "
Sep 10 21:11:45.664183 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:45.664158    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0bdb7174-83a2-4569-aa43-80f4601b8a94-plugins-config-volume\") pod \"0bdb7174-83a2-4569-aa43-80f4601b8a94\" (UID: \"0bdb7174-83a2-4569-aa43-80f4601b8a94\") "
Sep 10 21:11:45.664519 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:45.664486    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6cf86c07-c2d5-4241-94cd-34f752827b47-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6cf86c07-c2d5-4241-94cd-34f752827b47" (UID: "6cf86c07-c2d5-4241-94cd-34f752827b47"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:11:45.664621 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:45.664596    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0bdb7174-83a2-4569-aa43-80f4601b8a94-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0bdb7174-83a2-4569-aa43-80f4601b8a94" (UID: "0bdb7174-83a2-4569-aa43-80f4601b8a94"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:11:45.666245 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:45.666212    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6cf86c07-c2d5-4241-94cd-34f752827b47-kube-api-access-j2lpg" (OuterVolumeSpecName: "kube-api-access-j2lpg") pod "6cf86c07-c2d5-4241-94cd-34f752827b47" (UID: "6cf86c07-c2d5-4241-94cd-34f752827b47"). InnerVolumeSpecName "kube-api-access-j2lpg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:11:45.666371 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:45.666260    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0bdb7174-83a2-4569-aa43-80f4601b8a94-kube-api-access-cllsd" (OuterVolumeSpecName: "kube-api-access-cllsd") pod "0bdb7174-83a2-4569-aa43-80f4601b8a94" (UID: "0bdb7174-83a2-4569-aa43-80f4601b8a94"). InnerVolumeSpecName "kube-api-access-cllsd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:11:45.765879 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:45.765781    2564 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6cf86c07-c2d5-4241-94cd-34f752827b47-plugins-config-volume\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:11:45.765879 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:45.765815    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cllsd\" (UniqueName: \"kubernetes.io/projected/0bdb7174-83a2-4569-aa43-80f4601b8a94-kube-api-access-cllsd\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:11:45.765879 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:45.765831    2564 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0bdb7174-83a2-4569-aa43-80f4601b8a94-plugins-config-volume\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:11:45.765879 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:45.765842    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j2lpg\" (UniqueName: \"kubernetes.io/projected/6cf86c07-c2d5-4241-94cd-34f752827b47-kube-api-access-j2lpg\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:11:45.872525 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:45.872490    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a76e0c7b-2a52-4bec-9146-28ae9f461d50" path="/var/lib/kubelet/pods/a76e0c7b-2a52-4bec-9146-28ae9f461d50/volumes"
Sep 10 21:11:46.119137 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:46.119098    2564 generic.go:356] "Generic (PLEG): container finished" podID="0bdb7174-83a2-4569-aa43-80f4601b8a94" containerID="f55ef3d6a8d1e4114f792482448399da91ed54df1ca248c7ccab2c1e1292d7ff" exitCode=0
Sep 10 21:11:46.119365 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:46.119148    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-4fafd099-75787dc846-9zf75"
Sep 10 21:11:46.119365 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:46.119176    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-4fafd099-75787dc846-9zf75" event={"ID":"0bdb7174-83a2-4569-aa43-80f4601b8a94","Type":"ContainerDied","Data":"f55ef3d6a8d1e4114f792482448399da91ed54df1ca248c7ccab2c1e1292d7ff"}
Sep 10 21:11:46.119365 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:46.119249    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-4fafd099-75787dc846-9zf75" event={"ID":"0bdb7174-83a2-4569-aa43-80f4601b8a94","Type":"ContainerDied","Data":"81d07bc0438e1d5334a2a52dbda6fa062e8fe312e44ddd7104aba8f1a727ca96"}
Sep 10 21:11:46.119365 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:46.119259    2564 scope.go:117] "RemoveContainer" containerID="f55ef3d6a8d1e4114f792482448399da91ed54df1ca248c7ccab2c1e1292d7ff"
Sep 10 21:11:46.121378 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:46.121345    2564 generic.go:356] "Generic (PLEG): container finished" podID="6cf86c07-c2d5-4241-94cd-34f752827b47" containerID="74cb192274153f1883c85c7ea026892108104cc5297e1f5f7741596548b36a3e" exitCode=0
Sep 10 21:11:46.121513 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:46.121419    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-4fafd099-57f9b8b54f-vgtqr"
Sep 10 21:11:46.121513 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:46.121441    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-4fafd099-57f9b8b54f-vgtqr" event={"ID":"6cf86c07-c2d5-4241-94cd-34f752827b47","Type":"ContainerDied","Data":"74cb192274153f1883c85c7ea026892108104cc5297e1f5f7741596548b36a3e"}
Sep 10 21:11:46.121513 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:46.121504    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-4fafd099-57f9b8b54f-vgtqr" event={"ID":"6cf86c07-c2d5-4241-94cd-34f752827b47","Type":"ContainerDied","Data":"d35cceeb06ec2530a7a1f513e7ea4d7cfbd03314593f64de5429c1f9d3ba3654"}
Sep 10 21:11:46.129698 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:46.129681    2564 scope.go:117] "RemoveContainer" containerID="f55ef3d6a8d1e4114f792482448399da91ed54df1ca248c7ccab2c1e1292d7ff"
Sep 10 21:11:46.130011 ip-10-0-129-100 kubenswrapper[2564]: E0910 21:11:46.129990    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f55ef3d6a8d1e4114f792482448399da91ed54df1ca248c7ccab2c1e1292d7ff\": container with ID starting with f55ef3d6a8d1e4114f792482448399da91ed54df1ca248c7ccab2c1e1292d7ff not found: ID does not exist" containerID="f55ef3d6a8d1e4114f792482448399da91ed54df1ca248c7ccab2c1e1292d7ff"
Sep 10 21:11:46.130079 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:46.130020    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f55ef3d6a8d1e4114f792482448399da91ed54df1ca248c7ccab2c1e1292d7ff"} err="failed to get container status \"f55ef3d6a8d1e4114f792482448399da91ed54df1ca248c7ccab2c1e1292d7ff\": rpc error: code = NotFound desc = could not find container \"f55ef3d6a8d1e4114f792482448399da91ed54df1ca248c7ccab2c1e1292d7ff\": container with ID starting with f55ef3d6a8d1e4114f792482448399da91ed54df1ca248c7ccab2c1e1292d7ff not found: ID does not exist"
Sep 10 21:11:46.130079 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:46.130036    2564 scope.go:117] "RemoveContainer" containerID="74cb192274153f1883c85c7ea026892108104cc5297e1f5f7741596548b36a3e"
Sep 10 21:11:46.138423 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:46.138395    2564 scope.go:117] "RemoveContainer" containerID="74cb192274153f1883c85c7ea026892108104cc5297e1f5f7741596548b36a3e"
Sep 10 21:11:46.138670 ip-10-0-129-100 kubenswrapper[2564]: E0910 21:11:46.138650    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74cb192274153f1883c85c7ea026892108104cc5297e1f5f7741596548b36a3e\": container with ID starting with 74cb192274153f1883c85c7ea026892108104cc5297e1f5f7741596548b36a3e not found: ID does not exist" containerID="74cb192274153f1883c85c7ea026892108104cc5297e1f5f7741596548b36a3e"
Sep 10 21:11:46.138740 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:46.138684    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74cb192274153f1883c85c7ea026892108104cc5297e1f5f7741596548b36a3e"} err="failed to get container status \"74cb192274153f1883c85c7ea026892108104cc5297e1f5f7741596548b36a3e\": rpc error: code = NotFound desc = could not find container \"74cb192274153f1883c85c7ea026892108104cc5297e1f5f7741596548b36a3e\": container with ID starting with 74cb192274153f1883c85c7ea026892108104cc5297e1f5f7741596548b36a3e not found: ID does not exist"
Sep 10 21:11:46.148076 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:46.148051    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4fafd099-75787dc846-9zf75"]
Sep 10 21:11:46.150187 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:46.150165    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4fafd099-75787dc846-9zf75"]
Sep 10 21:11:46.166727 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:46.166692    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-4fafd099-57f9b8b54f-vgtqr"]
Sep 10 21:11:46.172081 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:46.172051    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-4fafd099-57f9b8b54f-vgtqr"]
Sep 10 21:11:46.586788 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:46.586758    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms"]
Sep 10 21:11:46.587137 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:46.587118    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a76e0c7b-2a52-4bec-9146-28ae9f461d50" containerName="revoke-keys"
Sep 10 21:11:46.587137 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:46.587129    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a76e0c7b-2a52-4bec-9146-28ae9f461d50" containerName="revoke-keys"
Sep 10 21:11:46.587137 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:46.587138    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bdb7174-83a2-4569-aa43-80f4601b8a94" containerName="payload-pre-processing"
Sep 10 21:11:46.587264 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:46.587144    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bdb7174-83a2-4569-aa43-80f4601b8a94" containerName="payload-pre-processing"
Sep 10 21:11:46.587264 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:46.587151    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cf86c07-c2d5-4241-94cd-34f752827b47" containerName="payload-processing"
Sep 10 21:11:46.587264 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:46.587157    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cf86c07-c2d5-4241-94cd-34f752827b47" containerName="payload-processing"
Sep 10 21:11:46.587264 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:46.587207    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="6cf86c07-c2d5-4241-94cd-34f752827b47" containerName="payload-processing"
Sep 10 21:11:46.587264 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:46.587213    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a76e0c7b-2a52-4bec-9146-28ae9f461d50" containerName="revoke-keys"
Sep 10 21:11:46.587264 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:46.587223    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="0bdb7174-83a2-4569-aa43-80f4601b8a94" containerName="payload-pre-processing"
Sep 10 21:11:46.591798 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:46.591763    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms"
Sep 10 21:11:46.597661 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:46.597641    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-d00f8e2d-gw-openshift-default-dockercfg-srz9b\""
Sep 10 21:11:46.603123 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:46.603096    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms"]
Sep 10 21:11:46.674126 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:46.674092    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cc2bt\" (UniqueName: \"kubernetes.io/projected/0724254e-ebd5-4fcc-85bb-d1aa65186fde-kube-api-access-cc2bt\") pod \"e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms\" (UID: \"0724254e-ebd5-4fcc-85bb-d1aa65186fde\") " pod="openshift-ingress/e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms"
Sep 10 21:11:46.674355 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:46.674153    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0724254e-ebd5-4fcc-85bb-d1aa65186fde-istio-podinfo\") pod \"e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms\" (UID: \"0724254e-ebd5-4fcc-85bb-d1aa65186fde\") " pod="openshift-ingress/e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms"
Sep 10 21:11:46.674355 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:46.674181    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0724254e-ebd5-4fcc-85bb-d1aa65186fde-credential-socket\") pod \"e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms\" (UID: \"0724254e-ebd5-4fcc-85bb-d1aa65186fde\") " pod="openshift-ingress/e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms"
Sep 10 21:11:46.674355 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:46.674219    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0724254e-ebd5-4fcc-85bb-d1aa65186fde-istiod-ca-cert\") pod \"e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms\" (UID: \"0724254e-ebd5-4fcc-85bb-d1aa65186fde\") " pod="openshift-ingress/e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms"
Sep 10 21:11:46.674355 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:46.674288    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0724254e-ebd5-4fcc-85bb-d1aa65186fde-istio-envoy\") pod \"e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms\" (UID: \"0724254e-ebd5-4fcc-85bb-d1aa65186fde\") " pod="openshift-ingress/e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms"
Sep 10 21:11:46.674355 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:46.674312    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0724254e-ebd5-4fcc-85bb-d1aa65186fde-istio-token\") pod \"e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms\" (UID: \"0724254e-ebd5-4fcc-85bb-d1aa65186fde\") " pod="openshift-ingress/e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms"
Sep 10 21:11:46.674624 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:46.674380    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0724254e-ebd5-4fcc-85bb-d1aa65186fde-workload-socket\") pod \"e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms\" (UID: \"0724254e-ebd5-4fcc-85bb-d1aa65186fde\") " pod="openshift-ingress/e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms"
Sep 10 21:11:46.674624 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:46.674404    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0724254e-ebd5-4fcc-85bb-d1aa65186fde-istio-data\") pod \"e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms\" (UID: \"0724254e-ebd5-4fcc-85bb-d1aa65186fde\") " pod="openshift-ingress/e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms"
Sep 10 21:11:46.674624 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:46.674456    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0724254e-ebd5-4fcc-85bb-d1aa65186fde-workload-certs\") pod \"e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms\" (UID: \"0724254e-ebd5-4fcc-85bb-d1aa65186fde\") " pod="openshift-ingress/e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms"
Sep 10 21:11:46.775576 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:46.775539    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0724254e-ebd5-4fcc-85bb-d1aa65186fde-credential-socket\") pod \"e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms\" (UID: \"0724254e-ebd5-4fcc-85bb-d1aa65186fde\") " pod="openshift-ingress/e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms"
Sep 10 21:11:46.775754 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:46.775585    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0724254e-ebd5-4fcc-85bb-d1aa65186fde-istiod-ca-cert\") pod \"e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms\" (UID: \"0724254e-ebd5-4fcc-85bb-d1aa65186fde\") " pod="openshift-ingress/e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms"
Sep 10 21:11:46.775754 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:46.775633    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0724254e-ebd5-4fcc-85bb-d1aa65186fde-istio-envoy\") pod \"e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms\" (UID: \"0724254e-ebd5-4fcc-85bb-d1aa65186fde\") " pod="openshift-ingress/e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms"
Sep 10 21:11:46.775754 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:46.775656    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0724254e-ebd5-4fcc-85bb-d1aa65186fde-istio-token\") pod \"e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms\" (UID: \"0724254e-ebd5-4fcc-85bb-d1aa65186fde\") " pod="openshift-ingress/e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms"
Sep 10 21:11:46.775754 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:46.775719    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0724254e-ebd5-4fcc-85bb-d1aa65186fde-workload-socket\") pod \"e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms\" (UID: \"0724254e-ebd5-4fcc-85bb-d1aa65186fde\") " pod="openshift-ingress/e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms"
Sep 10 21:11:46.775754 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:46.775744    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0724254e-ebd5-4fcc-85bb-d1aa65186fde-istio-data\") pod \"e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms\" (UID: \"0724254e-ebd5-4fcc-85bb-d1aa65186fde\") " pod="openshift-ingress/e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms"
Sep 10 21:11:46.776069 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:46.775782    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0724254e-ebd5-4fcc-85bb-d1aa65186fde-workload-certs\") pod \"e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms\" (UID: \"0724254e-ebd5-4fcc-85bb-d1aa65186fde\") " pod="openshift-ingress/e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms"
Sep 10 21:11:46.776069 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:46.775820    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cc2bt\" (UniqueName: \"kubernetes.io/projected/0724254e-ebd5-4fcc-85bb-d1aa65186fde-kube-api-access-cc2bt\") pod \"e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms\" (UID: \"0724254e-ebd5-4fcc-85bb-d1aa65186fde\") " pod="openshift-ingress/e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms"
Sep 10 21:11:46.776069 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:46.775868    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0724254e-ebd5-4fcc-85bb-d1aa65186fde-istio-podinfo\") pod \"e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms\" (UID: \"0724254e-ebd5-4fcc-85bb-d1aa65186fde\") " pod="openshift-ingress/e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms"
Sep 10 21:11:46.776069 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:46.775993    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0724254e-ebd5-4fcc-85bb-d1aa65186fde-credential-socket\") pod \"e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms\" (UID: \"0724254e-ebd5-4fcc-85bb-d1aa65186fde\") " pod="openshift-ingress/e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms"
Sep 10 21:11:46.776069 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:46.776062    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0724254e-ebd5-4fcc-85bb-d1aa65186fde-workload-socket\") pod \"e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms\" (UID: \"0724254e-ebd5-4fcc-85bb-d1aa65186fde\") " pod="openshift-ingress/e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms"
Sep 10 21:11:46.776381 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:46.776307    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0724254e-ebd5-4fcc-85bb-d1aa65186fde-istio-data\") pod \"e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms\" (UID: \"0724254e-ebd5-4fcc-85bb-d1aa65186fde\") " pod="openshift-ingress/e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms"
Sep 10 21:11:46.776462 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:46.776440    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0724254e-ebd5-4fcc-85bb-d1aa65186fde-workload-certs\") pod \"e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms\" (UID: \"0724254e-ebd5-4fcc-85bb-d1aa65186fde\") " pod="openshift-ingress/e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms"
Sep 10 21:11:46.776521 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:46.776457    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0724254e-ebd5-4fcc-85bb-d1aa65186fde-istiod-ca-cert\") pod \"e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms\" (UID: \"0724254e-ebd5-4fcc-85bb-d1aa65186fde\") " pod="openshift-ingress/e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms"
Sep 10 21:11:46.777955 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:46.777927    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0724254e-ebd5-4fcc-85bb-d1aa65186fde-istio-envoy\") pod \"e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms\" (UID: \"0724254e-ebd5-4fcc-85bb-d1aa65186fde\") " pod="openshift-ingress/e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms"
Sep 10 21:11:46.778224 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:46.778207    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0724254e-ebd5-4fcc-85bb-d1aa65186fde-istio-podinfo\") pod \"e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms\" (UID: \"0724254e-ebd5-4fcc-85bb-d1aa65186fde\") " pod="openshift-ingress/e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms"
Sep 10 21:11:46.783797 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:46.783767    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0724254e-ebd5-4fcc-85bb-d1aa65186fde-istio-token\") pod \"e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms\" (UID: \"0724254e-ebd5-4fcc-85bb-d1aa65186fde\") " pod="openshift-ingress/e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms"
Sep 10 21:11:46.783962 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:46.783943    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cc2bt\" (UniqueName: \"kubernetes.io/projected/0724254e-ebd5-4fcc-85bb-d1aa65186fde-kube-api-access-cc2bt\") pod \"e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms\" (UID: \"0724254e-ebd5-4fcc-85bb-d1aa65186fde\") " pod="openshift-ingress/e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms"
Sep 10 21:11:46.902979 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:46.902875    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms"
Sep 10 21:11:47.188067 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:47.188042    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms"]
Sep 10 21:11:47.188768 ip-10-0-129-100 kubenswrapper[2564]: W0910 21:11:47.188744    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0724254e_ebd5_4fcc_85bb_d1aa65186fde.slice/crio-6ce0447e87ee32906699da7b536237215e7fe3527dbf4cc6665f02b609648b73 WatchSource:0}: Error finding container 6ce0447e87ee32906699da7b536237215e7fe3527dbf4cc6665f02b609648b73: Status 404 returned error can't find the container with id 6ce0447e87ee32906699da7b536237215e7fe3527dbf4cc6665f02b609648b73
Sep 10 21:11:47.190976 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:47.190943    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 10 21:11:47.191034 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:47.191008    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 10 21:11:47.191070 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:47.191036    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 10 21:11:47.873079 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:47.873046    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0bdb7174-83a2-4569-aa43-80f4601b8a94" path="/var/lib/kubelet/pods/0bdb7174-83a2-4569-aa43-80f4601b8a94/volumes"
Sep 10 21:11:47.873468 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:47.873428    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6cf86c07-c2d5-4241-94cd-34f752827b47" path="/var/lib/kubelet/pods/6cf86c07-c2d5-4241-94cd-34f752827b47/volumes"
Sep 10 21:11:48.136641 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:48.136537    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms" event={"ID":"0724254e-ebd5-4fcc-85bb-d1aa65186fde","Type":"ContainerStarted","Data":"c5de3ef5f3e74b7509bed0b4198ede79a5695901d140aa6ee394297d5d31d0d8"}
Sep 10 21:11:48.136798 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:48.136645    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms" event={"ID":"0724254e-ebd5-4fcc-85bb-d1aa65186fde","Type":"ContainerStarted","Data":"6ce0447e87ee32906699da7b536237215e7fe3527dbf4cc6665f02b609648b73"}
Sep 10 21:11:48.157335 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:48.157280    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms" podStartSLOduration=2.157258792 podStartE2EDuration="2.157258792s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:11:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:11:48.156933865 +0000 UTC m=+888.844001144" watchObservedRunningTime="2026-09-10 21:11:48.157258792 +0000 UTC m=+888.844326069"
Sep 10 21:11:48.903854 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:48.903812    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms"
Sep 10 21:11:48.909740 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:48.909712    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms"
Sep 10 21:11:49.143049 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:49.143019    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms"
Sep 10 21:11:49.144093 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:49.144070    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms"
Sep 10 21:11:50.536546 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:50.536510    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-d00f8e2d-58d44644b6-bjcj8"]
Sep 10 21:11:50.541037 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:50.541019    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d00f8e2d-58d44644b6-bjcj8"
Sep 10 21:11:50.543562 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:50.543539    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-d00f8e2d\""
Sep 10 21:11:50.543627 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:50.543566    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-d00f8e2d-dockercfg-scnwk\""
Sep 10 21:11:50.554929 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:50.554901    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-d00f8e2d-58d44644b6-bjcj8"]
Sep 10 21:11:50.611278 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:50.611215    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dca77250-1806-43ca-8030-37acfe9c8c02-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-d00f8e2d-58d44644b6-bjcj8\" (UID: \"dca77250-1806-43ca-8030-37acfe9c8c02\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-d00f8e2d-58d44644b6-bjcj8"
Sep 10 21:11:50.611439 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:50.611378    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2qds\" (UniqueName: \"kubernetes.io/projected/dca77250-1806-43ca-8030-37acfe9c8c02-kube-api-access-j2qds\") pod \"payload-pre-processing-e2e-migrate-d00f8e2d-58d44644b6-bjcj8\" (UID: \"dca77250-1806-43ca-8030-37acfe9c8c02\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-d00f8e2d-58d44644b6-bjcj8"
Sep 10 21:11:50.712563 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:50.712523    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2qds\" (UniqueName: \"kubernetes.io/projected/dca77250-1806-43ca-8030-37acfe9c8c02-kube-api-access-j2qds\") pod \"payload-pre-processing-e2e-migrate-d00f8e2d-58d44644b6-bjcj8\" (UID: \"dca77250-1806-43ca-8030-37acfe9c8c02\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-d00f8e2d-58d44644b6-bjcj8"
Sep 10 21:11:50.712741 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:50.712588    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dca77250-1806-43ca-8030-37acfe9c8c02-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-d00f8e2d-58d44644b6-bjcj8\" (UID: \"dca77250-1806-43ca-8030-37acfe9c8c02\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-d00f8e2d-58d44644b6-bjcj8"
Sep 10 21:11:50.713337 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:50.713317    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dca77250-1806-43ca-8030-37acfe9c8c02-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-d00f8e2d-58d44644b6-bjcj8\" (UID: \"dca77250-1806-43ca-8030-37acfe9c8c02\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-d00f8e2d-58d44644b6-bjcj8"
Sep 10 21:11:50.725179 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:50.725151    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2qds\" (UniqueName: \"kubernetes.io/projected/dca77250-1806-43ca-8030-37acfe9c8c02-kube-api-access-j2qds\") pod \"payload-pre-processing-e2e-migrate-d00f8e2d-58d44644b6-bjcj8\" (UID: \"dca77250-1806-43ca-8030-37acfe9c8c02\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-d00f8e2d-58d44644b6-bjcj8"
Sep 10 21:11:50.852047 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:50.852015    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d00f8e2d-58d44644b6-bjcj8"
Sep 10 21:11:51.138004 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:51.137975    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-d00f8e2d-58d44644b6-bjcj8"]
Sep 10 21:11:51.139212 ip-10-0-129-100 kubenswrapper[2564]: W0910 21:11:51.139185    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddca77250_1806_43ca_8030_37acfe9c8c02.slice/crio-69c73f6f24db62b337f241322466e25ef9d8b395f395ef582b7f358f9cb8e993 WatchSource:0}: Error finding container 69c73f6f24db62b337f241322466e25ef9d8b395f395ef582b7f358f9cb8e993: Status 404 returned error can't find the container with id 69c73f6f24db62b337f241322466e25ef9d8b395f395ef582b7f358f9cb8e993
Sep 10 21:11:51.154503 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:51.154470    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d00f8e2d-58d44644b6-bjcj8" event={"ID":"dca77250-1806-43ca-8030-37acfe9c8c02","Type":"ContainerStarted","Data":"69c73f6f24db62b337f241322466e25ef9d8b395f395ef582b7f358f9cb8e993"}
Sep 10 21:11:52.162867 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:52.162821    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d00f8e2d-58d44644b6-bjcj8" event={"ID":"dca77250-1806-43ca-8030-37acfe9c8c02","Type":"ContainerStarted","Data":"5c7755a59a88c70bbf3eda9099a6a08a5e621809c295511528b4feaf9efade92"}
Sep 10 21:11:52.163308 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:52.162922    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d00f8e2d-58d44644b6-bjcj8"
Sep 10 21:11:52.184051 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:11:52.183995    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d00f8e2d-58d44644b6-bjcj8" podStartSLOduration=2.183979438 podStartE2EDuration="2.183979438s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:11:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:11:52.18144199 +0000 UTC m=+892.868509282" watchObservedRunningTime="2026-09-10 21:11:52.183979438 +0000 UTC m=+892.871046716"
Sep 10 21:12:01.151309 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:01.151277    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-cd9hp_0432bad8-86f5-4b0e-a0d4-2fdb728223f2/console-operator/2.log"
Sep 10 21:12:01.152320 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:01.152295    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-cd9hp_0432bad8-86f5-4b0e-a0d4-2fdb728223f2/console-operator/2.log"
Sep 10 21:12:01.158108 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:01.158087    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wrbhk_279e54f7-0db1-4e2d-a998-4b3ecdf992cd/ovn-acl-logging/0.log"
Sep 10 21:12:01.159108 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:01.159086    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wrbhk_279e54f7-0db1-4e2d-a998-4b3ecdf992cd/ovn-acl-logging/0.log"
Sep 10 21:12:03.172847 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:03.172808    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d00f8e2d-58d44644b6-bjcj8"
Sep 10 21:12:11.277272 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:11.277176    2564 generic.go:356] "Generic (PLEG): container finished" podID="0724254e-ebd5-4fcc-85bb-d1aa65186fde" containerID="c5de3ef5f3e74b7509bed0b4198ede79a5695901d140aa6ee394297d5d31d0d8" exitCode=0
Sep 10 21:12:11.277672 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:11.277260    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms" event={"ID":"0724254e-ebd5-4fcc-85bb-d1aa65186fde","Type":"ContainerDied","Data":"c5de3ef5f3e74b7509bed0b4198ede79a5695901d140aa6ee394297d5d31d0d8"}
Sep 10 21:12:11.277672 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:11.277657    2564 scope.go:117] "RemoveContainer" containerID="c5de3ef5f3e74b7509bed0b4198ede79a5695901d140aa6ee394297d5d31d0d8"
Sep 10 21:12:11.278902 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:11.278864    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 10 21:12:11.278986 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:11.278955    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 10 21:12:11.279024 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:11.279004    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 10 21:12:12.290047 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:12.289991    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms" event={"ID":"0724254e-ebd5-4fcc-85bb-d1aa65186fde","Type":"ContainerStarted","Data":"ae60b2263a0ce89aa442da281667f7cb8ba0b6eaa1e01db19f2aa248aa1ffaca"}
Sep 10 21:12:12.903544 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:12.903485    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms"
Sep 10 21:12:12.903904 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:12.903872    2564 patch_prober.go:28] interesting pod/e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Sep 10 21:12:12.904154 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:12.904121    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms" podUID="0724254e-ebd5-4fcc-85bb-d1aa65186fde" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Sep 10 21:12:13.903911 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:13.903864    2564 patch_prober.go:28] interesting pod/e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Sep 10 21:12:13.904432 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:13.903931    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms" podUID="0724254e-ebd5-4fcc-85bb-d1aa65186fde" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Sep 10 21:12:14.631109 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:14.631073    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d00f8e2d-r9njp"]
Sep 10 21:12:14.634930 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:14.634913    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d00f8e2d-r9njp"
Sep 10 21:12:14.637345 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:14.637315    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 21:12:14.637465 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:14.637388    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-m5c7x\""
Sep 10 21:12:14.643871 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:14.643844    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d00f8e2d-r9njp"]
Sep 10 21:12:14.727066 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:14.727020    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/57fb7843-79ff-4cf4-a3d0-355d5f583f39-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-d00f8e2d-r9njp\" (UID: \"57fb7843-79ff-4cf4-a3d0-355d5f583f39\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d00f8e2d-r9njp"
Sep 10 21:12:14.828171 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:14.828127    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/57fb7843-79ff-4cf4-a3d0-355d5f583f39-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-d00f8e2d-r9njp\" (UID: \"57fb7843-79ff-4cf4-a3d0-355d5f583f39\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d00f8e2d-r9njp"
Sep 10 21:12:14.828753 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:14.828732    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/57fb7843-79ff-4cf4-a3d0-355d5f583f39-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-d00f8e2d-r9njp\" (UID: \"57fb7843-79ff-4cf4-a3d0-355d5f583f39\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d00f8e2d-r9njp"
Sep 10 21:12:14.904046 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:14.903953    2564 patch_prober.go:28] interesting pod/e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Sep 10 21:12:14.904046 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:14.904014    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms" podUID="0724254e-ebd5-4fcc-85bb-d1aa65186fde" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Sep 10 21:12:14.946868 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:14.946834    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d00f8e2d-r9njp"
Sep 10 21:12:15.244053 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:15.244024    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d00f8e2d-r9njp"]
Sep 10 21:12:15.245765 ip-10-0-129-100 kubenswrapper[2564]: W0910 21:12:15.245736    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57fb7843_79ff_4cf4_a3d0_355d5f583f39.slice/crio-8944bae9a252b66dfde1b219d65f2fc150894cb9f14a9d54eacd2ee049f7b7c0 WatchSource:0}: Error finding container 8944bae9a252b66dfde1b219d65f2fc150894cb9f14a9d54eacd2ee049f7b7c0: Status 404 returned error can't find the container with id 8944bae9a252b66dfde1b219d65f2fc150894cb9f14a9d54eacd2ee049f7b7c0
Sep 10 21:12:15.306931 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:15.306900    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d00f8e2d-r9njp" event={"ID":"57fb7843-79ff-4cf4-a3d0-355d5f583f39","Type":"ContainerStarted","Data":"8944bae9a252b66dfde1b219d65f2fc150894cb9f14a9d54eacd2ee049f7b7c0"}
Sep 10 21:12:15.903560 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:15.903515    2564 patch_prober.go:28] interesting pod/e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Sep 10 21:12:15.903772 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:15.903585    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms" podUID="0724254e-ebd5-4fcc-85bb-d1aa65186fde" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Sep 10 21:12:16.314494 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:16.314456    2564 generic.go:356] "Generic (PLEG): container finished" podID="57fb7843-79ff-4cf4-a3d0-355d5f583f39" containerID="7e453cba57067a89407c319e63815eeb5e0f418c091578d3ba1efe0316f06287" exitCode=0
Sep 10 21:12:16.314848 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:16.314544    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d00f8e2d-r9njp" event={"ID":"57fb7843-79ff-4cf4-a3d0-355d5f583f39","Type":"ContainerDied","Data":"7e453cba57067a89407c319e63815eeb5e0f418c091578d3ba1efe0316f06287"}
Sep 10 21:12:16.904163 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:16.904121    2564 patch_prober.go:28] interesting pod/e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Sep 10 21:12:16.904377 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:16.904181    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms" podUID="0724254e-ebd5-4fcc-85bb-d1aa65186fde" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Sep 10 21:12:17.468193 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:17.468159    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d00f8e2d-r9njp"
Sep 10 21:12:17.551289 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:17.551255    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/57fb7843-79ff-4cf4-a3d0-355d5f583f39-maas-api-service-ca\") pod \"57fb7843-79ff-4cf4-a3d0-355d5f583f39\" (UID: \"57fb7843-79ff-4cf4-a3d0-355d5f583f39\") "
Sep 10 21:12:17.551686 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:17.551666    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57fb7843-79ff-4cf4-a3d0-355d5f583f39-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "57fb7843-79ff-4cf4-a3d0-355d5f583f39" (UID: "57fb7843-79ff-4cf4-a3d0-355d5f583f39"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:12:17.652784 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:17.652691    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/57fb7843-79ff-4cf4-a3d0-355d5f583f39-maas-api-service-ca\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:12:17.697120 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:17.697072    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-conflict-b-43415b1a-kserve-746b6f6cf4-29d8s"]
Sep 10 21:12:17.697492 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:17.697476    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57fb7843-79ff-4cf4-a3d0-355d5f583f39" containerName="revoke-keys"
Sep 10 21:12:17.697492 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:17.697492    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="57fb7843-79ff-4cf4-a3d0-355d5f583f39" containerName="revoke-keys"
Sep 10 21:12:17.697649 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:17.697552    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="57fb7843-79ff-4cf4-a3d0-355d5f583f39" containerName="revoke-keys"
Sep 10 21:12:17.700331 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:17.700310    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-43415b1a-kserve-746b6f6cf4-29d8s"
Sep 10 21:12:17.702707 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:17.702678    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-conflict-b-43415b1a-kserve-self-signed-certs\""
Sep 10 21:12:17.711314 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:17.711288    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-b-43415b1a-kserve-746b6f6cf4-29d8s"]
Sep 10 21:12:17.754091 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:17.754043    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f96f5a82-4c7f-41da-81f8-cc0839891c98-tls-certs\") pod \"e2e-conflict-b-43415b1a-kserve-746b6f6cf4-29d8s\" (UID: \"f96f5a82-4c7f-41da-81f8-cc0839891c98\") " pod="llm/e2e-conflict-b-43415b1a-kserve-746b6f6cf4-29d8s"
Sep 10 21:12:17.754312 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:17.754103    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f96f5a82-4c7f-41da-81f8-cc0839891c98-model-cache\") pod \"e2e-conflict-b-43415b1a-kserve-746b6f6cf4-29d8s\" (UID: \"f96f5a82-4c7f-41da-81f8-cc0839891c98\") " pod="llm/e2e-conflict-b-43415b1a-kserve-746b6f6cf4-29d8s"
Sep 10 21:12:17.754312 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:17.754202    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f96f5a82-4c7f-41da-81f8-cc0839891c98-dshm\") pod \"e2e-conflict-b-43415b1a-kserve-746b6f6cf4-29d8s\" (UID: \"f96f5a82-4c7f-41da-81f8-cc0839891c98\") " pod="llm/e2e-conflict-b-43415b1a-kserve-746b6f6cf4-29d8s"
Sep 10 21:12:17.754312 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:17.754280    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdc5g\" (UniqueName: \"kubernetes.io/projected/f96f5a82-4c7f-41da-81f8-cc0839891c98-kube-api-access-kdc5g\") pod \"e2e-conflict-b-43415b1a-kserve-746b6f6cf4-29d8s\" (UID: \"f96f5a82-4c7f-41da-81f8-cc0839891c98\") " pod="llm/e2e-conflict-b-43415b1a-kserve-746b6f6cf4-29d8s"
Sep 10 21:12:17.754462 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:17.754314    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f96f5a82-4c7f-41da-81f8-cc0839891c98-home\") pod \"e2e-conflict-b-43415b1a-kserve-746b6f6cf4-29d8s\" (UID: \"f96f5a82-4c7f-41da-81f8-cc0839891c98\") " pod="llm/e2e-conflict-b-43415b1a-kserve-746b6f6cf4-29d8s"
Sep 10 21:12:17.754462 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:17.754338    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f96f5a82-4c7f-41da-81f8-cc0839891c98-tmp-dir\") pod \"e2e-conflict-b-43415b1a-kserve-746b6f6cf4-29d8s\" (UID: \"f96f5a82-4c7f-41da-81f8-cc0839891c98\") " pod="llm/e2e-conflict-b-43415b1a-kserve-746b6f6cf4-29d8s"
Sep 10 21:12:17.855275 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:17.855205    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f96f5a82-4c7f-41da-81f8-cc0839891c98-dshm\") pod \"e2e-conflict-b-43415b1a-kserve-746b6f6cf4-29d8s\" (UID: \"f96f5a82-4c7f-41da-81f8-cc0839891c98\") " pod="llm/e2e-conflict-b-43415b1a-kserve-746b6f6cf4-29d8s"
Sep 10 21:12:17.855474 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:17.855289    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdc5g\" (UniqueName: \"kubernetes.io/projected/f96f5a82-4c7f-41da-81f8-cc0839891c98-kube-api-access-kdc5g\") pod \"e2e-conflict-b-43415b1a-kserve-746b6f6cf4-29d8s\" (UID: \"f96f5a82-4c7f-41da-81f8-cc0839891c98\") " pod="llm/e2e-conflict-b-43415b1a-kserve-746b6f6cf4-29d8s"
Sep 10 21:12:17.855474 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:17.855320    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f96f5a82-4c7f-41da-81f8-cc0839891c98-home\") pod \"e2e-conflict-b-43415b1a-kserve-746b6f6cf4-29d8s\" (UID: \"f96f5a82-4c7f-41da-81f8-cc0839891c98\") " pod="llm/e2e-conflict-b-43415b1a-kserve-746b6f6cf4-29d8s"
Sep 10 21:12:17.855474 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:17.855335    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f96f5a82-4c7f-41da-81f8-cc0839891c98-tmp-dir\") pod \"e2e-conflict-b-43415b1a-kserve-746b6f6cf4-29d8s\" (UID: \"f96f5a82-4c7f-41da-81f8-cc0839891c98\") " pod="llm/e2e-conflict-b-43415b1a-kserve-746b6f6cf4-29d8s"
Sep 10 21:12:17.855474 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:17.855400    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f96f5a82-4c7f-41da-81f8-cc0839891c98-tls-certs\") pod \"e2e-conflict-b-43415b1a-kserve-746b6f6cf4-29d8s\" (UID: \"f96f5a82-4c7f-41da-81f8-cc0839891c98\") " pod="llm/e2e-conflict-b-43415b1a-kserve-746b6f6cf4-29d8s"
Sep 10 21:12:17.855474 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:17.855441    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f96f5a82-4c7f-41da-81f8-cc0839891c98-model-cache\") pod \"e2e-conflict-b-43415b1a-kserve-746b6f6cf4-29d8s\" (UID: \"f96f5a82-4c7f-41da-81f8-cc0839891c98\") " pod="llm/e2e-conflict-b-43415b1a-kserve-746b6f6cf4-29d8s"
Sep 10 21:12:17.855796 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:17.855773    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f96f5a82-4c7f-41da-81f8-cc0839891c98-home\") pod \"e2e-conflict-b-43415b1a-kserve-746b6f6cf4-29d8s\" (UID: \"f96f5a82-4c7f-41da-81f8-cc0839891c98\") " pod="llm/e2e-conflict-b-43415b1a-kserve-746b6f6cf4-29d8s"
Sep 10 21:12:17.855843 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:17.855787    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f96f5a82-4c7f-41da-81f8-cc0839891c98-tmp-dir\") pod \"e2e-conflict-b-43415b1a-kserve-746b6f6cf4-29d8s\" (UID: \"f96f5a82-4c7f-41da-81f8-cc0839891c98\") " pod="llm/e2e-conflict-b-43415b1a-kserve-746b6f6cf4-29d8s"
Sep 10 21:12:17.855886 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:17.855871    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f96f5a82-4c7f-41da-81f8-cc0839891c98-model-cache\") pod \"e2e-conflict-b-43415b1a-kserve-746b6f6cf4-29d8s\" (UID: \"f96f5a82-4c7f-41da-81f8-cc0839891c98\") " pod="llm/e2e-conflict-b-43415b1a-kserve-746b6f6cf4-29d8s"
Sep 10 21:12:17.857605 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:17.857584    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f96f5a82-4c7f-41da-81f8-cc0839891c98-dshm\") pod \"e2e-conflict-b-43415b1a-kserve-746b6f6cf4-29d8s\" (UID: \"f96f5a82-4c7f-41da-81f8-cc0839891c98\") " pod="llm/e2e-conflict-b-43415b1a-kserve-746b6f6cf4-29d8s"
Sep 10 21:12:17.857847 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:17.857832    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f96f5a82-4c7f-41da-81f8-cc0839891c98-tls-certs\") pod \"e2e-conflict-b-43415b1a-kserve-746b6f6cf4-29d8s\" (UID: \"f96f5a82-4c7f-41da-81f8-cc0839891c98\") " pod="llm/e2e-conflict-b-43415b1a-kserve-746b6f6cf4-29d8s"
Sep 10 21:12:17.863988 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:17.863966    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdc5g\" (UniqueName: \"kubernetes.io/projected/f96f5a82-4c7f-41da-81f8-cc0839891c98-kube-api-access-kdc5g\") pod \"e2e-conflict-b-43415b1a-kserve-746b6f6cf4-29d8s\" (UID: \"f96f5a82-4c7f-41da-81f8-cc0839891c98\") " pod="llm/e2e-conflict-b-43415b1a-kserve-746b6f6cf4-29d8s"
Sep 10 21:12:17.907864 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:17.907784    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms"
Sep 10 21:12:17.908102 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:17.908080    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms"
Sep 10 21:12:17.908829 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:17.908807    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms"
Sep 10 21:12:18.010442 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:18.010396    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-43415b1a-kserve-746b6f6cf4-29d8s"
Sep 10 21:12:18.288717 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:18.288689    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-b-43415b1a-kserve-746b6f6cf4-29d8s"]
Sep 10 21:12:18.290211 ip-10-0-129-100 kubenswrapper[2564]: W0910 21:12:18.290184    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf96f5a82_4c7f_41da_81f8_cc0839891c98.slice/crio-78e7a7cd50176f24e0975f5db17ab33f06aca88100d0d3dfb37ff7eafbdab4e2 WatchSource:0}: Error finding container 78e7a7cd50176f24e0975f5db17ab33f06aca88100d0d3dfb37ff7eafbdab4e2: Status 404 returned error can't find the container with id 78e7a7cd50176f24e0975f5db17ab33f06aca88100d0d3dfb37ff7eafbdab4e2
Sep 10 21:12:18.327384 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:18.327343    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-43415b1a-kserve-746b6f6cf4-29d8s" event={"ID":"f96f5a82-4c7f-41da-81f8-cc0839891c98","Type":"ContainerStarted","Data":"78e7a7cd50176f24e0975f5db17ab33f06aca88100d0d3dfb37ff7eafbdab4e2"}
Sep 10 21:12:18.328883 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:18.328859    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d00f8e2d-r9njp"
Sep 10 21:12:18.329010 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:18.328888    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d00f8e2d-r9njp" event={"ID":"57fb7843-79ff-4cf4-a3d0-355d5f583f39","Type":"ContainerDied","Data":"8944bae9a252b66dfde1b219d65f2fc150894cb9f14a9d54eacd2ee049f7b7c0"}
Sep 10 21:12:18.329010 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:18.328932    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8944bae9a252b66dfde1b219d65f2fc150894cb9f14a9d54eacd2ee049f7b7c0"
Sep 10 21:12:19.336552 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:19.336510    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-43415b1a-kserve-746b6f6cf4-29d8s" event={"ID":"f96f5a82-4c7f-41da-81f8-cc0839891c98","Type":"ContainerStarted","Data":"bce98e306b5b45babe71a1833e01c8b1b2e5582939cf35a871c3fbd081f0236e"}
Sep 10 21:12:19.359117 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:19.359062    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-conflict-b-43415b1a-kserve-746b6f6cf4-29d8s" podStartSLOduration=2.359044748 podStartE2EDuration="2.359044748s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:12:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:12:19.357819736 +0000 UTC m=+920.044887053" watchObservedRunningTime="2026-09-10 21:12:19.359044748 +0000 UTC m=+920.046112074"
Sep 10 21:12:21.276903 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:21.276802    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-d00f8e2d-58d44644b6-bjcj8"]
Sep 10 21:12:21.277700 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:21.277654    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d00f8e2d-58d44644b6-bjcj8" podUID="dca77250-1806-43ca-8030-37acfe9c8c02" containerName="payload-pre-processing" containerID="cri-o://5c7755a59a88c70bbf3eda9099a6a08a5e621809c295511528b4feaf9efade92" gracePeriod=30
Sep 10 21:12:21.461145 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:21.461109    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d00f8e2d-r9njp"]
Sep 10 21:12:21.463680 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:21.463649    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d00f8e2d-r9njp"]
Sep 10 21:12:21.534607 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:21.534547    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d00f8e2d-58d44644b6-bjcj8"
Sep 10 21:12:21.589151 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:21.589074    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j2qds\" (UniqueName: \"kubernetes.io/projected/dca77250-1806-43ca-8030-37acfe9c8c02-kube-api-access-j2qds\") pod \"dca77250-1806-43ca-8030-37acfe9c8c02\" (UID: \"dca77250-1806-43ca-8030-37acfe9c8c02\") "
Sep 10 21:12:21.589616 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:21.589582    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dca77250-1806-43ca-8030-37acfe9c8c02-plugins-config-volume\") pod \"dca77250-1806-43ca-8030-37acfe9c8c02\" (UID: \"dca77250-1806-43ca-8030-37acfe9c8c02\") "
Sep 10 21:12:21.589985 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:21.589943    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dca77250-1806-43ca-8030-37acfe9c8c02-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "dca77250-1806-43ca-8030-37acfe9c8c02" (UID: "dca77250-1806-43ca-8030-37acfe9c8c02"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:12:21.590380 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:21.590360    2564 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dca77250-1806-43ca-8030-37acfe9c8c02-plugins-config-volume\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:12:21.591729 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:21.591699    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dca77250-1806-43ca-8030-37acfe9c8c02-kube-api-access-j2qds" (OuterVolumeSpecName: "kube-api-access-j2qds") pod "dca77250-1806-43ca-8030-37acfe9c8c02" (UID: "dca77250-1806-43ca-8030-37acfe9c8c02"). InnerVolumeSpecName "kube-api-access-j2qds". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:12:21.591821 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:21.591742    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms"]
Sep 10 21:12:21.592084 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:21.591949    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms" podUID="0724254e-ebd5-4fcc-85bb-d1aa65186fde" containerName="istio-proxy" containerID="cri-o://ae60b2263a0ce89aa442da281667f7cb8ba0b6eaa1e01db19f2aa248aa1ffaca" gracePeriod=30
Sep 10 21:12:21.692089 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:21.692049    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j2qds\" (UniqueName: \"kubernetes.io/projected/dca77250-1806-43ca-8030-37acfe9c8c02-kube-api-access-j2qds\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:12:21.873574 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:21.873539    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57fb7843-79ff-4cf4-a3d0-355d5f583f39" path="/var/lib/kubelet/pods/57fb7843-79ff-4cf4-a3d0-355d5f583f39/volumes"
Sep 10 21:12:22.356661 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:22.356625    2564 generic.go:356] "Generic (PLEG): container finished" podID="dca77250-1806-43ca-8030-37acfe9c8c02" containerID="5c7755a59a88c70bbf3eda9099a6a08a5e621809c295511528b4feaf9efade92" exitCode=0
Sep 10 21:12:22.357132 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:22.356697    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d00f8e2d-58d44644b6-bjcj8" event={"ID":"dca77250-1806-43ca-8030-37acfe9c8c02","Type":"ContainerDied","Data":"5c7755a59a88c70bbf3eda9099a6a08a5e621809c295511528b4feaf9efade92"}
Sep 10 21:12:22.357132 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:22.356708    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d00f8e2d-58d44644b6-bjcj8"
Sep 10 21:12:22.357132 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:22.356792    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d00f8e2d-58d44644b6-bjcj8" event={"ID":"dca77250-1806-43ca-8030-37acfe9c8c02","Type":"ContainerDied","Data":"69c73f6f24db62b337f241322466e25ef9d8b395f395ef582b7f358f9cb8e993"}
Sep 10 21:12:22.357132 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:22.356817    2564 scope.go:117] "RemoveContainer" containerID="5c7755a59a88c70bbf3eda9099a6a08a5e621809c295511528b4feaf9efade92"
Sep 10 21:12:22.368442 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:22.368408    2564 scope.go:117] "RemoveContainer" containerID="5c7755a59a88c70bbf3eda9099a6a08a5e621809c295511528b4feaf9efade92"
Sep 10 21:12:22.368812 ip-10-0-129-100 kubenswrapper[2564]: E0910 21:12:22.368789    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c7755a59a88c70bbf3eda9099a6a08a5e621809c295511528b4feaf9efade92\": container with ID starting with 5c7755a59a88c70bbf3eda9099a6a08a5e621809c295511528b4feaf9efade92 not found: ID does not exist" containerID="5c7755a59a88c70bbf3eda9099a6a08a5e621809c295511528b4feaf9efade92"
Sep 10 21:12:22.368906 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:22.368821    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c7755a59a88c70bbf3eda9099a6a08a5e621809c295511528b4feaf9efade92"} err="failed to get container status \"5c7755a59a88c70bbf3eda9099a6a08a5e621809c295511528b4feaf9efade92\": rpc error: code = NotFound desc = could not find container \"5c7755a59a88c70bbf3eda9099a6a08a5e621809c295511528b4feaf9efade92\": container with ID starting with 5c7755a59a88c70bbf3eda9099a6a08a5e621809c295511528b4feaf9efade92 not found: ID does not exist"
Sep 10 21:12:22.377734 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:22.377695    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-d00f8e2d-58d44644b6-bjcj8"]
Sep 10 21:12:22.380764 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:22.380737    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-801c3274-openshift-default-fc5588768-lc5v9"]
Sep 10 21:12:22.381121 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:22.381109    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dca77250-1806-43ca-8030-37acfe9c8c02" containerName="payload-pre-processing"
Sep 10 21:12:22.381159 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:22.381123    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="dca77250-1806-43ca-8030-37acfe9c8c02" containerName="payload-pre-processing"
Sep 10 21:12:22.381194 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:22.381180    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="dca77250-1806-43ca-8030-37acfe9c8c02" containerName="payload-pre-processing"
Sep 10 21:12:22.385590 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:22.385566    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-801c3274-openshift-default-fc5588768-lc5v9"
Sep 10 21:12:22.386698 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:22.386670    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-d00f8e2d-58d44644b6-bjcj8"]
Sep 10 21:12:22.387986 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:22.387971    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-801c3274-openshift-default-dockercfg-4mhxs\""
Sep 10 21:12:22.396386 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:22.396363    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-801c3274-openshift-default-fc5588768-lc5v9"]
Sep 10 21:12:22.500593 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:22.500556    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/895e91f5-daab-4818-ab7a-fe1c2e996ecc-credential-socket\") pod \"e2e-ait-801c3274-openshift-default-fc5588768-lc5v9\" (UID: \"895e91f5-daab-4818-ab7a-fe1c2e996ecc\") " pod="openshift-ingress/e2e-ait-801c3274-openshift-default-fc5588768-lc5v9"
Sep 10 21:12:22.500593 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:22.500592    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkqc8\" (UniqueName: \"kubernetes.io/projected/895e91f5-daab-4818-ab7a-fe1c2e996ecc-kube-api-access-bkqc8\") pod \"e2e-ait-801c3274-openshift-default-fc5588768-lc5v9\" (UID: \"895e91f5-daab-4818-ab7a-fe1c2e996ecc\") " pod="openshift-ingress/e2e-ait-801c3274-openshift-default-fc5588768-lc5v9"
Sep 10 21:12:22.500813 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:22.500620    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/895e91f5-daab-4818-ab7a-fe1c2e996ecc-istio-envoy\") pod \"e2e-ait-801c3274-openshift-default-fc5588768-lc5v9\" (UID: \"895e91f5-daab-4818-ab7a-fe1c2e996ecc\") " pod="openshift-ingress/e2e-ait-801c3274-openshift-default-fc5588768-lc5v9"
Sep 10 21:12:22.500813 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:22.500697    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/895e91f5-daab-4818-ab7a-fe1c2e996ecc-workload-socket\") pod \"e2e-ait-801c3274-openshift-default-fc5588768-lc5v9\" (UID: \"895e91f5-daab-4818-ab7a-fe1c2e996ecc\") " pod="openshift-ingress/e2e-ait-801c3274-openshift-default-fc5588768-lc5v9"
Sep 10 21:12:22.500813 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:22.500723    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/895e91f5-daab-4818-ab7a-fe1c2e996ecc-istiod-ca-cert\") pod \"e2e-ait-801c3274-openshift-default-fc5588768-lc5v9\" (UID: \"895e91f5-daab-4818-ab7a-fe1c2e996ecc\") " pod="openshift-ingress/e2e-ait-801c3274-openshift-default-fc5588768-lc5v9"
Sep 10 21:12:22.500813 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:22.500749    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/895e91f5-daab-4818-ab7a-fe1c2e996ecc-istio-token\") pod \"e2e-ait-801c3274-openshift-default-fc5588768-lc5v9\" (UID: \"895e91f5-daab-4818-ab7a-fe1c2e996ecc\") " pod="openshift-ingress/e2e-ait-801c3274-openshift-default-fc5588768-lc5v9"
Sep 10 21:12:22.500947 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:22.500833    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/895e91f5-daab-4818-ab7a-fe1c2e996ecc-workload-certs\") pod \"e2e-ait-801c3274-openshift-default-fc5588768-lc5v9\" (UID: \"895e91f5-daab-4818-ab7a-fe1c2e996ecc\") " pod="openshift-ingress/e2e-ait-801c3274-openshift-default-fc5588768-lc5v9"
Sep 10 21:12:22.500947 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:22.500880    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/895e91f5-daab-4818-ab7a-fe1c2e996ecc-istio-podinfo\") pod \"e2e-ait-801c3274-openshift-default-fc5588768-lc5v9\" (UID: \"895e91f5-daab-4818-ab7a-fe1c2e996ecc\") " pod="openshift-ingress/e2e-ait-801c3274-openshift-default-fc5588768-lc5v9"
Sep 10 21:12:22.500947 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:22.500912    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/895e91f5-daab-4818-ab7a-fe1c2e996ecc-istio-data\") pod \"e2e-ait-801c3274-openshift-default-fc5588768-lc5v9\" (UID: \"895e91f5-daab-4818-ab7a-fe1c2e996ecc\") " pod="openshift-ingress/e2e-ait-801c3274-openshift-default-fc5588768-lc5v9"
Sep 10 21:12:22.602158 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:22.602120    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/895e91f5-daab-4818-ab7a-fe1c2e996ecc-workload-certs\") pod \"e2e-ait-801c3274-openshift-default-fc5588768-lc5v9\" (UID: \"895e91f5-daab-4818-ab7a-fe1c2e996ecc\") " pod="openshift-ingress/e2e-ait-801c3274-openshift-default-fc5588768-lc5v9"
Sep 10 21:12:22.602342 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:22.602171    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/895e91f5-daab-4818-ab7a-fe1c2e996ecc-istio-podinfo\") pod \"e2e-ait-801c3274-openshift-default-fc5588768-lc5v9\" (UID: \"895e91f5-daab-4818-ab7a-fe1c2e996ecc\") " pod="openshift-ingress/e2e-ait-801c3274-openshift-default-fc5588768-lc5v9"
Sep 10 21:12:22.602342 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:22.602201    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/895e91f5-daab-4818-ab7a-fe1c2e996ecc-istio-data\") pod \"e2e-ait-801c3274-openshift-default-fc5588768-lc5v9\" (UID: \"895e91f5-daab-4818-ab7a-fe1c2e996ecc\") " pod="openshift-ingress/e2e-ait-801c3274-openshift-default-fc5588768-lc5v9"
Sep 10 21:12:22.602342 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:22.602262    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/895e91f5-daab-4818-ab7a-fe1c2e996ecc-credential-socket\") pod \"e2e-ait-801c3274-openshift-default-fc5588768-lc5v9\" (UID: \"895e91f5-daab-4818-ab7a-fe1c2e996ecc\") " pod="openshift-ingress/e2e-ait-801c3274-openshift-default-fc5588768-lc5v9"
Sep 10 21:12:22.602342 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:22.602287    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkqc8\" (UniqueName: \"kubernetes.io/projected/895e91f5-daab-4818-ab7a-fe1c2e996ecc-kube-api-access-bkqc8\") pod \"e2e-ait-801c3274-openshift-default-fc5588768-lc5v9\" (UID: \"895e91f5-daab-4818-ab7a-fe1c2e996ecc\") " pod="openshift-ingress/e2e-ait-801c3274-openshift-default-fc5588768-lc5v9"
Sep 10 21:12:22.602566 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:22.602439    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/895e91f5-daab-4818-ab7a-fe1c2e996ecc-istio-envoy\") pod \"e2e-ait-801c3274-openshift-default-fc5588768-lc5v9\" (UID: \"895e91f5-daab-4818-ab7a-fe1c2e996ecc\") " pod="openshift-ingress/e2e-ait-801c3274-openshift-default-fc5588768-lc5v9"
Sep 10 21:12:22.602566 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:22.602516    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/895e91f5-daab-4818-ab7a-fe1c2e996ecc-workload-socket\") pod \"e2e-ait-801c3274-openshift-default-fc5588768-lc5v9\" (UID: \"895e91f5-daab-4818-ab7a-fe1c2e996ecc\") " pod="openshift-ingress/e2e-ait-801c3274-openshift-default-fc5588768-lc5v9"
Sep 10 21:12:22.602566 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:22.602543    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/895e91f5-daab-4818-ab7a-fe1c2e996ecc-istiod-ca-cert\") pod \"e2e-ait-801c3274-openshift-default-fc5588768-lc5v9\" (UID: \"895e91f5-daab-4818-ab7a-fe1c2e996ecc\") " pod="openshift-ingress/e2e-ait-801c3274-openshift-default-fc5588768-lc5v9"
Sep 10 21:12:22.602726 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:22.602585    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/895e91f5-daab-4818-ab7a-fe1c2e996ecc-istio-token\") pod \"e2e-ait-801c3274-openshift-default-fc5588768-lc5v9\" (UID: \"895e91f5-daab-4818-ab7a-fe1c2e996ecc\") " pod="openshift-ingress/e2e-ait-801c3274-openshift-default-fc5588768-lc5v9"
Sep 10 21:12:22.602726 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:22.602594    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/895e91f5-daab-4818-ab7a-fe1c2e996ecc-workload-certs\") pod \"e2e-ait-801c3274-openshift-default-fc5588768-lc5v9\" (UID: \"895e91f5-daab-4818-ab7a-fe1c2e996ecc\") " pod="openshift-ingress/e2e-ait-801c3274-openshift-default-fc5588768-lc5v9"
Sep 10 21:12:22.602726 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:22.602639    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/895e91f5-daab-4818-ab7a-fe1c2e996ecc-istio-data\") pod \"e2e-ait-801c3274-openshift-default-fc5588768-lc5v9\" (UID: \"895e91f5-daab-4818-ab7a-fe1c2e996ecc\") " pod="openshift-ingress/e2e-ait-801c3274-openshift-default-fc5588768-lc5v9"
Sep 10 21:12:22.602726 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:22.602692    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/895e91f5-daab-4818-ab7a-fe1c2e996ecc-credential-socket\") pod \"e2e-ait-801c3274-openshift-default-fc5588768-lc5v9\" (UID: \"895e91f5-daab-4818-ab7a-fe1c2e996ecc\") " pod="openshift-ingress/e2e-ait-801c3274-openshift-default-fc5588768-lc5v9"
Sep 10 21:12:22.602897 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:22.602875    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/895e91f5-daab-4818-ab7a-fe1c2e996ecc-workload-socket\") pod \"e2e-ait-801c3274-openshift-default-fc5588768-lc5v9\" (UID: \"895e91f5-daab-4818-ab7a-fe1c2e996ecc\") " pod="openshift-ingress/e2e-ait-801c3274-openshift-default-fc5588768-lc5v9"
Sep 10 21:12:22.603242 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:22.603211    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/895e91f5-daab-4818-ab7a-fe1c2e996ecc-istiod-ca-cert\") pod \"e2e-ait-801c3274-openshift-default-fc5588768-lc5v9\" (UID: \"895e91f5-daab-4818-ab7a-fe1c2e996ecc\") " pod="openshift-ingress/e2e-ait-801c3274-openshift-default-fc5588768-lc5v9"
Sep 10 21:12:22.604600 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:22.604577    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/895e91f5-daab-4818-ab7a-fe1c2e996ecc-istio-envoy\") pod \"e2e-ait-801c3274-openshift-default-fc5588768-lc5v9\" (UID: \"895e91f5-daab-4818-ab7a-fe1c2e996ecc\") " pod="openshift-ingress/e2e-ait-801c3274-openshift-default-fc5588768-lc5v9"
Sep 10 21:12:22.604771 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:22.604752    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/895e91f5-daab-4818-ab7a-fe1c2e996ecc-istio-podinfo\") pod \"e2e-ait-801c3274-openshift-default-fc5588768-lc5v9\" (UID: \"895e91f5-daab-4818-ab7a-fe1c2e996ecc\") " pod="openshift-ingress/e2e-ait-801c3274-openshift-default-fc5588768-lc5v9"
Sep 10 21:12:22.611186 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:22.611127    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkqc8\" (UniqueName: \"kubernetes.io/projected/895e91f5-daab-4818-ab7a-fe1c2e996ecc-kube-api-access-bkqc8\") pod \"e2e-ait-801c3274-openshift-default-fc5588768-lc5v9\" (UID: \"895e91f5-daab-4818-ab7a-fe1c2e996ecc\") " pod="openshift-ingress/e2e-ait-801c3274-openshift-default-fc5588768-lc5v9"
Sep 10 21:12:22.611364 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:22.611336    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/895e91f5-daab-4818-ab7a-fe1c2e996ecc-istio-token\") pod \"e2e-ait-801c3274-openshift-default-fc5588768-lc5v9\" (UID: \"895e91f5-daab-4818-ab7a-fe1c2e996ecc\") " pod="openshift-ingress/e2e-ait-801c3274-openshift-default-fc5588768-lc5v9"
Sep 10 21:12:22.696930 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:22.696890    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-801c3274-openshift-default-fc5588768-lc5v9"
Sep 10 21:12:22.994529 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:22.994497    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-801c3274-openshift-default-fc5588768-lc5v9"]
Sep 10 21:12:22.995650 ip-10-0-129-100 kubenswrapper[2564]: W0910 21:12:22.995623    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod895e91f5_daab_4818_ab7a_fe1c2e996ecc.slice/crio-094fe824b734a5e0041386ab1651d85a7043295d2a63fcc86c19b1acd576aec9 WatchSource:0}: Error finding container 094fe824b734a5e0041386ab1651d85a7043295d2a63fcc86c19b1acd576aec9: Status 404 returned error can't find the container with id 094fe824b734a5e0041386ab1651d85a7043295d2a63fcc86c19b1acd576aec9
Sep 10 21:12:22.997864 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:22.997832    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 10 21:12:22.997965 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:22.997896    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 10 21:12:22.997965 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:22.997923    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 10 21:12:23.367151 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:23.367112    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-801c3274-openshift-default-fc5588768-lc5v9" event={"ID":"895e91f5-daab-4818-ab7a-fe1c2e996ecc","Type":"ContainerStarted","Data":"9165545f91cfa1c4fc06a7846bc93142cbf041cd2ba367bc1c75238b6a586878"}
Sep 10 21:12:23.367679 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:23.367209    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-801c3274-openshift-default-fc5588768-lc5v9" event={"ID":"895e91f5-daab-4818-ab7a-fe1c2e996ecc","Type":"ContainerStarted","Data":"094fe824b734a5e0041386ab1651d85a7043295d2a63fcc86c19b1acd576aec9"}
Sep 10 21:12:23.394033 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:23.393976    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-801c3274-openshift-default-fc5588768-lc5v9" podStartSLOduration=1.393959417 podStartE2EDuration="1.393959417s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:12:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:12:23.391777629 +0000 UTC m=+924.078844921" watchObservedRunningTime="2026-09-10 21:12:23.393959417 +0000 UTC m=+924.081026696"
Sep 10 21:12:23.697561 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:23.697473    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-801c3274-openshift-default-fc5588768-lc5v9"
Sep 10 21:12:23.875489 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:23.875456    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dca77250-1806-43ca-8030-37acfe9c8c02" path="/var/lib/kubelet/pods/dca77250-1806-43ca-8030-37acfe9c8c02/volumes"
Sep 10 21:12:24.702406 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:24.702372    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-801c3274-openshift-default-fc5588768-lc5v9"
Sep 10 21:12:25.378634 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:25.378601    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-801c3274-openshift-default-fc5588768-lc5v9"
Sep 10 21:12:25.379520 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:25.379503    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-801c3274-openshift-default-fc5588768-lc5v9"
Sep 10 21:12:26.811264 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:26.811214    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-801c3274-7c5555cf5-ksrlq"]
Sep 10 21:12:26.814930 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:26.814907    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-801c3274-7c5555cf5-ksrlq"
Sep 10 21:12:26.817544 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:26.817519    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-801c3274\""
Sep 10 21:12:26.817668 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:26.817599    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-801c3274-dockercfg-6wk6x\""
Sep 10 21:12:26.826720 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:26.826697    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-801c3274-7c5555cf5-ksrlq"]
Sep 10 21:12:26.854759 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:26.854685    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms"
Sep 10 21:12:26.947511 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:26.947478    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0724254e-ebd5-4fcc-85bb-d1aa65186fde-istio-data\") pod \"0724254e-ebd5-4fcc-85bb-d1aa65186fde\" (UID: \"0724254e-ebd5-4fcc-85bb-d1aa65186fde\") "
Sep 10 21:12:26.947511 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:26.947514    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0724254e-ebd5-4fcc-85bb-d1aa65186fde-workload-socket\") pod \"0724254e-ebd5-4fcc-85bb-d1aa65186fde\" (UID: \"0724254e-ebd5-4fcc-85bb-d1aa65186fde\") "
Sep 10 21:12:26.947756 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:26.947561    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0724254e-ebd5-4fcc-85bb-d1aa65186fde-credential-socket\") pod \"0724254e-ebd5-4fcc-85bb-d1aa65186fde\" (UID: \"0724254e-ebd5-4fcc-85bb-d1aa65186fde\") "
Sep 10 21:12:26.947756 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:26.947614    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0724254e-ebd5-4fcc-85bb-d1aa65186fde-workload-certs\") pod \"0724254e-ebd5-4fcc-85bb-d1aa65186fde\" (UID: \"0724254e-ebd5-4fcc-85bb-d1aa65186fde\") "
Sep 10 21:12:26.947756 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:26.947656    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0724254e-ebd5-4fcc-85bb-d1aa65186fde-istio-token\") pod \"0724254e-ebd5-4fcc-85bb-d1aa65186fde\" (UID: \"0724254e-ebd5-4fcc-85bb-d1aa65186fde\") "
Sep 10 21:12:26.947756 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:26.947679    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0724254e-ebd5-4fcc-85bb-d1aa65186fde-istio-podinfo\") pod \"0724254e-ebd5-4fcc-85bb-d1aa65186fde\" (UID: \"0724254e-ebd5-4fcc-85bb-d1aa65186fde\") "
Sep 10 21:12:26.947756 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:26.947696    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0724254e-ebd5-4fcc-85bb-d1aa65186fde-istiod-ca-cert\") pod \"0724254e-ebd5-4fcc-85bb-d1aa65186fde\" (UID: \"0724254e-ebd5-4fcc-85bb-d1aa65186fde\") "
Sep 10 21:12:26.947756 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:26.947741    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0724254e-ebd5-4fcc-85bb-d1aa65186fde-istio-envoy\") pod \"0724254e-ebd5-4fcc-85bb-d1aa65186fde\" (UID: \"0724254e-ebd5-4fcc-85bb-d1aa65186fde\") "
Sep 10 21:12:26.948064 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:26.947750    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0724254e-ebd5-4fcc-85bb-d1aa65186fde-istio-data" (OuterVolumeSpecName: "istio-data") pod "0724254e-ebd5-4fcc-85bb-d1aa65186fde" (UID: "0724254e-ebd5-4fcc-85bb-d1aa65186fde"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:12:26.948064 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:26.947773    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cc2bt\" (UniqueName: \"kubernetes.io/projected/0724254e-ebd5-4fcc-85bb-d1aa65186fde-kube-api-access-cc2bt\") pod \"0724254e-ebd5-4fcc-85bb-d1aa65186fde\" (UID: \"0724254e-ebd5-4fcc-85bb-d1aa65186fde\") "
Sep 10 21:12:26.948064 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:26.947847    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0724254e-ebd5-4fcc-85bb-d1aa65186fde-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0724254e-ebd5-4fcc-85bb-d1aa65186fde" (UID: "0724254e-ebd5-4fcc-85bb-d1aa65186fde"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:12:26.948064 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:26.947904    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0724254e-ebd5-4fcc-85bb-d1aa65186fde-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0724254e-ebd5-4fcc-85bb-d1aa65186fde" (UID: "0724254e-ebd5-4fcc-85bb-d1aa65186fde"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:12:26.948064 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:26.948049    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0724254e-ebd5-4fcc-85bb-d1aa65186fde-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0724254e-ebd5-4fcc-85bb-d1aa65186fde" (UID: "0724254e-ebd5-4fcc-85bb-d1aa65186fde"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:12:26.948361 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:26.948078    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1222cc65-e3a3-46dd-a158-6a3dd7122bbc-plugins-config-volume\") pod \"payload-processing-e2e-ait-801c3274-7c5555cf5-ksrlq\" (UID: \"1222cc65-e3a3-46dd-a158-6a3dd7122bbc\") " pod="openshift-ingress/payload-processing-e2e-ait-801c3274-7c5555cf5-ksrlq"
Sep 10 21:12:26.948361 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:26.948111    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wr6kt\" (UniqueName: \"kubernetes.io/projected/1222cc65-e3a3-46dd-a158-6a3dd7122bbc-kube-api-access-wr6kt\") pod \"payload-processing-e2e-ait-801c3274-7c5555cf5-ksrlq\" (UID: \"1222cc65-e3a3-46dd-a158-6a3dd7122bbc\") " pod="openshift-ingress/payload-processing-e2e-ait-801c3274-7c5555cf5-ksrlq"
Sep 10 21:12:26.948361 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:26.948268    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0724254e-ebd5-4fcc-85bb-d1aa65186fde-istiod-ca-cert\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:12:26.948361 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:26.948275    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0724254e-ebd5-4fcc-85bb-d1aa65186fde-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0724254e-ebd5-4fcc-85bb-d1aa65186fde" (UID: "0724254e-ebd5-4fcc-85bb-d1aa65186fde"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:12:26.948361 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:26.948285    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0724254e-ebd5-4fcc-85bb-d1aa65186fde-istio-data\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:12:26.948361 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:26.948336    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0724254e-ebd5-4fcc-85bb-d1aa65186fde-workload-socket\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:12:26.948361 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:26.948351    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0724254e-ebd5-4fcc-85bb-d1aa65186fde-credential-socket\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:12:26.949990 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:26.949962    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0724254e-ebd5-4fcc-85bb-d1aa65186fde-kube-api-access-cc2bt" (OuterVolumeSpecName: "kube-api-access-cc2bt") pod "0724254e-ebd5-4fcc-85bb-d1aa65186fde" (UID: "0724254e-ebd5-4fcc-85bb-d1aa65186fde"). InnerVolumeSpecName "kube-api-access-cc2bt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:12:26.950109 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:26.950015    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0724254e-ebd5-4fcc-85bb-d1aa65186fde-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0724254e-ebd5-4fcc-85bb-d1aa65186fde" (UID: "0724254e-ebd5-4fcc-85bb-d1aa65186fde"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:12:26.950305 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:26.950281    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0724254e-ebd5-4fcc-85bb-d1aa65186fde-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0724254e-ebd5-4fcc-85bb-d1aa65186fde" (UID: "0724254e-ebd5-4fcc-85bb-d1aa65186fde"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 21:12:26.950396 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:26.950339    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0724254e-ebd5-4fcc-85bb-d1aa65186fde-istio-token" (OuterVolumeSpecName: "istio-token") pod "0724254e-ebd5-4fcc-85bb-d1aa65186fde" (UID: "0724254e-ebd5-4fcc-85bb-d1aa65186fde"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:12:27.049472 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:27.049435    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1222cc65-e3a3-46dd-a158-6a3dd7122bbc-plugins-config-volume\") pod \"payload-processing-e2e-ait-801c3274-7c5555cf5-ksrlq\" (UID: \"1222cc65-e3a3-46dd-a158-6a3dd7122bbc\") " pod="openshift-ingress/payload-processing-e2e-ait-801c3274-7c5555cf5-ksrlq"
Sep 10 21:12:27.049472 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:27.049471    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wr6kt\" (UniqueName: \"kubernetes.io/projected/1222cc65-e3a3-46dd-a158-6a3dd7122bbc-kube-api-access-wr6kt\") pod \"payload-processing-e2e-ait-801c3274-7c5555cf5-ksrlq\" (UID: \"1222cc65-e3a3-46dd-a158-6a3dd7122bbc\") " pod="openshift-ingress/payload-processing-e2e-ait-801c3274-7c5555cf5-ksrlq"
Sep 10 21:12:27.049687 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:27.049526    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0724254e-ebd5-4fcc-85bb-d1aa65186fde-istio-token\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:12:27.049687 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:27.049536    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0724254e-ebd5-4fcc-85bb-d1aa65186fde-istio-podinfo\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:12:27.049687 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:27.049545    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0724254e-ebd5-4fcc-85bb-d1aa65186fde-istio-envoy\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:12:27.049687 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:27.049554    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cc2bt\" (UniqueName: \"kubernetes.io/projected/0724254e-ebd5-4fcc-85bb-d1aa65186fde-kube-api-access-cc2bt\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:12:27.049687 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:27.049564    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0724254e-ebd5-4fcc-85bb-d1aa65186fde-workload-certs\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:12:27.050189 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:27.050167    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1222cc65-e3a3-46dd-a158-6a3dd7122bbc-plugins-config-volume\") pod \"payload-processing-e2e-ait-801c3274-7c5555cf5-ksrlq\" (UID: \"1222cc65-e3a3-46dd-a158-6a3dd7122bbc\") " pod="openshift-ingress/payload-processing-e2e-ait-801c3274-7c5555cf5-ksrlq"
Sep 10 21:12:27.058527 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:27.058503    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wr6kt\" (UniqueName: \"kubernetes.io/projected/1222cc65-e3a3-46dd-a158-6a3dd7122bbc-kube-api-access-wr6kt\") pod \"payload-processing-e2e-ait-801c3274-7c5555cf5-ksrlq\" (UID: \"1222cc65-e3a3-46dd-a158-6a3dd7122bbc\") " pod="openshift-ingress/payload-processing-e2e-ait-801c3274-7c5555cf5-ksrlq"
Sep 10 21:12:27.126503 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:27.126410    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-801c3274-7c5555cf5-ksrlq"
Sep 10 21:12:27.392036 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:27.391961    2564 generic.go:356] "Generic (PLEG): container finished" podID="0724254e-ebd5-4fcc-85bb-d1aa65186fde" containerID="ae60b2263a0ce89aa442da281667f7cb8ba0b6eaa1e01db19f2aa248aa1ffaca" exitCode=0
Sep 10 21:12:27.392036 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:27.392009    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms"
Sep 10 21:12:27.392205 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:27.392045    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms" event={"ID":"0724254e-ebd5-4fcc-85bb-d1aa65186fde","Type":"ContainerDied","Data":"ae60b2263a0ce89aa442da281667f7cb8ba0b6eaa1e01db19f2aa248aa1ffaca"}
Sep 10 21:12:27.392205 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:27.392096    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms" event={"ID":"0724254e-ebd5-4fcc-85bb-d1aa65186fde","Type":"ContainerDied","Data":"6ce0447e87ee32906699da7b536237215e7fe3527dbf4cc6665f02b609648b73"}
Sep 10 21:12:27.392205 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:27.392121    2564 scope.go:117] "RemoveContainer" containerID="ae60b2263a0ce89aa442da281667f7cb8ba0b6eaa1e01db19f2aa248aa1ffaca"
Sep 10 21:12:27.398972 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:27.398947    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-801c3274-7c5555cf5-ksrlq"]
Sep 10 21:12:27.402727 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:27.402710    2564 scope.go:117] "RemoveContainer" containerID="c5de3ef5f3e74b7509bed0b4198ede79a5695901d140aa6ee394297d5d31d0d8"
Sep 10 21:12:27.403969 ip-10-0-129-100 kubenswrapper[2564]: W0910 21:12:27.403943    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1222cc65_e3a3_46dd_a158_6a3dd7122bbc.slice/crio-c97770c6843774b986bd826d48be3b1360aede5292f49c627911a3815cf94043 WatchSource:0}: Error finding container c97770c6843774b986bd826d48be3b1360aede5292f49c627911a3815cf94043: Status 404 returned error can't find the container with id c97770c6843774b986bd826d48be3b1360aede5292f49c627911a3815cf94043
Sep 10 21:12:27.411732 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:27.411710    2564 scope.go:117] "RemoveContainer" containerID="ae60b2263a0ce89aa442da281667f7cb8ba0b6eaa1e01db19f2aa248aa1ffaca"
Sep 10 21:12:27.411985 ip-10-0-129-100 kubenswrapper[2564]: E0910 21:12:27.411964    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae60b2263a0ce89aa442da281667f7cb8ba0b6eaa1e01db19f2aa248aa1ffaca\": container with ID starting with ae60b2263a0ce89aa442da281667f7cb8ba0b6eaa1e01db19f2aa248aa1ffaca not found: ID does not exist" containerID="ae60b2263a0ce89aa442da281667f7cb8ba0b6eaa1e01db19f2aa248aa1ffaca"
Sep 10 21:12:27.412040 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:27.411994    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae60b2263a0ce89aa442da281667f7cb8ba0b6eaa1e01db19f2aa248aa1ffaca"} err="failed to get container status \"ae60b2263a0ce89aa442da281667f7cb8ba0b6eaa1e01db19f2aa248aa1ffaca\": rpc error: code = NotFound desc = could not find container \"ae60b2263a0ce89aa442da281667f7cb8ba0b6eaa1e01db19f2aa248aa1ffaca\": container with ID starting with ae60b2263a0ce89aa442da281667f7cb8ba0b6eaa1e01db19f2aa248aa1ffaca not found: ID does not exist"
Sep 10 21:12:27.412040 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:27.412009    2564 scope.go:117] "RemoveContainer" containerID="c5de3ef5f3e74b7509bed0b4198ede79a5695901d140aa6ee394297d5d31d0d8"
Sep 10 21:12:27.412363 ip-10-0-129-100 kubenswrapper[2564]: E0910 21:12:27.412313    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5de3ef5f3e74b7509bed0b4198ede79a5695901d140aa6ee394297d5d31d0d8\": container with ID starting with c5de3ef5f3e74b7509bed0b4198ede79a5695901d140aa6ee394297d5d31d0d8 not found: ID does not exist" containerID="c5de3ef5f3e74b7509bed0b4198ede79a5695901d140aa6ee394297d5d31d0d8"
Sep 10 21:12:27.412494 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:27.412374    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5de3ef5f3e74b7509bed0b4198ede79a5695901d140aa6ee394297d5d31d0d8"} err="failed to get container status \"c5de3ef5f3e74b7509bed0b4198ede79a5695901d140aa6ee394297d5d31d0d8\": rpc error: code = NotFound desc = could not find container \"c5de3ef5f3e74b7509bed0b4198ede79a5695901d140aa6ee394297d5d31d0d8\": container with ID starting with c5de3ef5f3e74b7509bed0b4198ede79a5695901d140aa6ee394297d5d31d0d8 not found: ID does not exist"
Sep 10 21:12:27.415366 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:27.415346    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms"]
Sep 10 21:12:27.425285 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:27.425264    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-d00f8e2d-gw-openshift-default-6b9cbc57c6-c9lms"]
Sep 10 21:12:27.874886 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:27.874852    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0724254e-ebd5-4fcc-85bb-d1aa65186fde" path="/var/lib/kubelet/pods/0724254e-ebd5-4fcc-85bb-d1aa65186fde/volumes"
Sep 10 21:12:28.010913 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:28.010878    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-conflict-b-43415b1a-kserve-746b6f6cf4-29d8s"
Sep 10 21:12:28.011081 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:28.010932    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-conflict-b-43415b1a-kserve-746b6f6cf4-29d8s"
Sep 10 21:12:28.023442 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:28.023415    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-conflict-b-43415b1a-kserve-746b6f6cf4-29d8s"
Sep 10 21:12:28.400780 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:28.400744    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-801c3274-7c5555cf5-ksrlq" event={"ID":"1222cc65-e3a3-46dd-a158-6a3dd7122bbc","Type":"ContainerStarted","Data":"6ee69bfe6593b81f7746b2597837f0c4da9bbe13521a0664825e8359f2a4ebba"}
Sep 10 21:12:28.400967 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:28.400802    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-801c3274-7c5555cf5-ksrlq" event={"ID":"1222cc65-e3a3-46dd-a158-6a3dd7122bbc","Type":"ContainerStarted","Data":"c97770c6843774b986bd826d48be3b1360aede5292f49c627911a3815cf94043"}
Sep 10 21:12:28.400967 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:28.400834    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-801c3274-7c5555cf5-ksrlq"
Sep 10 21:12:28.412449 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:28.412425    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-conflict-b-43415b1a-kserve-746b6f6cf4-29d8s"
Sep 10 21:12:28.431520 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:28.431472    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-801c3274-7c5555cf5-ksrlq" podStartSLOduration=2.431458244 podStartE2EDuration="2.431458244s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:12:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:12:28.429025754 +0000 UTC m=+929.116093034" watchObservedRunningTime="2026-09-10 21:12:28.431458244 +0000 UTC m=+929.118525584"
Sep 10 21:12:39.410007 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:39.409973    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-801c3274-7c5555cf5-ksrlq"
Sep 10 21:12:41.420439 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:41.420395    2564 patch_prober.go:28] interesting pod/e2e-ait-801c3274-openshift-default-fc5588768-lc5v9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 21:12:41.420849 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:41.420462    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-801c3274-openshift-default-fc5588768-lc5v9" podUID="895e91f5-daab-4818-ab7a-fe1c2e996ecc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 21:12:43.496679 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:43.496639    2564 generic.go:356] "Generic (PLEG): container finished" podID="895e91f5-daab-4818-ab7a-fe1c2e996ecc" containerID="9165545f91cfa1c4fc06a7846bc93142cbf041cd2ba367bc1c75238b6a586878" exitCode=0
Sep 10 21:12:43.497111 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:43.496688    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-801c3274-openshift-default-fc5588768-lc5v9" event={"ID":"895e91f5-daab-4818-ab7a-fe1c2e996ecc","Type":"ContainerDied","Data":"9165545f91cfa1c4fc06a7846bc93142cbf041cd2ba367bc1c75238b6a586878"}
Sep 10 21:12:43.497111 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:43.497069    2564 scope.go:117] "RemoveContainer" containerID="9165545f91cfa1c4fc06a7846bc93142cbf041cd2ba367bc1c75238b6a586878"
Sep 10 21:12:43.498220 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:43.498183    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 10 21:12:43.498344 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:43.498297    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 10 21:12:43.498409 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:43.498352    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 10 21:12:44.504730 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:44.504694    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-801c3274-openshift-default-fc5588768-lc5v9" event={"ID":"895e91f5-daab-4818-ab7a-fe1c2e996ecc","Type":"ContainerStarted","Data":"a191b00154ce87294b4d0fd56d98261afb7c13052a05ad791bc243e7955e9845"}
Sep 10 21:12:44.697221 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:44.697181    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-801c3274-openshift-default-fc5588768-lc5v9"
Sep 10 21:12:44.697496 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:44.697470    2564 patch_prober.go:28] interesting pod/e2e-ait-801c3274-openshift-default-fc5588768-lc5v9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Sep 10 21:12:44.697550 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:44.697522    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-801c3274-openshift-default-fc5588768-lc5v9" podUID="895e91f5-daab-4818-ab7a-fe1c2e996ecc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Sep 10 21:12:45.697319 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:45.697280    2564 patch_prober.go:28] interesting pod/e2e-ait-801c3274-openshift-default-fc5588768-lc5v9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Sep 10 21:12:45.697804 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:45.697346    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-801c3274-openshift-default-fc5588768-lc5v9" podUID="895e91f5-daab-4818-ab7a-fe1c2e996ecc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Sep 10 21:12:46.698382 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:46.698343    2564 patch_prober.go:28] interesting pod/e2e-ait-801c3274-openshift-default-fc5588768-lc5v9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Sep 10 21:12:46.698799 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:46.698423    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-801c3274-openshift-default-fc5588768-lc5v9" podUID="895e91f5-daab-4818-ab7a-fe1c2e996ecc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Sep 10 21:12:47.697672 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:47.697634    2564 patch_prober.go:28] interesting pod/e2e-ait-801c3274-openshift-default-fc5588768-lc5v9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Sep 10 21:12:47.697847 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:47.697695    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-801c3274-openshift-default-fc5588768-lc5v9" podUID="895e91f5-daab-4818-ab7a-fe1c2e996ecc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Sep 10 21:12:48.697558 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:48.697521    2564 patch_prober.go:28] interesting pod/e2e-ait-801c3274-openshift-default-fc5588768-lc5v9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Sep 10 21:12:48.697943 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:48.697579    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-801c3274-openshift-default-fc5588768-lc5v9" podUID="895e91f5-daab-4818-ab7a-fe1c2e996ecc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Sep 10 21:12:49.698184 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:49.698145    2564 patch_prober.go:28] interesting pod/e2e-ait-801c3274-openshift-default-fc5588768-lc5v9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Sep 10 21:12:49.698613 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:49.698204    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-801c3274-openshift-default-fc5588768-lc5v9" podUID="895e91f5-daab-4818-ab7a-fe1c2e996ecc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Sep 10 21:12:50.476829 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:50.476793    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-801c3274-nvd97"]
Sep 10 21:12:50.477172 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:50.477159    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0724254e-ebd5-4fcc-85bb-d1aa65186fde" containerName="istio-proxy"
Sep 10 21:12:50.477172 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:50.477172    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0724254e-ebd5-4fcc-85bb-d1aa65186fde" containerName="istio-proxy"
Sep 10 21:12:50.477283 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:50.477257    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="0724254e-ebd5-4fcc-85bb-d1aa65186fde" containerName="istio-proxy"
Sep 10 21:12:50.477283 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:50.477267    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="0724254e-ebd5-4fcc-85bb-d1aa65186fde" containerName="istio-proxy"
Sep 10 21:12:50.479457 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:50.479442    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-801c3274-nvd97"
Sep 10 21:12:50.482083 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:50.482060    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-m5c7x\""
Sep 10 21:12:50.482257 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:50.482240    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 21:12:50.490807 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:50.490785    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-801c3274-nvd97"]
Sep 10 21:12:50.579863 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:50.579831    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb92d4dc-3426-41d6-98d8-2454054c8da1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-801c3274-nvd97\" (UID: \"eb92d4dc-3426-41d6-98d8-2454054c8da1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-801c3274-nvd97"
Sep 10 21:12:50.680951 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:50.680916    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb92d4dc-3426-41d6-98d8-2454054c8da1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-801c3274-nvd97\" (UID: \"eb92d4dc-3426-41d6-98d8-2454054c8da1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-801c3274-nvd97"
Sep 10 21:12:50.681583 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:50.681562    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb92d4dc-3426-41d6-98d8-2454054c8da1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-801c3274-nvd97\" (UID: \"eb92d4dc-3426-41d6-98d8-2454054c8da1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-801c3274-nvd97"
Sep 10 21:12:50.701105 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:50.701081    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-801c3274-openshift-default-fc5588768-lc5v9"
Sep 10 21:12:50.701482 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:50.701465    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-801c3274-openshift-default-fc5588768-lc5v9"
Sep 10 21:12:50.702159 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:50.702140    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-801c3274-openshift-default-fc5588768-lc5v9"
Sep 10 21:12:50.791483 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:50.791403    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-801c3274-nvd97"
Sep 10 21:12:51.071812 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:51.071782    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-801c3274-nvd97"]
Sep 10 21:12:51.071943 ip-10-0-129-100 kubenswrapper[2564]: W0910 21:12:51.071864    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb92d4dc_3426_41d6_98d8_2454054c8da1.slice/crio-562b7ad1122b83902786ca653645406d370ad5740ca91ad19bf2bd39ad0a63ef WatchSource:0}: Error finding container 562b7ad1122b83902786ca653645406d370ad5740ca91ad19bf2bd39ad0a63ef: Status 404 returned error can't find the container with id 562b7ad1122b83902786ca653645406d370ad5740ca91ad19bf2bd39ad0a63ef
Sep 10 21:12:51.545282 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:51.545222    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-801c3274-nvd97" event={"ID":"eb92d4dc-3426-41d6-98d8-2454054c8da1","Type":"ContainerStarted","Data":"d8c8a2faf8a2d27879ffee7a2a85b611604106ac1e98f1339c60eacfd123f44e"}
Sep 10 21:12:51.545466 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:51.545305    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-801c3274-nvd97" event={"ID":"eb92d4dc-3426-41d6-98d8-2454054c8da1","Type":"ContainerStarted","Data":"562b7ad1122b83902786ca653645406d370ad5740ca91ad19bf2bd39ad0a63ef"}
Sep 10 21:12:51.565421 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:51.565370    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-801c3274-nvd97" podStartSLOduration=1.5653545439999998 podStartE2EDuration="1.565354544s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:12:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:12:51.563825457 +0000 UTC m=+952.250892735" watchObservedRunningTime="2026-09-10 21:12:51.565354544 +0000 UTC m=+952.252422108"
Sep 10 21:12:52.552037 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:52.551996    2564 generic.go:356] "Generic (PLEG): container finished" podID="eb92d4dc-3426-41d6-98d8-2454054c8da1" containerID="d8c8a2faf8a2d27879ffee7a2a85b611604106ac1e98f1339c60eacfd123f44e" exitCode=0
Sep 10 21:12:52.552463 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:52.552083    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-801c3274-nvd97" event={"ID":"eb92d4dc-3426-41d6-98d8-2454054c8da1","Type":"ContainerDied","Data":"d8c8a2faf8a2d27879ffee7a2a85b611604106ac1e98f1339c60eacfd123f44e"}
Sep 10 21:12:53.689376 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:53.689348    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-801c3274-nvd97"
Sep 10 21:12:53.704149 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:53.704131    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb92d4dc-3426-41d6-98d8-2454054c8da1-maas-api-service-ca\") pod \"eb92d4dc-3426-41d6-98d8-2454054c8da1\" (UID: \"eb92d4dc-3426-41d6-98d8-2454054c8da1\") "
Sep 10 21:12:53.704467 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:53.704443    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb92d4dc-3426-41d6-98d8-2454054c8da1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "eb92d4dc-3426-41d6-98d8-2454054c8da1" (UID: "eb92d4dc-3426-41d6-98d8-2454054c8da1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:12:53.805001 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:53.804974    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb92d4dc-3426-41d6-98d8-2454054c8da1-maas-api-service-ca\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:12:54.565512 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:54.565480    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-801c3274-nvd97"
Sep 10 21:12:54.565687 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:54.565520    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-801c3274-nvd97" event={"ID":"eb92d4dc-3426-41d6-98d8-2454054c8da1","Type":"ContainerDied","Data":"562b7ad1122b83902786ca653645406d370ad5740ca91ad19bf2bd39ad0a63ef"}
Sep 10 21:12:54.565687 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:54.565565    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="562b7ad1122b83902786ca653645406d370ad5740ca91ad19bf2bd39ad0a63ef"
Sep 10 21:12:56.557501 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:56.557462    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-801c3274-7c5555cf5-ksrlq"]
Sep 10 21:12:56.557956 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:56.557777    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-801c3274-7c5555cf5-ksrlq" podUID="1222cc65-e3a3-46dd-a158-6a3dd7122bbc" containerName="payload-processing" containerID="cri-o://6ee69bfe6593b81f7746b2597837f0c4da9bbe13521a0664825e8359f2a4ebba" gracePeriod=30
Sep 10 21:12:56.736276 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:56.736245    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-801c3274-nvd97"]
Sep 10 21:12:56.738552 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:56.738529    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-801c3274-nvd97"]
Sep 10 21:12:56.813551 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:56.813484    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-801c3274-7c5555cf5-ksrlq"
Sep 10 21:12:56.831511 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:56.831306    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1222cc65-e3a3-46dd-a158-6a3dd7122bbc-plugins-config-volume\") pod \"1222cc65-e3a3-46dd-a158-6a3dd7122bbc\" (UID: \"1222cc65-e3a3-46dd-a158-6a3dd7122bbc\") "
Sep 10 21:12:56.831511 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:56.831345    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wr6kt\" (UniqueName: \"kubernetes.io/projected/1222cc65-e3a3-46dd-a158-6a3dd7122bbc-kube-api-access-wr6kt\") pod \"1222cc65-e3a3-46dd-a158-6a3dd7122bbc\" (UID: \"1222cc65-e3a3-46dd-a158-6a3dd7122bbc\") "
Sep 10 21:12:56.831899 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:56.831846    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1222cc65-e3a3-46dd-a158-6a3dd7122bbc-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1222cc65-e3a3-46dd-a158-6a3dd7122bbc" (UID: "1222cc65-e3a3-46dd-a158-6a3dd7122bbc"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:12:56.834392 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:56.834363    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1222cc65-e3a3-46dd-a158-6a3dd7122bbc-kube-api-access-wr6kt" (OuterVolumeSpecName: "kube-api-access-wr6kt") pod "1222cc65-e3a3-46dd-a158-6a3dd7122bbc" (UID: "1222cc65-e3a3-46dd-a158-6a3dd7122bbc"). InnerVolumeSpecName "kube-api-access-wr6kt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:12:56.916397 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:56.916362    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-c2de43-8gvg6"]
Sep 10 21:12:56.916910 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:56.916885    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb92d4dc-3426-41d6-98d8-2454054c8da1" containerName="revoke-keys"
Sep 10 21:12:56.917064 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:56.917047    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb92d4dc-3426-41d6-98d8-2454054c8da1" containerName="revoke-keys"
Sep 10 21:12:56.917159 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:56.917082    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0724254e-ebd5-4fcc-85bb-d1aa65186fde" containerName="istio-proxy"
Sep 10 21:12:56.917159 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:56.917091    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0724254e-ebd5-4fcc-85bb-d1aa65186fde" containerName="istio-proxy"
Sep 10 21:12:56.917159 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:56.917100    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1222cc65-e3a3-46dd-a158-6a3dd7122bbc" containerName="payload-processing"
Sep 10 21:12:56.917159 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:56.917109    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="1222cc65-e3a3-46dd-a158-6a3dd7122bbc" containerName="payload-processing"
Sep 10 21:12:56.917529 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:56.917293    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="1222cc65-e3a3-46dd-a158-6a3dd7122bbc" containerName="payload-processing"
Sep 10 21:12:56.917529 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:56.917312    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb92d4dc-3426-41d6-98d8-2454054c8da1" containerName="revoke-keys"
Sep 10 21:12:56.919761 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:56.919742    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-c2de43-8gvg6"
Sep 10 21:12:56.922379 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:56.922358    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 21:12:56.922487 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:56.922380    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-m5c7x\""
Sep 10 21:12:56.929197 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:56.928961    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-c2de43-8gvg6"]
Sep 10 21:12:56.932408 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:56.932379    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ecd9b563-0b13-4915-bd96-728ff464fd23-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-c2de43-8gvg6\" (UID: \"ecd9b563-0b13-4915-bd96-728ff464fd23\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-c2de43-8gvg6"
Sep 10 21:12:56.932568 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:56.932544    2564 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1222cc65-e3a3-46dd-a158-6a3dd7122bbc-plugins-config-volume\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:12:56.932641 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:56.932573    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wr6kt\" (UniqueName: \"kubernetes.io/projected/1222cc65-e3a3-46dd-a158-6a3dd7122bbc-kube-api-access-wr6kt\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:12:57.033341 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:57.033306    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ecd9b563-0b13-4915-bd96-728ff464fd23-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-c2de43-8gvg6\" (UID: \"ecd9b563-0b13-4915-bd96-728ff464fd23\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-c2de43-8gvg6"
Sep 10 21:12:57.033976 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:57.033955    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ecd9b563-0b13-4915-bd96-728ff464fd23-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-c2de43-8gvg6\" (UID: \"ecd9b563-0b13-4915-bd96-728ff464fd23\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-c2de43-8gvg6"
Sep 10 21:12:57.233808 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:57.233725    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-c2de43-8gvg6"
Sep 10 21:12:57.504633 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:57.504457    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-c2de43-8gvg6"]
Sep 10 21:12:57.506680 ip-10-0-129-100 kubenswrapper[2564]: W0910 21:12:57.506651    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecd9b563_0b13_4915_bd96_728ff464fd23.slice/crio-ebf123855bbfb36fbce149097f428044aef8f1574fc9d6e83e1eb8ba5ed44aac WatchSource:0}: Error finding container ebf123855bbfb36fbce149097f428044aef8f1574fc9d6e83e1eb8ba5ed44aac: Status 404 returned error can't find the container with id ebf123855bbfb36fbce149097f428044aef8f1574fc9d6e83e1eb8ba5ed44aac
Sep 10 21:12:57.588827 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:57.588801    2564 generic.go:356] "Generic (PLEG): container finished" podID="1222cc65-e3a3-46dd-a158-6a3dd7122bbc" containerID="6ee69bfe6593b81f7746b2597837f0c4da9bbe13521a0664825e8359f2a4ebba" exitCode=0
Sep 10 21:12:57.589189 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:57.588863    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-801c3274-7c5555cf5-ksrlq"
Sep 10 21:12:57.589189 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:57.588893    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-801c3274-7c5555cf5-ksrlq" event={"ID":"1222cc65-e3a3-46dd-a158-6a3dd7122bbc","Type":"ContainerDied","Data":"6ee69bfe6593b81f7746b2597837f0c4da9bbe13521a0664825e8359f2a4ebba"}
Sep 10 21:12:57.589189 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:57.588942    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-801c3274-7c5555cf5-ksrlq" event={"ID":"1222cc65-e3a3-46dd-a158-6a3dd7122bbc","Type":"ContainerDied","Data":"c97770c6843774b986bd826d48be3b1360aede5292f49c627911a3815cf94043"}
Sep 10 21:12:57.589189 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:57.588964    2564 scope.go:117] "RemoveContainer" containerID="6ee69bfe6593b81f7746b2597837f0c4da9bbe13521a0664825e8359f2a4ebba"
Sep 10 21:12:57.590363 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:57.590317    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-c2de43-8gvg6" event={"ID":"ecd9b563-0b13-4915-bd96-728ff464fd23","Type":"ContainerStarted","Data":"ebf123855bbfb36fbce149097f428044aef8f1574fc9d6e83e1eb8ba5ed44aac"}
Sep 10 21:12:57.597978 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:57.597963    2564 scope.go:117] "RemoveContainer" containerID="6ee69bfe6593b81f7746b2597837f0c4da9bbe13521a0664825e8359f2a4ebba"
Sep 10 21:12:57.598260 ip-10-0-129-100 kubenswrapper[2564]: E0910 21:12:57.598224    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ee69bfe6593b81f7746b2597837f0c4da9bbe13521a0664825e8359f2a4ebba\": container with ID starting with 6ee69bfe6593b81f7746b2597837f0c4da9bbe13521a0664825e8359f2a4ebba not found: ID does not exist" containerID="6ee69bfe6593b81f7746b2597837f0c4da9bbe13521a0664825e8359f2a4ebba"
Sep 10 21:12:57.598346 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:57.598266    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ee69bfe6593b81f7746b2597837f0c4da9bbe13521a0664825e8359f2a4ebba"} err="failed to get container status \"6ee69bfe6593b81f7746b2597837f0c4da9bbe13521a0664825e8359f2a4ebba\": rpc error: code = NotFound desc = could not find container \"6ee69bfe6593b81f7746b2597837f0c4da9bbe13521a0664825e8359f2a4ebba\": container with ID starting with 6ee69bfe6593b81f7746b2597837f0c4da9bbe13521a0664825e8359f2a4ebba not found: ID does not exist"
Sep 10 21:12:57.610889 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:57.610863    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-801c3274-7c5555cf5-ksrlq"]
Sep 10 21:12:57.618117 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:57.618097    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-801c3274-7c5555cf5-ksrlq"]
Sep 10 21:12:57.873731 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:57.873693    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1222cc65-e3a3-46dd-a158-6a3dd7122bbc" path="/var/lib/kubelet/pods/1222cc65-e3a3-46dd-a158-6a3dd7122bbc/volumes"
Sep 10 21:12:57.874076 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:57.874062    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb92d4dc-3426-41d6-98d8-2454054c8da1" path="/var/lib/kubelet/pods/eb92d4dc-3426-41d6-98d8-2454054c8da1/volumes"
Sep 10 21:12:57.911012 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:57.910982    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-801c3274-openshift-default-fc5588768-lc5v9"]
Sep 10 21:12:57.911203 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:57.911179    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-801c3274-openshift-default-fc5588768-lc5v9" podUID="895e91f5-daab-4818-ab7a-fe1c2e996ecc" containerName="istio-proxy" containerID="cri-o://a191b00154ce87294b4d0fd56d98261afb7c13052a05ad791bc243e7955e9845" gracePeriod=30
Sep 10 21:12:58.599309 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:58.599274    2564 generic.go:356] "Generic (PLEG): container finished" podID="ecd9b563-0b13-4915-bd96-728ff464fd23" containerID="2da6037d5d2a1631908aebc999860906ea873811bc84dfd43963017ddf6090c8" exitCode=0
Sep 10 21:12:58.599688 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:58.599368    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-c2de43-8gvg6" event={"ID":"ecd9b563-0b13-4915-bd96-728ff464fd23","Type":"ContainerDied","Data":"2da6037d5d2a1631908aebc999860906ea873811bc84dfd43963017ddf6090c8"}
Sep 10 21:12:58.617381 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:58.617357    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm"]
Sep 10 21:12:58.619720 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:58.619704    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm"
Sep 10 21:12:58.623581 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:58.623554    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-cbc740e6-openshift-default-dockercfg-dz5qs\""
Sep 10 21:12:58.632448 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:58.632426    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm"]
Sep 10 21:12:58.645780 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:58.645745    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jn4rx\" (UniqueName: \"kubernetes.io/projected/8261056a-56e1-408e-ac01-c378ad7387ff-kube-api-access-jn4rx\") pod \"e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm\" (UID: \"8261056a-56e1-408e-ac01-c378ad7387ff\") " pod="openshift-ingress/e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm"
Sep 10 21:12:58.645895 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:58.645787    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8261056a-56e1-408e-ac01-c378ad7387ff-workload-socket\") pod \"e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm\" (UID: \"8261056a-56e1-408e-ac01-c378ad7387ff\") " pod="openshift-ingress/e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm"
Sep 10 21:12:58.645895 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:58.645817    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8261056a-56e1-408e-ac01-c378ad7387ff-istio-data\") pod \"e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm\" (UID: \"8261056a-56e1-408e-ac01-c378ad7387ff\") " pod="openshift-ingress/e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm"
Sep 10 21:12:58.645895 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:58.645851    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8261056a-56e1-408e-ac01-c378ad7387ff-istio-token\") pod \"e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm\" (UID: \"8261056a-56e1-408e-ac01-c378ad7387ff\") " pod="openshift-ingress/e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm"
Sep 10 21:12:58.645895 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:58.645880    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8261056a-56e1-408e-ac01-c378ad7387ff-workload-certs\") pod \"e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm\" (UID: \"8261056a-56e1-408e-ac01-c378ad7387ff\") " pod="openshift-ingress/e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm"
Sep 10 21:12:58.646089 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:58.645903    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8261056a-56e1-408e-ac01-c378ad7387ff-istio-podinfo\") pod \"e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm\" (UID: \"8261056a-56e1-408e-ac01-c378ad7387ff\") " pod="openshift-ingress/e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm"
Sep 10 21:12:58.646089 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:58.645944    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8261056a-56e1-408e-ac01-c378ad7387ff-istiod-ca-cert\") pod \"e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm\" (UID: \"8261056a-56e1-408e-ac01-c378ad7387ff\") " pod="openshift-ingress/e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm"
Sep 10 21:12:58.646184 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:58.646104    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8261056a-56e1-408e-ac01-c378ad7387ff-credential-socket\") pod \"e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm\" (UID: \"8261056a-56e1-408e-ac01-c378ad7387ff\") " pod="openshift-ingress/e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm"
Sep 10 21:12:58.646184 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:58.646138    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8261056a-56e1-408e-ac01-c378ad7387ff-istio-envoy\") pod \"e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm\" (UID: \"8261056a-56e1-408e-ac01-c378ad7387ff\") " pod="openshift-ingress/e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm"
Sep 10 21:12:58.747505 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:58.747474    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8261056a-56e1-408e-ac01-c378ad7387ff-credential-socket\") pod \"e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm\" (UID: \"8261056a-56e1-408e-ac01-c378ad7387ff\") " pod="openshift-ingress/e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm"
Sep 10 21:12:58.747505 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:58.747507    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8261056a-56e1-408e-ac01-c378ad7387ff-istio-envoy\") pod \"e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm\" (UID: \"8261056a-56e1-408e-ac01-c378ad7387ff\") " pod="openshift-ingress/e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm"
Sep 10 21:12:58.747760 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:58.747532    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jn4rx\" (UniqueName: \"kubernetes.io/projected/8261056a-56e1-408e-ac01-c378ad7387ff-kube-api-access-jn4rx\") pod \"e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm\" (UID: \"8261056a-56e1-408e-ac01-c378ad7387ff\") " pod="openshift-ingress/e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm"
Sep 10 21:12:58.747760 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:58.747654    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8261056a-56e1-408e-ac01-c378ad7387ff-workload-socket\") pod \"e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm\" (UID: \"8261056a-56e1-408e-ac01-c378ad7387ff\") " pod="openshift-ingress/e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm"
Sep 10 21:12:58.747760 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:58.747686    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8261056a-56e1-408e-ac01-c378ad7387ff-istio-data\") pod \"e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm\" (UID: \"8261056a-56e1-408e-ac01-c378ad7387ff\") " pod="openshift-ingress/e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm"
Sep 10 21:12:58.747760 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:58.747713    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8261056a-56e1-408e-ac01-c378ad7387ff-istio-token\") pod \"e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm\" (UID: \"8261056a-56e1-408e-ac01-c378ad7387ff\") " pod="openshift-ingress/e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm"
Sep 10 21:12:58.747760 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:58.747747    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8261056a-56e1-408e-ac01-c378ad7387ff-workload-certs\") pod \"e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm\" (UID: \"8261056a-56e1-408e-ac01-c378ad7387ff\") " pod="openshift-ingress/e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm"
Sep 10 21:12:58.748024 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:58.747769    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8261056a-56e1-408e-ac01-c378ad7387ff-istio-podinfo\") pod \"e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm\" (UID: \"8261056a-56e1-408e-ac01-c378ad7387ff\") " pod="openshift-ingress/e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm"
Sep 10 21:12:58.748024 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:58.747821    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8261056a-56e1-408e-ac01-c378ad7387ff-istiod-ca-cert\") pod \"e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm\" (UID: \"8261056a-56e1-408e-ac01-c378ad7387ff\") " pod="openshift-ingress/e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm"
Sep 10 21:12:58.748024 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:58.747926    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8261056a-56e1-408e-ac01-c378ad7387ff-credential-socket\") pod \"e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm\" (UID: \"8261056a-56e1-408e-ac01-c378ad7387ff\") " pod="openshift-ingress/e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm"
Sep 10 21:12:58.748024 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:58.748009    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8261056a-56e1-408e-ac01-c378ad7387ff-istio-data\") pod \"e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm\" (UID: \"8261056a-56e1-408e-ac01-c378ad7387ff\") " pod="openshift-ingress/e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm"
Sep 10 21:12:58.748194 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:58.748071    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8261056a-56e1-408e-ac01-c378ad7387ff-workload-socket\") pod \"e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm\" (UID: \"8261056a-56e1-408e-ac01-c378ad7387ff\") " pod="openshift-ingress/e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm"
Sep 10 21:12:58.748554 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:58.748523    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8261056a-56e1-408e-ac01-c378ad7387ff-workload-certs\") pod \"e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm\" (UID: \"8261056a-56e1-408e-ac01-c378ad7387ff\") " pod="openshift-ingress/e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm"
Sep 10 21:12:58.749044 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:58.749018    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8261056a-56e1-408e-ac01-c378ad7387ff-istiod-ca-cert\") pod \"e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm\" (UID: \"8261056a-56e1-408e-ac01-c378ad7387ff\") " pod="openshift-ingress/e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm"
Sep 10 21:12:58.750085 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:58.750062    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8261056a-56e1-408e-ac01-c378ad7387ff-istio-envoy\") pod \"e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm\" (UID: \"8261056a-56e1-408e-ac01-c378ad7387ff\") " pod="openshift-ingress/e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm"
Sep 10 21:12:58.750363 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:58.750345    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8261056a-56e1-408e-ac01-c378ad7387ff-istio-podinfo\") pod \"e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm\" (UID: \"8261056a-56e1-408e-ac01-c378ad7387ff\") " pod="openshift-ingress/e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm"
Sep 10 21:12:58.759069 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:58.759049    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jn4rx\" (UniqueName: \"kubernetes.io/projected/8261056a-56e1-408e-ac01-c378ad7387ff-kube-api-access-jn4rx\") pod \"e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm\" (UID: \"8261056a-56e1-408e-ac01-c378ad7387ff\") " pod="openshift-ingress/e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm"
Sep 10 21:12:58.759163 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:58.759147    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8261056a-56e1-408e-ac01-c378ad7387ff-istio-token\") pod \"e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm\" (UID: \"8261056a-56e1-408e-ac01-c378ad7387ff\") " pod="openshift-ingress/e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm"
Sep 10 21:12:58.931653 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:58.931563    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm"
Sep 10 21:12:59.207163 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:59.207135    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm"]
Sep 10 21:12:59.209020 ip-10-0-129-100 kubenswrapper[2564]: W0910 21:12:59.208988    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8261056a_56e1_408e_ac01_c378ad7387ff.slice/crio-7d205ef870ae7107987c0615ce9a28176f5485846dcb2b0f98546e6e705b5dbb WatchSource:0}: Error finding container 7d205ef870ae7107987c0615ce9a28176f5485846dcb2b0f98546e6e705b5dbb: Status 404 returned error can't find the container with id 7d205ef870ae7107987c0615ce9a28176f5485846dcb2b0f98546e6e705b5dbb
Sep 10 21:12:59.213824 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:59.213787    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 10 21:12:59.213912 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:59.213872    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 10 21:12:59.213948 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:59.213917    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 10 21:12:59.607723 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:59.607682    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm" event={"ID":"8261056a-56e1-408e-ac01-c378ad7387ff","Type":"ContainerStarted","Data":"a696dbebe3fd18d0f445b96bee05252b55c261326e601e5cd7f54c26d4bb8d4d"}
Sep 10 21:12:59.608216 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:59.607736    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm" event={"ID":"8261056a-56e1-408e-ac01-c378ad7387ff","Type":"ContainerStarted","Data":"7d205ef870ae7107987c0615ce9a28176f5485846dcb2b0f98546e6e705b5dbb"}
Sep 10 21:12:59.629558 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:59.629499    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm" podStartSLOduration=1.629474675 podStartE2EDuration="1.629474675s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:12:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:12:59.628973988 +0000 UTC m=+960.316041307" watchObservedRunningTime="2026-09-10 21:12:59.629474675 +0000 UTC m=+960.316541959"
Sep 10 21:12:59.734934 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:59.734909    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-c2de43-8gvg6"
Sep 10 21:12:59.756357 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:59.756325    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ecd9b563-0b13-4915-bd96-728ff464fd23-maas-api-service-ca\") pod \"ecd9b563-0b13-4915-bd96-728ff464fd23\" (UID: \"ecd9b563-0b13-4915-bd96-728ff464fd23\") "
Sep 10 21:12:59.756986 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:59.756957    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ecd9b563-0b13-4915-bd96-728ff464fd23-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ecd9b563-0b13-4915-bd96-728ff464fd23" (UID: "ecd9b563-0b13-4915-bd96-728ff464fd23"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:12:59.857542 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:59.857513    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ecd9b563-0b13-4915-bd96-728ff464fd23-maas-api-service-ca\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:12:59.932162 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:12:59.932130    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm"
Sep 10 21:13:00.614475 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:00.614444    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-c2de43-8gvg6"
Sep 10 21:13:00.614866 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:00.614473    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-c2de43-8gvg6" event={"ID":"ecd9b563-0b13-4915-bd96-728ff464fd23","Type":"ContainerDied","Data":"ebf123855bbfb36fbce149097f428044aef8f1574fc9d6e83e1eb8ba5ed44aac"}
Sep 10 21:13:00.614866 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:00.614522    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ebf123855bbfb36fbce149097f428044aef8f1574fc9d6e83e1eb8ba5ed44aac"
Sep 10 21:13:00.937754 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:00.937681    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm"
Sep 10 21:13:01.620496 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:01.620455    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm"
Sep 10 21:13:01.621375 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:01.621355    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm"
Sep 10 21:13:03.180411 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:03.180335    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-801c3274-openshift-default-fc5588768-lc5v9"
Sep 10 21:13:03.294488 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:03.294448    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bkqc8\" (UniqueName: \"kubernetes.io/projected/895e91f5-daab-4818-ab7a-fe1c2e996ecc-kube-api-access-bkqc8\") pod \"895e91f5-daab-4818-ab7a-fe1c2e996ecc\" (UID: \"895e91f5-daab-4818-ab7a-fe1c2e996ecc\") "
Sep 10 21:13:03.294488 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:03.294496    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/895e91f5-daab-4818-ab7a-fe1c2e996ecc-istiod-ca-cert\") pod \"895e91f5-daab-4818-ab7a-fe1c2e996ecc\" (UID: \"895e91f5-daab-4818-ab7a-fe1c2e996ecc\") "
Sep 10 21:13:03.294714 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:03.294513    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/895e91f5-daab-4818-ab7a-fe1c2e996ecc-workload-certs\") pod \"895e91f5-daab-4818-ab7a-fe1c2e996ecc\" (UID: \"895e91f5-daab-4818-ab7a-fe1c2e996ecc\") "
Sep 10 21:13:03.294714 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:03.294552    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/895e91f5-daab-4818-ab7a-fe1c2e996ecc-istio-token\") pod \"895e91f5-daab-4818-ab7a-fe1c2e996ecc\" (UID: \"895e91f5-daab-4818-ab7a-fe1c2e996ecc\") "
Sep 10 21:13:03.294714 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:03.294579    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/895e91f5-daab-4818-ab7a-fe1c2e996ecc-istio-data\") pod \"895e91f5-daab-4818-ab7a-fe1c2e996ecc\" (UID: \"895e91f5-daab-4818-ab7a-fe1c2e996ecc\") "
Sep 10 21:13:03.294714 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:03.294598    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/895e91f5-daab-4818-ab7a-fe1c2e996ecc-workload-socket\") pod \"895e91f5-daab-4818-ab7a-fe1c2e996ecc\" (UID: \"895e91f5-daab-4818-ab7a-fe1c2e996ecc\") "
Sep 10 21:13:03.294714 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:03.294626    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/895e91f5-daab-4818-ab7a-fe1c2e996ecc-istio-podinfo\") pod \"895e91f5-daab-4818-ab7a-fe1c2e996ecc\" (UID: \"895e91f5-daab-4818-ab7a-fe1c2e996ecc\") "
Sep 10 21:13:03.295036 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:03.294740    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/895e91f5-daab-4818-ab7a-fe1c2e996ecc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "895e91f5-daab-4818-ab7a-fe1c2e996ecc" (UID: "895e91f5-daab-4818-ab7a-fe1c2e996ecc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:13:03.295036 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:03.294758    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/895e91f5-daab-4818-ab7a-fe1c2e996ecc-istio-envoy\") pod \"895e91f5-daab-4818-ab7a-fe1c2e996ecc\" (UID: \"895e91f5-daab-4818-ab7a-fe1c2e996ecc\") "
Sep 10 21:13:03.295036 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:03.294854    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/895e91f5-daab-4818-ab7a-fe1c2e996ecc-credential-socket\") pod \"895e91f5-daab-4818-ab7a-fe1c2e996ecc\" (UID: \"895e91f5-daab-4818-ab7a-fe1c2e996ecc\") "
Sep 10 21:13:03.295182 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:03.295162    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/895e91f5-daab-4818-ab7a-fe1c2e996ecc-workload-certs\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:13:03.295623 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:03.295441    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/895e91f5-daab-4818-ab7a-fe1c2e996ecc-istio-data" (OuterVolumeSpecName: "istio-data") pod "895e91f5-daab-4818-ab7a-fe1c2e996ecc" (UID: "895e91f5-daab-4818-ab7a-fe1c2e996ecc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:13:03.295623 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:03.295478    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/895e91f5-daab-4818-ab7a-fe1c2e996ecc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "895e91f5-daab-4818-ab7a-fe1c2e996ecc" (UID: "895e91f5-daab-4818-ab7a-fe1c2e996ecc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:13:03.295623 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:03.295513    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/895e91f5-daab-4818-ab7a-fe1c2e996ecc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "895e91f5-daab-4818-ab7a-fe1c2e996ecc" (UID: "895e91f5-daab-4818-ab7a-fe1c2e996ecc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:13:03.295623 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:03.295596    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/895e91f5-daab-4818-ab7a-fe1c2e996ecc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "895e91f5-daab-4818-ab7a-fe1c2e996ecc" (UID: "895e91f5-daab-4818-ab7a-fe1c2e996ecc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:13:03.297713 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:03.297685    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/895e91f5-daab-4818-ab7a-fe1c2e996ecc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "895e91f5-daab-4818-ab7a-fe1c2e996ecc" (UID: "895e91f5-daab-4818-ab7a-fe1c2e996ecc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:13:03.297797 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:03.297711    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/895e91f5-daab-4818-ab7a-fe1c2e996ecc-istio-token" (OuterVolumeSpecName: "istio-token") pod "895e91f5-daab-4818-ab7a-fe1c2e996ecc" (UID: "895e91f5-daab-4818-ab7a-fe1c2e996ecc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:13:03.297797 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:03.297750    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/895e91f5-daab-4818-ab7a-fe1c2e996ecc-kube-api-access-bkqc8" (OuterVolumeSpecName: "kube-api-access-bkqc8") pod "895e91f5-daab-4818-ab7a-fe1c2e996ecc" (UID: "895e91f5-daab-4818-ab7a-fe1c2e996ecc"). InnerVolumeSpecName "kube-api-access-bkqc8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:13:03.297912 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:03.297895    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/895e91f5-daab-4818-ab7a-fe1c2e996ecc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "895e91f5-daab-4818-ab7a-fe1c2e996ecc" (UID: "895e91f5-daab-4818-ab7a-fe1c2e996ecc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 21:13:03.395945 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:03.395909    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/895e91f5-daab-4818-ab7a-fe1c2e996ecc-istio-data\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:13:03.395945 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:03.395935    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/895e91f5-daab-4818-ab7a-fe1c2e996ecc-workload-socket\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:13:03.395945 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:03.395946    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/895e91f5-daab-4818-ab7a-fe1c2e996ecc-istio-podinfo\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:13:03.395945 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:03.395956    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/895e91f5-daab-4818-ab7a-fe1c2e996ecc-istio-envoy\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:13:03.396209 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:03.395965    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/895e91f5-daab-4818-ab7a-fe1c2e996ecc-credential-socket\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:13:03.396209 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:03.395973    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bkqc8\" (UniqueName: \"kubernetes.io/projected/895e91f5-daab-4818-ab7a-fe1c2e996ecc-kube-api-access-bkqc8\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:13:03.396209 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:03.395983    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/895e91f5-daab-4818-ab7a-fe1c2e996ecc-istiod-ca-cert\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:13:03.396209 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:03.395991    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/895e91f5-daab-4818-ab7a-fe1c2e996ecc-istio-token\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:13:03.634181 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:03.634142    2564 generic.go:356] "Generic (PLEG): container finished" podID="895e91f5-daab-4818-ab7a-fe1c2e996ecc" containerID="a191b00154ce87294b4d0fd56d98261afb7c13052a05ad791bc243e7955e9845" exitCode=0
Sep 10 21:13:03.634392 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:03.634191    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-801c3274-openshift-default-fc5588768-lc5v9"
Sep 10 21:13:03.634392 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:03.634253    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-801c3274-openshift-default-fc5588768-lc5v9" event={"ID":"895e91f5-daab-4818-ab7a-fe1c2e996ecc","Type":"ContainerDied","Data":"a191b00154ce87294b4d0fd56d98261afb7c13052a05ad791bc243e7955e9845"}
Sep 10 21:13:03.634392 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:03.634307    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-801c3274-openshift-default-fc5588768-lc5v9" event={"ID":"895e91f5-daab-4818-ab7a-fe1c2e996ecc","Type":"ContainerDied","Data":"094fe824b734a5e0041386ab1651d85a7043295d2a63fcc86c19b1acd576aec9"}
Sep 10 21:13:03.634392 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:03.634330    2564 scope.go:117] "RemoveContainer" containerID="a191b00154ce87294b4d0fd56d98261afb7c13052a05ad791bc243e7955e9845"
Sep 10 21:13:03.644205 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:03.644188    2564 scope.go:117] "RemoveContainer" containerID="9165545f91cfa1c4fc06a7846bc93142cbf041cd2ba367bc1c75238b6a586878"
Sep 10 21:13:03.652651 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:03.652632    2564 scope.go:117] "RemoveContainer" containerID="a191b00154ce87294b4d0fd56d98261afb7c13052a05ad791bc243e7955e9845"
Sep 10 21:13:03.652926 ip-10-0-129-100 kubenswrapper[2564]: E0910 21:13:03.652905    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a191b00154ce87294b4d0fd56d98261afb7c13052a05ad791bc243e7955e9845\": container with ID starting with a191b00154ce87294b4d0fd56d98261afb7c13052a05ad791bc243e7955e9845 not found: ID does not exist" containerID="a191b00154ce87294b4d0fd56d98261afb7c13052a05ad791bc243e7955e9845"
Sep 10 21:13:03.652989 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:03.652935    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a191b00154ce87294b4d0fd56d98261afb7c13052a05ad791bc243e7955e9845"} err="failed to get container status \"a191b00154ce87294b4d0fd56d98261afb7c13052a05ad791bc243e7955e9845\": rpc error: code = NotFound desc = could not find container \"a191b00154ce87294b4d0fd56d98261afb7c13052a05ad791bc243e7955e9845\": container with ID starting with a191b00154ce87294b4d0fd56d98261afb7c13052a05ad791bc243e7955e9845 not found: ID does not exist"
Sep 10 21:13:03.652989 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:03.652953    2564 scope.go:117] "RemoveContainer" containerID="9165545f91cfa1c4fc06a7846bc93142cbf041cd2ba367bc1c75238b6a586878"
Sep 10 21:13:03.653215 ip-10-0-129-100 kubenswrapper[2564]: E0910 21:13:03.653201    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9165545f91cfa1c4fc06a7846bc93142cbf041cd2ba367bc1c75238b6a586878\": container with ID starting with 9165545f91cfa1c4fc06a7846bc93142cbf041cd2ba367bc1c75238b6a586878 not found: ID does not exist" containerID="9165545f91cfa1c4fc06a7846bc93142cbf041cd2ba367bc1c75238b6a586878"
Sep 10 21:13:03.653269 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:03.653218    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9165545f91cfa1c4fc06a7846bc93142cbf041cd2ba367bc1c75238b6a586878"} err="failed to get container status \"9165545f91cfa1c4fc06a7846bc93142cbf041cd2ba367bc1c75238b6a586878\": rpc error: code = NotFound desc = could not find container \"9165545f91cfa1c4fc06a7846bc93142cbf041cd2ba367bc1c75238b6a586878\": container with ID starting with 9165545f91cfa1c4fc06a7846bc93142cbf041cd2ba367bc1c75238b6a586878 not found: ID does not exist"
Sep 10 21:13:03.657536 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:03.657512    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-801c3274-openshift-default-fc5588768-lc5v9"]
Sep 10 21:13:03.659870 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:03.659850    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-801c3274-openshift-default-fc5588768-lc5v9"]
Sep 10 21:13:03.875051 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:03.875016    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="895e91f5-daab-4818-ab7a-fe1c2e996ecc" path="/var/lib/kubelet/pods/895e91f5-daab-4818-ab7a-fe1c2e996ecc/volumes"
Sep 10 21:13:07.967925 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:07.967892    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-c2de43-8gvg6"]
Sep 10 21:13:07.970011 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:07.969990    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-c2de43-8gvg6"]
Sep 10 21:13:09.872455 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:09.872422    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ecd9b563-0b13-4915-bd96-728ff464fd23" path="/var/lib/kubelet/pods/ecd9b563-0b13-4915-bd96-728ff464fd23/volumes"
Sep 10 21:13:23.751653 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:23.751616    2564 generic.go:356] "Generic (PLEG): container finished" podID="8261056a-56e1-408e-ac01-c378ad7387ff" containerID="a696dbebe3fd18d0f445b96bee05252b55c261326e601e5cd7f54c26d4bb8d4d" exitCode=0
Sep 10 21:13:23.751653 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:23.751658    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm" event={"ID":"8261056a-56e1-408e-ac01-c378ad7387ff","Type":"ContainerDied","Data":"a696dbebe3fd18d0f445b96bee05252b55c261326e601e5cd7f54c26d4bb8d4d"}
Sep 10 21:13:23.752247 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:23.752160    2564 scope.go:117] "RemoveContainer" containerID="a696dbebe3fd18d0f445b96bee05252b55c261326e601e5cd7f54c26d4bb8d4d"
Sep 10 21:13:23.753347 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:23.753314    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 10 21:13:23.753430 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:23.753412    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 10 21:13:23.753479 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:23.753466    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 10 21:13:24.759576 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:24.759543    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm" event={"ID":"8261056a-56e1-408e-ac01-c378ad7387ff","Type":"ContainerStarted","Data":"f0c078e2c14f79ba4221824c4e0b5960a3ce047980b6c8f55a1fe45b5267b0c9"}
Sep 10 21:13:24.931887 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:24.931851    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm"
Sep 10 21:13:24.932067 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:24.932044    2564 patch_prober.go:28] interesting pod/e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 10 21:13:24.932126 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:24.932107    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm" podUID="8261056a-56e1-408e-ac01-c378ad7387ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 10 21:13:25.830933 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:25.830895    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-cbc740e6-wlk2n"]
Sep 10 21:13:25.831471 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:25.831452    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecd9b563-0b13-4915-bd96-728ff464fd23" containerName="revoke-keys"
Sep 10 21:13:25.831543 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:25.831476    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecd9b563-0b13-4915-bd96-728ff464fd23" containerName="revoke-keys"
Sep 10 21:13:25.831543 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:25.831498    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="895e91f5-daab-4818-ab7a-fe1c2e996ecc" containerName="istio-proxy"
Sep 10 21:13:25.831543 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:25.831507    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="895e91f5-daab-4818-ab7a-fe1c2e996ecc" containerName="istio-proxy"
Sep 10 21:13:25.831543 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:25.831527    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="895e91f5-daab-4818-ab7a-fe1c2e996ecc" containerName="istio-proxy"
Sep 10 21:13:25.831543 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:25.831535    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="895e91f5-daab-4818-ab7a-fe1c2e996ecc" containerName="istio-proxy"
Sep 10 21:13:25.831793 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:25.831637    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="895e91f5-daab-4818-ab7a-fe1c2e996ecc" containerName="istio-proxy"
Sep 10 21:13:25.831793 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:25.831649    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ecd9b563-0b13-4915-bd96-728ff464fd23" containerName="revoke-keys"
Sep 10 21:13:25.831793 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:25.831664    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="895e91f5-daab-4818-ab7a-fe1c2e996ecc" containerName="istio-proxy"
Sep 10 21:13:25.833741 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:25.833723    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-cbc740e6-wlk2n"
Sep 10 21:13:25.836706 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:25.836681    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-m5c7x\""
Sep 10 21:13:25.837142 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:25.837122    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 21:13:25.845586 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:25.845556    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-cbc740e6-wlk2n"]
Sep 10 21:13:25.906055 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:25.906023    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f261d12-5b90-42f1-9289-41af59e6253e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-cbc740e6-wlk2n\" (UID: \"8f261d12-5b90-42f1-9289-41af59e6253e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-cbc740e6-wlk2n"
Sep 10 21:13:25.932108 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:25.932073    2564 patch_prober.go:28] interesting pod/e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 10 21:13:25.932293 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:25.932130    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm" podUID="8261056a-56e1-408e-ac01-c378ad7387ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 10 21:13:26.006812 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:26.006777    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f261d12-5b90-42f1-9289-41af59e6253e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-cbc740e6-wlk2n\" (UID: \"8f261d12-5b90-42f1-9289-41af59e6253e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-cbc740e6-wlk2n"
Sep 10 21:13:26.007450 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:26.007432    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f261d12-5b90-42f1-9289-41af59e6253e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-cbc740e6-wlk2n\" (UID: \"8f261d12-5b90-42f1-9289-41af59e6253e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-cbc740e6-wlk2n"
Sep 10 21:13:26.145604 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:26.145512    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-cbc740e6-wlk2n"
Sep 10 21:13:26.463290 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:26.463257    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-cbc740e6-wlk2n"]
Sep 10 21:13:26.464013 ip-10-0-129-100 kubenswrapper[2564]: W0910 21:13:26.463986    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f261d12_5b90_42f1_9289_41af59e6253e.slice/crio-4b8f1877bbf0d190c04c754f8f6e2a8566ff9aa4ad365995d96f6ab1bf58f221 WatchSource:0}: Error finding container 4b8f1877bbf0d190c04c754f8f6e2a8566ff9aa4ad365995d96f6ab1bf58f221: Status 404 returned error can't find the container with id 4b8f1877bbf0d190c04c754f8f6e2a8566ff9aa4ad365995d96f6ab1bf58f221
Sep 10 21:13:26.777702 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:26.777658    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-cbc740e6-wlk2n" event={"ID":"8f261d12-5b90-42f1-9289-41af59e6253e","Type":"ContainerStarted","Data":"4b8f1877bbf0d190c04c754f8f6e2a8566ff9aa4ad365995d96f6ab1bf58f221"}
Sep 10 21:13:26.932422 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:26.932386    2564 patch_prober.go:28] interesting pod/e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 10 21:13:26.932791 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:26.932439    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm" podUID="8261056a-56e1-408e-ac01-c378ad7387ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 10 21:13:27.791065 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:27.790927    2564 generic.go:356] "Generic (PLEG): container finished" podID="8f261d12-5b90-42f1-9289-41af59e6253e" containerID="15951e6d640d916b999d45108dac8885f187eae3ff87d46875a026938cd43336" exitCode=0
Sep 10 21:13:27.791065 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:27.791027    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-cbc740e6-wlk2n" event={"ID":"8f261d12-5b90-42f1-9289-41af59e6253e","Type":"ContainerDied","Data":"15951e6d640d916b999d45108dac8885f187eae3ff87d46875a026938cd43336"}
Sep 10 21:13:27.931928 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:27.931890    2564 patch_prober.go:28] interesting pod/e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 10 21:13:27.932104 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:27.931946    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm" podUID="8261056a-56e1-408e-ac01-c378ad7387ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 10 21:13:28.932367 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:28.932336    2564 patch_prober.go:28] interesting pod/e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 10 21:13:28.932652 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:28.932396    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm" podUID="8261056a-56e1-408e-ac01-c378ad7387ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 10 21:13:28.944853 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:28.944829    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-cbc740e6-wlk2n"
Sep 10 21:13:29.032454 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:29.032423    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f261d12-5b90-42f1-9289-41af59e6253e-maas-api-service-ca\") pod \"8f261d12-5b90-42f1-9289-41af59e6253e\" (UID: \"8f261d12-5b90-42f1-9289-41af59e6253e\") "
Sep 10 21:13:29.032795 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:29.032774    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f261d12-5b90-42f1-9289-41af59e6253e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8f261d12-5b90-42f1-9289-41af59e6253e" (UID: "8f261d12-5b90-42f1-9289-41af59e6253e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:13:29.133756 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:29.133671    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f261d12-5b90-42f1-9289-41af59e6253e-maas-api-service-ca\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:13:29.339536 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:29.339494    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-b-43415b1a-kserve-746b6f6cf4-29d8s"]
Sep 10 21:13:29.805222 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:29.805189    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-cbc740e6-wlk2n"
Sep 10 21:13:29.805506 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:29.805188    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-cbc740e6-wlk2n" event={"ID":"8f261d12-5b90-42f1-9289-41af59e6253e","Type":"ContainerDied","Data":"4b8f1877bbf0d190c04c754f8f6e2a8566ff9aa4ad365995d96f6ab1bf58f221"}
Sep 10 21:13:29.805506 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:29.805499    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4b8f1877bbf0d190c04c754f8f6e2a8566ff9aa4ad365995d96f6ab1bf58f221"
Sep 10 21:13:29.936568 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:29.936537    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm"
Sep 10 21:13:29.937036 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:29.936926    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm"
Sep 10 21:13:29.937534 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:29.937516    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm"
Sep 10 21:13:33.320175 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:33.320140    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-cbc740e6-wlk2n"]
Sep 10 21:13:33.322315 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:33.322293    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-cbc740e6-wlk2n"]
Sep 10 21:13:33.462924 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:33.462891    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm"]
Sep 10 21:13:33.463160 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:33.463123    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm" podUID="8261056a-56e1-408e-ac01-c378ad7387ff" containerName="istio-proxy" containerID="cri-o://f0c078e2c14f79ba4221824c4e0b5960a3ce047980b6c8f55a1fe45b5267b0c9" gracePeriod=30
Sep 10 21:13:33.872844 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:33.872812    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f261d12-5b90-42f1-9289-41af59e6253e" path="/var/lib/kubelet/pods/8f261d12-5b90-42f1-9289-41af59e6253e/volumes"
Sep 10 21:13:38.715314 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:38.715286    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm"
Sep 10 21:13:38.726908 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:38.726846    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jn4rx\" (UniqueName: \"kubernetes.io/projected/8261056a-56e1-408e-ac01-c378ad7387ff-kube-api-access-jn4rx\") pod \"8261056a-56e1-408e-ac01-c378ad7387ff\" (UID: \"8261056a-56e1-408e-ac01-c378ad7387ff\") "
Sep 10 21:13:38.726908 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:38.726877    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8261056a-56e1-408e-ac01-c378ad7387ff-istio-token\") pod \"8261056a-56e1-408e-ac01-c378ad7387ff\" (UID: \"8261056a-56e1-408e-ac01-c378ad7387ff\") "
Sep 10 21:13:38.727092 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:38.726933    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8261056a-56e1-408e-ac01-c378ad7387ff-workload-socket\") pod \"8261056a-56e1-408e-ac01-c378ad7387ff\" (UID: \"8261056a-56e1-408e-ac01-c378ad7387ff\") "
Sep 10 21:13:38.727092 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:38.726956    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8261056a-56e1-408e-ac01-c378ad7387ff-credential-socket\") pod \"8261056a-56e1-408e-ac01-c378ad7387ff\" (UID: \"8261056a-56e1-408e-ac01-c378ad7387ff\") "
Sep 10 21:13:38.727092 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:38.726984    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8261056a-56e1-408e-ac01-c378ad7387ff-istio-podinfo\") pod \"8261056a-56e1-408e-ac01-c378ad7387ff\" (UID: \"8261056a-56e1-408e-ac01-c378ad7387ff\") "
Sep 10 21:13:38.727092 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:38.727017    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8261056a-56e1-408e-ac01-c378ad7387ff-istio-envoy\") pod \"8261056a-56e1-408e-ac01-c378ad7387ff\" (UID: \"8261056a-56e1-408e-ac01-c378ad7387ff\") "
Sep 10 21:13:38.727092 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:38.727045    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8261056a-56e1-408e-ac01-c378ad7387ff-workload-certs\") pod \"8261056a-56e1-408e-ac01-c378ad7387ff\" (UID: \"8261056a-56e1-408e-ac01-c378ad7387ff\") "
Sep 10 21:13:38.727092 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:38.727067    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8261056a-56e1-408e-ac01-c378ad7387ff-istio-data\") pod \"8261056a-56e1-408e-ac01-c378ad7387ff\" (UID: \"8261056a-56e1-408e-ac01-c378ad7387ff\") "
Sep 10 21:13:38.727418 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:38.727124    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8261056a-56e1-408e-ac01-c378ad7387ff-istiod-ca-cert\") pod \"8261056a-56e1-408e-ac01-c378ad7387ff\" (UID: \"8261056a-56e1-408e-ac01-c378ad7387ff\") "
Sep 10 21:13:38.727418 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:38.727248    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8261056a-56e1-408e-ac01-c378ad7387ff-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8261056a-56e1-408e-ac01-c378ad7387ff" (UID: "8261056a-56e1-408e-ac01-c378ad7387ff"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:13:38.727418 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:38.727295    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8261056a-56e1-408e-ac01-c378ad7387ff-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8261056a-56e1-408e-ac01-c378ad7387ff" (UID: "8261056a-56e1-408e-ac01-c378ad7387ff"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:13:38.727566 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:38.727446    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8261056a-56e1-408e-ac01-c378ad7387ff-istio-data" (OuterVolumeSpecName: "istio-data") pod "8261056a-56e1-408e-ac01-c378ad7387ff" (UID: "8261056a-56e1-408e-ac01-c378ad7387ff"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:13:38.727566 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:38.727538    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8261056a-56e1-408e-ac01-c378ad7387ff-istio-data\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:13:38.727566 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:38.727557    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8261056a-56e1-408e-ac01-c378ad7387ff-workload-socket\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:13:38.727719 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:38.727569    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8261056a-56e1-408e-ac01-c378ad7387ff-credential-socket\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:13:38.727719 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:38.727569    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8261056a-56e1-408e-ac01-c378ad7387ff-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8261056a-56e1-408e-ac01-c378ad7387ff" (UID: "8261056a-56e1-408e-ac01-c378ad7387ff"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:13:38.727719 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:38.727601    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8261056a-56e1-408e-ac01-c378ad7387ff-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8261056a-56e1-408e-ac01-c378ad7387ff" (UID: "8261056a-56e1-408e-ac01-c378ad7387ff"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:13:38.729087 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:38.729066    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8261056a-56e1-408e-ac01-c378ad7387ff-kube-api-access-jn4rx" (OuterVolumeSpecName: "kube-api-access-jn4rx") pod "8261056a-56e1-408e-ac01-c378ad7387ff" (UID: "8261056a-56e1-408e-ac01-c378ad7387ff"). InnerVolumeSpecName "kube-api-access-jn4rx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:13:38.729421 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:38.729402    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8261056a-56e1-408e-ac01-c378ad7387ff-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8261056a-56e1-408e-ac01-c378ad7387ff" (UID: "8261056a-56e1-408e-ac01-c378ad7387ff"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:13:38.729551 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:38.729532    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8261056a-56e1-408e-ac01-c378ad7387ff-istio-token" (OuterVolumeSpecName: "istio-token") pod "8261056a-56e1-408e-ac01-c378ad7387ff" (UID: "8261056a-56e1-408e-ac01-c378ad7387ff"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:13:38.729593 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:38.729537    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8261056a-56e1-408e-ac01-c378ad7387ff-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8261056a-56e1-408e-ac01-c378ad7387ff" (UID: "8261056a-56e1-408e-ac01-c378ad7387ff"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 21:13:38.828919 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:38.828877    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8261056a-56e1-408e-ac01-c378ad7387ff-istio-podinfo\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:13:38.828919 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:38.828913    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8261056a-56e1-408e-ac01-c378ad7387ff-istio-envoy\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:13:38.828919 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:38.828928    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8261056a-56e1-408e-ac01-c378ad7387ff-workload-certs\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:13:38.829158 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:38.828940    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8261056a-56e1-408e-ac01-c378ad7387ff-istiod-ca-cert\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:13:38.829158 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:38.828953    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jn4rx\" (UniqueName: \"kubernetes.io/projected/8261056a-56e1-408e-ac01-c378ad7387ff-kube-api-access-jn4rx\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:13:38.829158 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:38.828966    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8261056a-56e1-408e-ac01-c378ad7387ff-istio-token\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:13:38.857598 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:38.857563    2564 generic.go:356] "Generic (PLEG): container finished" podID="8261056a-56e1-408e-ac01-c378ad7387ff" containerID="f0c078e2c14f79ba4221824c4e0b5960a3ce047980b6c8f55a1fe45b5267b0c9" exitCode=0
Sep 10 21:13:38.857769 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:38.857612    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm" event={"ID":"8261056a-56e1-408e-ac01-c378ad7387ff","Type":"ContainerDied","Data":"f0c078e2c14f79ba4221824c4e0b5960a3ce047980b6c8f55a1fe45b5267b0c9"}
Sep 10 21:13:38.857769 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:38.857640    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm"
Sep 10 21:13:38.857769 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:38.857678    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm" event={"ID":"8261056a-56e1-408e-ac01-c378ad7387ff","Type":"ContainerDied","Data":"7d205ef870ae7107987c0615ce9a28176f5485846dcb2b0f98546e6e705b5dbb"}
Sep 10 21:13:38.857769 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:38.857699    2564 scope.go:117] "RemoveContainer" containerID="f0c078e2c14f79ba4221824c4e0b5960a3ce047980b6c8f55a1fe45b5267b0c9"
Sep 10 21:13:38.867915 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:38.867893    2564 scope.go:117] "RemoveContainer" containerID="a696dbebe3fd18d0f445b96bee05252b55c261326e601e5cd7f54c26d4bb8d4d"
Sep 10 21:13:38.876203 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:38.876182    2564 scope.go:117] "RemoveContainer" containerID="f0c078e2c14f79ba4221824c4e0b5960a3ce047980b6c8f55a1fe45b5267b0c9"
Sep 10 21:13:38.876515 ip-10-0-129-100 kubenswrapper[2564]: E0910 21:13:38.876494    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0c078e2c14f79ba4221824c4e0b5960a3ce047980b6c8f55a1fe45b5267b0c9\": container with ID starting with f0c078e2c14f79ba4221824c4e0b5960a3ce047980b6c8f55a1fe45b5267b0c9 not found: ID does not exist" containerID="f0c078e2c14f79ba4221824c4e0b5960a3ce047980b6c8f55a1fe45b5267b0c9"
Sep 10 21:13:38.876568 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:38.876524    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0c078e2c14f79ba4221824c4e0b5960a3ce047980b6c8f55a1fe45b5267b0c9"} err="failed to get container status \"f0c078e2c14f79ba4221824c4e0b5960a3ce047980b6c8f55a1fe45b5267b0c9\": rpc error: code = NotFound desc = could not find container \"f0c078e2c14f79ba4221824c4e0b5960a3ce047980b6c8f55a1fe45b5267b0c9\": container with ID starting with f0c078e2c14f79ba4221824c4e0b5960a3ce047980b6c8f55a1fe45b5267b0c9 not found: ID does not exist"
Sep 10 21:13:38.876568 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:38.876542    2564 scope.go:117] "RemoveContainer" containerID="a696dbebe3fd18d0f445b96bee05252b55c261326e601e5cd7f54c26d4bb8d4d"
Sep 10 21:13:38.876783 ip-10-0-129-100 kubenswrapper[2564]: E0910 21:13:38.876763    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a696dbebe3fd18d0f445b96bee05252b55c261326e601e5cd7f54c26d4bb8d4d\": container with ID starting with a696dbebe3fd18d0f445b96bee05252b55c261326e601e5cd7f54c26d4bb8d4d not found: ID does not exist" containerID="a696dbebe3fd18d0f445b96bee05252b55c261326e601e5cd7f54c26d4bb8d4d"
Sep 10 21:13:38.876848 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:38.876793    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a696dbebe3fd18d0f445b96bee05252b55c261326e601e5cd7f54c26d4bb8d4d"} err="failed to get container status \"a696dbebe3fd18d0f445b96bee05252b55c261326e601e5cd7f54c26d4bb8d4d\": rpc error: code = NotFound desc = could not find container \"a696dbebe3fd18d0f445b96bee05252b55c261326e601e5cd7f54c26d4bb8d4d\": container with ID starting with a696dbebe3fd18d0f445b96bee05252b55c261326e601e5cd7f54c26d4bb8d4d not found: ID does not exist"
Sep 10 21:13:38.886249 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:38.886207    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm"]
Sep 10 21:13:38.890095 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:38.890071    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-cbc740e6-openshift-default-5cc5ddd97b-xvgrm"]
Sep 10 21:13:39.874075 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:39.874039    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8261056a-56e1-408e-ac01-c378ad7387ff" path="/var/lib/kubelet/pods/8261056a-56e1-408e-ac01-c378ad7387ff/volumes"
Sep 10 21:13:44.364474 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:44.364431    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-conflict-b-43415b1a-kserve-746b6f6cf4-29d8s" podUID="f96f5a82-4c7f-41da-81f8-cc0839891c98" containerName="main" containerID="cri-o://bce98e306b5b45babe71a1833e01c8b1b2e5582939cf35a871c3fbd081f0236e" gracePeriod=45
Sep 10 21:13:44.614308 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:44.614285    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-43415b1a-kserve-746b6f6cf4-29d8s"
Sep 10 21:13:44.687093 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:44.687012    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kdc5g\" (UniqueName: \"kubernetes.io/projected/f96f5a82-4c7f-41da-81f8-cc0839891c98-kube-api-access-kdc5g\") pod \"f96f5a82-4c7f-41da-81f8-cc0839891c98\" (UID: \"f96f5a82-4c7f-41da-81f8-cc0839891c98\") "
Sep 10 21:13:44.687093 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:44.687077    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f96f5a82-4c7f-41da-81f8-cc0839891c98-tmp-dir\") pod \"f96f5a82-4c7f-41da-81f8-cc0839891c98\" (UID: \"f96f5a82-4c7f-41da-81f8-cc0839891c98\") "
Sep 10 21:13:44.687346 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:44.687157    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f96f5a82-4c7f-41da-81f8-cc0839891c98-dshm\") pod \"f96f5a82-4c7f-41da-81f8-cc0839891c98\" (UID: \"f96f5a82-4c7f-41da-81f8-cc0839891c98\") "
Sep 10 21:13:44.687346 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:44.687182    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f96f5a82-4c7f-41da-81f8-cc0839891c98-model-cache\") pod \"f96f5a82-4c7f-41da-81f8-cc0839891c98\" (UID: \"f96f5a82-4c7f-41da-81f8-cc0839891c98\") "
Sep 10 21:13:44.687346 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:44.687297    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f96f5a82-4c7f-41da-81f8-cc0839891c98-tls-certs\") pod \"f96f5a82-4c7f-41da-81f8-cc0839891c98\" (UID: \"f96f5a82-4c7f-41da-81f8-cc0839891c98\") "
Sep 10 21:13:44.687346 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:44.687322    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f96f5a82-4c7f-41da-81f8-cc0839891c98-home\") pod \"f96f5a82-4c7f-41da-81f8-cc0839891c98\" (UID: \"f96f5a82-4c7f-41da-81f8-cc0839891c98\") "
Sep 10 21:13:44.687558 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:44.687384    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f96f5a82-4c7f-41da-81f8-cc0839891c98-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f96f5a82-4c7f-41da-81f8-cc0839891c98" (UID: "f96f5a82-4c7f-41da-81f8-cc0839891c98"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:13:44.687558 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:44.687473    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f96f5a82-4c7f-41da-81f8-cc0839891c98-model-cache" (OuterVolumeSpecName: "model-cache") pod "f96f5a82-4c7f-41da-81f8-cc0839891c98" (UID: "f96f5a82-4c7f-41da-81f8-cc0839891c98"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:13:44.687638 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:44.687597    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f96f5a82-4c7f-41da-81f8-cc0839891c98-home" (OuterVolumeSpecName: "home") pod "f96f5a82-4c7f-41da-81f8-cc0839891c98" (UID: "f96f5a82-4c7f-41da-81f8-cc0839891c98"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:13:44.687698 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:44.687667    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f96f5a82-4c7f-41da-81f8-cc0839891c98-tmp-dir\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:13:44.687698 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:44.687682    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f96f5a82-4c7f-41da-81f8-cc0839891c98-model-cache\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:13:44.689165 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:44.689135    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f96f5a82-4c7f-41da-81f8-cc0839891c98-kube-api-access-kdc5g" (OuterVolumeSpecName: "kube-api-access-kdc5g") pod "f96f5a82-4c7f-41da-81f8-cc0839891c98" (UID: "f96f5a82-4c7f-41da-81f8-cc0839891c98"). InnerVolumeSpecName "kube-api-access-kdc5g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:13:44.689274 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:44.689210    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f96f5a82-4c7f-41da-81f8-cc0839891c98-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f96f5a82-4c7f-41da-81f8-cc0839891c98" (UID: "f96f5a82-4c7f-41da-81f8-cc0839891c98"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:13:44.689274 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:44.689218    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f96f5a82-4c7f-41da-81f8-cc0839891c98-dshm" (OuterVolumeSpecName: "dshm") pod "f96f5a82-4c7f-41da-81f8-cc0839891c98" (UID: "f96f5a82-4c7f-41da-81f8-cc0839891c98"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:13:44.788073 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:44.788039    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f96f5a82-4c7f-41da-81f8-cc0839891c98-tls-certs\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:13:44.788073 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:44.788067    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f96f5a82-4c7f-41da-81f8-cc0839891c98-home\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:13:44.788073 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:44.788077    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kdc5g\" (UniqueName: \"kubernetes.io/projected/f96f5a82-4c7f-41da-81f8-cc0839891c98-kube-api-access-kdc5g\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:13:44.788346 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:44.788087    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f96f5a82-4c7f-41da-81f8-cc0839891c98-dshm\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:13:44.894188 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:44.894151    2564 generic.go:356] "Generic (PLEG): container finished" podID="f96f5a82-4c7f-41da-81f8-cc0839891c98" containerID="bce98e306b5b45babe71a1833e01c8b1b2e5582939cf35a871c3fbd081f0236e" exitCode=0
Sep 10 21:13:44.894352 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:44.894192    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-43415b1a-kserve-746b6f6cf4-29d8s"
Sep 10 21:13:44.894352 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:44.894254    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-43415b1a-kserve-746b6f6cf4-29d8s" event={"ID":"f96f5a82-4c7f-41da-81f8-cc0839891c98","Type":"ContainerDied","Data":"bce98e306b5b45babe71a1833e01c8b1b2e5582939cf35a871c3fbd081f0236e"}
Sep 10 21:13:44.894352 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:44.894295    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-43415b1a-kserve-746b6f6cf4-29d8s" event={"ID":"f96f5a82-4c7f-41da-81f8-cc0839891c98","Type":"ContainerDied","Data":"78e7a7cd50176f24e0975f5db17ab33f06aca88100d0d3dfb37ff7eafbdab4e2"}
Sep 10 21:13:44.894352 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:44.894315    2564 scope.go:117] "RemoveContainer" containerID="bce98e306b5b45babe71a1833e01c8b1b2e5582939cf35a871c3fbd081f0236e"
Sep 10 21:13:44.904045 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:44.904027    2564 scope.go:117] "RemoveContainer" containerID="bce98e306b5b45babe71a1833e01c8b1b2e5582939cf35a871c3fbd081f0236e"
Sep 10 21:13:44.904307 ip-10-0-129-100 kubenswrapper[2564]: E0910 21:13:44.904288    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bce98e306b5b45babe71a1833e01c8b1b2e5582939cf35a871c3fbd081f0236e\": container with ID starting with bce98e306b5b45babe71a1833e01c8b1b2e5582939cf35a871c3fbd081f0236e not found: ID does not exist" containerID="bce98e306b5b45babe71a1833e01c8b1b2e5582939cf35a871c3fbd081f0236e"
Sep 10 21:13:44.904358 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:44.904317    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bce98e306b5b45babe71a1833e01c8b1b2e5582939cf35a871c3fbd081f0236e"} err="failed to get container status \"bce98e306b5b45babe71a1833e01c8b1b2e5582939cf35a871c3fbd081f0236e\": rpc error: code = NotFound desc = could not find container \"bce98e306b5b45babe71a1833e01c8b1b2e5582939cf35a871c3fbd081f0236e\": container with ID starting with bce98e306b5b45babe71a1833e01c8b1b2e5582939cf35a871c3fbd081f0236e not found: ID does not exist"
Sep 10 21:13:44.919643 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:44.919621    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-b-43415b1a-kserve-746b6f6cf4-29d8s"]
Sep 10 21:13:44.922664 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:44.922644    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-conflict-b-43415b1a-kserve-746b6f6cf4-29d8s"]
Sep 10 21:13:45.873353 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:45.873314    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f96f5a82-4c7f-41da-81f8-cc0839891c98" path="/var/lib/kubelet/pods/f96f5a82-4c7f-41da-81f8-cc0839891c98/volumes"
Sep 10 21:13:51.564324 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:51.564290    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-c2de43-openshift-default-65fc6484d-qts6j"]
Sep 10 21:13:51.564952 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:51.564517    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-autores-c2de43-openshift-default-65fc6484d-qts6j" podUID="65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d" containerName="istio-proxy" containerID="cri-o://1a13fba55c96e5411e4fa58b30e831b4506d85ba19c7aaee3794c3d9a3e0c862" gracePeriod=30
Sep 10 21:13:52.334276 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:52.334241    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm"]
Sep 10 21:13:52.334767 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:52.334746    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8261056a-56e1-408e-ac01-c378ad7387ff" containerName="istio-proxy"
Sep 10 21:13:52.334767 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:52.334766    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8261056a-56e1-408e-ac01-c378ad7387ff" containerName="istio-proxy"
Sep 10 21:13:52.334913 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:52.334784    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8261056a-56e1-408e-ac01-c378ad7387ff" containerName="istio-proxy"
Sep 10 21:13:52.334913 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:52.334793    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8261056a-56e1-408e-ac01-c378ad7387ff" containerName="istio-proxy"
Sep 10 21:13:52.334913 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:52.334804    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f96f5a82-4c7f-41da-81f8-cc0839891c98" containerName="main"
Sep 10 21:13:52.334913 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:52.334810    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f96f5a82-4c7f-41da-81f8-cc0839891c98" containerName="main"
Sep 10 21:13:52.334913 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:52.334817    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f261d12-5b90-42f1-9289-41af59e6253e" containerName="revoke-keys"
Sep 10 21:13:52.334913 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:52.334823    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f261d12-5b90-42f1-9289-41af59e6253e" containerName="revoke-keys"
Sep 10 21:13:52.334913 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:52.334877    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f96f5a82-4c7f-41da-81f8-cc0839891c98" containerName="main"
Sep 10 21:13:52.334913 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:52.334887    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f261d12-5b90-42f1-9289-41af59e6253e" containerName="revoke-keys"
Sep 10 21:13:52.334913 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:52.334893    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="8261056a-56e1-408e-ac01-c378ad7387ff" containerName="istio-proxy"
Sep 10 21:13:52.334913 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:52.334900    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="8261056a-56e1-408e-ac01-c378ad7387ff" containerName="istio-proxy"
Sep 10 21:13:52.339573 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:52.339552    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm"
Sep 10 21:13:52.341985 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:52.341962    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-65af3d-openshift-default-dockercfg-jbt7b\""
Sep 10 21:13:52.351036 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:52.351014    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm"]
Sep 10 21:13:52.449929 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:52.449895    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6-istio-podinfo\") pod \"e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm\" (UID: \"2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6\") " pod="openshift-ingress/e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm"
Sep 10 21:13:52.450076 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:52.449934    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6-workload-socket\") pod \"e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm\" (UID: \"2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6\") " pod="openshift-ingress/e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm"
Sep 10 21:13:52.450076 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:52.449961    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6-istio-token\") pod \"e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm\" (UID: \"2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6\") " pod="openshift-ingress/e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm"
Sep 10 21:13:52.450076 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:52.450016    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6-credential-socket\") pod \"e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm\" (UID: \"2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6\") " pod="openshift-ingress/e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm"
Sep 10 21:13:52.450076 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:52.450045    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6-istio-envoy\") pod \"e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm\" (UID: \"2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6\") " pod="openshift-ingress/e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm"
Sep 10 21:13:52.450076 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:52.450072    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6-istio-data\") pod \"e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm\" (UID: \"2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6\") " pod="openshift-ingress/e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm"
Sep 10 21:13:52.450276 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:52.450105    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6-workload-certs\") pod \"e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm\" (UID: \"2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6\") " pod="openshift-ingress/e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm"
Sep 10 21:13:52.450276 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:52.450140    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfd6k\" (UniqueName: \"kubernetes.io/projected/2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6-kube-api-access-xfd6k\") pod \"e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm\" (UID: \"2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6\") " pod="openshift-ingress/e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm"
Sep 10 21:13:52.450276 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:52.450158    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6-istiod-ca-cert\") pod \"e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm\" (UID: \"2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6\") " pod="openshift-ingress/e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm"
Sep 10 21:13:52.551575 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:52.551541    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6-workload-socket\") pod \"e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm\" (UID: \"2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6\") " pod="openshift-ingress/e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm"
Sep 10 21:13:52.551575 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:52.551576    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6-istio-token\") pod \"e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm\" (UID: \"2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6\") " pod="openshift-ingress/e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm"
Sep 10 21:13:52.551792 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:52.551594    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6-credential-socket\") pod \"e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm\" (UID: \"2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6\") " pod="openshift-ingress/e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm"
Sep 10 21:13:52.551792 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:52.551609    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6-istio-envoy\") pod \"e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm\" (UID: \"2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6\") " pod="openshift-ingress/e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm"
Sep 10 21:13:52.551792 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:52.551634    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6-istio-data\") pod \"e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm\" (UID: \"2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6\") " pod="openshift-ingress/e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm"
Sep 10 21:13:52.551792 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:52.551663    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6-workload-certs\") pod \"e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm\" (UID: \"2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6\") " pod="openshift-ingress/e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm"
Sep 10 21:13:52.551792 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:52.551687    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfd6k\" (UniqueName: \"kubernetes.io/projected/2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6-kube-api-access-xfd6k\") pod \"e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm\" (UID: \"2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6\") " pod="openshift-ingress/e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm"
Sep 10 21:13:52.551792 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:52.551703    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6-istiod-ca-cert\") pod \"e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm\" (UID: \"2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6\") " pod="openshift-ingress/e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm"
Sep 10 21:13:52.551792 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:52.551783    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6-istio-podinfo\") pod \"e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm\" (UID: \"2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6\") " pod="openshift-ingress/e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm"
Sep 10 21:13:52.552224 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:52.552002    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6-credential-socket\") pod \"e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm\" (UID: \"2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6\") " pod="openshift-ingress/e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm"
Sep 10 21:13:52.552224 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:52.552088    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6-workload-certs\") pod \"e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm\" (UID: \"2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6\") " pod="openshift-ingress/e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm"
Sep 10 21:13:52.552224 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:52.552124    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6-istio-data\") pod \"e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm\" (UID: \"2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6\") " pod="openshift-ingress/e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm"
Sep 10 21:13:52.552424 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:52.552366    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6-workload-socket\") pod \"e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm\" (UID: \"2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6\") " pod="openshift-ingress/e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm"
Sep 10 21:13:52.552473 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:52.552436    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6-istiod-ca-cert\") pod \"e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm\" (UID: \"2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6\") " pod="openshift-ingress/e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm"
Sep 10 21:13:52.553970 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:52.553950    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6-istio-envoy\") pod \"e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm\" (UID: \"2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6\") " pod="openshift-ingress/e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm"
Sep 10 21:13:52.554192 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:52.554176    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6-istio-podinfo\") pod \"e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm\" (UID: \"2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6\") " pod="openshift-ingress/e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm"
Sep 10 21:13:52.562639 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:52.562615    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6-istio-token\") pod \"e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm\" (UID: \"2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6\") " pod="openshift-ingress/e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm"
Sep 10 21:13:52.563510 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:52.563490    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfd6k\" (UniqueName: \"kubernetes.io/projected/2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6-kube-api-access-xfd6k\") pod \"e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm\" (UID: \"2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6\") " pod="openshift-ingress/e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm"
Sep 10 21:13:52.652568 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:52.652497    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm"
Sep 10 21:13:52.935061 ip-10-0-129-100 kubenswrapper[2564]: W0910 21:13:52.935031    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a2b71fe_f049_4fc8_8529_9cd56f0dfbe6.slice/crio-dec2c342dc1da7e68f36e68957161cab83404b1ab65f6784e91c06c90779580a WatchSource:0}: Error finding container dec2c342dc1da7e68f36e68957161cab83404b1ab65f6784e91c06c90779580a: Status 404 returned error can't find the container with id dec2c342dc1da7e68f36e68957161cab83404b1ab65f6784e91c06c90779580a
Sep 10 21:13:52.936551 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:52.936528    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm"]
Sep 10 21:13:52.937338 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:52.937306    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 10 21:13:52.937422 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:52.937368    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 10 21:13:52.937422 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:52.937396    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 10 21:13:52.944255 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:52.944207    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm" event={"ID":"2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6","Type":"ContainerStarted","Data":"dec2c342dc1da7e68f36e68957161cab83404b1ab65f6784e91c06c90779580a"}
Sep 10 21:13:53.951670 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:53.951634    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm" event={"ID":"2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6","Type":"ContainerStarted","Data":"5cca5733e9a43f246fd8ae08a5148db515a47748220fc9389f5c27a31e2d4b58"}
Sep 10 21:13:53.974176 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:53.974122    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm" podStartSLOduration=1.974107566 podStartE2EDuration="1.974107566s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:13:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:13:53.971336827 +0000 UTC m=+1014.658404108" watchObservedRunningTime="2026-09-10 21:13:53.974107566 +0000 UTC m=+1014.661174844"
Sep 10 21:13:54.653125 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:54.653089    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm"
Sep 10 21:13:54.657993 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:54.657972    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm"
Sep 10 21:13:54.958081 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:54.957999    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm"
Sep 10 21:13:54.958919 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:54.958898    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm"
Sep 10 21:13:56.825741 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:56.825684    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-c2de43-openshift-default-65fc6484d-qts6j"
Sep 10 21:13:56.892027 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:56.892000    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d-istio-envoy\") pod \"65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d\" (UID: \"65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d\") "
Sep 10 21:13:56.892201 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:56.892036    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-272dn\" (UniqueName: \"kubernetes.io/projected/65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d-kube-api-access-272dn\") pod \"65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d\" (UID: \"65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d\") "
Sep 10 21:13:56.892201 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:56.892071    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d-istio-data\") pod \"65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d\" (UID: \"65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d\") "
Sep 10 21:13:56.892201 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:56.892088    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d-istio-podinfo\") pod \"65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d\" (UID: \"65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d\") "
Sep 10 21:13:56.892201 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:56.892111    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d-workload-socket\") pod \"65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d\" (UID: \"65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d\") "
Sep 10 21:13:56.892201 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:56.892153    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d-workload-certs\") pod \"65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d\" (UID: \"65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d\") "
Sep 10 21:13:56.892201 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:56.892196    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d-credential-socket\") pod \"65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d\" (UID: \"65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d\") "
Sep 10 21:13:56.892585 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:56.892270    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d-istiod-ca-cert\") pod \"65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d\" (UID: \"65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d\") "
Sep 10 21:13:56.892585 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:56.892315    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d-istio-token\") pod \"65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d\" (UID: \"65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d\") "
Sep 10 21:13:56.892585 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:56.892404    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d-istio-data" (OuterVolumeSpecName: "istio-data") pod "65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d" (UID: "65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:13:56.892585 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:56.892491    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d" (UID: "65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:13:56.892797 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:56.892642    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d-istio-data\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:13:56.892797 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:56.892664    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d-workload-socket\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:13:56.892797 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:56.892639    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d" (UID: "65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:13:56.892797 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:56.892716    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d" (UID: "65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:13:56.892797 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:56.892786    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d" (UID: "65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:13:56.894321 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:56.894288    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d-kube-api-access-272dn" (OuterVolumeSpecName: "kube-api-access-272dn") pod "65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d" (UID: "65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d"). InnerVolumeSpecName "kube-api-access-272dn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:13:56.894321 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:56.894294    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d" (UID: "65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:13:56.894642 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:56.894620    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d-istio-token" (OuterVolumeSpecName: "istio-token") pod "65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d" (UID: "65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:13:56.894732 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:56.894637    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d" (UID: "65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 21:13:56.972407 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:56.972348    2564 generic.go:356] "Generic (PLEG): container finished" podID="65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d" containerID="1a13fba55c96e5411e4fa58b30e831b4506d85ba19c7aaee3794c3d9a3e0c862" exitCode=0
Sep 10 21:13:56.972407 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:56.972403    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-c2de43-openshift-default-65fc6484d-qts6j"
Sep 10 21:13:56.972667 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:56.972505    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-c2de43-openshift-default-65fc6484d-qts6j" event={"ID":"65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d","Type":"ContainerDied","Data":"1a13fba55c96e5411e4fa58b30e831b4506d85ba19c7aaee3794c3d9a3e0c862"}
Sep 10 21:13:56.972667 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:56.972566    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-c2de43-openshift-default-65fc6484d-qts6j" event={"ID":"65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d","Type":"ContainerDied","Data":"5e79bd67bd2a3704afa39f52f2c5f5503d94fbf4af020416af47a70a9a25663d"}
Sep 10 21:13:56.972667 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:56.972598    2564 scope.go:117] "RemoveContainer" containerID="1a13fba55c96e5411e4fa58b30e831b4506d85ba19c7aaee3794c3d9a3e0c862"
Sep 10 21:13:56.983808 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:56.983789    2564 scope.go:117] "RemoveContainer" containerID="5de2bf6ac5704f7bb73ddb0a23d15c510894553e37e20f166f58693756012610"
Sep 10 21:13:56.992204 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:56.992185    2564 scope.go:117] "RemoveContainer" containerID="1a13fba55c96e5411e4fa58b30e831b4506d85ba19c7aaee3794c3d9a3e0c862"
Sep 10 21:13:56.992511 ip-10-0-129-100 kubenswrapper[2564]: E0910 21:13:56.992490    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a13fba55c96e5411e4fa58b30e831b4506d85ba19c7aaee3794c3d9a3e0c862\": container with ID starting with 1a13fba55c96e5411e4fa58b30e831b4506d85ba19c7aaee3794c3d9a3e0c862 not found: ID does not exist" containerID="1a13fba55c96e5411e4fa58b30e831b4506d85ba19c7aaee3794c3d9a3e0c862"
Sep 10 21:13:56.992599 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:56.992524    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a13fba55c96e5411e4fa58b30e831b4506d85ba19c7aaee3794c3d9a3e0c862"} err="failed to get container status \"1a13fba55c96e5411e4fa58b30e831b4506d85ba19c7aaee3794c3d9a3e0c862\": rpc error: code = NotFound desc = could not find container \"1a13fba55c96e5411e4fa58b30e831b4506d85ba19c7aaee3794c3d9a3e0c862\": container with ID starting with 1a13fba55c96e5411e4fa58b30e831b4506d85ba19c7aaee3794c3d9a3e0c862 not found: ID does not exist"
Sep 10 21:13:56.992599 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:56.992552    2564 scope.go:117] "RemoveContainer" containerID="5de2bf6ac5704f7bb73ddb0a23d15c510894553e37e20f166f58693756012610"
Sep 10 21:13:56.992821 ip-10-0-129-100 kubenswrapper[2564]: E0910 21:13:56.992800    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5de2bf6ac5704f7bb73ddb0a23d15c510894553e37e20f166f58693756012610\": container with ID starting with 5de2bf6ac5704f7bb73ddb0a23d15c510894553e37e20f166f58693756012610 not found: ID does not exist" containerID="5de2bf6ac5704f7bb73ddb0a23d15c510894553e37e20f166f58693756012610"
Sep 10 21:13:56.992883 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:56.992826    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5de2bf6ac5704f7bb73ddb0a23d15c510894553e37e20f166f58693756012610"} err="failed to get container status \"5de2bf6ac5704f7bb73ddb0a23d15c510894553e37e20f166f58693756012610\": rpc error: code = NotFound desc = could not find container \"5de2bf6ac5704f7bb73ddb0a23d15c510894553e37e20f166f58693756012610\": container with ID starting with 5de2bf6ac5704f7bb73ddb0a23d15c510894553e37e20f166f58693756012610 not found: ID does not exist"
Sep 10 21:13:56.993404 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:56.993382    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d-credential-socket\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:13:56.993528 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:56.993407    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d-istiod-ca-cert\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:13:56.993528 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:56.993423    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d-istio-token\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:13:56.993528 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:56.993434    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d-istio-envoy\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:13:56.993528 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:56.993449    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-272dn\" (UniqueName: \"kubernetes.io/projected/65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d-kube-api-access-272dn\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:13:56.993528 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:56.993460    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d-istio-podinfo\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:13:56.993528 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:56.993473    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d-workload-certs\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:13:56.996870 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:56.996850    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-c2de43-openshift-default-65fc6484d-qts6j"]
Sep 10 21:13:57.000522 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:57.000501    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-autores-c2de43-openshift-default-65fc6484d-qts6j"]
Sep 10 21:13:57.874311 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:57.874278    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d" path="/var/lib/kubelet/pods/65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d/volumes"
Sep 10 21:13:57.953357 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:57.953326    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-65af3d-6789cddf5d-tsg6l"]
Sep 10 21:13:57.953708 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:57.953696    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d" containerName="istio-proxy"
Sep 10 21:13:57.953756 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:57.953710    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d" containerName="istio-proxy"
Sep 10 21:13:57.953756 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:57.953724    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d" containerName="istio-proxy"
Sep 10 21:13:57.953756 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:57.953730    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d" containerName="istio-proxy"
Sep 10 21:13:57.953848 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:57.953788    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d" containerName="istio-proxy"
Sep 10 21:13:57.958100 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:57.958082    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-65af3d-6789cddf5d-tsg6l"
Sep 10 21:13:57.961253 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:57.961218    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-65af3d-689cbdcf9c-tv9rm"]
Sep 10 21:13:57.961634 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:57.961620    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="65d71fdc-0f1f-4934-8b7e-a31bbb20cb3d" containerName="istio-proxy"
Sep 10 21:13:57.964026 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:57.964007    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-65af3d-dockercfg-mz7p4\""
Sep 10 21:13:57.964265 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:57.964221    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-65af3d\""
Sep 10 21:13:57.964714 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:57.964694    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-65af3d-689cbdcf9c-tv9rm"
Sep 10 21:13:57.970892 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:57.970872    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-65af3d-6789cddf5d-tsg6l"]
Sep 10 21:13:57.981883 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:57.981740    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-65af3d-689cbdcf9c-tv9rm"]
Sep 10 21:13:58.002817 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:58.002782    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c92pt\" (UniqueName: \"kubernetes.io/projected/4d77d887-95de-4a6b-9515-a92b0030ad9e-kube-api-access-c92pt\") pod \"payload-pre-processing-e2e-explicit-65af3d-6789cddf5d-tsg6l\" (UID: \"4d77d887-95de-4a6b-9515-a92b0030ad9e\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-65af3d-6789cddf5d-tsg6l"
Sep 10 21:13:58.003102 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:58.002829    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d77d887-95de-4a6b-9515-a92b0030ad9e-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-65af3d-6789cddf5d-tsg6l\" (UID: \"4d77d887-95de-4a6b-9515-a92b0030ad9e\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-65af3d-6789cddf5d-tsg6l"
Sep 10 21:13:58.103920 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:58.103883    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmxq2\" (UniqueName: \"kubernetes.io/projected/e352e2ae-068a-42b9-92e7-4e41b64bfd6c-kube-api-access-xmxq2\") pod \"payload-processing-e2e-explicit-65af3d-689cbdcf9c-tv9rm\" (UID: \"e352e2ae-068a-42b9-92e7-4e41b64bfd6c\") " pod="openshift-ingress/payload-processing-e2e-explicit-65af3d-689cbdcf9c-tv9rm"
Sep 10 21:13:58.104095 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:58.103949    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c92pt\" (UniqueName: \"kubernetes.io/projected/4d77d887-95de-4a6b-9515-a92b0030ad9e-kube-api-access-c92pt\") pod \"payload-pre-processing-e2e-explicit-65af3d-6789cddf5d-tsg6l\" (UID: \"4d77d887-95de-4a6b-9515-a92b0030ad9e\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-65af3d-6789cddf5d-tsg6l"
Sep 10 21:13:58.104095 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:58.103995    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d77d887-95de-4a6b-9515-a92b0030ad9e-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-65af3d-6789cddf5d-tsg6l\" (UID: \"4d77d887-95de-4a6b-9515-a92b0030ad9e\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-65af3d-6789cddf5d-tsg6l"
Sep 10 21:13:58.104095 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:58.104014    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e352e2ae-068a-42b9-92e7-4e41b64bfd6c-plugins-config-volume\") pod \"payload-processing-e2e-explicit-65af3d-689cbdcf9c-tv9rm\" (UID: \"e352e2ae-068a-42b9-92e7-4e41b64bfd6c\") " pod="openshift-ingress/payload-processing-e2e-explicit-65af3d-689cbdcf9c-tv9rm"
Sep 10 21:13:58.104738 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:58.104719    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d77d887-95de-4a6b-9515-a92b0030ad9e-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-65af3d-6789cddf5d-tsg6l\" (UID: \"4d77d887-95de-4a6b-9515-a92b0030ad9e\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-65af3d-6789cddf5d-tsg6l"
Sep 10 21:13:58.119154 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:58.119129    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c92pt\" (UniqueName: \"kubernetes.io/projected/4d77d887-95de-4a6b-9515-a92b0030ad9e-kube-api-access-c92pt\") pod \"payload-pre-processing-e2e-explicit-65af3d-6789cddf5d-tsg6l\" (UID: \"4d77d887-95de-4a6b-9515-a92b0030ad9e\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-65af3d-6789cddf5d-tsg6l"
Sep 10 21:13:58.205604 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:58.205501    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e352e2ae-068a-42b9-92e7-4e41b64bfd6c-plugins-config-volume\") pod \"payload-processing-e2e-explicit-65af3d-689cbdcf9c-tv9rm\" (UID: \"e352e2ae-068a-42b9-92e7-4e41b64bfd6c\") " pod="openshift-ingress/payload-processing-e2e-explicit-65af3d-689cbdcf9c-tv9rm"
Sep 10 21:13:58.205604 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:58.205564    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmxq2\" (UniqueName: \"kubernetes.io/projected/e352e2ae-068a-42b9-92e7-4e41b64bfd6c-kube-api-access-xmxq2\") pod \"payload-processing-e2e-explicit-65af3d-689cbdcf9c-tv9rm\" (UID: \"e352e2ae-068a-42b9-92e7-4e41b64bfd6c\") " pod="openshift-ingress/payload-processing-e2e-explicit-65af3d-689cbdcf9c-tv9rm"
Sep 10 21:13:58.206284 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:58.206258    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e352e2ae-068a-42b9-92e7-4e41b64bfd6c-plugins-config-volume\") pod \"payload-processing-e2e-explicit-65af3d-689cbdcf9c-tv9rm\" (UID: \"e352e2ae-068a-42b9-92e7-4e41b64bfd6c\") " pod="openshift-ingress/payload-processing-e2e-explicit-65af3d-689cbdcf9c-tv9rm"
Sep 10 21:13:58.221441 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:58.221410    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmxq2\" (UniqueName: \"kubernetes.io/projected/e352e2ae-068a-42b9-92e7-4e41b64bfd6c-kube-api-access-xmxq2\") pod \"payload-processing-e2e-explicit-65af3d-689cbdcf9c-tv9rm\" (UID: \"e352e2ae-068a-42b9-92e7-4e41b64bfd6c\") " pod="openshift-ingress/payload-processing-e2e-explicit-65af3d-689cbdcf9c-tv9rm"
Sep 10 21:13:58.269272 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:58.269214    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-65af3d-6789cddf5d-tsg6l"
Sep 10 21:13:58.281450 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:58.281424    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-65af3d-689cbdcf9c-tv9rm"
Sep 10 21:13:58.555250 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:58.555206    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-65af3d-6789cddf5d-tsg6l"]
Sep 10 21:13:58.556919 ip-10-0-129-100 kubenswrapper[2564]: W0910 21:13:58.556894    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d77d887_95de_4a6b_9515_a92b0030ad9e.slice/crio-80c3a9e7bf6f9882079bb1d8fd878738140ad915f74d2ec1f2c07b252df5bd33 WatchSource:0}: Error finding container 80c3a9e7bf6f9882079bb1d8fd878738140ad915f74d2ec1f2c07b252df5bd33: Status 404 returned error can't find the container with id 80c3a9e7bf6f9882079bb1d8fd878738140ad915f74d2ec1f2c07b252df5bd33
Sep 10 21:13:58.577903 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:58.577880    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-65af3d-689cbdcf9c-tv9rm"]
Sep 10 21:13:58.579348 ip-10-0-129-100 kubenswrapper[2564]: W0910 21:13:58.579320    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode352e2ae_068a_42b9_92e7_4e41b64bfd6c.slice/crio-87749b500ff3a099ac23f12a551888aa7d047629ee3a2df2fafe3773d215ce97 WatchSource:0}: Error finding container 87749b500ff3a099ac23f12a551888aa7d047629ee3a2df2fafe3773d215ce97: Status 404 returned error can't find the container with id 87749b500ff3a099ac23f12a551888aa7d047629ee3a2df2fafe3773d215ce97
Sep 10 21:13:59.000889 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:59.000780    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-65af3d-6789cddf5d-tsg6l" event={"ID":"4d77d887-95de-4a6b-9515-a92b0030ad9e","Type":"ContainerStarted","Data":"7e379f13a75165de4f1db17d5790292d1094ddf6b2fb0e1e26a86910839ba99a"}
Sep 10 21:13:59.000889 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:59.000852    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-65af3d-6789cddf5d-tsg6l" event={"ID":"4d77d887-95de-4a6b-9515-a92b0030ad9e","Type":"ContainerStarted","Data":"80c3a9e7bf6f9882079bb1d8fd878738140ad915f74d2ec1f2c07b252df5bd33"}
Sep 10 21:13:59.001399 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:59.000976    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-65af3d-6789cddf5d-tsg6l"
Sep 10 21:13:59.002478 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:59.002453    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-65af3d-689cbdcf9c-tv9rm" event={"ID":"e352e2ae-068a-42b9-92e7-4e41b64bfd6c","Type":"ContainerStarted","Data":"050efeb667bb172e5f349f81156adbd5ccad106b42697bb507dfa875b9bf3f50"}
Sep 10 21:13:59.002604 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:59.002501    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-65af3d-689cbdcf9c-tv9rm" event={"ID":"e352e2ae-068a-42b9-92e7-4e41b64bfd6c","Type":"ContainerStarted","Data":"87749b500ff3a099ac23f12a551888aa7d047629ee3a2df2fafe3773d215ce97"}
Sep 10 21:13:59.002604 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:59.002539    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-explicit-65af3d-689cbdcf9c-tv9rm"
Sep 10 21:13:59.033124 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:59.033067    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-explicit-65af3d-6789cddf5d-tsg6l" podStartSLOduration=2.033047251 podStartE2EDuration="2.033047251s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:13:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:13:59.029906717 +0000 UTC m=+1019.716973998" watchObservedRunningTime="2026-09-10 21:13:59.033047251 +0000 UTC m=+1019.720114535"
Sep 10 21:13:59.066928 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:13:59.066870    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-explicit-65af3d-689cbdcf9c-tv9rm" podStartSLOduration=2.066846371 podStartE2EDuration="2.066846371s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:13:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:13:59.066382318 +0000 UTC m=+1019.753449601" watchObservedRunningTime="2026-09-10 21:13:59.066846371 +0000 UTC m=+1019.753913655"
Sep 10 21:14:10.011432 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:10.011397    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-explicit-65af3d-689cbdcf9c-tv9rm"
Sep 10 21:14:10.011870 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:10.011479    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-65af3d-6789cddf5d-tsg6l"
Sep 10 21:14:17.117935 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:17.117898    2564 generic.go:356] "Generic (PLEG): container finished" podID="2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6" containerID="5cca5733e9a43f246fd8ae08a5148db515a47748220fc9389f5c27a31e2d4b58" exitCode=0
Sep 10 21:14:17.118346 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:17.117969    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm" event={"ID":"2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6","Type":"ContainerDied","Data":"5cca5733e9a43f246fd8ae08a5148db515a47748220fc9389f5c27a31e2d4b58"}
Sep 10 21:14:17.118393 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:17.118376    2564 scope.go:117] "RemoveContainer" containerID="5cca5733e9a43f246fd8ae08a5148db515a47748220fc9389f5c27a31e2d4b58"
Sep 10 21:14:17.119424 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:17.119397    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 10 21:14:17.119492 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:17.119465    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 10 21:14:17.119529 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:17.119520    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 10 21:14:18.125457 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:18.125417    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm" event={"ID":"2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6","Type":"ContainerStarted","Data":"4e1b985e798c5e1013d8630a1e26c34399c699c3e87ce9a3444c08187b01c5f2"}
Sep 10 21:14:18.653626 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:18.653587    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm"
Sep 10 21:14:18.653817 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:18.653759    2564 patch_prober.go:28] interesting pod/e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Sep 10 21:14:18.653897 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:18.653814    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm" podUID="2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Sep 10 21:14:19.652893 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:19.652854    2564 patch_prober.go:28] interesting pod/e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Sep 10 21:14:19.653396 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:19.652913    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm" podUID="2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Sep 10 21:14:20.653167 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:20.653127    2564 patch_prober.go:28] interesting pod/e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Sep 10 21:14:20.653602 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:20.653193    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm" podUID="2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Sep 10 21:14:21.653599 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:21.653557    2564 patch_prober.go:28] interesting pod/e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Sep 10 21:14:21.654027 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:21.653647    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm" podUID="2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Sep 10 21:14:22.653554 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:22.653515    2564 patch_prober.go:28] interesting pod/e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Sep 10 21:14:22.653740 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:22.653587    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm" podUID="2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Sep 10 21:14:23.657436 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:23.657405    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm"
Sep 10 21:14:23.657815 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:23.657677    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm"
Sep 10 21:14:23.658316 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:23.658299    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm"
Sep 10 21:14:36.154403 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:36.154372    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-65af3d-nd8xj"]
Sep 10 21:14:36.158344 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:36.158323    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-65af3d-nd8xj"
Sep 10 21:14:36.162945 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:36.162915    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-m5c7x\""
Sep 10 21:14:36.163189 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:36.163172    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 21:14:36.174605 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:36.174583    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-65af3d-nd8xj"]
Sep 10 21:14:36.246380 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:36.246351    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/81bc76a9-07a6-45b4-b0de-409292fdfc7c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-65af3d-nd8xj\" (UID: \"81bc76a9-07a6-45b4-b0de-409292fdfc7c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-65af3d-nd8xj"
Sep 10 21:14:36.347398 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:36.347360    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/81bc76a9-07a6-45b4-b0de-409292fdfc7c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-65af3d-nd8xj\" (UID: \"81bc76a9-07a6-45b4-b0de-409292fdfc7c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-65af3d-nd8xj"
Sep 10 21:14:36.347973 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:36.347953    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/81bc76a9-07a6-45b4-b0de-409292fdfc7c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-65af3d-nd8xj\" (UID: \"81bc76a9-07a6-45b4-b0de-409292fdfc7c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-65af3d-nd8xj"
Sep 10 21:14:36.469910 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:36.469833    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-65af3d-nd8xj"
Sep 10 21:14:36.743705 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:36.743681    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-65af3d-nd8xj"]
Sep 10 21:14:36.745677 ip-10-0-129-100 kubenswrapper[2564]: W0910 21:14:36.745650    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81bc76a9_07a6_45b4_b0de_409292fdfc7c.slice/crio-6d3c56ab126ac53c27681c93047cabad09f61a436f029f8827473f6c8f42808b WatchSource:0}: Error finding container 6d3c56ab126ac53c27681c93047cabad09f61a436f029f8827473f6c8f42808b: Status 404 returned error can't find the container with id 6d3c56ab126ac53c27681c93047cabad09f61a436f029f8827473f6c8f42808b
Sep 10 21:14:37.236626 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:37.236585    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-65af3d-nd8xj" event={"ID":"81bc76a9-07a6-45b4-b0de-409292fdfc7c","Type":"ContainerStarted","Data":"a85b793f1a1b3823dbc88552085e606662ca95da4e21630efc7f9b09e2a368d3"}
Sep 10 21:14:37.237086 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:37.236639    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-65af3d-nd8xj" event={"ID":"81bc76a9-07a6-45b4-b0de-409292fdfc7c","Type":"ContainerStarted","Data":"6d3c56ab126ac53c27681c93047cabad09f61a436f029f8827473f6c8f42808b"}
Sep 10 21:14:37.271639 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:37.271582    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-65af3d-nd8xj" podStartSLOduration=1.2715638 podStartE2EDuration="1.2715638s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:14:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:14:37.271021891 +0000 UTC m=+1057.958089170" watchObservedRunningTime="2026-09-10 21:14:37.2715638 +0000 UTC m=+1057.958631078"
Sep 10 21:14:38.243509 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:38.243475    2564 generic.go:356] "Generic (PLEG): container finished" podID="81bc76a9-07a6-45b4-b0de-409292fdfc7c" containerID="a85b793f1a1b3823dbc88552085e606662ca95da4e21630efc7f9b09e2a368d3" exitCode=0
Sep 10 21:14:38.243865 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:38.243551    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-65af3d-nd8xj" event={"ID":"81bc76a9-07a6-45b4-b0de-409292fdfc7c","Type":"ContainerDied","Data":"a85b793f1a1b3823dbc88552085e606662ca95da4e21630efc7f9b09e2a368d3"}
Sep 10 21:14:39.384799 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:39.384773    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-65af3d-nd8xj"
Sep 10 21:14:39.476212 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:39.476180    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/81bc76a9-07a6-45b4-b0de-409292fdfc7c-maas-api-service-ca\") pod \"81bc76a9-07a6-45b4-b0de-409292fdfc7c\" (UID: \"81bc76a9-07a6-45b4-b0de-409292fdfc7c\") "
Sep 10 21:14:39.476516 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:39.476495    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81bc76a9-07a6-45b4-b0de-409292fdfc7c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "81bc76a9-07a6-45b4-b0de-409292fdfc7c" (UID: "81bc76a9-07a6-45b4-b0de-409292fdfc7c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:14:39.576860 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:39.576820    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/81bc76a9-07a6-45b4-b0de-409292fdfc7c-maas-api-service-ca\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:14:40.256052 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:40.255972    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-65af3d-nd8xj"
Sep 10 21:14:40.256052 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:40.255987    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-65af3d-nd8xj" event={"ID":"81bc76a9-07a6-45b4-b0de-409292fdfc7c","Type":"ContainerDied","Data":"6d3c56ab126ac53c27681c93047cabad09f61a436f029f8827473f6c8f42808b"}
Sep 10 21:14:40.256052 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:40.256035    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6d3c56ab126ac53c27681c93047cabad09f61a436f029f8827473f6c8f42808b"
Sep 10 21:14:46.935943 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:46.935906    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-04db70-9zw4l"]
Sep 10 21:14:46.936546 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:46.936526    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81bc76a9-07a6-45b4-b0de-409292fdfc7c" containerName="revoke-keys"
Sep 10 21:14:46.936594 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:46.936552    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="81bc76a9-07a6-45b4-b0de-409292fdfc7c" containerName="revoke-keys"
Sep 10 21:14:46.936674 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:46.936660    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="81bc76a9-07a6-45b4-b0de-409292fdfc7c" containerName="revoke-keys"
Sep 10 21:14:46.940095 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:46.940074    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-04db70-9zw4l"
Sep 10 21:14:46.945453 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:46.945427    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 21:14:46.945557 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:46.945456    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-m5c7x\""
Sep 10 21:14:46.962172 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:46.962146    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-04db70-9zw4l"]
Sep 10 21:14:47.043903 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:47.043871    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8104baa5-f8a6-4cd2-a88a-1e0217df141f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-04db70-9zw4l\" (UID: \"8104baa5-f8a6-4cd2-a88a-1e0217df141f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-04db70-9zw4l"
Sep 10 21:14:47.144622 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:47.144585    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8104baa5-f8a6-4cd2-a88a-1e0217df141f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-04db70-9zw4l\" (UID: \"8104baa5-f8a6-4cd2-a88a-1e0217df141f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-04db70-9zw4l"
Sep 10 21:14:47.145168 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:47.145148    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8104baa5-f8a6-4cd2-a88a-1e0217df141f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-04db70-9zw4l\" (UID: \"8104baa5-f8a6-4cd2-a88a-1e0217df141f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-04db70-9zw4l"
Sep 10 21:14:47.252392 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:47.252302    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-04db70-9zw4l"
Sep 10 21:14:47.544233 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:47.544204    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-04db70-9zw4l"]
Sep 10 21:14:47.551046 ip-10-0-129-100 kubenswrapper[2564]: W0910 21:14:47.551015    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8104baa5_f8a6_4cd2_a88a_1e0217df141f.slice/crio-cec00009ec38a94673900a5bf6e270a00f9ae4b4fd46f530ea9261b769521a4c WatchSource:0}: Error finding container cec00009ec38a94673900a5bf6e270a00f9ae4b4fd46f530ea9261b769521a4c: Status 404 returned error can't find the container with id cec00009ec38a94673900a5bf6e270a00f9ae4b4fd46f530ea9261b769521a4c
Sep 10 21:14:48.282965 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:48.282933    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-65af3d-689cbdcf9c-tv9rm"]
Sep 10 21:14:48.283447 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:48.283157    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-explicit-65af3d-689cbdcf9c-tv9rm" podUID="e352e2ae-068a-42b9-92e7-4e41b64bfd6c" containerName="payload-processing" containerID="cri-o://050efeb667bb172e5f349f81156adbd5ccad106b42697bb507dfa875b9bf3f50" gracePeriod=30
Sep 10 21:14:48.288735 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:48.288711    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-65af3d-6789cddf5d-tsg6l"]
Sep 10 21:14:48.289083 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:48.289046    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-explicit-65af3d-6789cddf5d-tsg6l" podUID="4d77d887-95de-4a6b-9515-a92b0030ad9e" containerName="payload-pre-processing" containerID="cri-o://7e379f13a75165de4f1db17d5790292d1094ddf6b2fb0e1e26a86910839ba99a" gracePeriod=30
Sep 10 21:14:48.308451 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:48.308423    2564 generic.go:356] "Generic (PLEG): container finished" podID="8104baa5-f8a6-4cd2-a88a-1e0217df141f" containerID="f08ffa531db7e1469c7839a4e999859d3b4f78ed947a9e93a1a0f37319c4e5be" exitCode=0
Sep 10 21:14:48.308603 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:48.308510    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-04db70-9zw4l" event={"ID":"8104baa5-f8a6-4cd2-a88a-1e0217df141f","Type":"ContainerDied","Data":"f08ffa531db7e1469c7839a4e999859d3b4f78ed947a9e93a1a0f37319c4e5be"}
Sep 10 21:14:48.308603 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:48.308571    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-04db70-9zw4l" event={"ID":"8104baa5-f8a6-4cd2-a88a-1e0217df141f","Type":"ContainerStarted","Data":"cec00009ec38a94673900a5bf6e270a00f9ae4b4fd46f530ea9261b769521a4c"}
Sep 10 21:14:48.481415 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:48.481365    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-65af3d-nd8xj"]
Sep 10 21:14:48.486339 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:48.486310    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-65af3d-nd8xj"]
Sep 10 21:14:48.537495 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:48.537472    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-65af3d-689cbdcf9c-tv9rm"
Sep 10 21:14:48.570334 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:48.570307    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-65af3d-6789cddf5d-tsg6l"
Sep 10 21:14:48.658596 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:48.658562    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c92pt\" (UniqueName: \"kubernetes.io/projected/4d77d887-95de-4a6b-9515-a92b0030ad9e-kube-api-access-c92pt\") pod \"4d77d887-95de-4a6b-9515-a92b0030ad9e\" (UID: \"4d77d887-95de-4a6b-9515-a92b0030ad9e\") "
Sep 10 21:14:48.658785 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:48.658607    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e352e2ae-068a-42b9-92e7-4e41b64bfd6c-plugins-config-volume\") pod \"e352e2ae-068a-42b9-92e7-4e41b64bfd6c\" (UID: \"e352e2ae-068a-42b9-92e7-4e41b64bfd6c\") "
Sep 10 21:14:48.658785 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:48.658643    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xmxq2\" (UniqueName: \"kubernetes.io/projected/e352e2ae-068a-42b9-92e7-4e41b64bfd6c-kube-api-access-xmxq2\") pod \"e352e2ae-068a-42b9-92e7-4e41b64bfd6c\" (UID: \"e352e2ae-068a-42b9-92e7-4e41b64bfd6c\") "
Sep 10 21:14:48.658785 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:48.658665    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d77d887-95de-4a6b-9515-a92b0030ad9e-plugins-config-volume\") pod \"4d77d887-95de-4a6b-9515-a92b0030ad9e\" (UID: \"4d77d887-95de-4a6b-9515-a92b0030ad9e\") "
Sep 10 21:14:48.659072 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:48.659047    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d77d887-95de-4a6b-9515-a92b0030ad9e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4d77d887-95de-4a6b-9515-a92b0030ad9e" (UID: "4d77d887-95de-4a6b-9515-a92b0030ad9e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:14:48.659134 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:48.659051    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e352e2ae-068a-42b9-92e7-4e41b64bfd6c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e352e2ae-068a-42b9-92e7-4e41b64bfd6c" (UID: "e352e2ae-068a-42b9-92e7-4e41b64bfd6c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:14:48.660663 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:48.660634    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d77d887-95de-4a6b-9515-a92b0030ad9e-kube-api-access-c92pt" (OuterVolumeSpecName: "kube-api-access-c92pt") pod "4d77d887-95de-4a6b-9515-a92b0030ad9e" (UID: "4d77d887-95de-4a6b-9515-a92b0030ad9e"). InnerVolumeSpecName "kube-api-access-c92pt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:14:48.660760 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:48.660685    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e352e2ae-068a-42b9-92e7-4e41b64bfd6c-kube-api-access-xmxq2" (OuterVolumeSpecName: "kube-api-access-xmxq2") pod "e352e2ae-068a-42b9-92e7-4e41b64bfd6c" (UID: "e352e2ae-068a-42b9-92e7-4e41b64bfd6c"). InnerVolumeSpecName "kube-api-access-xmxq2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:14:48.759458 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:48.759421    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c92pt\" (UniqueName: \"kubernetes.io/projected/4d77d887-95de-4a6b-9515-a92b0030ad9e-kube-api-access-c92pt\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:14:48.759458 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:48.759452    2564 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e352e2ae-068a-42b9-92e7-4e41b64bfd6c-plugins-config-volume\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:14:48.759458 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:48.759463    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xmxq2\" (UniqueName: \"kubernetes.io/projected/e352e2ae-068a-42b9-92e7-4e41b64bfd6c-kube-api-access-xmxq2\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:14:48.759659 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:48.759472    2564 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d77d887-95de-4a6b-9515-a92b0030ad9e-plugins-config-volume\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:14:49.315342 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:49.315307    2564 generic.go:356] "Generic (PLEG): container finished" podID="4d77d887-95de-4a6b-9515-a92b0030ad9e" containerID="7e379f13a75165de4f1db17d5790292d1094ddf6b2fb0e1e26a86910839ba99a" exitCode=0
Sep 10 21:14:49.315748 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:49.315362    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-65af3d-6789cddf5d-tsg6l"
Sep 10 21:14:49.315748 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:49.315398    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-65af3d-6789cddf5d-tsg6l" event={"ID":"4d77d887-95de-4a6b-9515-a92b0030ad9e","Type":"ContainerDied","Data":"7e379f13a75165de4f1db17d5790292d1094ddf6b2fb0e1e26a86910839ba99a"}
Sep 10 21:14:49.315748 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:49.315459    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-65af3d-6789cddf5d-tsg6l" event={"ID":"4d77d887-95de-4a6b-9515-a92b0030ad9e","Type":"ContainerDied","Data":"80c3a9e7bf6f9882079bb1d8fd878738140ad915f74d2ec1f2c07b252df5bd33"}
Sep 10 21:14:49.315748 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:49.315489    2564 scope.go:117] "RemoveContainer" containerID="7e379f13a75165de4f1db17d5790292d1094ddf6b2fb0e1e26a86910839ba99a"
Sep 10 21:14:49.316846 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:49.316796    2564 generic.go:356] "Generic (PLEG): container finished" podID="e352e2ae-068a-42b9-92e7-4e41b64bfd6c" containerID="050efeb667bb172e5f349f81156adbd5ccad106b42697bb507dfa875b9bf3f50" exitCode=0
Sep 10 21:14:49.316846 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:49.316812    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-65af3d-689cbdcf9c-tv9rm"
Sep 10 21:14:49.316953 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:49.316854    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-65af3d-689cbdcf9c-tv9rm" event={"ID":"e352e2ae-068a-42b9-92e7-4e41b64bfd6c","Type":"ContainerDied","Data":"050efeb667bb172e5f349f81156adbd5ccad106b42697bb507dfa875b9bf3f50"}
Sep 10 21:14:49.316953 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:49.316918    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-65af3d-689cbdcf9c-tv9rm" event={"ID":"e352e2ae-068a-42b9-92e7-4e41b64bfd6c","Type":"ContainerDied","Data":"87749b500ff3a099ac23f12a551888aa7d047629ee3a2df2fafe3773d215ce97"}
Sep 10 21:14:49.335296 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:49.335208    2564 scope.go:117] "RemoveContainer" containerID="7e379f13a75165de4f1db17d5790292d1094ddf6b2fb0e1e26a86910839ba99a"
Sep 10 21:14:49.335608 ip-10-0-129-100 kubenswrapper[2564]: E0910 21:14:49.335584    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e379f13a75165de4f1db17d5790292d1094ddf6b2fb0e1e26a86910839ba99a\": container with ID starting with 7e379f13a75165de4f1db17d5790292d1094ddf6b2fb0e1e26a86910839ba99a not found: ID does not exist" containerID="7e379f13a75165de4f1db17d5790292d1094ddf6b2fb0e1e26a86910839ba99a"
Sep 10 21:14:49.335698 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:49.335617    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e379f13a75165de4f1db17d5790292d1094ddf6b2fb0e1e26a86910839ba99a"} err="failed to get container status \"7e379f13a75165de4f1db17d5790292d1094ddf6b2fb0e1e26a86910839ba99a\": rpc error: code = NotFound desc = could not find container \"7e379f13a75165de4f1db17d5790292d1094ddf6b2fb0e1e26a86910839ba99a\": container with ID starting with 7e379f13a75165de4f1db17d5790292d1094ddf6b2fb0e1e26a86910839ba99a not found: ID does not exist"
Sep 10 21:14:49.335698 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:49.335639    2564 scope.go:117] "RemoveContainer" containerID="050efeb667bb172e5f349f81156adbd5ccad106b42697bb507dfa875b9bf3f50"
Sep 10 21:14:49.345154 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:49.345130    2564 scope.go:117] "RemoveContainer" containerID="050efeb667bb172e5f349f81156adbd5ccad106b42697bb507dfa875b9bf3f50"
Sep 10 21:14:49.345318 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:49.345298    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-65af3d-6789cddf5d-tsg6l"]
Sep 10 21:14:49.345509 ip-10-0-129-100 kubenswrapper[2564]: E0910 21:14:49.345491    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"050efeb667bb172e5f349f81156adbd5ccad106b42697bb507dfa875b9bf3f50\": container with ID starting with 050efeb667bb172e5f349f81156adbd5ccad106b42697bb507dfa875b9bf3f50 not found: ID does not exist" containerID="050efeb667bb172e5f349f81156adbd5ccad106b42697bb507dfa875b9bf3f50"
Sep 10 21:14:49.345565 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:49.345521    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"050efeb667bb172e5f349f81156adbd5ccad106b42697bb507dfa875b9bf3f50"} err="failed to get container status \"050efeb667bb172e5f349f81156adbd5ccad106b42697bb507dfa875b9bf3f50\": rpc error: code = NotFound desc = could not find container \"050efeb667bb172e5f349f81156adbd5ccad106b42697bb507dfa875b9bf3f50\": container with ID starting with 050efeb667bb172e5f349f81156adbd5ccad106b42697bb507dfa875b9bf3f50 not found: ID does not exist"
Sep 10 21:14:49.352265 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:49.352201    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-65af3d-6789cddf5d-tsg6l"]
Sep 10 21:14:49.369942 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:49.369910    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-65af3d-689cbdcf9c-tv9rm"]
Sep 10 21:14:49.376185 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:49.376150    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-65af3d-689cbdcf9c-tv9rm"]
Sep 10 21:14:49.459963 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:49.459939    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-04db70-9zw4l"
Sep 10 21:14:49.567836 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:49.567796    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8104baa5-f8a6-4cd2-a88a-1e0217df141f-maas-api-service-ca\") pod \"8104baa5-f8a6-4cd2-a88a-1e0217df141f\" (UID: \"8104baa5-f8a6-4cd2-a88a-1e0217df141f\") "
Sep 10 21:14:49.568279 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:49.568251    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8104baa5-f8a6-4cd2-a88a-1e0217df141f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8104baa5-f8a6-4cd2-a88a-1e0217df141f" (UID: "8104baa5-f8a6-4cd2-a88a-1e0217df141f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:14:49.669081 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:49.669038    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8104baa5-f8a6-4cd2-a88a-1e0217df141f-maas-api-service-ca\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:14:49.873894 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:49.873811    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d77d887-95de-4a6b-9515-a92b0030ad9e" path="/var/lib/kubelet/pods/4d77d887-95de-4a6b-9515-a92b0030ad9e/volumes"
Sep 10 21:14:49.874313 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:49.874293    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81bc76a9-07a6-45b4-b0de-409292fdfc7c" path="/var/lib/kubelet/pods/81bc76a9-07a6-45b4-b0de-409292fdfc7c/volumes"
Sep 10 21:14:49.874771 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:49.874753    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e352e2ae-068a-42b9-92e7-4e41b64bfd6c" path="/var/lib/kubelet/pods/e352e2ae-068a-42b9-92e7-4e41b64bfd6c/volumes"
Sep 10 21:14:50.324406 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:50.324374    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-04db70-9zw4l"
Sep 10 21:14:50.324406 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:50.324388    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-04db70-9zw4l" event={"ID":"8104baa5-f8a6-4cd2-a88a-1e0217df141f","Type":"ContainerDied","Data":"cec00009ec38a94673900a5bf6e270a00f9ae4b4fd46f530ea9261b769521a4c"}
Sep 10 21:14:50.324894 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:50.324446    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cec00009ec38a94673900a5bf6e270a00f9ae4b4fd46f530ea9261b769521a4c"
Sep 10 21:14:55.318574 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:55.318486    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm"]
Sep 10 21:14:55.319040 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:55.318756    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm" podUID="2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6" containerName="istio-proxy" containerID="cri-o://4e1b985e798c5e1013d8630a1e26c34399c699c3e87ce9a3444c08187b01c5f2" gracePeriod=30
Sep 10 21:14:56.035403 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:56.035368    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-6324ec-openshift-default-ccd7b8754-mmhmn"]
Sep 10 21:14:56.035721 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:56.035709    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d77d887-95de-4a6b-9515-a92b0030ad9e" containerName="payload-pre-processing"
Sep 10 21:14:56.035772 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:56.035722    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d77d887-95de-4a6b-9515-a92b0030ad9e" containerName="payload-pre-processing"
Sep 10 21:14:56.035772 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:56.035730    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8104baa5-f8a6-4cd2-a88a-1e0217df141f" containerName="revoke-keys"
Sep 10 21:14:56.035772 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:56.035737    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8104baa5-f8a6-4cd2-a88a-1e0217df141f" containerName="revoke-keys"
Sep 10 21:14:56.035772 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:56.035762    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e352e2ae-068a-42b9-92e7-4e41b64bfd6c" containerName="payload-processing"
Sep 10 21:14:56.035772 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:56.035768    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e352e2ae-068a-42b9-92e7-4e41b64bfd6c" containerName="payload-processing"
Sep 10 21:14:56.035926 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:56.035820    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="8104baa5-f8a6-4cd2-a88a-1e0217df141f" containerName="revoke-keys"
Sep 10 21:14:56.035926 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:56.035829    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d77d887-95de-4a6b-9515-a92b0030ad9e" containerName="payload-pre-processing"
Sep 10 21:14:56.035926 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:56.035837    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e352e2ae-068a-42b9-92e7-4e41b64bfd6c" containerName="payload-processing"
Sep 10 21:14:56.040249 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:56.040210    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-6324ec-openshift-default-ccd7b8754-mmhmn"
Sep 10 21:14:56.043909 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:56.043882    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-6324ec-openshift-default-dockercfg-hfzbh\""
Sep 10 21:14:56.054917 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:56.054893    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-6324ec-openshift-default-ccd7b8754-mmhmn"]
Sep 10 21:14:56.126216 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:56.126185    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91aae7b6-0929-4a4d-a75b-34574e25b3f3-istio-token\") pod \"e2e-noten-6324ec-openshift-default-ccd7b8754-mmhmn\" (UID: \"91aae7b6-0929-4a4d-a75b-34574e25b3f3\") " pod="openshift-ingress/e2e-noten-6324ec-openshift-default-ccd7b8754-mmhmn"
Sep 10 21:14:56.126368 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:56.126285    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/91aae7b6-0929-4a4d-a75b-34574e25b3f3-istiod-ca-cert\") pod \"e2e-noten-6324ec-openshift-default-ccd7b8754-mmhmn\" (UID: \"91aae7b6-0929-4a4d-a75b-34574e25b3f3\") " pod="openshift-ingress/e2e-noten-6324ec-openshift-default-ccd7b8754-mmhmn"
Sep 10 21:14:56.126368 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:56.126355    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/91aae7b6-0929-4a4d-a75b-34574e25b3f3-workload-certs\") pod \"e2e-noten-6324ec-openshift-default-ccd7b8754-mmhmn\" (UID: \"91aae7b6-0929-4a4d-a75b-34574e25b3f3\") " pod="openshift-ingress/e2e-noten-6324ec-openshift-default-ccd7b8754-mmhmn"
Sep 10 21:14:56.126455 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:56.126374    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/91aae7b6-0929-4a4d-a75b-34574e25b3f3-istio-envoy\") pod \"e2e-noten-6324ec-openshift-default-ccd7b8754-mmhmn\" (UID: \"91aae7b6-0929-4a4d-a75b-34574e25b3f3\") " pod="openshift-ingress/e2e-noten-6324ec-openshift-default-ccd7b8754-mmhmn"
Sep 10 21:14:56.126455 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:56.126397    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/91aae7b6-0929-4a4d-a75b-34574e25b3f3-istio-data\") pod \"e2e-noten-6324ec-openshift-default-ccd7b8754-mmhmn\" (UID: \"91aae7b6-0929-4a4d-a75b-34574e25b3f3\") " pod="openshift-ingress/e2e-noten-6324ec-openshift-default-ccd7b8754-mmhmn"
Sep 10 21:14:56.126542 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:56.126472    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/91aae7b6-0929-4a4d-a75b-34574e25b3f3-credential-socket\") pod \"e2e-noten-6324ec-openshift-default-ccd7b8754-mmhmn\" (UID: \"91aae7b6-0929-4a4d-a75b-34574e25b3f3\") " pod="openshift-ingress/e2e-noten-6324ec-openshift-default-ccd7b8754-mmhmn"
Sep 10 21:14:56.126542 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:56.126506    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/91aae7b6-0929-4a4d-a75b-34574e25b3f3-istio-podinfo\") pod \"e2e-noten-6324ec-openshift-default-ccd7b8754-mmhmn\" (UID: \"91aae7b6-0929-4a4d-a75b-34574e25b3f3\") " pod="openshift-ingress/e2e-noten-6324ec-openshift-default-ccd7b8754-mmhmn"
Sep 10 21:14:56.126542 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:56.126523    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9hh6\" (UniqueName: \"kubernetes.io/projected/91aae7b6-0929-4a4d-a75b-34574e25b3f3-kube-api-access-s9hh6\") pod \"e2e-noten-6324ec-openshift-default-ccd7b8754-mmhmn\" (UID: \"91aae7b6-0929-4a4d-a75b-34574e25b3f3\") " pod="openshift-ingress/e2e-noten-6324ec-openshift-default-ccd7b8754-mmhmn"
Sep 10 21:14:56.126653 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:56.126552    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/91aae7b6-0929-4a4d-a75b-34574e25b3f3-workload-socket\") pod \"e2e-noten-6324ec-openshift-default-ccd7b8754-mmhmn\" (UID: \"91aae7b6-0929-4a4d-a75b-34574e25b3f3\") " pod="openshift-ingress/e2e-noten-6324ec-openshift-default-ccd7b8754-mmhmn"
Sep 10 21:14:56.227828 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:56.227791    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91aae7b6-0929-4a4d-a75b-34574e25b3f3-istio-token\") pod \"e2e-noten-6324ec-openshift-default-ccd7b8754-mmhmn\" (UID: \"91aae7b6-0929-4a4d-a75b-34574e25b3f3\") " pod="openshift-ingress/e2e-noten-6324ec-openshift-default-ccd7b8754-mmhmn"
Sep 10 21:14:56.228014 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:56.227862    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/91aae7b6-0929-4a4d-a75b-34574e25b3f3-istiod-ca-cert\") pod \"e2e-noten-6324ec-openshift-default-ccd7b8754-mmhmn\" (UID: \"91aae7b6-0929-4a4d-a75b-34574e25b3f3\") " pod="openshift-ingress/e2e-noten-6324ec-openshift-default-ccd7b8754-mmhmn"
Sep 10 21:14:56.228014 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:56.227942    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/91aae7b6-0929-4a4d-a75b-34574e25b3f3-workload-certs\") pod \"e2e-noten-6324ec-openshift-default-ccd7b8754-mmhmn\" (UID: \"91aae7b6-0929-4a4d-a75b-34574e25b3f3\") " pod="openshift-ingress/e2e-noten-6324ec-openshift-default-ccd7b8754-mmhmn"
Sep 10 21:14:56.228014 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:56.227970    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/91aae7b6-0929-4a4d-a75b-34574e25b3f3-istio-envoy\") pod \"e2e-noten-6324ec-openshift-default-ccd7b8754-mmhmn\" (UID: \"91aae7b6-0929-4a4d-a75b-34574e25b3f3\") " pod="openshift-ingress/e2e-noten-6324ec-openshift-default-ccd7b8754-mmhmn"
Sep 10 21:14:56.228014 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:56.228008    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/91aae7b6-0929-4a4d-a75b-34574e25b3f3-istio-data\") pod \"e2e-noten-6324ec-openshift-default-ccd7b8754-mmhmn\" (UID: \"91aae7b6-0929-4a4d-a75b-34574e25b3f3\") " pod="openshift-ingress/e2e-noten-6324ec-openshift-default-ccd7b8754-mmhmn"
Sep 10 21:14:56.228269 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:56.228189    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/91aae7b6-0929-4a4d-a75b-34574e25b3f3-credential-socket\") pod \"e2e-noten-6324ec-openshift-default-ccd7b8754-mmhmn\" (UID: \"91aae7b6-0929-4a4d-a75b-34574e25b3f3\") " pod="openshift-ingress/e2e-noten-6324ec-openshift-default-ccd7b8754-mmhmn"
Sep 10 21:14:56.228341 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:56.228269    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/91aae7b6-0929-4a4d-a75b-34574e25b3f3-istio-podinfo\") pod \"e2e-noten-6324ec-openshift-default-ccd7b8754-mmhmn\" (UID: \"91aae7b6-0929-4a4d-a75b-34574e25b3f3\") " pod="openshift-ingress/e2e-noten-6324ec-openshift-default-ccd7b8754-mmhmn"
Sep 10 21:14:56.228341 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:56.228298    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9hh6\" (UniqueName: \"kubernetes.io/projected/91aae7b6-0929-4a4d-a75b-34574e25b3f3-kube-api-access-s9hh6\") pod \"e2e-noten-6324ec-openshift-default-ccd7b8754-mmhmn\" (UID: \"91aae7b6-0929-4a4d-a75b-34574e25b3f3\") " pod="openshift-ingress/e2e-noten-6324ec-openshift-default-ccd7b8754-mmhmn"
Sep 10 21:14:56.228453 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:56.228347    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/91aae7b6-0929-4a4d-a75b-34574e25b3f3-workload-socket\") pod \"e2e-noten-6324ec-openshift-default-ccd7b8754-mmhmn\" (UID: \"91aae7b6-0929-4a4d-a75b-34574e25b3f3\") " pod="openshift-ingress/e2e-noten-6324ec-openshift-default-ccd7b8754-mmhmn"
Sep 10 21:14:56.228453 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:56.228407    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/91aae7b6-0929-4a4d-a75b-34574e25b3f3-workload-certs\") pod \"e2e-noten-6324ec-openshift-default-ccd7b8754-mmhmn\" (UID: \"91aae7b6-0929-4a4d-a75b-34574e25b3f3\") " pod="openshift-ingress/e2e-noten-6324ec-openshift-default-ccd7b8754-mmhmn"
Sep 10 21:14:56.228717 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:56.228691    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/91aae7b6-0929-4a4d-a75b-34574e25b3f3-istiod-ca-cert\") pod \"e2e-noten-6324ec-openshift-default-ccd7b8754-mmhmn\" (UID: \"91aae7b6-0929-4a4d-a75b-34574e25b3f3\") " pod="openshift-ingress/e2e-noten-6324ec-openshift-default-ccd7b8754-mmhmn"
Sep 10 21:14:56.228803 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:56.228782    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/91aae7b6-0929-4a4d-a75b-34574e25b3f3-istio-data\") pod \"e2e-noten-6324ec-openshift-default-ccd7b8754-mmhmn\" (UID: \"91aae7b6-0929-4a4d-a75b-34574e25b3f3\") " pod="openshift-ingress/e2e-noten-6324ec-openshift-default-ccd7b8754-mmhmn"
Sep 10 21:14:56.228913 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:56.228897    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/91aae7b6-0929-4a4d-a75b-34574e25b3f3-workload-socket\") pod \"e2e-noten-6324ec-openshift-default-ccd7b8754-mmhmn\" (UID: \"91aae7b6-0929-4a4d-a75b-34574e25b3f3\") " pod="openshift-ingress/e2e-noten-6324ec-openshift-default-ccd7b8754-mmhmn"
Sep 10 21:14:56.228999 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:56.228977    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/91aae7b6-0929-4a4d-a75b-34574e25b3f3-credential-socket\") pod \"e2e-noten-6324ec-openshift-default-ccd7b8754-mmhmn\" (UID: \"91aae7b6-0929-4a4d-a75b-34574e25b3f3\") " pod="openshift-ingress/e2e-noten-6324ec-openshift-default-ccd7b8754-mmhmn"
Sep 10 21:14:56.230441 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:56.230419    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/91aae7b6-0929-4a4d-a75b-34574e25b3f3-istio-envoy\") pod \"e2e-noten-6324ec-openshift-default-ccd7b8754-mmhmn\" (UID: \"91aae7b6-0929-4a4d-a75b-34574e25b3f3\") " pod="openshift-ingress/e2e-noten-6324ec-openshift-default-ccd7b8754-mmhmn"
Sep 10 21:14:56.230880 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:56.230859    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/91aae7b6-0929-4a4d-a75b-34574e25b3f3-istio-podinfo\") pod \"e2e-noten-6324ec-openshift-default-ccd7b8754-mmhmn\" (UID: \"91aae7b6-0929-4a4d-a75b-34574e25b3f3\") " pod="openshift-ingress/e2e-noten-6324ec-openshift-default-ccd7b8754-mmhmn"
Sep 10 21:14:56.235980 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:56.235955    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9hh6\" (UniqueName: \"kubernetes.io/projected/91aae7b6-0929-4a4d-a75b-34574e25b3f3-kube-api-access-s9hh6\") pod \"e2e-noten-6324ec-openshift-default-ccd7b8754-mmhmn\" (UID: \"91aae7b6-0929-4a4d-a75b-34574e25b3f3\") " pod="openshift-ingress/e2e-noten-6324ec-openshift-default-ccd7b8754-mmhmn"
Sep 10 21:14:56.236106 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:56.236085    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91aae7b6-0929-4a4d-a75b-34574e25b3f3-istio-token\") pod \"e2e-noten-6324ec-openshift-default-ccd7b8754-mmhmn\" (UID: \"91aae7b6-0929-4a4d-a75b-34574e25b3f3\") " pod="openshift-ingress/e2e-noten-6324ec-openshift-default-ccd7b8754-mmhmn"
Sep 10 21:14:56.350807 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:56.350780    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-6324ec-openshift-default-ccd7b8754-mmhmn"
Sep 10 21:14:56.633279 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:56.633247    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-6324ec-openshift-default-ccd7b8754-mmhmn"]
Sep 10 21:14:56.634381 ip-10-0-129-100 kubenswrapper[2564]: W0910 21:14:56.634354    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91aae7b6_0929_4a4d_a75b_34574e25b3f3.slice/crio-6b6f184954c78b86f4e51bbc451a3e5e09febc14171f47961182b482861f5638 WatchSource:0}: Error finding container 6b6f184954c78b86f4e51bbc451a3e5e09febc14171f47961182b482861f5638: Status 404 returned error can't find the container with id 6b6f184954c78b86f4e51bbc451a3e5e09febc14171f47961182b482861f5638
Sep 10 21:14:56.636568 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:56.636535    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 10 21:14:56.636644 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:56.636606    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 10 21:14:56.636644 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:56.636634    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 10 21:14:57.369966 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:57.369924    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-6324ec-openshift-default-ccd7b8754-mmhmn" event={"ID":"91aae7b6-0929-4a4d-a75b-34574e25b3f3","Type":"ContainerStarted","Data":"e14ce26cabd8bddf81f92f6fa2d3bb39f2274b71c477948933974e5afc1d7b70"}
Sep 10 21:14:57.370393 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:57.369992    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-6324ec-openshift-default-ccd7b8754-mmhmn" event={"ID":"91aae7b6-0929-4a4d-a75b-34574e25b3f3","Type":"ContainerStarted","Data":"6b6f184954c78b86f4e51bbc451a3e5e09febc14171f47961182b482861f5638"}
Sep 10 21:14:57.411130 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:57.411082    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-6324ec-openshift-default-ccd7b8754-mmhmn" podStartSLOduration=1.411065522 podStartE2EDuration="1.411065522s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:14:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:14:57.408756769 +0000 UTC m=+1078.095824049" watchObservedRunningTime="2026-09-10 21:14:57.411065522 +0000 UTC m=+1078.098132801"
Sep 10 21:14:57.839684 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:57.839649    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-04db70-6797ddc6d6-lsr7z"]
Sep 10 21:14:57.839934 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:57.839903    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-04db70-6797ddc6d6-lsr7z" podUID="9f4a09a7-a0c5-4e2b-bbc5-d6d29131b16f" containerName="payload-pre-processing" containerID="cri-o://5c070c96b8309da4557f7571e3edb231e92d2e5dbe9ad3005122c17fa7a2e6c5" gracePeriod=30
Sep 10 21:14:58.115465 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:58.115438    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-04db70-6797ddc6d6-lsr7z"
Sep 10 21:14:58.245111 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:58.245074    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-whwmm\" (UniqueName: \"kubernetes.io/projected/9f4a09a7-a0c5-4e2b-bbc5-d6d29131b16f-kube-api-access-whwmm\") pod \"9f4a09a7-a0c5-4e2b-bbc5-d6d29131b16f\" (UID: \"9f4a09a7-a0c5-4e2b-bbc5-d6d29131b16f\") "
Sep 10 21:14:58.245305 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:58.245128    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f4a09a7-a0c5-4e2b-bbc5-d6d29131b16f-plugins-config-volume\") pod \"9f4a09a7-a0c5-4e2b-bbc5-d6d29131b16f\" (UID: \"9f4a09a7-a0c5-4e2b-bbc5-d6d29131b16f\") "
Sep 10 21:14:58.245567 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:58.245538    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f4a09a7-a0c5-4e2b-bbc5-d6d29131b16f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9f4a09a7-a0c5-4e2b-bbc5-d6d29131b16f" (UID: "9f4a09a7-a0c5-4e2b-bbc5-d6d29131b16f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:14:58.247192 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:58.247161    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f4a09a7-a0c5-4e2b-bbc5-d6d29131b16f-kube-api-access-whwmm" (OuterVolumeSpecName: "kube-api-access-whwmm") pod "9f4a09a7-a0c5-4e2b-bbc5-d6d29131b16f" (UID: "9f4a09a7-a0c5-4e2b-bbc5-d6d29131b16f"). InnerVolumeSpecName "kube-api-access-whwmm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:14:58.340873 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:58.340815    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-04db70-9zw4l"]
Sep 10 21:14:58.344764 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:58.344703    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-04db70-9zw4l"]
Sep 10 21:14:58.346674 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:58.346654    2564 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f4a09a7-a0c5-4e2b-bbc5-d6d29131b16f-plugins-config-volume\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:14:58.346727 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:58.346677    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-whwmm\" (UniqueName: \"kubernetes.io/projected/9f4a09a7-a0c5-4e2b-bbc5-d6d29131b16f-kube-api-access-whwmm\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:14:58.351561 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:58.351536    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-6324ec-openshift-default-ccd7b8754-mmhmn"
Sep 10 21:14:58.356422 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:58.356400    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-6324ec-openshift-default-ccd7b8754-mmhmn"
Sep 10 21:14:58.378736 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:58.378694    2564 generic.go:356] "Generic (PLEG): container finished" podID="9f4a09a7-a0c5-4e2b-bbc5-d6d29131b16f" containerID="5c070c96b8309da4557f7571e3edb231e92d2e5dbe9ad3005122c17fa7a2e6c5" exitCode=0
Sep 10 21:14:58.379909 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:58.379887    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-04db70-6797ddc6d6-lsr7z"
Sep 10 21:14:58.380456 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:58.380424    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-04db70-6797ddc6d6-lsr7z" event={"ID":"9f4a09a7-a0c5-4e2b-bbc5-d6d29131b16f","Type":"ContainerDied","Data":"5c070c96b8309da4557f7571e3edb231e92d2e5dbe9ad3005122c17fa7a2e6c5"}
Sep 10 21:14:58.380577 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:58.380488    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-04db70-6797ddc6d6-lsr7z" event={"ID":"9f4a09a7-a0c5-4e2b-bbc5-d6d29131b16f","Type":"ContainerDied","Data":"5a83f6ca1194f6015753657bd1262ed981eae8c62bd480afa71b5681def55cdd"}
Sep 10 21:14:58.380577 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:58.380521    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-6324ec-openshift-default-ccd7b8754-mmhmn"
Sep 10 21:14:58.380577 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:58.380542    2564 scope.go:117] "RemoveContainer" containerID="5c070c96b8309da4557f7571e3edb231e92d2e5dbe9ad3005122c17fa7a2e6c5"
Sep 10 21:14:58.381790 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:58.381770    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-6324ec-openshift-default-ccd7b8754-mmhmn"
Sep 10 21:14:58.392800 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:58.392770    2564 scope.go:117] "RemoveContainer" containerID="5c070c96b8309da4557f7571e3edb231e92d2e5dbe9ad3005122c17fa7a2e6c5"
Sep 10 21:14:58.393198 ip-10-0-129-100 kubenswrapper[2564]: E0910 21:14:58.393169    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c070c96b8309da4557f7571e3edb231e92d2e5dbe9ad3005122c17fa7a2e6c5\": container with ID starting with 5c070c96b8309da4557f7571e3edb231e92d2e5dbe9ad3005122c17fa7a2e6c5 not found: ID does not exist" containerID="5c070c96b8309da4557f7571e3edb231e92d2e5dbe9ad3005122c17fa7a2e6c5"
Sep 10 21:14:58.393332 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:58.393216    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c070c96b8309da4557f7571e3edb231e92d2e5dbe9ad3005122c17fa7a2e6c5"} err="failed to get container status \"5c070c96b8309da4557f7571e3edb231e92d2e5dbe9ad3005122c17fa7a2e6c5\": rpc error: code = NotFound desc = could not find container \"5c070c96b8309da4557f7571e3edb231e92d2e5dbe9ad3005122c17fa7a2e6c5\": container with ID starting with 5c070c96b8309da4557f7571e3edb231e92d2e5dbe9ad3005122c17fa7a2e6c5 not found: ID does not exist"
Sep 10 21:14:58.434126 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:58.434089    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-04db70-6797ddc6d6-lsr7z"]
Sep 10 21:14:58.443831 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:58.443803    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-04db70-6797ddc6d6-lsr7z"]
Sep 10 21:14:59.872392 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:59.872365    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8104baa5-f8a6-4cd2-a88a-1e0217df141f" path="/var/lib/kubelet/pods/8104baa5-f8a6-4cd2-a88a-1e0217df141f/volumes"
Sep 10 21:14:59.872732 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:14:59.872718    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f4a09a7-a0c5-4e2b-bbc5-d6d29131b16f" path="/var/lib/kubelet/pods/9f4a09a7-a0c5-4e2b-bbc5-d6d29131b16f/volumes"
Sep 10 21:15:00.145412 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:00.145330    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-7eaf1f-29817915-7446q"]
Sep 10 21:15:00.145731 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:00.145714    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f4a09a7-a0c5-4e2b-bbc5-d6d29131b16f" containerName="payload-pre-processing"
Sep 10 21:15:00.145786 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:00.145732    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f4a09a7-a0c5-4e2b-bbc5-d6d29131b16f" containerName="payload-pre-processing"
Sep 10 21:15:00.145823 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:00.145810    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f4a09a7-a0c5-4e2b-bbc5-d6d29131b16f" containerName="payload-pre-processing"
Sep 10 21:15:00.150010 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:00.149994    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-7eaf1f-29817915-7446q"
Sep 10 21:15:00.152465 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:00.152439    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-m5c7x\""
Sep 10 21:15:00.160036 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:00.160013    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-7eaf1f-29817915-7446q"
Sep 10 21:15:00.161072 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:00.161047    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-7eaf1f-29817915-7446q"]
Sep 10 21:15:00.457138 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:00.457118    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-7eaf1f-29817915-7446q"]
Sep 10 21:15:00.459528 ip-10-0-129-100 kubenswrapper[2564]: W0910 21:15:00.459502    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d1e63a8_e49a_4ac3_b8c4_b8affd70d029.slice/crio-8e4d23fc60607ebea295d60f7e2b32a75efa10d0f288a19dd046e25c978c8cf5 WatchSource:0}: Error finding container 8e4d23fc60607ebea295d60f7e2b32a75efa10d0f288a19dd046e25c978c8cf5: Status 404 returned error can't find the container with id 8e4d23fc60607ebea295d60f7e2b32a75efa10d0f288a19dd046e25c978c8cf5
Sep 10 21:15:00.566631 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:00.566606    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm"
Sep 10 21:15:00.669558 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:00.669534    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6-istio-token\") pod \"2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6\" (UID: \"2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6\") "
Sep 10 21:15:00.669708 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:00.669573    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6-workload-certs\") pod \"2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6\" (UID: \"2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6\") "
Sep 10 21:15:00.669708 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:00.669642    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6-credential-socket\") pod \"2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6\" (UID: \"2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6\") "
Sep 10 21:15:00.669708 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:00.669670    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6-workload-socket\") pod \"2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6\" (UID: \"2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6\") "
Sep 10 21:15:00.669708 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:00.669700    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6-istio-podinfo\") pod \"2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6\" (UID: \"2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6\") "
Sep 10 21:15:00.669922 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:00.669761    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6-istio-data\") pod \"2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6\" (UID: \"2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6\") "
Sep 10 21:15:00.669922 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:00.669787    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xfd6k\" (UniqueName: \"kubernetes.io/projected/2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6-kube-api-access-xfd6k\") pod \"2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6\" (UID: \"2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6\") "
Sep 10 21:15:00.669922 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:00.669826    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6-istiod-ca-cert\") pod \"2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6\" (UID: \"2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6\") "
Sep 10 21:15:00.669922 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:00.669855    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6-istio-envoy\") pod \"2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6\" (UID: \"2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6\") "
Sep 10 21:15:00.670105 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:00.669984    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6" (UID: "2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:15:00.670156 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:00.670135    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6-istio-data" (OuterVolumeSpecName: "istio-data") pod "2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6" (UID: "2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:15:00.670214 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:00.670162    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6-credential-socket\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:15:00.670296 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:00.670272    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6" (UID: "2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:15:00.670350 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:00.670334    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6" (UID: "2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:15:00.670999 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:00.670951    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6" (UID: "2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:15:00.674462 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:00.673658    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6-kube-api-access-xfd6k" (OuterVolumeSpecName: "kube-api-access-xfd6k") pod "2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6" (UID: "2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6"). InnerVolumeSpecName "kube-api-access-xfd6k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:15:00.674670 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:00.674493    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6" (UID: "2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:15:00.676183 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:00.675755    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6-istio-token" (OuterVolumeSpecName: "istio-token") pod "2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6" (UID: "2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:15:00.681274 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:00.681217    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6" (UID: "2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 21:15:00.771051 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:00.770998    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6-istio-podinfo\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:15:00.771051 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:00.771019    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6-istio-data\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:15:00.771051 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:00.771029    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xfd6k\" (UniqueName: \"kubernetes.io/projected/2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6-kube-api-access-xfd6k\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:15:00.771051 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:00.771045    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6-istiod-ca-cert\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:15:00.771051 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:00.771054    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6-istio-envoy\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:15:00.771342 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:00.771062    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6-istio-token\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:15:00.771342 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:00.771069    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6-workload-certs\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:15:00.771342 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:00.771077    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6-workload-socket\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:15:01.397275 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:01.397223    2564 generic.go:356] "Generic (PLEG): container finished" podID="2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6" containerID="4e1b985e798c5e1013d8630a1e26c34399c699c3e87ce9a3444c08187b01c5f2" exitCode=0
Sep 10 21:15:01.397721 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:01.397309    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm"
Sep 10 21:15:01.397721 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:01.397304    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm" event={"ID":"2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6","Type":"ContainerDied","Data":"4e1b985e798c5e1013d8630a1e26c34399c699c3e87ce9a3444c08187b01c5f2"}
Sep 10 21:15:01.397721 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:01.397425    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm" event={"ID":"2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6","Type":"ContainerDied","Data":"dec2c342dc1da7e68f36e68957161cab83404b1ab65f6784e91c06c90779580a"}
Sep 10 21:15:01.397721 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:01.397448    2564 scope.go:117] "RemoveContainer" containerID="4e1b985e798c5e1013d8630a1e26c34399c699c3e87ce9a3444c08187b01c5f2"
Sep 10 21:15:01.399050 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:01.399031    2564 generic.go:356] "Generic (PLEG): container finished" podID="6d1e63a8-e49a-4ac3-b8c4-b8affd70d029" containerID="baae3845a3140ae4c16c75df78df08138a4f19f2cc8c874a9d39632450d6ca5e" exitCode=0
Sep 10 21:15:01.399148 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:01.399079    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-7eaf1f-29817915-7446q" event={"ID":"6d1e63a8-e49a-4ac3-b8c4-b8affd70d029","Type":"ContainerDied","Data":"baae3845a3140ae4c16c75df78df08138a4f19f2cc8c874a9d39632450d6ca5e"}
Sep 10 21:15:01.399148 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:01.399113    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-7eaf1f-29817915-7446q" event={"ID":"6d1e63a8-e49a-4ac3-b8c4-b8affd70d029","Type":"ContainerStarted","Data":"8e4d23fc60607ebea295d60f7e2b32a75efa10d0f288a19dd046e25c978c8cf5"}
Sep 10 21:15:01.406769 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:01.406752    2564 scope.go:117] "RemoveContainer" containerID="5cca5733e9a43f246fd8ae08a5148db515a47748220fc9389f5c27a31e2d4b58"
Sep 10 21:15:01.415127 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:01.415107    2564 scope.go:117] "RemoveContainer" containerID="4e1b985e798c5e1013d8630a1e26c34399c699c3e87ce9a3444c08187b01c5f2"
Sep 10 21:15:01.415405 ip-10-0-129-100 kubenswrapper[2564]: E0910 21:15:01.415386    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e1b985e798c5e1013d8630a1e26c34399c699c3e87ce9a3444c08187b01c5f2\": container with ID starting with 4e1b985e798c5e1013d8630a1e26c34399c699c3e87ce9a3444c08187b01c5f2 not found: ID does not exist" containerID="4e1b985e798c5e1013d8630a1e26c34399c699c3e87ce9a3444c08187b01c5f2"
Sep 10 21:15:01.415487 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:01.415418    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e1b985e798c5e1013d8630a1e26c34399c699c3e87ce9a3444c08187b01c5f2"} err="failed to get container status \"4e1b985e798c5e1013d8630a1e26c34399c699c3e87ce9a3444c08187b01c5f2\": rpc error: code = NotFound desc = could not find container \"4e1b985e798c5e1013d8630a1e26c34399c699c3e87ce9a3444c08187b01c5f2\": container with ID starting with 4e1b985e798c5e1013d8630a1e26c34399c699c3e87ce9a3444c08187b01c5f2 not found: ID does not exist"
Sep 10 21:15:01.415487 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:01.415441    2564 scope.go:117] "RemoveContainer" containerID="5cca5733e9a43f246fd8ae08a5148db515a47748220fc9389f5c27a31e2d4b58"
Sep 10 21:15:01.415710 ip-10-0-129-100 kubenswrapper[2564]: E0910 21:15:01.415692    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5cca5733e9a43f246fd8ae08a5148db515a47748220fc9389f5c27a31e2d4b58\": container with ID starting with 5cca5733e9a43f246fd8ae08a5148db515a47748220fc9389f5c27a31e2d4b58 not found: ID does not exist" containerID="5cca5733e9a43f246fd8ae08a5148db515a47748220fc9389f5c27a31e2d4b58"
Sep 10 21:15:01.415751 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:01.415715    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cca5733e9a43f246fd8ae08a5148db515a47748220fc9389f5c27a31e2d4b58"} err="failed to get container status \"5cca5733e9a43f246fd8ae08a5148db515a47748220fc9389f5c27a31e2d4b58\": rpc error: code = NotFound desc = could not find container \"5cca5733e9a43f246fd8ae08a5148db515a47748220fc9389f5c27a31e2d4b58\": container with ID starting with 5cca5733e9a43f246fd8ae08a5148db515a47748220fc9389f5c27a31e2d4b58 not found: ID does not exist"
Sep 10 21:15:01.455505 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:01.455428    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm"]
Sep 10 21:15:01.472161 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:01.472131    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-65af3d-openshift-default-c9589bb84-4s8pm"]
Sep 10 21:15:01.874293 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:01.874261    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6" path="/var/lib/kubelet/pods/2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6/volumes"
Sep 10 21:15:02.539790 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:02.539763    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-7eaf1f-29817915-7446q"
Sep 10 21:15:03.413649 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:03.413619    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-7eaf1f-29817915-7446q"
Sep 10 21:15:03.413849 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:03.413654    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-7eaf1f-29817915-7446q" event={"ID":"6d1e63a8-e49a-4ac3-b8c4-b8affd70d029","Type":"ContainerDied","Data":"8e4d23fc60607ebea295d60f7e2b32a75efa10d0f288a19dd046e25c978c8cf5"}
Sep 10 21:15:03.413849 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:03.413699    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8e4d23fc60607ebea295d60f7e2b32a75efa10d0f288a19dd046e25c978c8cf5"
Sep 10 21:15:06.098858 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:06.098821    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7eaf1f-zlvlh"]
Sep 10 21:15:06.099316 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:06.099160    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6" containerName="istio-proxy"
Sep 10 21:15:06.099316 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:06.099171    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6" containerName="istio-proxy"
Sep 10 21:15:06.099316 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:06.099180    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d1e63a8-e49a-4ac3-b8c4-b8affd70d029" containerName="cleanup"
Sep 10 21:15:06.099316 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:06.099185    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d1e63a8-e49a-4ac3-b8c4-b8affd70d029" containerName="cleanup"
Sep 10 21:15:06.099316 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:06.099202    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6" containerName="istio-proxy"
Sep 10 21:15:06.099316 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:06.099208    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6" containerName="istio-proxy"
Sep 10 21:15:06.099316 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:06.099278    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6" containerName="istio-proxy"
Sep 10 21:15:06.099316 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:06.099287    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d1e63a8-e49a-4ac3-b8c4-b8affd70d029" containerName="cleanup"
Sep 10 21:15:06.099316 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:06.099293    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a2b71fe-f049-4fc8-8529-9cd56f0dfbe6" containerName="istio-proxy"
Sep 10 21:15:06.102376 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:06.102353    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7eaf1f-zlvlh"
Sep 10 21:15:06.104949 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:06.104914    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 21:15:06.105075 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:06.104923    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-m5c7x\""
Sep 10 21:15:06.112977 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:06.112953    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7eaf1f-zlvlh"]
Sep 10 21:15:06.220604 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:06.220569    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d3c874e-d974-468e-9cca-4d6778a10ff8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-7eaf1f-zlvlh\" (UID: \"8d3c874e-d974-468e-9cca-4d6778a10ff8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7eaf1f-zlvlh"
Sep 10 21:15:06.321421 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:06.321382    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d3c874e-d974-468e-9cca-4d6778a10ff8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-7eaf1f-zlvlh\" (UID: \"8d3c874e-d974-468e-9cca-4d6778a10ff8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7eaf1f-zlvlh"
Sep 10 21:15:06.321977 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:06.321957    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d3c874e-d974-468e-9cca-4d6778a10ff8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-7eaf1f-zlvlh\" (UID: \"8d3c874e-d974-468e-9cca-4d6778a10ff8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7eaf1f-zlvlh"
Sep 10 21:15:06.413559 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:06.413477    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7eaf1f-zlvlh"
Sep 10 21:15:06.685013 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:06.684980    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7eaf1f-zlvlh"]
Sep 10 21:15:06.686584 ip-10-0-129-100 kubenswrapper[2564]: W0910 21:15:06.686557    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d3c874e_d974_468e_9cca_4d6778a10ff8.slice/crio-95a60a2a42919b1525187fb3782156f532e7c7655529a349844ffc559f203ae4 WatchSource:0}: Error finding container 95a60a2a42919b1525187fb3782156f532e7c7655529a349844ffc559f203ae4: Status 404 returned error can't find the container with id 95a60a2a42919b1525187fb3782156f532e7c7655529a349844ffc559f203ae4
Sep 10 21:15:07.437398 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:07.437368    2564 generic.go:356] "Generic (PLEG): container finished" podID="8d3c874e-d974-468e-9cca-4d6778a10ff8" containerID="1e81daf9dd6c4edfb75767208bfb95432ef75f37181d718797bbce2e82762226" exitCode=0
Sep 10 21:15:07.437764 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:07.437454    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7eaf1f-zlvlh" event={"ID":"8d3c874e-d974-468e-9cca-4d6778a10ff8","Type":"ContainerDied","Data":"1e81daf9dd6c4edfb75767208bfb95432ef75f37181d718797bbce2e82762226"}
Sep 10 21:15:07.437764 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:07.437512    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7eaf1f-zlvlh" event={"ID":"8d3c874e-d974-468e-9cca-4d6778a10ff8","Type":"ContainerStarted","Data":"95a60a2a42919b1525187fb3782156f532e7c7655529a349844ffc559f203ae4"}
Sep 10 21:15:08.586393 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:08.586370    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7eaf1f-zlvlh"
Sep 10 21:15:08.741134 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:08.741029    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d3c874e-d974-468e-9cca-4d6778a10ff8-maas-api-service-ca\") pod \"8d3c874e-d974-468e-9cca-4d6778a10ff8\" (UID: \"8d3c874e-d974-468e-9cca-4d6778a10ff8\") "
Sep 10 21:15:08.741453 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:08.741429    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d3c874e-d974-468e-9cca-4d6778a10ff8-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8d3c874e-d974-468e-9cca-4d6778a10ff8" (UID: "8d3c874e-d974-468e-9cca-4d6778a10ff8"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:15:08.842649 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:08.842611    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d3c874e-d974-468e-9cca-4d6778a10ff8-maas-api-service-ca\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:15:09.217342 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:09.217310    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-6324ec-openshift-default-ccd7b8754-mmhmn"]
Sep 10 21:15:09.217531 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:09.217505    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-6324ec-openshift-default-ccd7b8754-mmhmn" podUID="91aae7b6-0929-4a4d-a75b-34574e25b3f3" containerName="istio-proxy" containerID="cri-o://e14ce26cabd8bddf81f92f6fa2d3bb39f2274b71c477948933974e5afc1d7b70" gracePeriod=30
Sep 10 21:15:09.454624 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:09.454590    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7eaf1f-zlvlh"
Sep 10 21:15:09.454807 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:09.454584    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7eaf1f-zlvlh" event={"ID":"8d3c874e-d974-468e-9cca-4d6778a10ff8","Type":"ContainerDied","Data":"95a60a2a42919b1525187fb3782156f532e7c7655529a349844ffc559f203ae4"}
Sep 10 21:15:09.454807 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:09.454751    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="95a60a2a42919b1525187fb3782156f532e7c7655529a349844ffc559f203ae4"
Sep 10 21:15:13.381947 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:13.381911    2564 patch_prober.go:28] interesting pod/e2e-noten-6324ec-openshift-default-ccd7b8754-mmhmn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 21:15:13.382324 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:13.381981    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-noten-6324ec-openshift-default-ccd7b8754-mmhmn" podUID="91aae7b6-0929-4a4d-a75b-34574e25b3f3" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 21:15:14.470779 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:14.470747    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-6324ec-openshift-default-ccd7b8754-mmhmn"
Sep 10 21:15:14.484352 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:14.484282    2564 generic.go:356] "Generic (PLEG): container finished" podID="91aae7b6-0929-4a4d-a75b-34574e25b3f3" containerID="e14ce26cabd8bddf81f92f6fa2d3bb39f2274b71c477948933974e5afc1d7b70" exitCode=0
Sep 10 21:15:14.484352 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:14.484327    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-6324ec-openshift-default-ccd7b8754-mmhmn"
Sep 10 21:15:14.484499 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:14.484371    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-6324ec-openshift-default-ccd7b8754-mmhmn" event={"ID":"91aae7b6-0929-4a4d-a75b-34574e25b3f3","Type":"ContainerDied","Data":"e14ce26cabd8bddf81f92f6fa2d3bb39f2274b71c477948933974e5afc1d7b70"}
Sep 10 21:15:14.484499 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:14.484422    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-6324ec-openshift-default-ccd7b8754-mmhmn" event={"ID":"91aae7b6-0929-4a4d-a75b-34574e25b3f3","Type":"ContainerDied","Data":"6b6f184954c78b86f4e51bbc451a3e5e09febc14171f47961182b482861f5638"}
Sep 10 21:15:14.484499 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:14.484446    2564 scope.go:117] "RemoveContainer" containerID="e14ce26cabd8bddf81f92f6fa2d3bb39f2274b71c477948933974e5afc1d7b70"
Sep 10 21:15:14.501697 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:14.495793    2564 scope.go:117] "RemoveContainer" containerID="e14ce26cabd8bddf81f92f6fa2d3bb39f2274b71c477948933974e5afc1d7b70"
Sep 10 21:15:14.501697 ip-10-0-129-100 kubenswrapper[2564]: E0910 21:15:14.496544    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e14ce26cabd8bddf81f92f6fa2d3bb39f2274b71c477948933974e5afc1d7b70\": container with ID starting with e14ce26cabd8bddf81f92f6fa2d3bb39f2274b71c477948933974e5afc1d7b70 not found: ID does not exist" containerID="e14ce26cabd8bddf81f92f6fa2d3bb39f2274b71c477948933974e5afc1d7b70"
Sep 10 21:15:14.501697 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:14.496700    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e14ce26cabd8bddf81f92f6fa2d3bb39f2274b71c477948933974e5afc1d7b70"} err="failed to get container status \"e14ce26cabd8bddf81f92f6fa2d3bb39f2274b71c477948933974e5afc1d7b70\": rpc error: code = NotFound desc = could not find container \"e14ce26cabd8bddf81f92f6fa2d3bb39f2274b71c477948933974e5afc1d7b70\": container with ID starting with e14ce26cabd8bddf81f92f6fa2d3bb39f2274b71c477948933974e5afc1d7b70 not found: ID does not exist"
Sep 10 21:15:14.595656 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:14.595625    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/91aae7b6-0929-4a4d-a75b-34574e25b3f3-istio-data\") pod \"91aae7b6-0929-4a4d-a75b-34574e25b3f3\" (UID: \"91aae7b6-0929-4a4d-a75b-34574e25b3f3\") "
Sep 10 21:15:14.595845 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:14.595676    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/91aae7b6-0929-4a4d-a75b-34574e25b3f3-credential-socket\") pod \"91aae7b6-0929-4a4d-a75b-34574e25b3f3\" (UID: \"91aae7b6-0929-4a4d-a75b-34574e25b3f3\") "
Sep 10 21:15:14.595845 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:14.595727    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91aae7b6-0929-4a4d-a75b-34574e25b3f3-istio-token\") pod \"91aae7b6-0929-4a4d-a75b-34574e25b3f3\" (UID: \"91aae7b6-0929-4a4d-a75b-34574e25b3f3\") "
Sep 10 21:15:14.595845 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:14.595756    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/91aae7b6-0929-4a4d-a75b-34574e25b3f3-istio-podinfo\") pod \"91aae7b6-0929-4a4d-a75b-34574e25b3f3\" (UID: \"91aae7b6-0929-4a4d-a75b-34574e25b3f3\") "
Sep 10 21:15:14.595845 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:14.595783    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/91aae7b6-0929-4a4d-a75b-34574e25b3f3-workload-certs\") pod \"91aae7b6-0929-4a4d-a75b-34574e25b3f3\" (UID: \"91aae7b6-0929-4a4d-a75b-34574e25b3f3\") "
Sep 10 21:15:14.595845 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:14.595803    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s9hh6\" (UniqueName: \"kubernetes.io/projected/91aae7b6-0929-4a4d-a75b-34574e25b3f3-kube-api-access-s9hh6\") pod \"91aae7b6-0929-4a4d-a75b-34574e25b3f3\" (UID: \"91aae7b6-0929-4a4d-a75b-34574e25b3f3\") "
Sep 10 21:15:14.596104 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:14.595850    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/91aae7b6-0929-4a4d-a75b-34574e25b3f3-workload-socket\") pod \"91aae7b6-0929-4a4d-a75b-34574e25b3f3\" (UID: \"91aae7b6-0929-4a4d-a75b-34574e25b3f3\") "
Sep 10 21:15:14.596104 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:14.595901    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/91aae7b6-0929-4a4d-a75b-34574e25b3f3-istio-envoy\") pod \"91aae7b6-0929-4a4d-a75b-34574e25b3f3\" (UID: \"91aae7b6-0929-4a4d-a75b-34574e25b3f3\") "
Sep 10 21:15:14.596104 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:14.595939    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/91aae7b6-0929-4a4d-a75b-34574e25b3f3-istiod-ca-cert\") pod \"91aae7b6-0929-4a4d-a75b-34574e25b3f3\" (UID: \"91aae7b6-0929-4a4d-a75b-34574e25b3f3\") "
Sep 10 21:15:14.596271 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:14.595914    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91aae7b6-0929-4a4d-a75b-34574e25b3f3-istio-data" (OuterVolumeSpecName: "istio-data") pod "91aae7b6-0929-4a4d-a75b-34574e25b3f3" (UID: "91aae7b6-0929-4a4d-a75b-34574e25b3f3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:15:14.596271 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:14.596000    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91aae7b6-0929-4a4d-a75b-34574e25b3f3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "91aae7b6-0929-4a4d-a75b-34574e25b3f3" (UID: "91aae7b6-0929-4a4d-a75b-34574e25b3f3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:15:14.596271 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:14.596074    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91aae7b6-0929-4a4d-a75b-34574e25b3f3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "91aae7b6-0929-4a4d-a75b-34574e25b3f3" (UID: "91aae7b6-0929-4a4d-a75b-34574e25b3f3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:15:14.596271 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:14.596159    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91aae7b6-0929-4a4d-a75b-34574e25b3f3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "91aae7b6-0929-4a4d-a75b-34574e25b3f3" (UID: "91aae7b6-0929-4a4d-a75b-34574e25b3f3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:15:14.596512 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:14.596288    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91aae7b6-0929-4a4d-a75b-34574e25b3f3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "91aae7b6-0929-4a4d-a75b-34574e25b3f3" (UID: "91aae7b6-0929-4a4d-a75b-34574e25b3f3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:15:14.598082 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:14.598053    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91aae7b6-0929-4a4d-a75b-34574e25b3f3-kube-api-access-s9hh6" (OuterVolumeSpecName: "kube-api-access-s9hh6") pod "91aae7b6-0929-4a4d-a75b-34574e25b3f3" (UID: "91aae7b6-0929-4a4d-a75b-34574e25b3f3"). InnerVolumeSpecName "kube-api-access-s9hh6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:15:14.598082 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:14.598075    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91aae7b6-0929-4a4d-a75b-34574e25b3f3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "91aae7b6-0929-4a4d-a75b-34574e25b3f3" (UID: "91aae7b6-0929-4a4d-a75b-34574e25b3f3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:15:14.598390 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:14.598374    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/91aae7b6-0929-4a4d-a75b-34574e25b3f3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "91aae7b6-0929-4a4d-a75b-34574e25b3f3" (UID: "91aae7b6-0929-4a4d-a75b-34574e25b3f3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 21:15:14.598458 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:14.598391    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91aae7b6-0929-4a4d-a75b-34574e25b3f3-istio-token" (OuterVolumeSpecName: "istio-token") pod "91aae7b6-0929-4a4d-a75b-34574e25b3f3" (UID: "91aae7b6-0929-4a4d-a75b-34574e25b3f3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:15:14.697171 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:14.697136    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/91aae7b6-0929-4a4d-a75b-34574e25b3f3-istio-data\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:15:14.697171 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:14.697164    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/91aae7b6-0929-4a4d-a75b-34574e25b3f3-credential-socket\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:15:14.697171 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:14.697175    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91aae7b6-0929-4a4d-a75b-34574e25b3f3-istio-token\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:15:14.697417 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:14.697182    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/91aae7b6-0929-4a4d-a75b-34574e25b3f3-istio-podinfo\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:15:14.697417 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:14.697191    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/91aae7b6-0929-4a4d-a75b-34574e25b3f3-workload-certs\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:15:14.697417 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:14.697199    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s9hh6\" (UniqueName: \"kubernetes.io/projected/91aae7b6-0929-4a4d-a75b-34574e25b3f3-kube-api-access-s9hh6\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:15:14.697417 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:14.697207    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/91aae7b6-0929-4a4d-a75b-34574e25b3f3-workload-socket\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:15:14.697417 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:14.697215    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/91aae7b6-0929-4a4d-a75b-34574e25b3f3-istio-envoy\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:15:14.697417 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:14.697223    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/91aae7b6-0929-4a4d-a75b-34574e25b3f3-istiod-ca-cert\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:15:14.843947 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:14.843916    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-6324ec-openshift-default-ccd7b8754-mmhmn"]
Sep 10 21:15:14.851533 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:14.851506    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-6324ec-openshift-default-ccd7b8754-mmhmn"]
Sep 10 21:15:15.873347 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:15.873312    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91aae7b6-0929-4a4d-a75b-34574e25b3f3" path="/var/lib/kubelet/pods/91aae7b6-0929-4a4d-a75b-34574e25b3f3/volumes"
Sep 10 21:15:16.689442 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:16.689410    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-7eaf1f-29817915-7446q"]
Sep 10 21:15:16.693861 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:16.693833    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-7eaf1f-29817915-7446q"]
Sep 10 21:15:16.721247 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:16.721203    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-7eaf1f-7b5598797f-2ktm8"]
Sep 10 21:15:16.721467 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:16.721439    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-7eaf1f-7b5598797f-2ktm8" podUID="c2d80fed-c2c1-423a-8f72-8bf3d31686e2" containerName="payload-processing" containerID="cri-o://ceffb9e1cf43aa76906f23bf30a07fb01577f78579fc287ed7e12d8c51d4876c" gracePeriod=30
Sep 10 21:15:16.731402 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:16.731375    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-7eaf1f-74b7584db-t4n7g"]
Sep 10 21:15:16.731584 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:16.731564    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-7eaf1f-74b7584db-t4n7g" podUID="54c3e9a7-ee07-4f39-9d7e-dbb93a23d89e" containerName="payload-pre-processing" containerID="cri-o://c8844492ba0cc272b438ab609ac70cf91e351adb25879b6d4ef48a27fa2588df" gracePeriod=30
Sep 10 21:15:16.931108 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:16.931074    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7eaf1f-zlvlh"]
Sep 10 21:15:16.937676 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:16.937650    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7eaf1f-zlvlh"]
Sep 10 21:15:16.998856 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:16.998832    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-7eaf1f-7b5598797f-2ktm8"
Sep 10 21:15:17.008170 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:17.008147    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-7eaf1f-74b7584db-t4n7g"
Sep 10 21:15:17.116635 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:17.116603    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q5njg\" (UniqueName: \"kubernetes.io/projected/c2d80fed-c2c1-423a-8f72-8bf3d31686e2-kube-api-access-q5njg\") pod \"c2d80fed-c2c1-423a-8f72-8bf3d31686e2\" (UID: \"c2d80fed-c2c1-423a-8f72-8bf3d31686e2\") "
Sep 10 21:15:17.116801 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:17.116685    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/54c3e9a7-ee07-4f39-9d7e-dbb93a23d89e-plugins-config-volume\") pod \"54c3e9a7-ee07-4f39-9d7e-dbb93a23d89e\" (UID: \"54c3e9a7-ee07-4f39-9d7e-dbb93a23d89e\") "
Sep 10 21:15:17.116801 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:17.116718    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c2d80fed-c2c1-423a-8f72-8bf3d31686e2-plugins-config-volume\") pod \"c2d80fed-c2c1-423a-8f72-8bf3d31686e2\" (UID: \"c2d80fed-c2c1-423a-8f72-8bf3d31686e2\") "
Sep 10 21:15:17.116801 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:17.116756    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cmc7w\" (UniqueName: \"kubernetes.io/projected/54c3e9a7-ee07-4f39-9d7e-dbb93a23d89e-kube-api-access-cmc7w\") pod \"54c3e9a7-ee07-4f39-9d7e-dbb93a23d89e\" (UID: \"54c3e9a7-ee07-4f39-9d7e-dbb93a23d89e\") "
Sep 10 21:15:17.117070 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:17.117038    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54c3e9a7-ee07-4f39-9d7e-dbb93a23d89e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "54c3e9a7-ee07-4f39-9d7e-dbb93a23d89e" (UID: "54c3e9a7-ee07-4f39-9d7e-dbb93a23d89e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:15:17.117070 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:17.117059    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2d80fed-c2c1-423a-8f72-8bf3d31686e2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c2d80fed-c2c1-423a-8f72-8bf3d31686e2" (UID: "c2d80fed-c2c1-423a-8f72-8bf3d31686e2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:15:17.118721 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:17.118700    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2d80fed-c2c1-423a-8f72-8bf3d31686e2-kube-api-access-q5njg" (OuterVolumeSpecName: "kube-api-access-q5njg") pod "c2d80fed-c2c1-423a-8f72-8bf3d31686e2" (UID: "c2d80fed-c2c1-423a-8f72-8bf3d31686e2"). InnerVolumeSpecName "kube-api-access-q5njg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:15:17.118798 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:17.118781    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54c3e9a7-ee07-4f39-9d7e-dbb93a23d89e-kube-api-access-cmc7w" (OuterVolumeSpecName: "kube-api-access-cmc7w") pod "54c3e9a7-ee07-4f39-9d7e-dbb93a23d89e" (UID: "54c3e9a7-ee07-4f39-9d7e-dbb93a23d89e"). InnerVolumeSpecName "kube-api-access-cmc7w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:15:17.218036 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:17.218005    2564 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c2d80fed-c2c1-423a-8f72-8bf3d31686e2-plugins-config-volume\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:15:17.218036 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:17.218030    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cmc7w\" (UniqueName: \"kubernetes.io/projected/54c3e9a7-ee07-4f39-9d7e-dbb93a23d89e-kube-api-access-cmc7w\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:15:17.218036 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:17.218041    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q5njg\" (UniqueName: \"kubernetes.io/projected/c2d80fed-c2c1-423a-8f72-8bf3d31686e2-kube-api-access-q5njg\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:15:17.218298 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:17.218050    2564 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/54c3e9a7-ee07-4f39-9d7e-dbb93a23d89e-plugins-config-volume\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:15:17.503430 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:17.503398    2564 generic.go:356] "Generic (PLEG): container finished" podID="c2d80fed-c2c1-423a-8f72-8bf3d31686e2" containerID="ceffb9e1cf43aa76906f23bf30a07fb01577f78579fc287ed7e12d8c51d4876c" exitCode=0
Sep 10 21:15:17.503588 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:17.503437    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-7eaf1f-7b5598797f-2ktm8"
Sep 10 21:15:17.503588 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:17.503482    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-7eaf1f-7b5598797f-2ktm8" event={"ID":"c2d80fed-c2c1-423a-8f72-8bf3d31686e2","Type":"ContainerDied","Data":"ceffb9e1cf43aa76906f23bf30a07fb01577f78579fc287ed7e12d8c51d4876c"}
Sep 10 21:15:17.503588 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:17.503528    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-7eaf1f-7b5598797f-2ktm8" event={"ID":"c2d80fed-c2c1-423a-8f72-8bf3d31686e2","Type":"ContainerDied","Data":"d1039dedb3a5d788ae3764af7554ed728399d56f09b6cc54d53024560abe946a"}
Sep 10 21:15:17.503588 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:17.503552    2564 scope.go:117] "RemoveContainer" containerID="ceffb9e1cf43aa76906f23bf30a07fb01577f78579fc287ed7e12d8c51d4876c"
Sep 10 21:15:17.504872 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:17.504850    2564 generic.go:356] "Generic (PLEG): container finished" podID="54c3e9a7-ee07-4f39-9d7e-dbb93a23d89e" containerID="c8844492ba0cc272b438ab609ac70cf91e351adb25879b6d4ef48a27fa2588df" exitCode=0
Sep 10 21:15:17.504966 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:17.504891    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-7eaf1f-74b7584db-t4n7g" event={"ID":"54c3e9a7-ee07-4f39-9d7e-dbb93a23d89e","Type":"ContainerDied","Data":"c8844492ba0cc272b438ab609ac70cf91e351adb25879b6d4ef48a27fa2588df"}
Sep 10 21:15:17.504966 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:17.504897    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-7eaf1f-74b7584db-t4n7g"
Sep 10 21:15:17.504966 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:17.504922    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-7eaf1f-74b7584db-t4n7g" event={"ID":"54c3e9a7-ee07-4f39-9d7e-dbb93a23d89e","Type":"ContainerDied","Data":"bbdebdc20039baa9365e8619e6e19f66b97cd63583176e1b58f4013eb08fd112"}
Sep 10 21:15:17.514744 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:17.514702    2564 scope.go:117] "RemoveContainer" containerID="ceffb9e1cf43aa76906f23bf30a07fb01577f78579fc287ed7e12d8c51d4876c"
Sep 10 21:15:17.515242 ip-10-0-129-100 kubenswrapper[2564]: E0910 21:15:17.515195    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ceffb9e1cf43aa76906f23bf30a07fb01577f78579fc287ed7e12d8c51d4876c\": container with ID starting with ceffb9e1cf43aa76906f23bf30a07fb01577f78579fc287ed7e12d8c51d4876c not found: ID does not exist" containerID="ceffb9e1cf43aa76906f23bf30a07fb01577f78579fc287ed7e12d8c51d4876c"
Sep 10 21:15:17.515361 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:17.515253    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ceffb9e1cf43aa76906f23bf30a07fb01577f78579fc287ed7e12d8c51d4876c"} err="failed to get container status \"ceffb9e1cf43aa76906f23bf30a07fb01577f78579fc287ed7e12d8c51d4876c\": rpc error: code = NotFound desc = could not find container \"ceffb9e1cf43aa76906f23bf30a07fb01577f78579fc287ed7e12d8c51d4876c\": container with ID starting with ceffb9e1cf43aa76906f23bf30a07fb01577f78579fc287ed7e12d8c51d4876c not found: ID does not exist"
Sep 10 21:15:17.515361 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:17.515278    2564 scope.go:117] "RemoveContainer" containerID="c8844492ba0cc272b438ab609ac70cf91e351adb25879b6d4ef48a27fa2588df"
Sep 10 21:15:17.523438 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:17.523422    2564 scope.go:117] "RemoveContainer" containerID="c8844492ba0cc272b438ab609ac70cf91e351adb25879b6d4ef48a27fa2588df"
Sep 10 21:15:17.523682 ip-10-0-129-100 kubenswrapper[2564]: E0910 21:15:17.523665    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8844492ba0cc272b438ab609ac70cf91e351adb25879b6d4ef48a27fa2588df\": container with ID starting with c8844492ba0cc272b438ab609ac70cf91e351adb25879b6d4ef48a27fa2588df not found: ID does not exist" containerID="c8844492ba0cc272b438ab609ac70cf91e351adb25879b6d4ef48a27fa2588df"
Sep 10 21:15:17.523727 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:17.523690    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8844492ba0cc272b438ab609ac70cf91e351adb25879b6d4ef48a27fa2588df"} err="failed to get container status \"c8844492ba0cc272b438ab609ac70cf91e351adb25879b6d4ef48a27fa2588df\": rpc error: code = NotFound desc = could not find container \"c8844492ba0cc272b438ab609ac70cf91e351adb25879b6d4ef48a27fa2588df\": container with ID starting with c8844492ba0cc272b438ab609ac70cf91e351adb25879b6d4ef48a27fa2588df not found: ID does not exist"
Sep 10 21:15:17.530192 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:17.530174    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-7eaf1f-7b5598797f-2ktm8"]
Sep 10 21:15:17.532114 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:17.532096    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-7eaf1f-7b5598797f-2ktm8"]
Sep 10 21:15:17.542290 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:17.542269    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-7eaf1f-74b7584db-t4n7g"]
Sep 10 21:15:17.545799 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:17.545780    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-7eaf1f-74b7584db-t4n7g"]
Sep 10 21:15:17.872538 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:17.872499    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54c3e9a7-ee07-4f39-9d7e-dbb93a23d89e" path="/var/lib/kubelet/pods/54c3e9a7-ee07-4f39-9d7e-dbb93a23d89e/volumes"
Sep 10 21:15:17.872916 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:17.872897    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d1e63a8-e49a-4ac3-b8c4-b8affd70d029" path="/var/lib/kubelet/pods/6d1e63a8-e49a-4ac3-b8c4-b8affd70d029/volumes"
Sep 10 21:15:17.873280 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:17.873257    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d3c874e-d974-468e-9cca-4d6778a10ff8" path="/var/lib/kubelet/pods/8d3c874e-d974-468e-9cca-4d6778a10ff8/volumes"
Sep 10 21:15:17.873595 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:17.873582    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2d80fed-c2c1-423a-8f72-8bf3d31686e2" path="/var/lib/kubelet/pods/c2d80fed-c2c1-423a-8f72-8bf3d31686e2/volumes"
Sep 10 21:15:19.865666 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:19.865631    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-899bf7e2-6bd4dbf46b-w2czk"]
Sep 10 21:15:19.866159 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:19.866139    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54c3e9a7-ee07-4f39-9d7e-dbb93a23d89e" containerName="payload-pre-processing"
Sep 10 21:15:19.866255 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:19.866163    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="54c3e9a7-ee07-4f39-9d7e-dbb93a23d89e" containerName="payload-pre-processing"
Sep 10 21:15:19.866255 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:19.866186    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91aae7b6-0929-4a4d-a75b-34574e25b3f3" containerName="istio-proxy"
Sep 10 21:15:19.866255 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:19.866195    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="91aae7b6-0929-4a4d-a75b-34574e25b3f3" containerName="istio-proxy"
Sep 10 21:15:19.866255 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:19.866211    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2d80fed-c2c1-423a-8f72-8bf3d31686e2" containerName="payload-processing"
Sep 10 21:15:19.866255 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:19.866221    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2d80fed-c2c1-423a-8f72-8bf3d31686e2" containerName="payload-processing"
Sep 10 21:15:19.866255 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:19.866251    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d3c874e-d974-468e-9cca-4d6778a10ff8" containerName="revoke-keys"
Sep 10 21:15:19.866552 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:19.866259    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d3c874e-d974-468e-9cca-4d6778a10ff8" containerName="revoke-keys"
Sep 10 21:15:19.866552 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:19.866354    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="54c3e9a7-ee07-4f39-9d7e-dbb93a23d89e" containerName="payload-pre-processing"
Sep 10 21:15:19.866552 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:19.866366    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2d80fed-c2c1-423a-8f72-8bf3d31686e2" containerName="payload-processing"
Sep 10 21:15:19.866552 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:19.866376    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d3c874e-d974-468e-9cca-4d6778a10ff8" containerName="revoke-keys"
Sep 10 21:15:19.866552 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:19.866386    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="91aae7b6-0929-4a4d-a75b-34574e25b3f3" containerName="istio-proxy"
Sep 10 21:15:19.870929 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:19.870908    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-899bf7e2-77747f657-hxjs4"]
Sep 10 21:15:19.871053 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:19.871015    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-899bf7e2-6bd4dbf46b-w2czk"
Sep 10 21:15:19.874065 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:19.874047    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-899bf7e2-77747f657-hxjs4"
Sep 10 21:15:19.876168 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:19.876146    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-899bf7e2\""
Sep 10 21:15:19.876464 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:19.876441    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-899bf7e2-dockercfg-sdb2s\""
Sep 10 21:15:19.886915 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:19.886890    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-899bf7e2-77747f657-hxjs4"]
Sep 10 21:15:19.895771 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:19.895745    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-899bf7e2-6bd4dbf46b-w2czk"]
Sep 10 21:15:20.040688 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:20.040657    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxb5k\" (UniqueName: \"kubernetes.io/projected/f9381c51-d427-44f9-9af8-f1352968c507-kube-api-access-mxb5k\") pod \"payload-processing-e2e-mt-899bf7e2-77747f657-hxjs4\" (UID: \"f9381c51-d427-44f9-9af8-f1352968c507\") " pod="openshift-ingress/payload-processing-e2e-mt-899bf7e2-77747f657-hxjs4"
Sep 10 21:15:20.040880 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:20.040697    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9l5f\" (UniqueName: \"kubernetes.io/projected/5a9fce01-5671-4f01-b4f9-793d8d86acba-kube-api-access-c9l5f\") pod \"payload-pre-processing-e2e-mt-899bf7e2-6bd4dbf46b-w2czk\" (UID: \"5a9fce01-5671-4f01-b4f9-793d8d86acba\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-899bf7e2-6bd4dbf46b-w2czk"
Sep 10 21:15:20.040880 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:20.040723    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5a9fce01-5671-4f01-b4f9-793d8d86acba-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-899bf7e2-6bd4dbf46b-w2czk\" (UID: \"5a9fce01-5671-4f01-b4f9-793d8d86acba\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-899bf7e2-6bd4dbf46b-w2czk"
Sep 10 21:15:20.040880 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:20.040740    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f9381c51-d427-44f9-9af8-f1352968c507-plugins-config-volume\") pod \"payload-processing-e2e-mt-899bf7e2-77747f657-hxjs4\" (UID: \"f9381c51-d427-44f9-9af8-f1352968c507\") " pod="openshift-ingress/payload-processing-e2e-mt-899bf7e2-77747f657-hxjs4"
Sep 10 21:15:20.142055 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:20.141963    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5a9fce01-5671-4f01-b4f9-793d8d86acba-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-899bf7e2-6bd4dbf46b-w2czk\" (UID: \"5a9fce01-5671-4f01-b4f9-793d8d86acba\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-899bf7e2-6bd4dbf46b-w2czk"
Sep 10 21:15:20.142055 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:20.141998    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f9381c51-d427-44f9-9af8-f1352968c507-plugins-config-volume\") pod \"payload-processing-e2e-mt-899bf7e2-77747f657-hxjs4\" (UID: \"f9381c51-d427-44f9-9af8-f1352968c507\") " pod="openshift-ingress/payload-processing-e2e-mt-899bf7e2-77747f657-hxjs4"
Sep 10 21:15:20.142290 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:20.142079    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxb5k\" (UniqueName: \"kubernetes.io/projected/f9381c51-d427-44f9-9af8-f1352968c507-kube-api-access-mxb5k\") pod \"payload-processing-e2e-mt-899bf7e2-77747f657-hxjs4\" (UID: \"f9381c51-d427-44f9-9af8-f1352968c507\") " pod="openshift-ingress/payload-processing-e2e-mt-899bf7e2-77747f657-hxjs4"
Sep 10 21:15:20.142290 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:20.142101    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9l5f\" (UniqueName: \"kubernetes.io/projected/5a9fce01-5671-4f01-b4f9-793d8d86acba-kube-api-access-c9l5f\") pod \"payload-pre-processing-e2e-mt-899bf7e2-6bd4dbf46b-w2czk\" (UID: \"5a9fce01-5671-4f01-b4f9-793d8d86acba\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-899bf7e2-6bd4dbf46b-w2czk"
Sep 10 21:15:20.142799 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:20.142777    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f9381c51-d427-44f9-9af8-f1352968c507-plugins-config-volume\") pod \"payload-processing-e2e-mt-899bf7e2-77747f657-hxjs4\" (UID: \"f9381c51-d427-44f9-9af8-f1352968c507\") " pod="openshift-ingress/payload-processing-e2e-mt-899bf7e2-77747f657-hxjs4"
Sep 10 21:15:20.142834 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:20.142792    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5a9fce01-5671-4f01-b4f9-793d8d86acba-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-899bf7e2-6bd4dbf46b-w2czk\" (UID: \"5a9fce01-5671-4f01-b4f9-793d8d86acba\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-899bf7e2-6bd4dbf46b-w2czk"
Sep 10 21:15:20.150787 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:20.150759    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxb5k\" (UniqueName: \"kubernetes.io/projected/f9381c51-d427-44f9-9af8-f1352968c507-kube-api-access-mxb5k\") pod \"payload-processing-e2e-mt-899bf7e2-77747f657-hxjs4\" (UID: \"f9381c51-d427-44f9-9af8-f1352968c507\") " pod="openshift-ingress/payload-processing-e2e-mt-899bf7e2-77747f657-hxjs4"
Sep 10 21:15:20.150913 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:20.150822    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9l5f\" (UniqueName: \"kubernetes.io/projected/5a9fce01-5671-4f01-b4f9-793d8d86acba-kube-api-access-c9l5f\") pod \"payload-pre-processing-e2e-mt-899bf7e2-6bd4dbf46b-w2czk\" (UID: \"5a9fce01-5671-4f01-b4f9-793d8d86acba\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-899bf7e2-6bd4dbf46b-w2czk"
Sep 10 21:15:20.182876 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:20.182848    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-899bf7e2-6bd4dbf46b-w2czk"
Sep 10 21:15:20.190183 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:20.190157    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-899bf7e2-77747f657-hxjs4"
Sep 10 21:15:20.458125 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:20.458098    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-899bf7e2-6bd4dbf46b-w2czk"]
Sep 10 21:15:20.459768 ip-10-0-129-100 kubenswrapper[2564]: W0910 21:15:20.459731    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a9fce01_5671_4f01_b4f9_793d8d86acba.slice/crio-ae0823aadbcbb78bfa943aac76b5914f01a8f8589298ce8c35c48f2b417f2c09 WatchSource:0}: Error finding container ae0823aadbcbb78bfa943aac76b5914f01a8f8589298ce8c35c48f2b417f2c09: Status 404 returned error can't find the container with id ae0823aadbcbb78bfa943aac76b5914f01a8f8589298ce8c35c48f2b417f2c09
Sep 10 21:15:20.465115 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:20.465095    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-899bf7e2-77747f657-hxjs4"]
Sep 10 21:15:20.467417 ip-10-0-129-100 kubenswrapper[2564]: W0910 21:15:20.467396    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9381c51_d427_44f9_9af8_f1352968c507.slice/crio-bef2476bcdd5db5b4f7bd18ba85975aa936637245d57e7fad572ebdd975bdb61 WatchSource:0}: Error finding container bef2476bcdd5db5b4f7bd18ba85975aa936637245d57e7fad572ebdd975bdb61: Status 404 returned error can't find the container with id bef2476bcdd5db5b4f7bd18ba85975aa936637245d57e7fad572ebdd975bdb61
Sep 10 21:15:20.527900 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:20.527870    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-899bf7e2-77747f657-hxjs4" event={"ID":"f9381c51-d427-44f9-9af8-f1352968c507","Type":"ContainerStarted","Data":"bef2476bcdd5db5b4f7bd18ba85975aa936637245d57e7fad572ebdd975bdb61"}
Sep 10 21:15:20.529672 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:20.529646    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-899bf7e2-6bd4dbf46b-w2czk" event={"ID":"5a9fce01-5671-4f01-b4f9-793d8d86acba","Type":"ContainerStarted","Data":"ae0823aadbcbb78bfa943aac76b5914f01a8f8589298ce8c35c48f2b417f2c09"}
Sep 10 21:15:21.536752 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:21.536714    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-899bf7e2-77747f657-hxjs4" event={"ID":"f9381c51-d427-44f9-9af8-f1352968c507","Type":"ContainerStarted","Data":"b4a9cffaaee8f1fb560422a40f1878306cb88cda1e9da4a85aaa4f749f52d58b"}
Sep 10 21:15:21.537178 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:21.536827    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-899bf7e2-77747f657-hxjs4"
Sep 10 21:15:21.538280 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:21.538254    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-899bf7e2-6bd4dbf46b-w2czk" event={"ID":"5a9fce01-5671-4f01-b4f9-793d8d86acba","Type":"ContainerStarted","Data":"f637abb30399c80a9aecc6bfbf54d75980b9f21d0075079ee3a6c0ed252045a9"}
Sep 10 21:15:21.538401 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:21.538352    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-899bf7e2-6bd4dbf46b-w2czk"
Sep 10 21:15:21.556466 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:21.556422    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-899bf7e2-77747f657-hxjs4" podStartSLOduration=2.556410745 podStartE2EDuration="2.556410745s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:15:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:15:21.554464598 +0000 UTC m=+1102.241531876" watchObservedRunningTime="2026-09-10 21:15:21.556410745 +0000 UTC m=+1102.243478023"
Sep 10 21:15:21.574800 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:21.574761    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-899bf7e2-6bd4dbf46b-w2czk" podStartSLOduration=2.574747608 podStartE2EDuration="2.574747608s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:15:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:15:21.572318098 +0000 UTC m=+1102.259385375" watchObservedRunningTime="2026-09-10 21:15:21.574747608 +0000 UTC m=+1102.261814885"
Sep 10 21:15:25.074535 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:25.074490    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx"]
Sep 10 21:15:25.078416 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:25.078386    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx"
Sep 10 21:15:25.080929 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:25.080904    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-af7150-openshift-default-dockercfg-c2x25\""
Sep 10 21:15:25.086575 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:25.086497    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3008517c-ea98-4f07-85a7-c711e23cd25a-istiod-ca-cert\") pod \"e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx\" (UID: \"3008517c-ea98-4f07-85a7-c711e23cd25a\") " pod="openshift-ingress/e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx"
Sep 10 21:15:25.086575 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:25.086561    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3008517c-ea98-4f07-85a7-c711e23cd25a-workload-socket\") pod \"e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx\" (UID: \"3008517c-ea98-4f07-85a7-c711e23cd25a\") " pod="openshift-ingress/e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx"
Sep 10 21:15:25.086766 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:25.086593    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3008517c-ea98-4f07-85a7-c711e23cd25a-istio-data\") pod \"e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx\" (UID: \"3008517c-ea98-4f07-85a7-c711e23cd25a\") " pod="openshift-ingress/e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx"
Sep 10 21:15:25.086766 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:25.086648    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3008517c-ea98-4f07-85a7-c711e23cd25a-istio-token\") pod \"e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx\" (UID: \"3008517c-ea98-4f07-85a7-c711e23cd25a\") " pod="openshift-ingress/e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx"
Sep 10 21:15:25.086766 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:25.086674    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3008517c-ea98-4f07-85a7-c711e23cd25a-workload-certs\") pod \"e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx\" (UID: \"3008517c-ea98-4f07-85a7-c711e23cd25a\") " pod="openshift-ingress/e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx"
Sep 10 21:15:25.086766 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:25.086709    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3008517c-ea98-4f07-85a7-c711e23cd25a-credential-socket\") pod \"e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx\" (UID: \"3008517c-ea98-4f07-85a7-c711e23cd25a\") " pod="openshift-ingress/e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx"
Sep 10 21:15:25.086766 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:25.086741    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3008517c-ea98-4f07-85a7-c711e23cd25a-istio-envoy\") pod \"e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx\" (UID: \"3008517c-ea98-4f07-85a7-c711e23cd25a\") " pod="openshift-ingress/e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx"
Sep 10 21:15:25.087086 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:25.086785    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rg98j\" (UniqueName: \"kubernetes.io/projected/3008517c-ea98-4f07-85a7-c711e23cd25a-kube-api-access-rg98j\") pod \"e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx\" (UID: \"3008517c-ea98-4f07-85a7-c711e23cd25a\") " pod="openshift-ingress/e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx"
Sep 10 21:15:25.087086 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:25.086842    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3008517c-ea98-4f07-85a7-c711e23cd25a-istio-podinfo\") pod \"e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx\" (UID: \"3008517c-ea98-4f07-85a7-c711e23cd25a\") " pod="openshift-ingress/e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx"
Sep 10 21:15:25.090579 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:25.090551    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx"]
Sep 10 21:15:25.187661 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:25.187621    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rg98j\" (UniqueName: \"kubernetes.io/projected/3008517c-ea98-4f07-85a7-c711e23cd25a-kube-api-access-rg98j\") pod \"e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx\" (UID: \"3008517c-ea98-4f07-85a7-c711e23cd25a\") " pod="openshift-ingress/e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx"
Sep 10 21:15:25.187833 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:25.187674    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3008517c-ea98-4f07-85a7-c711e23cd25a-istio-podinfo\") pod \"e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx\" (UID: \"3008517c-ea98-4f07-85a7-c711e23cd25a\") " pod="openshift-ingress/e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx"
Sep 10 21:15:25.187833 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:25.187732    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3008517c-ea98-4f07-85a7-c711e23cd25a-istiod-ca-cert\") pod \"e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx\" (UID: \"3008517c-ea98-4f07-85a7-c711e23cd25a\") " pod="openshift-ingress/e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx"
Sep 10 21:15:25.187833 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:25.187775    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3008517c-ea98-4f07-85a7-c711e23cd25a-workload-socket\") pod \"e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx\" (UID: \"3008517c-ea98-4f07-85a7-c711e23cd25a\") " pod="openshift-ingress/e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx"
Sep 10 21:15:25.187833 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:25.187807    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3008517c-ea98-4f07-85a7-c711e23cd25a-istio-data\") pod \"e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx\" (UID: \"3008517c-ea98-4f07-85a7-c711e23cd25a\") " pod="openshift-ingress/e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx"
Sep 10 21:15:25.188046 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:25.187860    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3008517c-ea98-4f07-85a7-c711e23cd25a-istio-token\") pod \"e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx\" (UID: \"3008517c-ea98-4f07-85a7-c711e23cd25a\") " pod="openshift-ingress/e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx"
Sep 10 21:15:25.188046 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:25.187887    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3008517c-ea98-4f07-85a7-c711e23cd25a-workload-certs\") pod \"e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx\" (UID: \"3008517c-ea98-4f07-85a7-c711e23cd25a\") " pod="openshift-ingress/e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx"
Sep 10 21:15:25.188046 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:25.187919    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3008517c-ea98-4f07-85a7-c711e23cd25a-credential-socket\") pod \"e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx\" (UID: \"3008517c-ea98-4f07-85a7-c711e23cd25a\") " pod="openshift-ingress/e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx"
Sep 10 21:15:25.188046 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:25.187955    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3008517c-ea98-4f07-85a7-c711e23cd25a-istio-envoy\") pod \"e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx\" (UID: \"3008517c-ea98-4f07-85a7-c711e23cd25a\") " pod="openshift-ingress/e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx"
Sep 10 21:15:25.188423 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:25.188395    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3008517c-ea98-4f07-85a7-c711e23cd25a-credential-socket\") pod \"e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx\" (UID: \"3008517c-ea98-4f07-85a7-c711e23cd25a\") " pod="openshift-ingress/e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx"
Sep 10 21:15:25.188555 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:25.188387    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3008517c-ea98-4f07-85a7-c711e23cd25a-workload-certs\") pod \"e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx\" (UID: \"3008517c-ea98-4f07-85a7-c711e23cd25a\") " pod="openshift-ingress/e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx"
Sep 10 21:15:25.188555 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:25.188465    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3008517c-ea98-4f07-85a7-c711e23cd25a-istio-data\") pod \"e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx\" (UID: \"3008517c-ea98-4f07-85a7-c711e23cd25a\") " pod="openshift-ingress/e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx"
Sep 10 21:15:25.188555 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:25.188526    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3008517c-ea98-4f07-85a7-c711e23cd25a-workload-socket\") pod \"e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx\" (UID: \"3008517c-ea98-4f07-85a7-c711e23cd25a\") " pod="openshift-ingress/e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx"
Sep 10 21:15:25.188721 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:25.188624    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3008517c-ea98-4f07-85a7-c711e23cd25a-istiod-ca-cert\") pod \"e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx\" (UID: \"3008517c-ea98-4f07-85a7-c711e23cd25a\") " pod="openshift-ingress/e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx"
Sep 10 21:15:25.190108 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:25.190083    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3008517c-ea98-4f07-85a7-c711e23cd25a-istio-envoy\") pod \"e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx\" (UID: \"3008517c-ea98-4f07-85a7-c711e23cd25a\") " pod="openshift-ingress/e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx"
Sep 10 21:15:25.190253 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:25.190215    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3008517c-ea98-4f07-85a7-c711e23cd25a-istio-podinfo\") pod \"e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx\" (UID: \"3008517c-ea98-4f07-85a7-c711e23cd25a\") " pod="openshift-ingress/e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx"
Sep 10 21:15:25.198015 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:25.197996    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3008517c-ea98-4f07-85a7-c711e23cd25a-istio-token\") pod \"e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx\" (UID: \"3008517c-ea98-4f07-85a7-c711e23cd25a\") " pod="openshift-ingress/e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx"
Sep 10 21:15:25.198281 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:25.198263    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rg98j\" (UniqueName: \"kubernetes.io/projected/3008517c-ea98-4f07-85a7-c711e23cd25a-kube-api-access-rg98j\") pod \"e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx\" (UID: \"3008517c-ea98-4f07-85a7-c711e23cd25a\") " pod="openshift-ingress/e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx"
Sep 10 21:15:25.391504 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:25.391421    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx"
Sep 10 21:15:25.669541 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:25.669519    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx"]
Sep 10 21:15:25.672075 ip-10-0-129-100 kubenswrapper[2564]: W0910 21:15:25.672034    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3008517c_ea98_4f07_85a7_c711e23cd25a.slice/crio-971da780919c8516bf671245affa0652d9683cdcfe6191e81b5209818171d321 WatchSource:0}: Error finding container 971da780919c8516bf671245affa0652d9683cdcfe6191e81b5209818171d321: Status 404 returned error can't find the container with id 971da780919c8516bf671245affa0652d9683cdcfe6191e81b5209818171d321
Sep 10 21:15:25.674312 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:25.674280    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 10 21:15:25.674383 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:25.674348    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 10 21:15:25.674383 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:25.674373    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 10 21:15:26.570545 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:26.570497    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx" event={"ID":"3008517c-ea98-4f07-85a7-c711e23cd25a","Type":"ContainerStarted","Data":"6c93003deab05ec59f150175c4573f3fbd4ef6326190db84a8ac612d57ccd5b2"}
Sep 10 21:15:26.570923 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:26.570566    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx" event={"ID":"3008517c-ea98-4f07-85a7-c711e23cd25a","Type":"ContainerStarted","Data":"971da780919c8516bf671245affa0652d9683cdcfe6191e81b5209818171d321"}
Sep 10 21:15:26.594578 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:26.594520    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx" podStartSLOduration=1.5944923869999998 podStartE2EDuration="1.594492387s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:15:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:15:26.593440184 +0000 UTC m=+1107.280507464" watchObservedRunningTime="2026-09-10 21:15:26.594492387 +0000 UTC m=+1107.281559667"
Sep 10 21:15:27.392582 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:27.392546    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx"
Sep 10 21:15:27.397420 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:27.397396    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx"
Sep 10 21:15:27.576885 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:27.576852    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx"
Sep 10 21:15:27.577890 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:27.577871    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx"
Sep 10 21:15:32.546295 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:32.546260    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-899bf7e2-6bd4dbf46b-w2czk"
Sep 10 21:15:32.546674 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:32.546330    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-899bf7e2-77747f657-hxjs4"
Sep 10 21:15:43.619455 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:43.619404    2564 patch_prober.go:28] interesting pod/e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 21:15:43.619864 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:43.619472    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx" podUID="3008517c-ea98-4f07-85a7-c711e23cd25a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 21:15:44.683949 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:44.683913    2564 generic.go:356] "Generic (PLEG): container finished" podID="3008517c-ea98-4f07-85a7-c711e23cd25a" containerID="6c93003deab05ec59f150175c4573f3fbd4ef6326190db84a8ac612d57ccd5b2" exitCode=0
Sep 10 21:15:44.684501 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:44.683976    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx" event={"ID":"3008517c-ea98-4f07-85a7-c711e23cd25a","Type":"ContainerDied","Data":"6c93003deab05ec59f150175c4573f3fbd4ef6326190db84a8ac612d57ccd5b2"}
Sep 10 21:15:44.684579 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:44.684510    2564 scope.go:117] "RemoveContainer" containerID="6c93003deab05ec59f150175c4573f3fbd4ef6326190db84a8ac612d57ccd5b2"
Sep 10 21:15:44.685665 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:44.685620    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 10 21:15:44.685768 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:44.685703    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 10 21:15:44.685768 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:44.685738    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 10 21:15:45.693830 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:45.693794    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx" event={"ID":"3008517c-ea98-4f07-85a7-c711e23cd25a","Type":"ContainerStarted","Data":"57bb67b8950065ad5bffb18f251bd6e24769fb3eb3a7be9842abb77a474dc053"}
Sep 10 21:15:46.392290 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:46.392250    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx"
Sep 10 21:15:46.392555 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:46.392529    2564 patch_prober.go:28] interesting pod/e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 10 21:15:46.392647 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:46.392592    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx" podUID="3008517c-ea98-4f07-85a7-c711e23cd25a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 10 21:15:47.392304 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:47.392260    2564 patch_prober.go:28] interesting pod/e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 10 21:15:47.392706 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:47.392335    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx" podUID="3008517c-ea98-4f07-85a7-c711e23cd25a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 10 21:15:48.392564 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:48.392519    2564 patch_prober.go:28] interesting pod/e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 10 21:15:48.393030 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:48.392597    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx" podUID="3008517c-ea98-4f07-85a7-c711e23cd25a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 10 21:15:49.392827 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:49.392787    2564 patch_prober.go:28] interesting pod/e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 10 21:15:49.393254 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:49.392851    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx" podUID="3008517c-ea98-4f07-85a7-c711e23cd25a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 10 21:15:50.392102 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:50.392061    2564 patch_prober.go:28] interesting pod/e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 10 21:15:50.392336 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:50.392129    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx" podUID="3008517c-ea98-4f07-85a7-c711e23cd25a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 10 21:15:51.396573 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:51.396540    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx"
Sep 10 21:15:51.396959 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:51.396917    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx"
Sep 10 21:15:51.397711 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:51.397693    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx"
Sep 10 21:15:54.008593 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:54.008552    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq"]
Sep 10 21:15:54.013773 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:54.013750    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq"
Sep 10 21:15:54.016399 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:54.016371    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-7810bd-openshift-default-dockercfg-tb42b\""
Sep 10 21:15:54.023111 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:54.023083    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq"]
Sep 10 21:15:54.150441 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:54.150401    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f497ebed-8418-49b5-ac33-1153d0ead2ab-istio-podinfo\") pod \"e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq\" (UID: \"f497ebed-8418-49b5-ac33-1153d0ead2ab\") " pod="openshift-ingress/e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq"
Sep 10 21:15:54.150441 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:54.150442    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f497ebed-8418-49b5-ac33-1153d0ead2ab-credential-socket\") pod \"e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq\" (UID: \"f497ebed-8418-49b5-ac33-1153d0ead2ab\") " pod="openshift-ingress/e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq"
Sep 10 21:15:54.150668 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:54.150518    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f497ebed-8418-49b5-ac33-1153d0ead2ab-workload-socket\") pod \"e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq\" (UID: \"f497ebed-8418-49b5-ac33-1153d0ead2ab\") " pod="openshift-ingress/e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq"
Sep 10 21:15:54.150668 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:54.150548    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f497ebed-8418-49b5-ac33-1153d0ead2ab-istiod-ca-cert\") pod \"e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq\" (UID: \"f497ebed-8418-49b5-ac33-1153d0ead2ab\") " pod="openshift-ingress/e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq"
Sep 10 21:15:54.150668 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:54.150573    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wp2h\" (UniqueName: \"kubernetes.io/projected/f497ebed-8418-49b5-ac33-1153d0ead2ab-kube-api-access-2wp2h\") pod \"e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq\" (UID: \"f497ebed-8418-49b5-ac33-1153d0ead2ab\") " pod="openshift-ingress/e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq"
Sep 10 21:15:54.150668 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:54.150592    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f497ebed-8418-49b5-ac33-1153d0ead2ab-workload-certs\") pod \"e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq\" (UID: \"f497ebed-8418-49b5-ac33-1153d0ead2ab\") " pod="openshift-ingress/e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq"
Sep 10 21:15:54.150668 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:54.150608    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f497ebed-8418-49b5-ac33-1153d0ead2ab-istio-token\") pod \"e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq\" (UID: \"f497ebed-8418-49b5-ac33-1153d0ead2ab\") " pod="openshift-ingress/e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq"
Sep 10 21:15:54.150668 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:54.150663    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f497ebed-8418-49b5-ac33-1153d0ead2ab-istio-envoy\") pod \"e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq\" (UID: \"f497ebed-8418-49b5-ac33-1153d0ead2ab\") " pod="openshift-ingress/e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq"
Sep 10 21:15:54.150863 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:54.150696    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f497ebed-8418-49b5-ac33-1153d0ead2ab-istio-data\") pod \"e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq\" (UID: \"f497ebed-8418-49b5-ac33-1153d0ead2ab\") " pod="openshift-ingress/e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq"
Sep 10 21:15:54.251519 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:54.251476    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f497ebed-8418-49b5-ac33-1153d0ead2ab-istio-envoy\") pod \"e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq\" (UID: \"f497ebed-8418-49b5-ac33-1153d0ead2ab\") " pod="openshift-ingress/e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq"
Sep 10 21:15:54.251708 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:54.251532    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f497ebed-8418-49b5-ac33-1153d0ead2ab-istio-data\") pod \"e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq\" (UID: \"f497ebed-8418-49b5-ac33-1153d0ead2ab\") " pod="openshift-ingress/e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq"
Sep 10 21:15:54.251708 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:54.251556    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f497ebed-8418-49b5-ac33-1153d0ead2ab-istio-podinfo\") pod \"e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq\" (UID: \"f497ebed-8418-49b5-ac33-1153d0ead2ab\") " pod="openshift-ingress/e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq"
Sep 10 21:15:54.251708 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:54.251574    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f497ebed-8418-49b5-ac33-1153d0ead2ab-credential-socket\") pod \"e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq\" (UID: \"f497ebed-8418-49b5-ac33-1153d0ead2ab\") " pod="openshift-ingress/e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq"
Sep 10 21:15:54.251708 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:54.251616    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f497ebed-8418-49b5-ac33-1153d0ead2ab-workload-socket\") pod \"e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq\" (UID: \"f497ebed-8418-49b5-ac33-1153d0ead2ab\") " pod="openshift-ingress/e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq"
Sep 10 21:15:54.251890 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:54.251770    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f497ebed-8418-49b5-ac33-1153d0ead2ab-istiod-ca-cert\") pod \"e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq\" (UID: \"f497ebed-8418-49b5-ac33-1153d0ead2ab\") " pod="openshift-ingress/e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq"
Sep 10 21:15:54.251890 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:54.251825    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wp2h\" (UniqueName: \"kubernetes.io/projected/f497ebed-8418-49b5-ac33-1153d0ead2ab-kube-api-access-2wp2h\") pod \"e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq\" (UID: \"f497ebed-8418-49b5-ac33-1153d0ead2ab\") " pod="openshift-ingress/e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq"
Sep 10 21:15:54.251890 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:54.251857    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f497ebed-8418-49b5-ac33-1153d0ead2ab-workload-certs\") pod \"e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq\" (UID: \"f497ebed-8418-49b5-ac33-1153d0ead2ab\") " pod="openshift-ingress/e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq"
Sep 10 21:15:54.251890 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:54.251887    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f497ebed-8418-49b5-ac33-1153d0ead2ab-istio-token\") pod \"e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq\" (UID: \"f497ebed-8418-49b5-ac33-1153d0ead2ab\") " pod="openshift-ingress/e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq"
Sep 10 21:15:54.252107 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:54.252000    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f497ebed-8418-49b5-ac33-1153d0ead2ab-workload-socket\") pod \"e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq\" (UID: \"f497ebed-8418-49b5-ac33-1153d0ead2ab\") " pod="openshift-ingress/e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq"
Sep 10 21:15:54.252107 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:54.252088    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f497ebed-8418-49b5-ac33-1153d0ead2ab-credential-socket\") pod \"e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq\" (UID: \"f497ebed-8418-49b5-ac33-1153d0ead2ab\") " pod="openshift-ingress/e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq"
Sep 10 21:15:54.252281 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:54.252254    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f497ebed-8418-49b5-ac33-1153d0ead2ab-workload-certs\") pod \"e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq\" (UID: \"f497ebed-8418-49b5-ac33-1153d0ead2ab\") " pod="openshift-ingress/e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq"
Sep 10 21:15:54.252346 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:54.252321    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f497ebed-8418-49b5-ac33-1153d0ead2ab-istio-data\") pod \"e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq\" (UID: \"f497ebed-8418-49b5-ac33-1153d0ead2ab\") " pod="openshift-ingress/e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq"
Sep 10 21:15:54.252630 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:54.252605    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f497ebed-8418-49b5-ac33-1153d0ead2ab-istiod-ca-cert\") pod \"e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq\" (UID: \"f497ebed-8418-49b5-ac33-1153d0ead2ab\") " pod="openshift-ingress/e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq"
Sep 10 21:15:54.253933 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:54.253913    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f497ebed-8418-49b5-ac33-1153d0ead2ab-istio-envoy\") pod \"e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq\" (UID: \"f497ebed-8418-49b5-ac33-1153d0ead2ab\") " pod="openshift-ingress/e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq"
Sep 10 21:15:54.254151 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:54.254138    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f497ebed-8418-49b5-ac33-1153d0ead2ab-istio-podinfo\") pod \"e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq\" (UID: \"f497ebed-8418-49b5-ac33-1153d0ead2ab\") " pod="openshift-ingress/e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq"
Sep 10 21:15:54.260730 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:54.260673    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f497ebed-8418-49b5-ac33-1153d0ead2ab-istio-token\") pod \"e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq\" (UID: \"f497ebed-8418-49b5-ac33-1153d0ead2ab\") " pod="openshift-ingress/e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq"
Sep 10 21:15:54.261157 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:54.261136    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wp2h\" (UniqueName: \"kubernetes.io/projected/f497ebed-8418-49b5-ac33-1153d0ead2ab-kube-api-access-2wp2h\") pod \"e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq\" (UID: \"f497ebed-8418-49b5-ac33-1153d0ead2ab\") " pod="openshift-ingress/e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq"
Sep 10 21:15:54.325077 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:54.325040    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq"
Sep 10 21:15:54.604844 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:54.604816    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq"]
Sep 10 21:15:54.606380 ip-10-0-129-100 kubenswrapper[2564]: W0910 21:15:54.606354    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf497ebed_8418_49b5_ac33_1153d0ead2ab.slice/crio-463dc4dab3cfd0ab413382dfffc166a372ef7ed1b94fe5f13e8858905fcbd618 WatchSource:0}: Error finding container 463dc4dab3cfd0ab413382dfffc166a372ef7ed1b94fe5f13e8858905fcbd618: Status 404 returned error can't find the container with id 463dc4dab3cfd0ab413382dfffc166a372ef7ed1b94fe5f13e8858905fcbd618
Sep 10 21:15:54.608545 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:54.608510    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 10 21:15:54.608650 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:54.608611    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 10 21:15:54.608716 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:54.608673    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 10 21:15:54.751723 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:54.751688    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq" event={"ID":"f497ebed-8418-49b5-ac33-1153d0ead2ab","Type":"ContainerStarted","Data":"7fe466b7a44b46accf5a6449a87556e82ef146581d3d5ab3a9e060a8c1e02069"}
Sep 10 21:15:54.751901 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:54.751754    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq" event={"ID":"f497ebed-8418-49b5-ac33-1153d0ead2ab","Type":"ContainerStarted","Data":"463dc4dab3cfd0ab413382dfffc166a372ef7ed1b94fe5f13e8858905fcbd618"}
Sep 10 21:15:54.782682 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:54.782615    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq" podStartSLOduration=1.7825921550000001 podStartE2EDuration="1.782592155s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:15:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:15:54.778918284 +0000 UTC m=+1135.465985599" watchObservedRunningTime="2026-09-10 21:15:54.782592155 +0000 UTC m=+1135.469659433"
Sep 10 21:15:55.325952 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:55.325913    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq"
Sep 10 21:15:55.330752 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:55.330728    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq"
Sep 10 21:15:55.757900 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:55.757819    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq"
Sep 10 21:15:55.758678 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:15:55.758658    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq"
Sep 10 21:16:00.441052 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:00.441009    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-899bf7e2-77747f657-hxjs4"]
Sep 10 21:16:00.441563 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:00.441245    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-899bf7e2-77747f657-hxjs4" podUID="f9381c51-d427-44f9-9af8-f1352968c507" containerName="payload-processing" containerID="cri-o://b4a9cffaaee8f1fb560422a40f1878306cb88cda1e9da4a85aaa4f749f52d58b" gracePeriod=30
Sep 10 21:16:00.448999 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:00.448802    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-899bf7e2-6bd4dbf46b-w2czk"]
Sep 10 21:16:00.449165 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:00.449066    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-899bf7e2-6bd4dbf46b-w2czk" podUID="5a9fce01-5671-4f01-b4f9-793d8d86acba" containerName="payload-pre-processing" containerID="cri-o://f637abb30399c80a9aecc6bfbf54d75980b9f21d0075079ee3a6c0ed252045a9" gracePeriod=30
Sep 10 21:16:00.720041 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:00.720013    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-899bf7e2-77747f657-hxjs4"
Sep 10 21:16:00.723487 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:00.723464    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-899bf7e2-6bd4dbf46b-w2czk"
Sep 10 21:16:00.798408 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:00.798162    2564 generic.go:356] "Generic (PLEG): container finished" podID="f9381c51-d427-44f9-9af8-f1352968c507" containerID="b4a9cffaaee8f1fb560422a40f1878306cb88cda1e9da4a85aaa4f749f52d58b" exitCode=0
Sep 10 21:16:00.798408 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:00.798297    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-899bf7e2-77747f657-hxjs4" event={"ID":"f9381c51-d427-44f9-9af8-f1352968c507","Type":"ContainerDied","Data":"b4a9cffaaee8f1fb560422a40f1878306cb88cda1e9da4a85aaa4f749f52d58b"}
Sep 10 21:16:00.798408 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:00.798381    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-899bf7e2-77747f657-hxjs4" event={"ID":"f9381c51-d427-44f9-9af8-f1352968c507","Type":"ContainerDied","Data":"bef2476bcdd5db5b4f7bd18ba85975aa936637245d57e7fad572ebdd975bdb61"}
Sep 10 21:16:00.798741 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:00.798420    2564 scope.go:117] "RemoveContainer" containerID="b4a9cffaaee8f1fb560422a40f1878306cb88cda1e9da4a85aaa4f749f52d58b"
Sep 10 21:16:00.799449 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:00.798847    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-899bf7e2-77747f657-hxjs4"
Sep 10 21:16:00.801720 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:00.801696    2564 generic.go:356] "Generic (PLEG): container finished" podID="5a9fce01-5671-4f01-b4f9-793d8d86acba" containerID="f637abb30399c80a9aecc6bfbf54d75980b9f21d0075079ee3a6c0ed252045a9" exitCode=0
Sep 10 21:16:00.802040 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:00.801730    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-899bf7e2-6bd4dbf46b-w2czk" event={"ID":"5a9fce01-5671-4f01-b4f9-793d8d86acba","Type":"ContainerDied","Data":"f637abb30399c80a9aecc6bfbf54d75980b9f21d0075079ee3a6c0ed252045a9"}
Sep 10 21:16:00.802040 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:00.801764    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-899bf7e2-6bd4dbf46b-w2czk"
Sep 10 21:16:00.802040 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:00.801793    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-899bf7e2-6bd4dbf46b-w2czk" event={"ID":"5a9fce01-5671-4f01-b4f9-793d8d86acba","Type":"ContainerDied","Data":"ae0823aadbcbb78bfa943aac76b5914f01a8f8589298ce8c35c48f2b417f2c09"}
Sep 10 21:16:00.810026 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:00.810003    2564 scope.go:117] "RemoveContainer" containerID="b4a9cffaaee8f1fb560422a40f1878306cb88cda1e9da4a85aaa4f749f52d58b"
Sep 10 21:16:00.810342 ip-10-0-129-100 kubenswrapper[2564]: E0910 21:16:00.810322    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4a9cffaaee8f1fb560422a40f1878306cb88cda1e9da4a85aaa4f749f52d58b\": container with ID starting with b4a9cffaaee8f1fb560422a40f1878306cb88cda1e9da4a85aaa4f749f52d58b not found: ID does not exist" containerID="b4a9cffaaee8f1fb560422a40f1878306cb88cda1e9da4a85aaa4f749f52d58b"
Sep 10 21:16:00.810414 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:00.810351    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4a9cffaaee8f1fb560422a40f1878306cb88cda1e9da4a85aaa4f749f52d58b"} err="failed to get container status \"b4a9cffaaee8f1fb560422a40f1878306cb88cda1e9da4a85aaa4f749f52d58b\": rpc error: code = NotFound desc = could not find container \"b4a9cffaaee8f1fb560422a40f1878306cb88cda1e9da4a85aaa4f749f52d58b\": container with ID starting with b4a9cffaaee8f1fb560422a40f1878306cb88cda1e9da4a85aaa4f749f52d58b not found: ID does not exist"
Sep 10 21:16:00.810414 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:00.810369    2564 scope.go:117] "RemoveContainer" containerID="f637abb30399c80a9aecc6bfbf54d75980b9f21d0075079ee3a6c0ed252045a9"
Sep 10 21:16:00.810921 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:00.810897    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mxb5k\" (UniqueName: \"kubernetes.io/projected/f9381c51-d427-44f9-9af8-f1352968c507-kube-api-access-mxb5k\") pod \"f9381c51-d427-44f9-9af8-f1352968c507\" (UID: \"f9381c51-d427-44f9-9af8-f1352968c507\") "
Sep 10 21:16:00.811017 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:00.810947    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f9381c51-d427-44f9-9af8-f1352968c507-plugins-config-volume\") pod \"f9381c51-d427-44f9-9af8-f1352968c507\" (UID: \"f9381c51-d427-44f9-9af8-f1352968c507\") "
Sep 10 21:16:00.811017 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:00.810991    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5a9fce01-5671-4f01-b4f9-793d8d86acba-plugins-config-volume\") pod \"5a9fce01-5671-4f01-b4f9-793d8d86acba\" (UID: \"5a9fce01-5671-4f01-b4f9-793d8d86acba\") "
Sep 10 21:16:00.811107 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:00.811094    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c9l5f\" (UniqueName: \"kubernetes.io/projected/5a9fce01-5671-4f01-b4f9-793d8d86acba-kube-api-access-c9l5f\") pod \"5a9fce01-5671-4f01-b4f9-793d8d86acba\" (UID: \"5a9fce01-5671-4f01-b4f9-793d8d86acba\") "
Sep 10 21:16:00.811411 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:00.811390    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9381c51-d427-44f9-9af8-f1352968c507-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f9381c51-d427-44f9-9af8-f1352968c507" (UID: "f9381c51-d427-44f9-9af8-f1352968c507"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:16:00.811474 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:00.811424    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a9fce01-5671-4f01-b4f9-793d8d86acba-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5a9fce01-5671-4f01-b4f9-793d8d86acba" (UID: "5a9fce01-5671-4f01-b4f9-793d8d86acba"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:16:00.813077 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:00.813053    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9381c51-d427-44f9-9af8-f1352968c507-kube-api-access-mxb5k" (OuterVolumeSpecName: "kube-api-access-mxb5k") pod "f9381c51-d427-44f9-9af8-f1352968c507" (UID: "f9381c51-d427-44f9-9af8-f1352968c507"). InnerVolumeSpecName "kube-api-access-mxb5k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:16:00.813077 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:00.813065    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a9fce01-5671-4f01-b4f9-793d8d86acba-kube-api-access-c9l5f" (OuterVolumeSpecName: "kube-api-access-c9l5f") pod "5a9fce01-5671-4f01-b4f9-793d8d86acba" (UID: "5a9fce01-5671-4f01-b4f9-793d8d86acba"). InnerVolumeSpecName "kube-api-access-c9l5f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:16:00.818865 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:00.818846    2564 scope.go:117] "RemoveContainer" containerID="f637abb30399c80a9aecc6bfbf54d75980b9f21d0075079ee3a6c0ed252045a9"
Sep 10 21:16:00.819185 ip-10-0-129-100 kubenswrapper[2564]: E0910 21:16:00.819164    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f637abb30399c80a9aecc6bfbf54d75980b9f21d0075079ee3a6c0ed252045a9\": container with ID starting with f637abb30399c80a9aecc6bfbf54d75980b9f21d0075079ee3a6c0ed252045a9 not found: ID does not exist" containerID="f637abb30399c80a9aecc6bfbf54d75980b9f21d0075079ee3a6c0ed252045a9"
Sep 10 21:16:00.819272 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:00.819195    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f637abb30399c80a9aecc6bfbf54d75980b9f21d0075079ee3a6c0ed252045a9"} err="failed to get container status \"f637abb30399c80a9aecc6bfbf54d75980b9f21d0075079ee3a6c0ed252045a9\": rpc error: code = NotFound desc = could not find container \"f637abb30399c80a9aecc6bfbf54d75980b9f21d0075079ee3a6c0ed252045a9\": container with ID starting with f637abb30399c80a9aecc6bfbf54d75980b9f21d0075079ee3a6c0ed252045a9 not found: ID does not exist"
Sep 10 21:16:00.912568 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:00.912531    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c9l5f\" (UniqueName: \"kubernetes.io/projected/5a9fce01-5671-4f01-b4f9-793d8d86acba-kube-api-access-c9l5f\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:16:00.912568 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:00.912560    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mxb5k\" (UniqueName: \"kubernetes.io/projected/f9381c51-d427-44f9-9af8-f1352968c507-kube-api-access-mxb5k\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:16:00.912568 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:00.912571    2564 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f9381c51-d427-44f9-9af8-f1352968c507-plugins-config-volume\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:16:00.912797 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:00.912582    2564 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5a9fce01-5671-4f01-b4f9-793d8d86acba-plugins-config-volume\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:16:01.122568 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:01.122534    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-899bf7e2-77747f657-hxjs4"]
Sep 10 21:16:01.126378 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:01.126354    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-899bf7e2-77747f657-hxjs4"]
Sep 10 21:16:01.137244 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:01.137206    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-899bf7e2-6bd4dbf46b-w2czk"]
Sep 10 21:16:01.144385 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:01.144356    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-899bf7e2-6bd4dbf46b-w2czk"]
Sep 10 21:16:01.874735 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:01.874692    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a9fce01-5671-4f01-b4f9-793d8d86acba" path="/var/lib/kubelet/pods/5a9fce01-5671-4f01-b4f9-793d8d86acba/volumes"
Sep 10 21:16:01.875260 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:01.875223    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9381c51-d427-44f9-9af8-f1352968c507" path="/var/lib/kubelet/pods/f9381c51-d427-44f9-9af8-f1352968c507/volumes"
Sep 10 21:16:11.799420 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:11.799379    2564 patch_prober.go:28] interesting pod/e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 21:16:11.799814 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:11.799459    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq" podUID="f497ebed-8418-49b5-ac33-1153d0ead2ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 21:16:12.881450 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:12.881360    2564 generic.go:356] "Generic (PLEG): container finished" podID="f497ebed-8418-49b5-ac33-1153d0ead2ab" containerID="7fe466b7a44b46accf5a6449a87556e82ef146581d3d5ab3a9e060a8c1e02069" exitCode=0
Sep 10 21:16:12.881450 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:12.881434    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq" event={"ID":"f497ebed-8418-49b5-ac33-1153d0ead2ab","Type":"ContainerDied","Data":"7fe466b7a44b46accf5a6449a87556e82ef146581d3d5ab3a9e060a8c1e02069"}
Sep 10 21:16:12.882023 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:12.881962    2564 scope.go:117] "RemoveContainer" containerID="7fe466b7a44b46accf5a6449a87556e82ef146581d3d5ab3a9e060a8c1e02069"
Sep 10 21:16:12.883040 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:12.883009    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 10 21:16:12.883135 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:12.883080    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 10 21:16:12.883135 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:12.883110    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 10 21:16:13.901810 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:13.901771    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq" event={"ID":"f497ebed-8418-49b5-ac33-1153d0ead2ab","Type":"ContainerStarted","Data":"30bf3f187fd8d43aff1f5115c1b49c6e58dcaaf97c12eda1f7195304dac81998"}
Sep 10 21:16:14.325442 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:14.325400    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq"
Sep 10 21:16:14.325618 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:14.325579    2564 patch_prober.go:28] interesting pod/e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Sep 10 21:16:14.325680 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:14.325636    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq" podUID="f497ebed-8418-49b5-ac33-1153d0ead2ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Sep 10 21:16:15.325560 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:15.325521    2564 patch_prober.go:28] interesting pod/e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Sep 10 21:16:15.325949 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:15.325589    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq" podUID="f497ebed-8418-49b5-ac33-1153d0ead2ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Sep 10 21:16:16.325906 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:16.325863    2564 patch_prober.go:28] interesting pod/e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Sep 10 21:16:16.326415 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:16.325928    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq" podUID="f497ebed-8418-49b5-ac33-1153d0ead2ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Sep 10 21:16:17.325458 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:17.325423    2564 patch_prober.go:28] interesting pod/e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Sep 10 21:16:17.325639 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:17.325480    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq" podUID="f497ebed-8418-49b5-ac33-1153d0ead2ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Sep 10 21:16:18.326165 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:18.326127    2564 patch_prober.go:28] interesting pod/e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Sep 10 21:16:18.326590 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:18.326184    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq" podUID="f497ebed-8418-49b5-ac33-1153d0ead2ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Sep 10 21:16:19.329535 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:19.329500    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq"
Sep 10 21:16:19.329983 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:19.329791    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq"
Sep 10 21:16:19.330614 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:19.330598    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq"
Sep 10 21:16:22.237520 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:22.237480    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858"]
Sep 10 21:16:22.238030 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:22.238014    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9381c51-d427-44f9-9af8-f1352968c507" containerName="payload-processing"
Sep 10 21:16:22.238076 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:22.238034    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9381c51-d427-44f9-9af8-f1352968c507" containerName="payload-processing"
Sep 10 21:16:22.238111 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:22.238083    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a9fce01-5671-4f01-b4f9-793d8d86acba" containerName="payload-pre-processing"
Sep 10 21:16:22.238111 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:22.238092    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a9fce01-5671-4f01-b4f9-793d8d86acba" containerName="payload-pre-processing"
Sep 10 21:16:22.238183 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:22.238167    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a9fce01-5671-4f01-b4f9-793d8d86acba" containerName="payload-pre-processing"
Sep 10 21:16:22.238183 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:22.238180    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9381c51-d427-44f9-9af8-f1352968c507" containerName="payload-processing"
Sep 10 21:16:22.240549 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:22.240532    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858"
Sep 10 21:16:22.243143 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:22.243119    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-9cce25-openshift-default-dockercfg-8mvp5\""
Sep 10 21:16:22.252388 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:22.252317    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858"]
Sep 10 21:16:22.329328 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:22.329294    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07031e9c-e22d-4734-83db-7c781f9f5d3c-istio-envoy\") pod \"e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858\" (UID: \"07031e9c-e22d-4734-83db-7c781f9f5d3c\") " pod="openshift-ingress/e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858"
Sep 10 21:16:22.329506 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:22.329346    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6hs7\" (UniqueName: \"kubernetes.io/projected/07031e9c-e22d-4734-83db-7c781f9f5d3c-kube-api-access-l6hs7\") pod \"e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858\" (UID: \"07031e9c-e22d-4734-83db-7c781f9f5d3c\") " pod="openshift-ingress/e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858"
Sep 10 21:16:22.329506 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:22.329455    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07031e9c-e22d-4734-83db-7c781f9f5d3c-workload-socket\") pod \"e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858\" (UID: \"07031e9c-e22d-4734-83db-7c781f9f5d3c\") " pod="openshift-ingress/e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858"
Sep 10 21:16:22.329506 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:22.329491    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07031e9c-e22d-4734-83db-7c781f9f5d3c-credential-socket\") pod \"e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858\" (UID: \"07031e9c-e22d-4734-83db-7c781f9f5d3c\") " pod="openshift-ingress/e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858"
Sep 10 21:16:22.329642 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:22.329578    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07031e9c-e22d-4734-83db-7c781f9f5d3c-istiod-ca-cert\") pod \"e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858\" (UID: \"07031e9c-e22d-4734-83db-7c781f9f5d3c\") " pod="openshift-ingress/e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858"
Sep 10 21:16:22.329642 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:22.329612    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07031e9c-e22d-4734-83db-7c781f9f5d3c-workload-certs\") pod \"e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858\" (UID: \"07031e9c-e22d-4734-83db-7c781f9f5d3c\") " pod="openshift-ingress/e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858"
Sep 10 21:16:22.329642 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:22.329637    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07031e9c-e22d-4734-83db-7c781f9f5d3c-istio-token\") pod \"e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858\" (UID: \"07031e9c-e22d-4734-83db-7c781f9f5d3c\") " pod="openshift-ingress/e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858"
Sep 10 21:16:22.329751 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:22.329678    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07031e9c-e22d-4734-83db-7c781f9f5d3c-istio-podinfo\") pod \"e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858\" (UID: \"07031e9c-e22d-4734-83db-7c781f9f5d3c\") " pod="openshift-ingress/e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858"
Sep 10 21:16:22.329751 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:22.329708    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07031e9c-e22d-4734-83db-7c781f9f5d3c-istio-data\") pod \"e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858\" (UID: \"07031e9c-e22d-4734-83db-7c781f9f5d3c\") " pod="openshift-ingress/e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858"
Sep 10 21:16:22.430974 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:22.430932    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07031e9c-e22d-4734-83db-7c781f9f5d3c-istiod-ca-cert\") pod \"e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858\" (UID: \"07031e9c-e22d-4734-83db-7c781f9f5d3c\") " pod="openshift-ingress/e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858"
Sep 10 21:16:22.430974 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:22.430973    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07031e9c-e22d-4734-83db-7c781f9f5d3c-workload-certs\") pod \"e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858\" (UID: \"07031e9c-e22d-4734-83db-7c781f9f5d3c\") " pod="openshift-ingress/e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858"
Sep 10 21:16:22.431266 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:22.430996    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07031e9c-e22d-4734-83db-7c781f9f5d3c-istio-token\") pod \"e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858\" (UID: \"07031e9c-e22d-4734-83db-7c781f9f5d3c\") " pod="openshift-ingress/e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858"
Sep 10 21:16:22.431266 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:22.431033    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07031e9c-e22d-4734-83db-7c781f9f5d3c-istio-podinfo\") pod \"e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858\" (UID: \"07031e9c-e22d-4734-83db-7c781f9f5d3c\") " pod="openshift-ingress/e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858"
Sep 10 21:16:22.431266 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:22.431061    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07031e9c-e22d-4734-83db-7c781f9f5d3c-istio-data\") pod \"e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858\" (UID: \"07031e9c-e22d-4734-83db-7c781f9f5d3c\") " pod="openshift-ingress/e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858"
Sep 10 21:16:22.431266 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:22.431137    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07031e9c-e22d-4734-83db-7c781f9f5d3c-istio-envoy\") pod \"e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858\" (UID: \"07031e9c-e22d-4734-83db-7c781f9f5d3c\") " pod="openshift-ingress/e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858"
Sep 10 21:16:22.431266 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:22.431174    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6hs7\" (UniqueName: \"kubernetes.io/projected/07031e9c-e22d-4734-83db-7c781f9f5d3c-kube-api-access-l6hs7\") pod \"e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858\" (UID: \"07031e9c-e22d-4734-83db-7c781f9f5d3c\") " pod="openshift-ingress/e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858"
Sep 10 21:16:22.431266 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:22.431215    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07031e9c-e22d-4734-83db-7c781f9f5d3c-workload-socket\") pod \"e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858\" (UID: \"07031e9c-e22d-4734-83db-7c781f9f5d3c\") " pod="openshift-ingress/e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858"
Sep 10 21:16:22.431683 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:22.431293    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07031e9c-e22d-4734-83db-7c781f9f5d3c-credential-socket\") pod \"e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858\" (UID: \"07031e9c-e22d-4734-83db-7c781f9f5d3c\") " pod="openshift-ingress/e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858"
Sep 10 21:16:22.431683 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:22.431462    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07031e9c-e22d-4734-83db-7c781f9f5d3c-workload-certs\") pod \"e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858\" (UID: \"07031e9c-e22d-4734-83db-7c781f9f5d3c\") " pod="openshift-ingress/e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858"
Sep 10 21:16:22.431683 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:22.431563    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07031e9c-e22d-4734-83db-7c781f9f5d3c-istio-data\") pod \"e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858\" (UID: \"07031e9c-e22d-4734-83db-7c781f9f5d3c\") " pod="openshift-ingress/e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858"
Sep 10 21:16:22.431683 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:22.431640    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07031e9c-e22d-4734-83db-7c781f9f5d3c-credential-socket\") pod \"e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858\" (UID: \"07031e9c-e22d-4734-83db-7c781f9f5d3c\") " pod="openshift-ingress/e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858"
Sep 10 21:16:22.431872 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:22.431757    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07031e9c-e22d-4734-83db-7c781f9f5d3c-workload-socket\") pod \"e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858\" (UID: \"07031e9c-e22d-4734-83db-7c781f9f5d3c\") " pod="openshift-ingress/e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858"
Sep 10 21:16:22.431910 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:22.431866    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07031e9c-e22d-4734-83db-7c781f9f5d3c-istiod-ca-cert\") pod \"e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858\" (UID: \"07031e9c-e22d-4734-83db-7c781f9f5d3c\") " pod="openshift-ingress/e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858"
Sep 10 21:16:22.433423 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:22.433400    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07031e9c-e22d-4734-83db-7c781f9f5d3c-istio-envoy\") pod \"e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858\" (UID: \"07031e9c-e22d-4734-83db-7c781f9f5d3c\") " pod="openshift-ingress/e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858"
Sep 10 21:16:22.433725 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:22.433644    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07031e9c-e22d-4734-83db-7c781f9f5d3c-istio-podinfo\") pod \"e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858\" (UID: \"07031e9c-e22d-4734-83db-7c781f9f5d3c\") " pod="openshift-ingress/e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858"
Sep 10 21:16:22.439802 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:22.439775    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07031e9c-e22d-4734-83db-7c781f9f5d3c-istio-token\") pod \"e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858\" (UID: \"07031e9c-e22d-4734-83db-7c781f9f5d3c\") " pod="openshift-ingress/e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858"
Sep 10 21:16:22.439933 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:22.439887    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6hs7\" (UniqueName: \"kubernetes.io/projected/07031e9c-e22d-4734-83db-7c781f9f5d3c-kube-api-access-l6hs7\") pod \"e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858\" (UID: \"07031e9c-e22d-4734-83db-7c781f9f5d3c\") " pod="openshift-ingress/e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858"
Sep 10 21:16:22.551679 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:22.551646    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858"
Sep 10 21:16:22.830269 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:22.830242    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858"]
Sep 10 21:16:22.831337 ip-10-0-129-100 kubenswrapper[2564]: W0910 21:16:22.831311    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07031e9c_e22d_4734_83db_7c781f9f5d3c.slice/crio-cf1b91663022107e554870661572b341f3c65ae75d0d55bc8bb55ce32a9ed58b WatchSource:0}: Error finding container cf1b91663022107e554870661572b341f3c65ae75d0d55bc8bb55ce32a9ed58b: Status 404 returned error can't find the container with id cf1b91663022107e554870661572b341f3c65ae75d0d55bc8bb55ce32a9ed58b
Sep 10 21:16:22.833521 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:22.833491    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 10 21:16:22.833591 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:22.833556    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 10 21:16:22.833629 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:22.833588    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 10 21:16:22.967134 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:22.967082    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858" event={"ID":"07031e9c-e22d-4734-83db-7c781f9f5d3c","Type":"ContainerStarted","Data":"43be1e877ec30228dd9898dab411de762045a1d1763212ccfb001808953ae767"}
Sep 10 21:16:22.967341 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:22.967163    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858" event={"ID":"07031e9c-e22d-4734-83db-7c781f9f5d3c","Type":"ContainerStarted","Data":"cf1b91663022107e554870661572b341f3c65ae75d0d55bc8bb55ce32a9ed58b"}
Sep 10 21:16:22.989677 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:22.989619    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858" podStartSLOduration=0.989602642 podStartE2EDuration="989.602642ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:16:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:16:22.988422021 +0000 UTC m=+1163.675489317" watchObservedRunningTime="2026-09-10 21:16:22.989602642 +0000 UTC m=+1163.676670120"
Sep 10 21:16:23.552642 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:23.552598    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858"
Sep 10 21:16:23.554045 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:23.554021    2564 patch_prober.go:28] interesting pod/e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Sep 10 21:16:23.554125 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:23.554077    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858" podUID="07031e9c-e22d-4734-83db-7c781f9f5d3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Sep 10 21:16:24.556124 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:24.556089    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858"
Sep 10 21:16:24.979185 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:24.979102    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858"
Sep 10 21:16:24.980273 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:24.980219    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858"
Sep 10 21:16:26.779128 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:26.779086    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-9cce25-79ffbcc55d-fdz2l"]
Sep 10 21:16:26.782738 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:26.782721    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-9cce25-79ffbcc55d-fdz2l"
Sep 10 21:16:26.785306 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:26.785273    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-9cce25-dockercfg-q95cz\""
Sep 10 21:16:26.785525 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:26.785501    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-9cce25\""
Sep 10 21:16:26.796415 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:26.796391    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-9cce25-79ffbcc55d-fdz2l"]
Sep 10 21:16:26.872038 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:26.871826    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9d15cad8-cc2a-42c5-bfa7-b0230c9764b1-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-9cce25-79ffbcc55d-fdz2l\" (UID: \"9d15cad8-cc2a-42c5-bfa7-b0230c9764b1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-9cce25-79ffbcc55d-fdz2l"
Sep 10 21:16:26.872038 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:26.871960    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2r4tn\" (UniqueName: \"kubernetes.io/projected/9d15cad8-cc2a-42c5-bfa7-b0230c9764b1-kube-api-access-2r4tn\") pod \"payload-pre-processing-e2e-shared-a-w2-9cce25-79ffbcc55d-fdz2l\" (UID: \"9d15cad8-cc2a-42c5-bfa7-b0230c9764b1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-9cce25-79ffbcc55d-fdz2l"
Sep 10 21:16:26.973125 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:26.973080    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9d15cad8-cc2a-42c5-bfa7-b0230c9764b1-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-9cce25-79ffbcc55d-fdz2l\" (UID: \"9d15cad8-cc2a-42c5-bfa7-b0230c9764b1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-9cce25-79ffbcc55d-fdz2l"
Sep 10 21:16:26.973375 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:26.973146    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2r4tn\" (UniqueName: \"kubernetes.io/projected/9d15cad8-cc2a-42c5-bfa7-b0230c9764b1-kube-api-access-2r4tn\") pod \"payload-pre-processing-e2e-shared-a-w2-9cce25-79ffbcc55d-fdz2l\" (UID: \"9d15cad8-cc2a-42c5-bfa7-b0230c9764b1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-9cce25-79ffbcc55d-fdz2l"
Sep 10 21:16:26.973831 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:26.973807    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9d15cad8-cc2a-42c5-bfa7-b0230c9764b1-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-9cce25-79ffbcc55d-fdz2l\" (UID: \"9d15cad8-cc2a-42c5-bfa7-b0230c9764b1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-9cce25-79ffbcc55d-fdz2l"
Sep 10 21:16:26.982093 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:26.982064    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2r4tn\" (UniqueName: \"kubernetes.io/projected/9d15cad8-cc2a-42c5-bfa7-b0230c9764b1-kube-api-access-2r4tn\") pod \"payload-pre-processing-e2e-shared-a-w2-9cce25-79ffbcc55d-fdz2l\" (UID: \"9d15cad8-cc2a-42c5-bfa7-b0230c9764b1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-9cce25-79ffbcc55d-fdz2l"
Sep 10 21:16:27.093767 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:27.093726    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-9cce25-79ffbcc55d-fdz2l"
Sep 10 21:16:27.367402 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:27.367368    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-9cce25-79ffbcc55d-fdz2l"]
Sep 10 21:16:27.369884 ip-10-0-129-100 kubenswrapper[2564]: W0910 21:16:27.369858    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d15cad8_cc2a_42c5_bfa7_b0230c9764b1.slice/crio-d7473f54056d131e1d5c88735684d1cc62e956229eaf5a9321677cf8df9587ae WatchSource:0}: Error finding container d7473f54056d131e1d5c88735684d1cc62e956229eaf5a9321677cf8df9587ae: Status 404 returned error can't find the container with id d7473f54056d131e1d5c88735684d1cc62e956229eaf5a9321677cf8df9587ae
Sep 10 21:16:27.997319 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:27.997283    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-9cce25-79ffbcc55d-fdz2l" event={"ID":"9d15cad8-cc2a-42c5-bfa7-b0230c9764b1","Type":"ContainerStarted","Data":"07c5e457a5fc9eb3008aff8cb18ba4c13f98ce719ac5539e05f55a30a15dabae"}
Sep 10 21:16:27.997319 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:27.997335    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-9cce25-79ffbcc55d-fdz2l" event={"ID":"9d15cad8-cc2a-42c5-bfa7-b0230c9764b1","Type":"ContainerStarted","Data":"d7473f54056d131e1d5c88735684d1cc62e956229eaf5a9321677cf8df9587ae"}
Sep 10 21:16:27.997857 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:27.997384    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-9cce25-79ffbcc55d-fdz2l"
Sep 10 21:16:28.015051 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:28.015002    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-9cce25-79ffbcc55d-fdz2l" podStartSLOduration=2.01498654 podStartE2EDuration="2.01498654s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:16:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:16:28.014180383 +0000 UTC m=+1168.701247664" watchObservedRunningTime="2026-09-10 21:16:28.01498654 +0000 UTC m=+1168.702053818"
Sep 10 21:16:39.004817 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:39.004778    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-9cce25-79ffbcc55d-fdz2l"
Sep 10 21:16:40.097497 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:40.097463    2564 patch_prober.go:28] interesting pod/e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": read tcp 10.134.0.2:59742->10.134.0.70:15021: read: connection reset by peer" start-of-body=
Sep 10 21:16:40.098014 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:40.097982    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858" podUID="07031e9c-e22d-4734-83db-7c781f9f5d3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": read tcp 10.134.0.2:59742->10.134.0.70:15021: read: connection reset by peer"
Sep 10 21:16:41.077580 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:41.077540    2564 generic.go:356] "Generic (PLEG): container finished" podID="07031e9c-e22d-4734-83db-7c781f9f5d3c" containerID="43be1e877ec30228dd9898dab411de762045a1d1763212ccfb001808953ae767" exitCode=0
Sep 10 21:16:41.077764 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:41.077613    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858" event={"ID":"07031e9c-e22d-4734-83db-7c781f9f5d3c","Type":"ContainerDied","Data":"43be1e877ec30228dd9898dab411de762045a1d1763212ccfb001808953ae767"}
Sep 10 21:16:41.078018 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:41.078002    2564 scope.go:117] "RemoveContainer" containerID="43be1e877ec30228dd9898dab411de762045a1d1763212ccfb001808953ae767"
Sep 10 21:16:41.079083 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:41.079050    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 10 21:16:41.079165 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:41.079119    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 10 21:16:41.079165 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:41.079157    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 10 21:16:42.092626 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:42.092578    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858" event={"ID":"07031e9c-e22d-4734-83db-7c781f9f5d3c","Type":"ContainerStarted","Data":"422b24a581db7a37f1f2b290040c98ea1eb86ac3b369735414a7d66326d6df33"}
Sep 10 21:16:42.552577 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:42.552540    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858"
Sep 10 21:16:42.552775 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:42.552756    2564 patch_prober.go:28] interesting pod/e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Sep 10 21:16:42.552833 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:42.552814    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858" podUID="07031e9c-e22d-4734-83db-7c781f9f5d3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Sep 10 21:16:43.553097 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:43.553057    2564 patch_prober.go:28] interesting pod/e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Sep 10 21:16:43.553559 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:43.553114    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858" podUID="07031e9c-e22d-4734-83db-7c781f9f5d3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Sep 10 21:16:44.552631 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:44.552594    2564 patch_prober.go:28] interesting pod/e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Sep 10 21:16:44.552812 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:44.552652    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858" podUID="07031e9c-e22d-4734-83db-7c781f9f5d3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Sep 10 21:16:45.553085 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:45.553045    2564 patch_prober.go:28] interesting pod/e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Sep 10 21:16:45.553513 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:45.553107    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858" podUID="07031e9c-e22d-4734-83db-7c781f9f5d3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Sep 10 21:16:46.552620 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:46.552584    2564 patch_prober.go:28] interesting pod/e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Sep 10 21:16:46.552805 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:46.552639    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858" podUID="07031e9c-e22d-4734-83db-7c781f9f5d3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Sep 10 21:16:47.695440 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:47.695402    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858"
Sep 10 21:16:47.695834 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:47.695775    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858"
Sep 10 21:16:47.696545 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:47.696524    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858"
Sep 10 21:16:50.431024 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:50.430919    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm"]
Sep 10 21:16:50.434706 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:50.434681    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm"
Sep 10 21:16:50.437324 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:50.437301    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-95d905-openshift-default-dockercfg-62vtf\""
Sep 10 21:16:50.452510 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:50.452479    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm"]
Sep 10 21:16:50.591825 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:50.591787    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8bdb2cf7-06eb-4025-b562-67b6558a214d-istiod-ca-cert\") pod \"e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm\" (UID: \"8bdb2cf7-06eb-4025-b562-67b6558a214d\") " pod="openshift-ingress/e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm"
Sep 10 21:16:50.591825 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:50.591835    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8bdb2cf7-06eb-4025-b562-67b6558a214d-workload-socket\") pod \"e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm\" (UID: \"8bdb2cf7-06eb-4025-b562-67b6558a214d\") " pod="openshift-ingress/e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm"
Sep 10 21:16:50.592063 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:50.591867    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8bdb2cf7-06eb-4025-b562-67b6558a214d-credential-socket\") pod \"e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm\" (UID: \"8bdb2cf7-06eb-4025-b562-67b6558a214d\") " pod="openshift-ingress/e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm"
Sep 10 21:16:50.592063 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:50.591900    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8bdb2cf7-06eb-4025-b562-67b6558a214d-istio-data\") pod \"e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm\" (UID: \"8bdb2cf7-06eb-4025-b562-67b6558a214d\") " pod="openshift-ingress/e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm"
Sep 10 21:16:50.592063 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:50.591947    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8bdb2cf7-06eb-4025-b562-67b6558a214d-workload-certs\") pod \"e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm\" (UID: \"8bdb2cf7-06eb-4025-b562-67b6558a214d\") " pod="openshift-ingress/e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm"
Sep 10 21:16:50.592063 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:50.591997    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8bdb2cf7-06eb-4025-b562-67b6558a214d-istio-token\") pod \"e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm\" (UID: \"8bdb2cf7-06eb-4025-b562-67b6558a214d\") " pod="openshift-ingress/e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm"
Sep 10 21:16:50.592063 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:50.592029    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8bdb2cf7-06eb-4025-b562-67b6558a214d-istio-podinfo\") pod \"e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm\" (UID: \"8bdb2cf7-06eb-4025-b562-67b6558a214d\") " pod="openshift-ingress/e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm"
Sep 10 21:16:50.592358 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:50.592075    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8bdb2cf7-06eb-4025-b562-67b6558a214d-istio-envoy\") pod \"e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm\" (UID: \"8bdb2cf7-06eb-4025-b562-67b6558a214d\") " pod="openshift-ingress/e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm"
Sep 10 21:16:50.592358 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:50.592170    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-625gk\" (UniqueName: \"kubernetes.io/projected/8bdb2cf7-06eb-4025-b562-67b6558a214d-kube-api-access-625gk\") pod \"e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm\" (UID: \"8bdb2cf7-06eb-4025-b562-67b6558a214d\") " pod="openshift-ingress/e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm"
Sep 10 21:16:50.693018 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:50.692921    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-625gk\" (UniqueName: \"kubernetes.io/projected/8bdb2cf7-06eb-4025-b562-67b6558a214d-kube-api-access-625gk\") pod \"e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm\" (UID: \"8bdb2cf7-06eb-4025-b562-67b6558a214d\") " pod="openshift-ingress/e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm"
Sep 10 21:16:50.693018 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:50.692972    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8bdb2cf7-06eb-4025-b562-67b6558a214d-istiod-ca-cert\") pod \"e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm\" (UID: \"8bdb2cf7-06eb-4025-b562-67b6558a214d\") " pod="openshift-ingress/e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm"
Sep 10 21:16:50.693298 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:50.693091    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8bdb2cf7-06eb-4025-b562-67b6558a214d-workload-socket\") pod \"e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm\" (UID: \"8bdb2cf7-06eb-4025-b562-67b6558a214d\") " pod="openshift-ingress/e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm"
Sep 10 21:16:50.693298 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:50.693139    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8bdb2cf7-06eb-4025-b562-67b6558a214d-credential-socket\") pod \"e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm\" (UID: \"8bdb2cf7-06eb-4025-b562-67b6558a214d\") " pod="openshift-ingress/e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm"
Sep 10 21:16:50.693298 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:50.693164    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8bdb2cf7-06eb-4025-b562-67b6558a214d-istio-data\") pod \"e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm\" (UID: \"8bdb2cf7-06eb-4025-b562-67b6558a214d\") " pod="openshift-ingress/e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm"
Sep 10 21:16:50.693541 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:50.693352    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8bdb2cf7-06eb-4025-b562-67b6558a214d-workload-certs\") pod \"e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm\" (UID: \"8bdb2cf7-06eb-4025-b562-67b6558a214d\") " pod="openshift-ingress/e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm"
Sep 10 21:16:50.693541 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:50.693394    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8bdb2cf7-06eb-4025-b562-67b6558a214d-istio-token\") pod \"e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm\" (UID: \"8bdb2cf7-06eb-4025-b562-67b6558a214d\") " pod="openshift-ingress/e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm"
Sep 10 21:16:50.693541 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:50.693422    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8bdb2cf7-06eb-4025-b562-67b6558a214d-istio-podinfo\") pod \"e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm\" (UID: \"8bdb2cf7-06eb-4025-b562-67b6558a214d\") " pod="openshift-ingress/e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm"
Sep 10 21:16:50.693541 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:50.693509    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8bdb2cf7-06eb-4025-b562-67b6558a214d-workload-socket\") pod \"e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm\" (UID: \"8bdb2cf7-06eb-4025-b562-67b6558a214d\") " pod="openshift-ingress/e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm"
Sep 10 21:16:50.693752 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:50.693546    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8bdb2cf7-06eb-4025-b562-67b6558a214d-credential-socket\") pod \"e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm\" (UID: \"8bdb2cf7-06eb-4025-b562-67b6558a214d\") " pod="openshift-ingress/e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm"
Sep 10 21:16:50.693752 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:50.693581    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8bdb2cf7-06eb-4025-b562-67b6558a214d-istio-data\") pod \"e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm\" (UID: \"8bdb2cf7-06eb-4025-b562-67b6558a214d\") " pod="openshift-ingress/e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm"
Sep 10 21:16:50.693752 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:50.693657    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8bdb2cf7-06eb-4025-b562-67b6558a214d-istio-envoy\") pod \"e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm\" (UID: \"8bdb2cf7-06eb-4025-b562-67b6558a214d\") " pod="openshift-ingress/e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm"
Sep 10 21:16:50.693752 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:50.693707    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8bdb2cf7-06eb-4025-b562-67b6558a214d-istiod-ca-cert\") pod \"e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm\" (UID: \"8bdb2cf7-06eb-4025-b562-67b6558a214d\") " pod="openshift-ingress/e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm"
Sep 10 21:16:50.693752 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:50.693713    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8bdb2cf7-06eb-4025-b562-67b6558a214d-workload-certs\") pod \"e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm\" (UID: \"8bdb2cf7-06eb-4025-b562-67b6558a214d\") " pod="openshift-ingress/e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm"
Sep 10 21:16:50.695748 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:50.695728    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8bdb2cf7-06eb-4025-b562-67b6558a214d-istio-envoy\") pod \"e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm\" (UID: \"8bdb2cf7-06eb-4025-b562-67b6558a214d\") " pod="openshift-ingress/e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm"
Sep 10 21:16:50.695998 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:50.695979    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8bdb2cf7-06eb-4025-b562-67b6558a214d-istio-podinfo\") pod \"e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm\" (UID: \"8bdb2cf7-06eb-4025-b562-67b6558a214d\") " pod="openshift-ingress/e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm"
Sep 10 21:16:50.701202 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:50.701182    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-625gk\" (UniqueName: \"kubernetes.io/projected/8bdb2cf7-06eb-4025-b562-67b6558a214d-kube-api-access-625gk\") pod \"e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm\" (UID: \"8bdb2cf7-06eb-4025-b562-67b6558a214d\") " pod="openshift-ingress/e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm"
Sep 10 21:16:50.701329 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:50.701212    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8bdb2cf7-06eb-4025-b562-67b6558a214d-istio-token\") pod \"e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm\" (UID: \"8bdb2cf7-06eb-4025-b562-67b6558a214d\") " pod="openshift-ingress/e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm"
Sep 10 21:16:50.745448 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:50.745412    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm"
Sep 10 21:16:51.022636 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:51.022597    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm"]
Sep 10 21:16:51.023874 ip-10-0-129-100 kubenswrapper[2564]: W0910 21:16:51.023843    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bdb2cf7_06eb_4025_b562_67b6558a214d.slice/crio-22e8e7823d37bf2433b1b19429bb55627721c10d77c5e8710afb29f52632197d WatchSource:0}: Error finding container 22e8e7823d37bf2433b1b19429bb55627721c10d77c5e8710afb29f52632197d: Status 404 returned error can't find the container with id 22e8e7823d37bf2433b1b19429bb55627721c10d77c5e8710afb29f52632197d
Sep 10 21:16:51.026109 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:51.026069    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 10 21:16:51.026196 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:51.026178    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 10 21:16:51.026259 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:51.026242    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 10 21:16:51.151699 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:51.151659    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm" event={"ID":"8bdb2cf7-06eb-4025-b562-67b6558a214d","Type":"ContainerStarted","Data":"1b6cb6dfaa078ac85d5159205865b95744cb1b3ce565b2a946d4b3cd845b4b5b"}
Sep 10 21:16:51.151854 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:51.151732    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm" event={"ID":"8bdb2cf7-06eb-4025-b562-67b6558a214d","Type":"ContainerStarted","Data":"22e8e7823d37bf2433b1b19429bb55627721c10d77c5e8710afb29f52632197d"}
Sep 10 21:16:51.175158 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:51.175093    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm" podStartSLOduration=1.175072253 podStartE2EDuration="1.175072253s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:16:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:16:51.171867033 +0000 UTC m=+1191.858934313" watchObservedRunningTime="2026-09-10 21:16:51.175072253 +0000 UTC m=+1191.862139535"
Sep 10 21:16:51.745794 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:51.745755    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm"
Sep 10 21:16:52.750892 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:52.750863    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm"
Sep 10 21:16:53.165118 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:53.165091    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm"
Sep 10 21:16:53.166147 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:53.166123    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm"
Sep 10 21:16:55.126250 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:55.126200    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-95d905-6b86994766-f2kd6"]
Sep 10 21:16:55.129860 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:55.129841    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-95d905-6b86994766-f2kd6"
Sep 10 21:16:55.132150 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:55.132128    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-95d905\""
Sep 10 21:16:55.132324 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:55.132132    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-95d905-dockercfg-4dl29\""
Sep 10 21:16:55.140758 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:55.140729    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-95d905-6b86994766-f2kd6"]
Sep 10 21:16:55.230994 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:55.230958    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/14cb0f09-b88c-4703-af89-13ca0079b174-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-95d905-6b86994766-f2kd6\" (UID: \"14cb0f09-b88c-4703-af89-13ca0079b174\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-95d905-6b86994766-f2kd6"
Sep 10 21:16:55.231175 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:55.231011    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slpsv\" (UniqueName: \"kubernetes.io/projected/14cb0f09-b88c-4703-af89-13ca0079b174-kube-api-access-slpsv\") pod \"payload-pre-processing-e2e-shared-b-w2-95d905-6b86994766-f2kd6\" (UID: \"14cb0f09-b88c-4703-af89-13ca0079b174\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-95d905-6b86994766-f2kd6"
Sep 10 21:16:55.332377 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:55.332340    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/14cb0f09-b88c-4703-af89-13ca0079b174-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-95d905-6b86994766-f2kd6\" (UID: \"14cb0f09-b88c-4703-af89-13ca0079b174\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-95d905-6b86994766-f2kd6"
Sep 10 21:16:55.332585 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:55.332386    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slpsv\" (UniqueName: \"kubernetes.io/projected/14cb0f09-b88c-4703-af89-13ca0079b174-kube-api-access-slpsv\") pod \"payload-pre-processing-e2e-shared-b-w2-95d905-6b86994766-f2kd6\" (UID: \"14cb0f09-b88c-4703-af89-13ca0079b174\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-95d905-6b86994766-f2kd6"
Sep 10 21:16:55.333064 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:55.333038    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/14cb0f09-b88c-4703-af89-13ca0079b174-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-95d905-6b86994766-f2kd6\" (UID: \"14cb0f09-b88c-4703-af89-13ca0079b174\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-95d905-6b86994766-f2kd6"
Sep 10 21:16:55.340664 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:55.340635    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-slpsv\" (UniqueName: \"kubernetes.io/projected/14cb0f09-b88c-4703-af89-13ca0079b174-kube-api-access-slpsv\") pod \"payload-pre-processing-e2e-shared-b-w2-95d905-6b86994766-f2kd6\" (UID: \"14cb0f09-b88c-4703-af89-13ca0079b174\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-95d905-6b86994766-f2kd6"
Sep 10 21:16:55.441869 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:55.441770    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-95d905-6b86994766-f2kd6"
Sep 10 21:16:55.717125 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:55.717096    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-95d905-6b86994766-f2kd6"]
Sep 10 21:16:55.719275 ip-10-0-129-100 kubenswrapper[2564]: W0910 21:16:55.719243    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14cb0f09_b88c_4703_af89_13ca0079b174.slice/crio-45321351f219e718dcbfb01412c902d1e125c3ab491b112d5a4b0b7bf3994942 WatchSource:0}: Error finding container 45321351f219e718dcbfb01412c902d1e125c3ab491b112d5a4b0b7bf3994942: Status 404 returned error can't find the container with id 45321351f219e718dcbfb01412c902d1e125c3ab491b112d5a4b0b7bf3994942
Sep 10 21:16:56.191658 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:56.191621    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-95d905-6b86994766-f2kd6" event={"ID":"14cb0f09-b88c-4703-af89-13ca0079b174","Type":"ContainerStarted","Data":"33517f49febba26176d00fcc5308b81788272fdd1922e8a4fd0836bffb6d3b40"}
Sep 10 21:16:56.192257 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:56.191770    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-95d905-6b86994766-f2kd6"
Sep 10 21:16:56.192257 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:56.191794    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-95d905-6b86994766-f2kd6" event={"ID":"14cb0f09-b88c-4703-af89-13ca0079b174","Type":"ContainerStarted","Data":"45321351f219e718dcbfb01412c902d1e125c3ab491b112d5a4b0b7bf3994942"}
Sep 10 21:16:56.211334 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:16:56.211275    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-95d905-6b86994766-f2kd6" podStartSLOduration=1.211258999 podStartE2EDuration="1.211258999s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:16:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:16:56.208427256 +0000 UTC m=+1196.895494534" watchObservedRunningTime="2026-09-10 21:16:56.211258999 +0000 UTC m=+1196.898326278"
Sep 10 21:17:01.192213 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:01.192183    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-cd9hp_0432bad8-86f5-4b0e-a0d4-2fdb728223f2/console-operator/2.log"
Sep 10 21:17:01.196482 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:01.196455    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-cd9hp_0432bad8-86f5-4b0e-a0d4-2fdb728223f2/console-operator/2.log"
Sep 10 21:17:01.198842 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:01.198820    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wrbhk_279e54f7-0db1-4e2d-a998-4b3ecdf992cd/ovn-acl-logging/0.log"
Sep 10 21:17:01.202981 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:01.202962    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wrbhk_279e54f7-0db1-4e2d-a998-4b3ecdf992cd/ovn-acl-logging/0.log"
Sep 10 21:17:07.200218 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:07.200186    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-95d905-6b86994766-f2kd6"
Sep 10 21:17:12.293376 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:12.293288    2564 generic.go:356] "Generic (PLEG): container finished" podID="8bdb2cf7-06eb-4025-b562-67b6558a214d" containerID="1b6cb6dfaa078ac85d5159205865b95744cb1b3ce565b2a946d4b3cd845b4b5b" exitCode=0
Sep 10 21:17:12.293376 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:12.293363    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm" event={"ID":"8bdb2cf7-06eb-4025-b562-67b6558a214d","Type":"ContainerDied","Data":"1b6cb6dfaa078ac85d5159205865b95744cb1b3ce565b2a946d4b3cd845b4b5b"}
Sep 10 21:17:12.293888 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:12.293759    2564 scope.go:117] "RemoveContainer" containerID="1b6cb6dfaa078ac85d5159205865b95744cb1b3ce565b2a946d4b3cd845b4b5b"
Sep 10 21:17:12.294845 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:12.294815    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 10 21:17:12.294913 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:12.294898    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 10 21:17:12.294952 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:12.294938    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 10 21:17:13.304790 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:13.304753    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm" event={"ID":"8bdb2cf7-06eb-4025-b562-67b6558a214d","Type":"ContainerStarted","Data":"09900ee9e1192926263636beb13a957621a9d73e1f07f39ccb7ab815fd0fa4b8"}
Sep 10 21:17:13.746177 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:13.746085    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm"
Sep 10 21:17:13.746354 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:13.746309    2564 patch_prober.go:28] interesting pod/e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Sep 10 21:17:13.746401 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:13.746368    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm" podUID="8bdb2cf7-06eb-4025-b562-67b6558a214d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Sep 10 21:17:14.746222 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:14.746175    2564 patch_prober.go:28] interesting pod/e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Sep 10 21:17:14.746658 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:14.746282    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm" podUID="8bdb2cf7-06eb-4025-b562-67b6558a214d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Sep 10 21:17:15.746829 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:15.746788    2564 patch_prober.go:28] interesting pod/e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Sep 10 21:17:15.747257 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:15.746882    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm" podUID="8bdb2cf7-06eb-4025-b562-67b6558a214d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Sep 10 21:17:16.746204 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:16.746168    2564 patch_prober.go:28] interesting pod/e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Sep 10 21:17:16.746408 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:16.746225    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm" podUID="8bdb2cf7-06eb-4025-b562-67b6558a214d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Sep 10 21:17:17.746085 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:17.746050    2564 patch_prober.go:28] interesting pod/e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Sep 10 21:17:17.746545 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:17.746120    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm" podUID="8bdb2cf7-06eb-4025-b562-67b6558a214d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Sep 10 21:17:18.750167 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:18.750132    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm"
Sep 10 21:17:18.750594 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:18.750493    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm"
Sep 10 21:17:18.751118 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:18.751100    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm"
Sep 10 21:17:27.104246 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:27.104196    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk"]
Sep 10 21:17:27.107456 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:27.107415    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk"
Sep 10 21:17:27.110043 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:27.110023    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-fc0caf1f-openshift-default-dockercfg-2swzm\""
Sep 10 21:17:27.122178 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:27.122146    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk"]
Sep 10 21:17:27.238129 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:27.238082    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f90239b4-a68d-4e0e-af42-dbdd88ed5ee9-workload-certs\") pod \"e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk\" (UID: \"f90239b4-a68d-4e0e-af42-dbdd88ed5ee9\") " pod="openshift-ingress/e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk"
Sep 10 21:17:27.238353 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:27.238141    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f90239b4-a68d-4e0e-af42-dbdd88ed5ee9-istio-token\") pod \"e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk\" (UID: \"f90239b4-a68d-4e0e-af42-dbdd88ed5ee9\") " pod="openshift-ingress/e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk"
Sep 10 21:17:27.238353 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:27.238214    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f90239b4-a68d-4e0e-af42-dbdd88ed5ee9-credential-socket\") pod \"e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk\" (UID: \"f90239b4-a68d-4e0e-af42-dbdd88ed5ee9\") " pod="openshift-ingress/e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk"
Sep 10 21:17:27.238353 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:27.238291    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f90239b4-a68d-4e0e-af42-dbdd88ed5ee9-istio-data\") pod \"e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk\" (UID: \"f90239b4-a68d-4e0e-af42-dbdd88ed5ee9\") " pod="openshift-ingress/e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk"
Sep 10 21:17:27.238353 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:27.238327    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f90239b4-a68d-4e0e-af42-dbdd88ed5ee9-workload-socket\") pod \"e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk\" (UID: \"f90239b4-a68d-4e0e-af42-dbdd88ed5ee9\") " pod="openshift-ingress/e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk"
Sep 10 21:17:27.238353 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:27.238344    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcdcl\" (UniqueName: \"kubernetes.io/projected/f90239b4-a68d-4e0e-af42-dbdd88ed5ee9-kube-api-access-bcdcl\") pod \"e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk\" (UID: \"f90239b4-a68d-4e0e-af42-dbdd88ed5ee9\") " pod="openshift-ingress/e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk"
Sep 10 21:17:27.238589 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:27.238449    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f90239b4-a68d-4e0e-af42-dbdd88ed5ee9-istio-envoy\") pod \"e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk\" (UID: \"f90239b4-a68d-4e0e-af42-dbdd88ed5ee9\") " pod="openshift-ingress/e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk"
Sep 10 21:17:27.238589 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:27.238482    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f90239b4-a68d-4e0e-af42-dbdd88ed5ee9-istio-podinfo\") pod \"e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk\" (UID: \"f90239b4-a68d-4e0e-af42-dbdd88ed5ee9\") " pod="openshift-ingress/e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk"
Sep 10 21:17:27.238589 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:27.238567    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f90239b4-a68d-4e0e-af42-dbdd88ed5ee9-istiod-ca-cert\") pod \"e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk\" (UID: \"f90239b4-a68d-4e0e-af42-dbdd88ed5ee9\") " pod="openshift-ingress/e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk"
Sep 10 21:17:27.339420 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:27.339383    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f90239b4-a68d-4e0e-af42-dbdd88ed5ee9-istio-envoy\") pod \"e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk\" (UID: \"f90239b4-a68d-4e0e-af42-dbdd88ed5ee9\") " pod="openshift-ingress/e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk"
Sep 10 21:17:27.339420 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:27.339425    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f90239b4-a68d-4e0e-af42-dbdd88ed5ee9-istio-podinfo\") pod \"e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk\" (UID: \"f90239b4-a68d-4e0e-af42-dbdd88ed5ee9\") " pod="openshift-ingress/e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk"
Sep 10 21:17:27.339689 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:27.339469    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f90239b4-a68d-4e0e-af42-dbdd88ed5ee9-istiod-ca-cert\") pod \"e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk\" (UID: \"f90239b4-a68d-4e0e-af42-dbdd88ed5ee9\") " pod="openshift-ingress/e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk"
Sep 10 21:17:27.339689 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:27.339506    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f90239b4-a68d-4e0e-af42-dbdd88ed5ee9-workload-certs\") pod \"e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk\" (UID: \"f90239b4-a68d-4e0e-af42-dbdd88ed5ee9\") " pod="openshift-ingress/e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk"
Sep 10 21:17:27.339689 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:27.339547    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f90239b4-a68d-4e0e-af42-dbdd88ed5ee9-istio-token\") pod \"e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk\" (UID: \"f90239b4-a68d-4e0e-af42-dbdd88ed5ee9\") " pod="openshift-ingress/e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk"
Sep 10 21:17:27.339689 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:27.339576    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f90239b4-a68d-4e0e-af42-dbdd88ed5ee9-credential-socket\") pod \"e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk\" (UID: \"f90239b4-a68d-4e0e-af42-dbdd88ed5ee9\") " pod="openshift-ingress/e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk"
Sep 10 21:17:27.339689 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:27.339610    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f90239b4-a68d-4e0e-af42-dbdd88ed5ee9-istio-data\") pod \"e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk\" (UID: \"f90239b4-a68d-4e0e-af42-dbdd88ed5ee9\") " pod="openshift-ingress/e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk"
Sep 10 21:17:27.340064 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:27.339759    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f90239b4-a68d-4e0e-af42-dbdd88ed5ee9-workload-socket\") pod \"e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk\" (UID: \"f90239b4-a68d-4e0e-af42-dbdd88ed5ee9\") " pod="openshift-ingress/e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk"
Sep 10 21:17:27.340064 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:27.339795    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcdcl\" (UniqueName: \"kubernetes.io/projected/f90239b4-a68d-4e0e-af42-dbdd88ed5ee9-kube-api-access-bcdcl\") pod \"e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk\" (UID: \"f90239b4-a68d-4e0e-af42-dbdd88ed5ee9\") " pod="openshift-ingress/e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk"
Sep 10 21:17:27.340064 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:27.339937    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f90239b4-a68d-4e0e-af42-dbdd88ed5ee9-workload-certs\") pod \"e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk\" (UID: \"f90239b4-a68d-4e0e-af42-dbdd88ed5ee9\") " pod="openshift-ingress/e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk"
Sep 10 21:17:27.340064 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:27.339951    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f90239b4-a68d-4e0e-af42-dbdd88ed5ee9-credential-socket\") pod \"e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk\" (UID: \"f90239b4-a68d-4e0e-af42-dbdd88ed5ee9\") " pod="openshift-ingress/e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk"
Sep 10 21:17:27.340064 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:27.340006    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f90239b4-a68d-4e0e-af42-dbdd88ed5ee9-istio-data\") pod \"e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk\" (UID: \"f90239b4-a68d-4e0e-af42-dbdd88ed5ee9\") " pod="openshift-ingress/e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk"
Sep 10 21:17:27.340355 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:27.340219    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f90239b4-a68d-4e0e-af42-dbdd88ed5ee9-workload-socket\") pod \"e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk\" (UID: \"f90239b4-a68d-4e0e-af42-dbdd88ed5ee9\") " pod="openshift-ingress/e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk"
Sep 10 21:17:27.340645 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:27.340616    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f90239b4-a68d-4e0e-af42-dbdd88ed5ee9-istiod-ca-cert\") pod \"e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk\" (UID: \"f90239b4-a68d-4e0e-af42-dbdd88ed5ee9\") " pod="openshift-ingress/e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk"
Sep 10 21:17:27.342621 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:27.342599    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f90239b4-a68d-4e0e-af42-dbdd88ed5ee9-istio-envoy\") pod \"e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk\" (UID: \"f90239b4-a68d-4e0e-af42-dbdd88ed5ee9\") " pod="openshift-ingress/e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk"
Sep 10 21:17:27.342930 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:27.342910    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f90239b4-a68d-4e0e-af42-dbdd88ed5ee9-istio-podinfo\") pod \"e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk\" (UID: \"f90239b4-a68d-4e0e-af42-dbdd88ed5ee9\") " pod="openshift-ingress/e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk"
Sep 10 21:17:27.347758 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:27.347733    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcdcl\" (UniqueName: \"kubernetes.io/projected/f90239b4-a68d-4e0e-af42-dbdd88ed5ee9-kube-api-access-bcdcl\") pod \"e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk\" (UID: \"f90239b4-a68d-4e0e-af42-dbdd88ed5ee9\") " pod="openshift-ingress/e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk"
Sep 10 21:17:27.347833 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:27.347801    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f90239b4-a68d-4e0e-af42-dbdd88ed5ee9-istio-token\") pod \"e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk\" (UID: \"f90239b4-a68d-4e0e-af42-dbdd88ed5ee9\") " pod="openshift-ingress/e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk"
Sep 10 21:17:27.418164 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:27.418071    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk"
Sep 10 21:17:27.694683 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:27.694651    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk"]
Sep 10 21:17:27.696264 ip-10-0-129-100 kubenswrapper[2564]: W0910 21:17:27.696196    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf90239b4_a68d_4e0e_af42_dbdd88ed5ee9.slice/crio-96d56b4d732db693a0e24dd16c60fb891439d7033352f9bed354faa47e88043c WatchSource:0}: Error finding container 96d56b4d732db693a0e24dd16c60fb891439d7033352f9bed354faa47e88043c: Status 404 returned error can't find the container with id 96d56b4d732db693a0e24dd16c60fb891439d7033352f9bed354faa47e88043c
Sep 10 21:17:27.698541 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:27.698502    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 10 21:17:27.698620 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:27.698581    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 10 21:17:27.698620 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:27.698612    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 10 21:17:28.394526 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:28.394486    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk" event={"ID":"f90239b4-a68d-4e0e-af42-dbdd88ed5ee9","Type":"ContainerStarted","Data":"e9197efcd3656ae541cdfd8bc14a30ce638e28cfa9da5e2eee05b130fde04677"}
Sep 10 21:17:28.394980 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:28.394557    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk" event={"ID":"f90239b4-a68d-4e0e-af42-dbdd88ed5ee9","Type":"ContainerStarted","Data":"96d56b4d732db693a0e24dd16c60fb891439d7033352f9bed354faa47e88043c"}
Sep 10 21:17:28.417284 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:28.417209    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk" podStartSLOduration=1.4171911289999999 podStartE2EDuration="1.417191129s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:17:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:17:28.415634385 +0000 UTC m=+1229.102701664" watchObservedRunningTime="2026-09-10 21:17:28.417191129 +0000 UTC m=+1229.104258407"
Sep 10 21:17:28.418846 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:28.418826    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk"
Sep 10 21:17:28.424787 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:28.424760    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk"
Sep 10 21:17:29.400401 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:29.400368    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk"
Sep 10 21:17:29.401425 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:29.401403    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk"
Sep 10 21:17:32.177920 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:32.177883    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-fc0caf1f-69ff97d67d-hq52d"]
Sep 10 21:17:32.181742 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:32.181721    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-fc0caf1f-69ff97d67d-hq52d"
Sep 10 21:17:32.184073 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:32.184040    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-fc0caf1f\""
Sep 10 21:17:32.184211 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:32.184076    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-fc0caf1f-dockercfg-cf2p2\""
Sep 10 21:17:32.192991 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:32.192964    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-fc0caf1f-69ff97d67d-hq52d"]
Sep 10 21:17:32.286508 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:32.286466    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fsk8\" (UniqueName: \"kubernetes.io/projected/4df02f01-a99a-45fc-9d0e-57b04a6180df-kube-api-access-7fsk8\") pod \"payload-pre-processing-e2e-mt-fc0caf1f-69ff97d67d-hq52d\" (UID: \"4df02f01-a99a-45fc-9d0e-57b04a6180df\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-fc0caf1f-69ff97d67d-hq52d"
Sep 10 21:17:32.286508 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:32.286512    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4df02f01-a99a-45fc-9d0e-57b04a6180df-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-fc0caf1f-69ff97d67d-hq52d\" (UID: \"4df02f01-a99a-45fc-9d0e-57b04a6180df\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-fc0caf1f-69ff97d67d-hq52d"
Sep 10 21:17:32.387878 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:32.387835    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4df02f01-a99a-45fc-9d0e-57b04a6180df-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-fc0caf1f-69ff97d67d-hq52d\" (UID: \"4df02f01-a99a-45fc-9d0e-57b04a6180df\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-fc0caf1f-69ff97d67d-hq52d"
Sep 10 21:17:32.388061 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:32.387991    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fsk8\" (UniqueName: \"kubernetes.io/projected/4df02f01-a99a-45fc-9d0e-57b04a6180df-kube-api-access-7fsk8\") pod \"payload-pre-processing-e2e-mt-fc0caf1f-69ff97d67d-hq52d\" (UID: \"4df02f01-a99a-45fc-9d0e-57b04a6180df\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-fc0caf1f-69ff97d67d-hq52d"
Sep 10 21:17:32.388616 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:32.388595    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4df02f01-a99a-45fc-9d0e-57b04a6180df-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-fc0caf1f-69ff97d67d-hq52d\" (UID: \"4df02f01-a99a-45fc-9d0e-57b04a6180df\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-fc0caf1f-69ff97d67d-hq52d"
Sep 10 21:17:32.400327 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:32.400295    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fsk8\" (UniqueName: \"kubernetes.io/projected/4df02f01-a99a-45fc-9d0e-57b04a6180df-kube-api-access-7fsk8\") pod \"payload-pre-processing-e2e-mt-fc0caf1f-69ff97d67d-hq52d\" (UID: \"4df02f01-a99a-45fc-9d0e-57b04a6180df\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-fc0caf1f-69ff97d67d-hq52d"
Sep 10 21:17:32.493953 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:32.493834    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-fc0caf1f-69ff97d67d-hq52d"
Sep 10 21:17:32.774154 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:32.774114    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-fc0caf1f-69ff97d67d-hq52d"]
Sep 10 21:17:32.775043 ip-10-0-129-100 kubenswrapper[2564]: W0910 21:17:32.775007    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4df02f01_a99a_45fc_9d0e_57b04a6180df.slice/crio-f6ae0262d8ecb43c2376c5f2e2b885a37d2cdfc3982e620dcd6fb4957896b96f WatchSource:0}: Error finding container f6ae0262d8ecb43c2376c5f2e2b885a37d2cdfc3982e620dcd6fb4957896b96f: Status 404 returned error can't find the container with id f6ae0262d8ecb43c2376c5f2e2b885a37d2cdfc3982e620dcd6fb4957896b96f
Sep 10 21:17:33.426896 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:33.426856    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-fc0caf1f-69ff97d67d-hq52d" event={"ID":"4df02f01-a99a-45fc-9d0e-57b04a6180df","Type":"ContainerStarted","Data":"b2c8199fb4865b0d6cd0d432f464f2ebbce1172433e6389e226c237186dc1021"}
Sep 10 21:17:33.427374 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:33.426910    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-fc0caf1f-69ff97d67d-hq52d" event={"ID":"4df02f01-a99a-45fc-9d0e-57b04a6180df","Type":"ContainerStarted","Data":"f6ae0262d8ecb43c2376c5f2e2b885a37d2cdfc3982e620dcd6fb4957896b96f"}
Sep 10 21:17:33.427374 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:33.427069    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-fc0caf1f-69ff97d67d-hq52d"
Sep 10 21:17:33.446540 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:33.446479    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-fc0caf1f-69ff97d67d-hq52d" podStartSLOduration=1.446460442 podStartE2EDuration="1.446460442s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:17:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:17:33.445096482 +0000 UTC m=+1234.132163762" watchObservedRunningTime="2026-09-10 21:17:33.446460442 +0000 UTC m=+1234.133527721"
Sep 10 21:17:44.434421 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:44.434384    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-fc0caf1f-69ff97d67d-hq52d"
Sep 10 21:17:49.534645 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:49.534544    2564 generic.go:356] "Generic (PLEG): container finished" podID="f90239b4-a68d-4e0e-af42-dbdd88ed5ee9" containerID="e9197efcd3656ae541cdfd8bc14a30ce638e28cfa9da5e2eee05b130fde04677" exitCode=0
Sep 10 21:17:49.534645 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:49.534584    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk" event={"ID":"f90239b4-a68d-4e0e-af42-dbdd88ed5ee9","Type":"ContainerDied","Data":"e9197efcd3656ae541cdfd8bc14a30ce638e28cfa9da5e2eee05b130fde04677"}
Sep 10 21:17:49.535175 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:49.534982    2564 scope.go:117] "RemoveContainer" containerID="e9197efcd3656ae541cdfd8bc14a30ce638e28cfa9da5e2eee05b130fde04677"
Sep 10 21:17:49.536138 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:49.536108    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 10 21:17:49.536243 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:49.536181    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 10 21:17:49.536243 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:49.536219    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 10 21:17:50.542861 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:50.542827    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk" event={"ID":"f90239b4-a68d-4e0e-af42-dbdd88ed5ee9","Type":"ContainerStarted","Data":"5e28ec1ccc47386bd709918f48dc51117ba57b1ee57aa20a3cc8feaa639f3199"}
Sep 10 21:17:51.419274 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:51.419205    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk"
Sep 10 21:17:51.419483 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:51.419458    2564 patch_prober.go:28] interesting pod/e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" start-of-body=
Sep 10 21:17:51.419564 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:51.419516    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk" podUID="f90239b4-a68d-4e0e-af42-dbdd88ed5ee9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused"
Sep 10 21:17:52.418681 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:52.418593    2564 patch_prober.go:28] interesting pod/e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" start-of-body=
Sep 10 21:17:52.418681 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:52.418651    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk" podUID="f90239b4-a68d-4e0e-af42-dbdd88ed5ee9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused"
Sep 10 21:17:53.419305 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:53.419268    2564 patch_prober.go:28] interesting pod/e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" start-of-body=
Sep 10 21:17:53.419771 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:53.419340    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk" podUID="f90239b4-a68d-4e0e-af42-dbdd88ed5ee9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused"
Sep 10 21:17:54.418811 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:54.418776    2564 patch_prober.go:28] interesting pod/e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" start-of-body=
Sep 10 21:17:54.419077 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:54.419034    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk" podUID="f90239b4-a68d-4e0e-af42-dbdd88ed5ee9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused"
Sep 10 21:17:55.585679 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:55.585647    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk"
Sep 10 21:17:55.586155 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:55.586049    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk"
Sep 10 21:17:55.586972 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:55.586951    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk"
Sep 10 21:17:59.907056 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:17:59.907022    2564 scope.go:117] "RemoveContainer" containerID="090b0b26f1bb6f21725f713483ab205f7402790086eea0900eff443eaf5d32f8"
Sep 10 21:18:29.429928 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:18:29.429892    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fc0caf1f-dtgzm"]
Sep 10 21:18:29.433372 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:18:29.433354    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fc0caf1f-dtgzm"
Sep 10 21:18:29.436036 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:18:29.436011    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 21:18:29.436161 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:18:29.436104    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-m5c7x\""
Sep 10 21:18:29.444197 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:18:29.444175    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fc0caf1f-dtgzm"]
Sep 10 21:18:29.528568 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:18:29.528528    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/76937f25-3fb7-46ba-9706-bcba736416c9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-fc0caf1f-dtgzm\" (UID: \"76937f25-3fb7-46ba-9706-bcba736416c9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fc0caf1f-dtgzm"
Sep 10 21:18:29.629295 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:18:29.629258    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/76937f25-3fb7-46ba-9706-bcba736416c9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-fc0caf1f-dtgzm\" (UID: \"76937f25-3fb7-46ba-9706-bcba736416c9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fc0caf1f-dtgzm"
Sep 10 21:18:29.629879 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:18:29.629858    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/76937f25-3fb7-46ba-9706-bcba736416c9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-fc0caf1f-dtgzm\" (UID: \"76937f25-3fb7-46ba-9706-bcba736416c9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fc0caf1f-dtgzm"
Sep 10 21:18:29.745286 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:18:29.745193    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fc0caf1f-dtgzm"
Sep 10 21:18:30.036326 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:18:30.036302    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fc0caf1f-dtgzm"]
Sep 10 21:18:30.038273 ip-10-0-129-100 kubenswrapper[2564]: W0910 21:18:30.038244    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76937f25_3fb7_46ba_9706_bcba736416c9.slice/crio-daf656d7829fa2cda997ddb462862d322ef742fd00c708523a8ee8ae23e44cf3 WatchSource:0}: Error finding container daf656d7829fa2cda997ddb462862d322ef742fd00c708523a8ee8ae23e44cf3: Status 404 returned error can't find the container with id daf656d7829fa2cda997ddb462862d322ef742fd00c708523a8ee8ae23e44cf3
Sep 10 21:18:30.799374 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:18:30.799339    2564 generic.go:356] "Generic (PLEG): container finished" podID="76937f25-3fb7-46ba-9706-bcba736416c9" containerID="de50ce30d2a5061cbc49cd4c73f32f312ade6228f73fcc880eeabb9205f971c2" exitCode=0
Sep 10 21:18:30.799752 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:18:30.799426    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fc0caf1f-dtgzm" event={"ID":"76937f25-3fb7-46ba-9706-bcba736416c9","Type":"ContainerDied","Data":"de50ce30d2a5061cbc49cd4c73f32f312ade6228f73fcc880eeabb9205f971c2"}
Sep 10 21:18:30.799752 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:18:30.799498    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fc0caf1f-dtgzm" event={"ID":"76937f25-3fb7-46ba-9706-bcba736416c9","Type":"ContainerStarted","Data":"daf656d7829fa2cda997ddb462862d322ef742fd00c708523a8ee8ae23e44cf3"}
Sep 10 21:18:31.938003 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:18:31.937976    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fc0caf1f-dtgzm"
Sep 10 21:18:31.951727 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:18:31.951705    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/76937f25-3fb7-46ba-9706-bcba736416c9-maas-api-service-ca\") pod \"76937f25-3fb7-46ba-9706-bcba736416c9\" (UID: \"76937f25-3fb7-46ba-9706-bcba736416c9\") "
Sep 10 21:18:31.952018 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:18:31.951999    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76937f25-3fb7-46ba-9706-bcba736416c9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "76937f25-3fb7-46ba-9706-bcba736416c9" (UID: "76937f25-3fb7-46ba-9706-bcba736416c9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:18:32.052987 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:18:32.052954    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/76937f25-3fb7-46ba-9706-bcba736416c9-maas-api-service-ca\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:18:32.812616 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:18:32.812581    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fc0caf1f-dtgzm"
Sep 10 21:18:32.812785 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:18:32.812613    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fc0caf1f-dtgzm" event={"ID":"76937f25-3fb7-46ba-9706-bcba736416c9","Type":"ContainerDied","Data":"daf656d7829fa2cda997ddb462862d322ef742fd00c708523a8ee8ae23e44cf3"}
Sep 10 21:18:32.812785 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:18:32.812660    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="daf656d7829fa2cda997ddb462862d322ef742fd00c708523a8ee8ae23e44cf3"
Sep 10 21:18:45.213815 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:18:45.213778    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-fc0caf1f-69ff97d67d-hq52d"]
Sep 10 21:18:45.214220 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:18:45.214060    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-fc0caf1f-69ff97d67d-hq52d" podUID="4df02f01-a99a-45fc-9d0e-57b04a6180df" containerName="payload-pre-processing" containerID="cri-o://b2c8199fb4865b0d6cd0d432f464f2ebbce1172433e6389e226c237186dc1021" gracePeriod=30
Sep 10 21:18:45.425825 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:18:45.425791    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fc0caf1f-dtgzm"]
Sep 10 21:18:45.428218 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:18:45.428190    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fc0caf1f-dtgzm"]
Sep 10 21:18:45.465650 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:18:45.465598    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-fc0caf1f-69ff97d67d-hq52d"
Sep 10 21:18:45.577189 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:18:45.577154    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4df02f01-a99a-45fc-9d0e-57b04a6180df-plugins-config-volume\") pod \"4df02f01-a99a-45fc-9d0e-57b04a6180df\" (UID: \"4df02f01-a99a-45fc-9d0e-57b04a6180df\") "
Sep 10 21:18:45.577403 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:18:45.577321    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7fsk8\" (UniqueName: \"kubernetes.io/projected/4df02f01-a99a-45fc-9d0e-57b04a6180df-kube-api-access-7fsk8\") pod \"4df02f01-a99a-45fc-9d0e-57b04a6180df\" (UID: \"4df02f01-a99a-45fc-9d0e-57b04a6180df\") "
Sep 10 21:18:45.577594 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:18:45.577567    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4df02f01-a99a-45fc-9d0e-57b04a6180df-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4df02f01-a99a-45fc-9d0e-57b04a6180df" (UID: "4df02f01-a99a-45fc-9d0e-57b04a6180df"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:18:45.579379 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:18:45.579345    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4df02f01-a99a-45fc-9d0e-57b04a6180df-kube-api-access-7fsk8" (OuterVolumeSpecName: "kube-api-access-7fsk8") pod "4df02f01-a99a-45fc-9d0e-57b04a6180df" (UID: "4df02f01-a99a-45fc-9d0e-57b04a6180df"). InnerVolumeSpecName "kube-api-access-7fsk8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:18:45.678687 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:18:45.678645    2564 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4df02f01-a99a-45fc-9d0e-57b04a6180df-plugins-config-volume\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:18:45.678687 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:18:45.678689    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7fsk8\" (UniqueName: \"kubernetes.io/projected/4df02f01-a99a-45fc-9d0e-57b04a6180df-kube-api-access-7fsk8\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:18:45.873481 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:18:45.873447    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76937f25-3fb7-46ba-9706-bcba736416c9" path="/var/lib/kubelet/pods/76937f25-3fb7-46ba-9706-bcba736416c9/volumes"
Sep 10 21:18:45.895213 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:18:45.895187    2564 generic.go:356] "Generic (PLEG): container finished" podID="4df02f01-a99a-45fc-9d0e-57b04a6180df" containerID="b2c8199fb4865b0d6cd0d432f464f2ebbce1172433e6389e226c237186dc1021" exitCode=0
Sep 10 21:18:45.895383 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:18:45.895238    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-fc0caf1f-69ff97d67d-hq52d"
Sep 10 21:18:45.895383 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:18:45.895267    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-fc0caf1f-69ff97d67d-hq52d" event={"ID":"4df02f01-a99a-45fc-9d0e-57b04a6180df","Type":"ContainerDied","Data":"b2c8199fb4865b0d6cd0d432f464f2ebbce1172433e6389e226c237186dc1021"}
Sep 10 21:18:45.895383 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:18:45.895316    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-fc0caf1f-69ff97d67d-hq52d" event={"ID":"4df02f01-a99a-45fc-9d0e-57b04a6180df","Type":"ContainerDied","Data":"f6ae0262d8ecb43c2376c5f2e2b885a37d2cdfc3982e620dcd6fb4957896b96f"}
Sep 10 21:18:45.895383 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:18:45.895337    2564 scope.go:117] "RemoveContainer" containerID="b2c8199fb4865b0d6cd0d432f464f2ebbce1172433e6389e226c237186dc1021"
Sep 10 21:18:45.905295 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:18:45.905276    2564 scope.go:117] "RemoveContainer" containerID="b2c8199fb4865b0d6cd0d432f464f2ebbce1172433e6389e226c237186dc1021"
Sep 10 21:18:45.905543 ip-10-0-129-100 kubenswrapper[2564]: E0910 21:18:45.905524    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2c8199fb4865b0d6cd0d432f464f2ebbce1172433e6389e226c237186dc1021\": container with ID starting with b2c8199fb4865b0d6cd0d432f464f2ebbce1172433e6389e226c237186dc1021 not found: ID does not exist" containerID="b2c8199fb4865b0d6cd0d432f464f2ebbce1172433e6389e226c237186dc1021"
Sep 10 21:18:45.905621 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:18:45.905550    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2c8199fb4865b0d6cd0d432f464f2ebbce1172433e6389e226c237186dc1021"} err="failed to get container status \"b2c8199fb4865b0d6cd0d432f464f2ebbce1172433e6389e226c237186dc1021\": rpc error: code = NotFound desc = could not find container \"b2c8199fb4865b0d6cd0d432f464f2ebbce1172433e6389e226c237186dc1021\": container with ID starting with b2c8199fb4865b0d6cd0d432f464f2ebbce1172433e6389e226c237186dc1021 not found: ID does not exist"
Sep 10 21:18:45.929260 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:18:45.929219    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-fc0caf1f-69ff97d67d-hq52d"]
Sep 10 21:18:45.931603 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:18:45.931582    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-fc0caf1f-69ff97d67d-hq52d"]
Sep 10 21:18:47.873946 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:18:47.873907    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4df02f01-a99a-45fc-9d0e-57b04a6180df" path="/var/lib/kubelet/pods/4df02f01-a99a-45fc-9d0e-57b04a6180df/volumes"
Sep 10 21:18:59.928656 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:18:59.928625    2564 scope.go:117] "RemoveContainer" containerID="d8c8a2faf8a2d27879ffee7a2a85b611604106ac1e98f1339c60eacfd123f44e"
Sep 10 21:18:59.937127 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:18:59.937109    2564 scope.go:117] "RemoveContainer" containerID="2da6037d5d2a1631908aebc999860906ea873811bc84dfd43963017ddf6090c8"
Sep 10 21:18:59.944884 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:18:59.944863    2564 scope.go:117] "RemoveContainer" containerID="7e453cba57067a89407c319e63815eeb5e0f418c091578d3ba1efe0316f06287"
Sep 10 21:19:37.801415 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:19:37.801377    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk"]
Sep 10 21:19:37.801990 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:19:37.801688    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk" podUID="f90239b4-a68d-4e0e-af42-dbdd88ed5ee9" containerName="istio-proxy" containerID="cri-o://5e28ec1ccc47386bd709918f48dc51117ba57b1ee57aa20a3cc8feaa639f3199" gracePeriod=30
Sep 10 21:19:40.589166 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:19:40.589125    2564 patch_prober.go:28] interesting pod/e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 21:19:40.589571 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:19:40.589203    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk" podUID="f90239b4-a68d-4e0e-af42-dbdd88ed5ee9" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 21:19:43.069529 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:19:43.069465    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk"
Sep 10 21:19:43.219196 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:19:43.219149    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f90239b4-a68d-4e0e-af42-dbdd88ed5ee9-istio-podinfo\") pod \"f90239b4-a68d-4e0e-af42-dbdd88ed5ee9\" (UID: \"f90239b4-a68d-4e0e-af42-dbdd88ed5ee9\") "
Sep 10 21:19:43.219196 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:19:43.219208    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f90239b4-a68d-4e0e-af42-dbdd88ed5ee9-istio-token\") pod \"f90239b4-a68d-4e0e-af42-dbdd88ed5ee9\" (UID: \"f90239b4-a68d-4e0e-af42-dbdd88ed5ee9\") "
Sep 10 21:19:43.219463 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:19:43.219277    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f90239b4-a68d-4e0e-af42-dbdd88ed5ee9-workload-socket\") pod \"f90239b4-a68d-4e0e-af42-dbdd88ed5ee9\" (UID: \"f90239b4-a68d-4e0e-af42-dbdd88ed5ee9\") "
Sep 10 21:19:43.219463 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:19:43.219321    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f90239b4-a68d-4e0e-af42-dbdd88ed5ee9-istio-envoy\") pod \"f90239b4-a68d-4e0e-af42-dbdd88ed5ee9\" (UID: \"f90239b4-a68d-4e0e-af42-dbdd88ed5ee9\") "
Sep 10 21:19:43.219463 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:19:43.219352    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bcdcl\" (UniqueName: \"kubernetes.io/projected/f90239b4-a68d-4e0e-af42-dbdd88ed5ee9-kube-api-access-bcdcl\") pod \"f90239b4-a68d-4e0e-af42-dbdd88ed5ee9\" (UID: \"f90239b4-a68d-4e0e-af42-dbdd88ed5ee9\") "
Sep 10 21:19:43.219463 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:19:43.219388    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f90239b4-a68d-4e0e-af42-dbdd88ed5ee9-credential-socket\") pod \"f90239b4-a68d-4e0e-af42-dbdd88ed5ee9\" (UID: \"f90239b4-a68d-4e0e-af42-dbdd88ed5ee9\") "
Sep 10 21:19:43.219463 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:19:43.219438    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f90239b4-a68d-4e0e-af42-dbdd88ed5ee9-istiod-ca-cert\") pod \"f90239b4-a68d-4e0e-af42-dbdd88ed5ee9\" (UID: \"f90239b4-a68d-4e0e-af42-dbdd88ed5ee9\") "
Sep 10 21:19:43.219746 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:19:43.219491    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f90239b4-a68d-4e0e-af42-dbdd88ed5ee9-workload-certs\") pod \"f90239b4-a68d-4e0e-af42-dbdd88ed5ee9\" (UID: \"f90239b4-a68d-4e0e-af42-dbdd88ed5ee9\") "
Sep 10 21:19:43.219746 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:19:43.219544    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f90239b4-a68d-4e0e-af42-dbdd88ed5ee9-istio-data\") pod \"f90239b4-a68d-4e0e-af42-dbdd88ed5ee9\" (UID: \"f90239b4-a68d-4e0e-af42-dbdd88ed5ee9\") "
Sep 10 21:19:43.219746 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:19:43.219615    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f90239b4-a68d-4e0e-af42-dbdd88ed5ee9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f90239b4-a68d-4e0e-af42-dbdd88ed5ee9" (UID: "f90239b4-a68d-4e0e-af42-dbdd88ed5ee9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:19:43.219746 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:19:43.219632    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f90239b4-a68d-4e0e-af42-dbdd88ed5ee9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f90239b4-a68d-4e0e-af42-dbdd88ed5ee9" (UID: "f90239b4-a68d-4e0e-af42-dbdd88ed5ee9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:19:43.219962 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:19:43.219843    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f90239b4-a68d-4e0e-af42-dbdd88ed5ee9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f90239b4-a68d-4e0e-af42-dbdd88ed5ee9" (UID: "f90239b4-a68d-4e0e-af42-dbdd88ed5ee9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:19:43.219962 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:19:43.219857    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f90239b4-a68d-4e0e-af42-dbdd88ed5ee9-istio-data" (OuterVolumeSpecName: "istio-data") pod "f90239b4-a68d-4e0e-af42-dbdd88ed5ee9" (UID: "f90239b4-a68d-4e0e-af42-dbdd88ed5ee9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:19:43.219962 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:19:43.219889    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f90239b4-a68d-4e0e-af42-dbdd88ed5ee9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f90239b4-a68d-4e0e-af42-dbdd88ed5ee9" (UID: "f90239b4-a68d-4e0e-af42-dbdd88ed5ee9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:19:43.220121 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:19:43.219978    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f90239b4-a68d-4e0e-af42-dbdd88ed5ee9-workload-socket\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:19:43.220121 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:19:43.219995    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f90239b4-a68d-4e0e-af42-dbdd88ed5ee9-credential-socket\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:19:43.220121 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:19:43.220010    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f90239b4-a68d-4e0e-af42-dbdd88ed5ee9-workload-certs\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:19:43.220121 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:19:43.220022    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f90239b4-a68d-4e0e-af42-dbdd88ed5ee9-istio-data\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:19:43.221572 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:19:43.221530    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f90239b4-a68d-4e0e-af42-dbdd88ed5ee9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f90239b4-a68d-4e0e-af42-dbdd88ed5ee9" (UID: "f90239b4-a68d-4e0e-af42-dbdd88ed5ee9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 21:19:43.221696 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:19:43.221616    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f90239b4-a68d-4e0e-af42-dbdd88ed5ee9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f90239b4-a68d-4e0e-af42-dbdd88ed5ee9" (UID: "f90239b4-a68d-4e0e-af42-dbdd88ed5ee9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:19:43.221696 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:19:43.221634    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f90239b4-a68d-4e0e-af42-dbdd88ed5ee9-istio-token" (OuterVolumeSpecName: "istio-token") pod "f90239b4-a68d-4e0e-af42-dbdd88ed5ee9" (UID: "f90239b4-a68d-4e0e-af42-dbdd88ed5ee9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:19:43.221797 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:19:43.221776    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f90239b4-a68d-4e0e-af42-dbdd88ed5ee9-kube-api-access-bcdcl" (OuterVolumeSpecName: "kube-api-access-bcdcl") pod "f90239b4-a68d-4e0e-af42-dbdd88ed5ee9" (UID: "f90239b4-a68d-4e0e-af42-dbdd88ed5ee9"). InnerVolumeSpecName "kube-api-access-bcdcl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:19:43.243082 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:19:43.243058    2564 generic.go:356] "Generic (PLEG): container finished" podID="f90239b4-a68d-4e0e-af42-dbdd88ed5ee9" containerID="5e28ec1ccc47386bd709918f48dc51117ba57b1ee57aa20a3cc8feaa639f3199" exitCode=0
Sep 10 21:19:43.243185 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:19:43.243108    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk"
Sep 10 21:19:43.243185 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:19:43.243140    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk" event={"ID":"f90239b4-a68d-4e0e-af42-dbdd88ed5ee9","Type":"ContainerDied","Data":"5e28ec1ccc47386bd709918f48dc51117ba57b1ee57aa20a3cc8feaa639f3199"}
Sep 10 21:19:43.243296 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:19:43.243197    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk" event={"ID":"f90239b4-a68d-4e0e-af42-dbdd88ed5ee9","Type":"ContainerDied","Data":"96d56b4d732db693a0e24dd16c60fb891439d7033352f9bed354faa47e88043c"}
Sep 10 21:19:43.243296 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:19:43.243241    2564 scope.go:117] "RemoveContainer" containerID="5e28ec1ccc47386bd709918f48dc51117ba57b1ee57aa20a3cc8feaa639f3199"
Sep 10 21:19:43.252947 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:19:43.252929    2564 scope.go:117] "RemoveContainer" containerID="e9197efcd3656ae541cdfd8bc14a30ce638e28cfa9da5e2eee05b130fde04677"
Sep 10 21:19:43.261328 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:19:43.261311    2564 scope.go:117] "RemoveContainer" containerID="5e28ec1ccc47386bd709918f48dc51117ba57b1ee57aa20a3cc8feaa639f3199"
Sep 10 21:19:43.261593 ip-10-0-129-100 kubenswrapper[2564]: E0910 21:19:43.261574    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e28ec1ccc47386bd709918f48dc51117ba57b1ee57aa20a3cc8feaa639f3199\": container with ID starting with 5e28ec1ccc47386bd709918f48dc51117ba57b1ee57aa20a3cc8feaa639f3199 not found: ID does not exist" containerID="5e28ec1ccc47386bd709918f48dc51117ba57b1ee57aa20a3cc8feaa639f3199"
Sep 10 21:19:43.261641 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:19:43.261604    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e28ec1ccc47386bd709918f48dc51117ba57b1ee57aa20a3cc8feaa639f3199"} err="failed to get container status \"5e28ec1ccc47386bd709918f48dc51117ba57b1ee57aa20a3cc8feaa639f3199\": rpc error: code = NotFound desc = could not find container \"5e28ec1ccc47386bd709918f48dc51117ba57b1ee57aa20a3cc8feaa639f3199\": container with ID starting with 5e28ec1ccc47386bd709918f48dc51117ba57b1ee57aa20a3cc8feaa639f3199 not found: ID does not exist"
Sep 10 21:19:43.261641 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:19:43.261620    2564 scope.go:117] "RemoveContainer" containerID="e9197efcd3656ae541cdfd8bc14a30ce638e28cfa9da5e2eee05b130fde04677"
Sep 10 21:19:43.261873 ip-10-0-129-100 kubenswrapper[2564]: E0910 21:19:43.261854    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9197efcd3656ae541cdfd8bc14a30ce638e28cfa9da5e2eee05b130fde04677\": container with ID starting with e9197efcd3656ae541cdfd8bc14a30ce638e28cfa9da5e2eee05b130fde04677 not found: ID does not exist" containerID="e9197efcd3656ae541cdfd8bc14a30ce638e28cfa9da5e2eee05b130fde04677"
Sep 10 21:19:43.261921 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:19:43.261881    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9197efcd3656ae541cdfd8bc14a30ce638e28cfa9da5e2eee05b130fde04677"} err="failed to get container status \"e9197efcd3656ae541cdfd8bc14a30ce638e28cfa9da5e2eee05b130fde04677\": rpc error: code = NotFound desc = could not find container \"e9197efcd3656ae541cdfd8bc14a30ce638e28cfa9da5e2eee05b130fde04677\": container with ID starting with e9197efcd3656ae541cdfd8bc14a30ce638e28cfa9da5e2eee05b130fde04677 not found: ID does not exist"
Sep 10 21:19:43.280844 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:19:43.280822    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk"]
Sep 10 21:19:43.287068 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:19:43.287044    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-fc0caf1f-openshift-default-869c4f5fb-xz5xk"]
Sep 10 21:19:43.321313 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:19:43.321262    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f90239b4-a68d-4e0e-af42-dbdd88ed5ee9-istio-podinfo\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:19:43.321313 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:19:43.321279    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f90239b4-a68d-4e0e-af42-dbdd88ed5ee9-istio-token\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:19:43.321313 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:19:43.321291    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f90239b4-a68d-4e0e-af42-dbdd88ed5ee9-istio-envoy\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:19:43.321313 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:19:43.321299    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bcdcl\" (UniqueName: \"kubernetes.io/projected/f90239b4-a68d-4e0e-af42-dbdd88ed5ee9-kube-api-access-bcdcl\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:19:43.321313 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:19:43.321306    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f90239b4-a68d-4e0e-af42-dbdd88ed5ee9-istiod-ca-cert\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:19:43.880299 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:19:43.880268    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f90239b4-a68d-4e0e-af42-dbdd88ed5ee9" path="/var/lib/kubelet/pods/f90239b4-a68d-4e0e-af42-dbdd88ed5ee9/volumes"
Sep 10 21:19:59.978360 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:19:59.978331    2564 scope.go:117] "RemoveContainer" containerID="15951e6d640d916b999d45108dac8885f187eae3ff87d46875a026938cd43336"
Sep 10 21:20:38.341152 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:38.341109    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m"]
Sep 10 21:20:38.341654 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:38.341491    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f90239b4-a68d-4e0e-af42-dbdd88ed5ee9" containerName="istio-proxy"
Sep 10 21:20:38.341654 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:38.341503    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f90239b4-a68d-4e0e-af42-dbdd88ed5ee9" containerName="istio-proxy"
Sep 10 21:20:38.341654 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:38.341510    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f90239b4-a68d-4e0e-af42-dbdd88ed5ee9" containerName="istio-proxy"
Sep 10 21:20:38.341654 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:38.341516    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f90239b4-a68d-4e0e-af42-dbdd88ed5ee9" containerName="istio-proxy"
Sep 10 21:20:38.341654 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:38.341535    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4df02f01-a99a-45fc-9d0e-57b04a6180df" containerName="payload-pre-processing"
Sep 10 21:20:38.341654 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:38.341541    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4df02f01-a99a-45fc-9d0e-57b04a6180df" containerName="payload-pre-processing"
Sep 10 21:20:38.341654 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:38.341553    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76937f25-3fb7-46ba-9706-bcba736416c9" containerName="revoke-keys"
Sep 10 21:20:38.341654 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:38.341558    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="76937f25-3fb7-46ba-9706-bcba736416c9" containerName="revoke-keys"
Sep 10 21:20:38.341654 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:38.341610    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="4df02f01-a99a-45fc-9d0e-57b04a6180df" containerName="payload-pre-processing"
Sep 10 21:20:38.341654 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:38.341618    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f90239b4-a68d-4e0e-af42-dbdd88ed5ee9" containerName="istio-proxy"
Sep 10 21:20:38.341654 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:38.341626    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="76937f25-3fb7-46ba-9706-bcba736416c9" containerName="revoke-keys"
Sep 10 21:20:38.344784 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:38.344767    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m"
Sep 10 21:20:38.354725 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:38.354704    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-e074ad-openshift-default-dockercfg-kks24\""
Sep 10 21:20:38.381863 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:38.381833    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m"]
Sep 10 21:20:38.447307 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:38.447269    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f64c0f39-698d-4864-81f3-4db811d4cf54-workload-certs\") pod \"e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m\" (UID: \"f64c0f39-698d-4864-81f3-4db811d4cf54\") " pod="openshift-ingress/e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m"
Sep 10 21:20:38.447307 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:38.447307    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f64c0f39-698d-4864-81f3-4db811d4cf54-istio-envoy\") pod \"e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m\" (UID: \"f64c0f39-698d-4864-81f3-4db811d4cf54\") " pod="openshift-ingress/e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m"
Sep 10 21:20:38.447508 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:38.447328    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f64c0f39-698d-4864-81f3-4db811d4cf54-istio-podinfo\") pod \"e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m\" (UID: \"f64c0f39-698d-4864-81f3-4db811d4cf54\") " pod="openshift-ingress/e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m"
Sep 10 21:20:38.447508 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:38.447408    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f64c0f39-698d-4864-81f3-4db811d4cf54-istio-token\") pod \"e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m\" (UID: \"f64c0f39-698d-4864-81f3-4db811d4cf54\") " pod="openshift-ingress/e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m"
Sep 10 21:20:38.447508 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:38.447440    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f64c0f39-698d-4864-81f3-4db811d4cf54-istiod-ca-cert\") pod \"e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m\" (UID: \"f64c0f39-698d-4864-81f3-4db811d4cf54\") " pod="openshift-ingress/e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m"
Sep 10 21:20:38.447508 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:38.447465    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f64c0f39-698d-4864-81f3-4db811d4cf54-credential-socket\") pod \"e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m\" (UID: \"f64c0f39-698d-4864-81f3-4db811d4cf54\") " pod="openshift-ingress/e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m"
Sep 10 21:20:38.447646 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:38.447547    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whwqn\" (UniqueName: \"kubernetes.io/projected/f64c0f39-698d-4864-81f3-4db811d4cf54-kube-api-access-whwqn\") pod \"e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m\" (UID: \"f64c0f39-698d-4864-81f3-4db811d4cf54\") " pod="openshift-ingress/e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m"
Sep 10 21:20:38.447646 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:38.447565    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f64c0f39-698d-4864-81f3-4db811d4cf54-workload-socket\") pod \"e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m\" (UID: \"f64c0f39-698d-4864-81f3-4db811d4cf54\") " pod="openshift-ingress/e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m"
Sep 10 21:20:38.447646 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:38.447594    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f64c0f39-698d-4864-81f3-4db811d4cf54-istio-data\") pod \"e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m\" (UID: \"f64c0f39-698d-4864-81f3-4db811d4cf54\") " pod="openshift-ingress/e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m"
Sep 10 21:20:38.548462 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:38.548425    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f64c0f39-698d-4864-81f3-4db811d4cf54-istio-token\") pod \"e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m\" (UID: \"f64c0f39-698d-4864-81f3-4db811d4cf54\") " pod="openshift-ingress/e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m"
Sep 10 21:20:38.548462 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:38.548463    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f64c0f39-698d-4864-81f3-4db811d4cf54-istiod-ca-cert\") pod \"e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m\" (UID: \"f64c0f39-698d-4864-81f3-4db811d4cf54\") " pod="openshift-ingress/e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m"
Sep 10 21:20:38.548666 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:38.548595    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f64c0f39-698d-4864-81f3-4db811d4cf54-credential-socket\") pod \"e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m\" (UID: \"f64c0f39-698d-4864-81f3-4db811d4cf54\") " pod="openshift-ingress/e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m"
Sep 10 21:20:38.548713 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:38.548682    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whwqn\" (UniqueName: \"kubernetes.io/projected/f64c0f39-698d-4864-81f3-4db811d4cf54-kube-api-access-whwqn\") pod \"e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m\" (UID: \"f64c0f39-698d-4864-81f3-4db811d4cf54\") " pod="openshift-ingress/e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m"
Sep 10 21:20:38.548753 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:38.548714    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f64c0f39-698d-4864-81f3-4db811d4cf54-workload-socket\") pod \"e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m\" (UID: \"f64c0f39-698d-4864-81f3-4db811d4cf54\") " pod="openshift-ingress/e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m"
Sep 10 21:20:38.548788 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:38.548752    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f64c0f39-698d-4864-81f3-4db811d4cf54-istio-data\") pod \"e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m\" (UID: \"f64c0f39-698d-4864-81f3-4db811d4cf54\") " pod="openshift-ingress/e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m"
Sep 10 21:20:38.548886 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:38.548857    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f64c0f39-698d-4864-81f3-4db811d4cf54-workload-certs\") pod \"e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m\" (UID: \"f64c0f39-698d-4864-81f3-4db811d4cf54\") " pod="openshift-ingress/e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m"
Sep 10 21:20:38.548928 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:38.548916    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f64c0f39-698d-4864-81f3-4db811d4cf54-istio-envoy\") pod \"e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m\" (UID: \"f64c0f39-698d-4864-81f3-4db811d4cf54\") " pod="openshift-ingress/e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m"
Sep 10 21:20:38.548980 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:38.548952    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f64c0f39-698d-4864-81f3-4db811d4cf54-istio-podinfo\") pod \"e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m\" (UID: \"f64c0f39-698d-4864-81f3-4db811d4cf54\") " pod="openshift-ingress/e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m"
Sep 10 21:20:38.548980 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:38.548966    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f64c0f39-698d-4864-81f3-4db811d4cf54-credential-socket\") pod \"e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m\" (UID: \"f64c0f39-698d-4864-81f3-4db811d4cf54\") " pod="openshift-ingress/e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m"
Sep 10 21:20:38.549084 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:38.549064    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f64c0f39-698d-4864-81f3-4db811d4cf54-istio-data\") pod \"e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m\" (UID: \"f64c0f39-698d-4864-81f3-4db811d4cf54\") " pod="openshift-ingress/e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m"
Sep 10 21:20:38.549178 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:38.549155    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f64c0f39-698d-4864-81f3-4db811d4cf54-workload-certs\") pod \"e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m\" (UID: \"f64c0f39-698d-4864-81f3-4db811d4cf54\") " pod="openshift-ingress/e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m"
Sep 10 21:20:38.549265 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:38.549196    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f64c0f39-698d-4864-81f3-4db811d4cf54-istiod-ca-cert\") pod \"e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m\" (UID: \"f64c0f39-698d-4864-81f3-4db811d4cf54\") " pod="openshift-ingress/e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m"
Sep 10 21:20:38.549349 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:38.549329    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f64c0f39-698d-4864-81f3-4db811d4cf54-workload-socket\") pod \"e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m\" (UID: \"f64c0f39-698d-4864-81f3-4db811d4cf54\") " pod="openshift-ingress/e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m"
Sep 10 21:20:38.551185 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:38.551156    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f64c0f39-698d-4864-81f3-4db811d4cf54-istio-envoy\") pod \"e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m\" (UID: \"f64c0f39-698d-4864-81f3-4db811d4cf54\") " pod="openshift-ingress/e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m"
Sep 10 21:20:38.551400 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:38.551384    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f64c0f39-698d-4864-81f3-4db811d4cf54-istio-podinfo\") pod \"e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m\" (UID: \"f64c0f39-698d-4864-81f3-4db811d4cf54\") " pod="openshift-ingress/e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m"
Sep 10 21:20:38.561764 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:38.561742    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f64c0f39-698d-4864-81f3-4db811d4cf54-istio-token\") pod \"e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m\" (UID: \"f64c0f39-698d-4864-81f3-4db811d4cf54\") " pod="openshift-ingress/e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m"
Sep 10 21:20:38.566019 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:38.565994    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whwqn\" (UniqueName: \"kubernetes.io/projected/f64c0f39-698d-4864-81f3-4db811d4cf54-kube-api-access-whwqn\") pod \"e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m\" (UID: \"f64c0f39-698d-4864-81f3-4db811d4cf54\") " pod="openshift-ingress/e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m"
Sep 10 21:20:38.654151 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:38.654074    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m"
Sep 10 21:20:38.952454 ip-10-0-129-100 kubenswrapper[2564]: W0910 21:20:38.952424    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf64c0f39_698d_4864_81f3_4db811d4cf54.slice/crio-486ca6f55b251776df2b775d09af96445fbd1f57c6d645cf0b02a8d6e9122ceb WatchSource:0}: Error finding container 486ca6f55b251776df2b775d09af96445fbd1f57c6d645cf0b02a8d6e9122ceb: Status 404 returned error can't find the container with id 486ca6f55b251776df2b775d09af96445fbd1f57c6d645cf0b02a8d6e9122ceb
Sep 10 21:20:38.952641 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:38.952616    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m"]
Sep 10 21:20:38.954708 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:38.954676    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 10 21:20:38.954801 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:38.954741    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 10 21:20:38.954801 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:38.954769    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 10 21:20:39.576508 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:39.576470    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m" event={"ID":"f64c0f39-698d-4864-81f3-4db811d4cf54","Type":"ContainerStarted","Data":"831859cc829f2912ea79e233b8a33627c832519c87c79153ed1cab9beb82828d"}
Sep 10 21:20:39.576909 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:39.576529    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m" event={"ID":"f64c0f39-698d-4864-81f3-4db811d4cf54","Type":"ContainerStarted","Data":"486ca6f55b251776df2b775d09af96445fbd1f57c6d645cf0b02a8d6e9122ceb"}
Sep 10 21:20:39.612368 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:39.612314    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m" podStartSLOduration=1.612297506 podStartE2EDuration="1.612297506s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:20:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:20:39.610493905 +0000 UTC m=+1420.297561216" watchObservedRunningTime="2026-09-10 21:20:39.612297506 +0000 UTC m=+1420.299364785"
Sep 10 21:20:39.654923 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:39.654887    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m"
Sep 10 21:20:40.660660 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:40.660590    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m"
Sep 10 21:20:41.588044 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:41.588007    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m"
Sep 10 21:20:41.588949 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:41.588928    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m"
Sep 10 21:20:43.770500 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:43.770458    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-e074ad-677d855b9d-pdnt8"]
Sep 10 21:20:43.771143 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:43.771124    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f90239b4-a68d-4e0e-af42-dbdd88ed5ee9" containerName="istio-proxy"
Sep 10 21:20:43.774586 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:43.774567    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-e074ad-677d855b9d-pdnt8"
Sep 10 21:20:43.779545 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:43.779522    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-e074ad\""
Sep 10 21:20:43.779661 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:43.779526    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-e074ad-dockercfg-dbg9l\""
Sep 10 21:20:43.790753 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:43.790734    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-e074ad-677d855b9d-pdnt8"]
Sep 10 21:20:43.857454 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:43.857419    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-e074ad-77cb745677-svk4b"]
Sep 10 21:20:43.860991 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:43.860971    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-e074ad-77cb745677-svk4b"
Sep 10 21:20:43.903738 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:43.903711    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nk97d\" (UniqueName: \"kubernetes.io/projected/f8e14ac8-d63e-4b43-894b-2a8d45557214-kube-api-access-nk97d\") pod \"payload-pre-processing-e2e-api-a-e074ad-677d855b9d-pdnt8\" (UID: \"f8e14ac8-d63e-4b43-894b-2a8d45557214\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-e074ad-677d855b9d-pdnt8"
Sep 10 21:20:43.903888 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:43.903778    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/29160f73-92d3-489a-84b8-870644814e9a-plugins-config-volume\") pod \"payload-processing-e2e-api-a-e074ad-77cb745677-svk4b\" (UID: \"29160f73-92d3-489a-84b8-870644814e9a\") " pod="openshift-ingress/payload-processing-e2e-api-a-e074ad-77cb745677-svk4b"
Sep 10 21:20:43.903888 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:43.903806    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8e14ac8-d63e-4b43-894b-2a8d45557214-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-e074ad-677d855b9d-pdnt8\" (UID: \"f8e14ac8-d63e-4b43-894b-2a8d45557214\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-e074ad-677d855b9d-pdnt8"
Sep 10 21:20:43.903888 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:43.903835    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnkmf\" (UniqueName: \"kubernetes.io/projected/29160f73-92d3-489a-84b8-870644814e9a-kube-api-access-qnkmf\") pod \"payload-processing-e2e-api-a-e074ad-77cb745677-svk4b\" (UID: \"29160f73-92d3-489a-84b8-870644814e9a\") " pod="openshift-ingress/payload-processing-e2e-api-a-e074ad-77cb745677-svk4b"
Sep 10 21:20:43.918522 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:43.918501    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-e074ad-77cb745677-svk4b"]
Sep 10 21:20:44.004889 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:44.004856    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nk97d\" (UniqueName: \"kubernetes.io/projected/f8e14ac8-d63e-4b43-894b-2a8d45557214-kube-api-access-nk97d\") pod \"payload-pre-processing-e2e-api-a-e074ad-677d855b9d-pdnt8\" (UID: \"f8e14ac8-d63e-4b43-894b-2a8d45557214\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-e074ad-677d855b9d-pdnt8"
Sep 10 21:20:44.005068 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:44.004922    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/29160f73-92d3-489a-84b8-870644814e9a-plugins-config-volume\") pod \"payload-processing-e2e-api-a-e074ad-77cb745677-svk4b\" (UID: \"29160f73-92d3-489a-84b8-870644814e9a\") " pod="openshift-ingress/payload-processing-e2e-api-a-e074ad-77cb745677-svk4b"
Sep 10 21:20:44.005068 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:44.004965    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8e14ac8-d63e-4b43-894b-2a8d45557214-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-e074ad-677d855b9d-pdnt8\" (UID: \"f8e14ac8-d63e-4b43-894b-2a8d45557214\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-e074ad-677d855b9d-pdnt8"
Sep 10 21:20:44.005068 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:44.005018    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnkmf\" (UniqueName: \"kubernetes.io/projected/29160f73-92d3-489a-84b8-870644814e9a-kube-api-access-qnkmf\") pod \"payload-processing-e2e-api-a-e074ad-77cb745677-svk4b\" (UID: \"29160f73-92d3-489a-84b8-870644814e9a\") " pod="openshift-ingress/payload-processing-e2e-api-a-e074ad-77cb745677-svk4b"
Sep 10 21:20:44.005644 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:44.005624    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/29160f73-92d3-489a-84b8-870644814e9a-plugins-config-volume\") pod \"payload-processing-e2e-api-a-e074ad-77cb745677-svk4b\" (UID: \"29160f73-92d3-489a-84b8-870644814e9a\") " pod="openshift-ingress/payload-processing-e2e-api-a-e074ad-77cb745677-svk4b"
Sep 10 21:20:44.005781 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:44.005761    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8e14ac8-d63e-4b43-894b-2a8d45557214-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-e074ad-677d855b9d-pdnt8\" (UID: \"f8e14ac8-d63e-4b43-894b-2a8d45557214\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-e074ad-677d855b9d-pdnt8"
Sep 10 21:20:44.033539 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:44.033480    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnkmf\" (UniqueName: \"kubernetes.io/projected/29160f73-92d3-489a-84b8-870644814e9a-kube-api-access-qnkmf\") pod \"payload-processing-e2e-api-a-e074ad-77cb745677-svk4b\" (UID: \"29160f73-92d3-489a-84b8-870644814e9a\") " pod="openshift-ingress/payload-processing-e2e-api-a-e074ad-77cb745677-svk4b"
Sep 10 21:20:44.033679 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:44.033658    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nk97d\" (UniqueName: \"kubernetes.io/projected/f8e14ac8-d63e-4b43-894b-2a8d45557214-kube-api-access-nk97d\") pod \"payload-pre-processing-e2e-api-a-e074ad-677d855b9d-pdnt8\" (UID: \"f8e14ac8-d63e-4b43-894b-2a8d45557214\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-e074ad-677d855b9d-pdnt8"
Sep 10 21:20:44.085552 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:44.085515    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-e074ad-677d855b9d-pdnt8"
Sep 10 21:20:44.171761 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:44.171729    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-e074ad-77cb745677-svk4b"
Sep 10 21:20:44.361042 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:44.361015    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-e074ad-677d855b9d-pdnt8"]
Sep 10 21:20:44.361678 ip-10-0-129-100 kubenswrapper[2564]: W0910 21:20:44.361651    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8e14ac8_d63e_4b43_894b_2a8d45557214.slice/crio-5e086b1d8ba1e6fdb242f2334f6298b846bec48a417bf259d0e75cefb375bf18 WatchSource:0}: Error finding container 5e086b1d8ba1e6fdb242f2334f6298b846bec48a417bf259d0e75cefb375bf18: Status 404 returned error can't find the container with id 5e086b1d8ba1e6fdb242f2334f6298b846bec48a417bf259d0e75cefb375bf18
Sep 10 21:20:44.470095 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:44.470056    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-e074ad-77cb745677-svk4b"]
Sep 10 21:20:44.470991 ip-10-0-129-100 kubenswrapper[2564]: W0910 21:20:44.470961    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29160f73_92d3_489a_84b8_870644814e9a.slice/crio-73abc963e73e412d2078bb275c4f92f30d87549d759dd77ee2c1823b2c2370a1 WatchSource:0}: Error finding container 73abc963e73e412d2078bb275c4f92f30d87549d759dd77ee2c1823b2c2370a1: Status 404 returned error can't find the container with id 73abc963e73e412d2078bb275c4f92f30d87549d759dd77ee2c1823b2c2370a1
Sep 10 21:20:44.608643 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:44.608603    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-e074ad-77cb745677-svk4b" event={"ID":"29160f73-92d3-489a-84b8-870644814e9a","Type":"ContainerStarted","Data":"e78f5ea4b76af403f6616dcb54401a80cff58c83a51124c124185b550c086ceb"}
Sep 10 21:20:44.608877 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:44.608673    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-e074ad-77cb745677-svk4b" event={"ID":"29160f73-92d3-489a-84b8-870644814e9a","Type":"ContainerStarted","Data":"73abc963e73e412d2078bb275c4f92f30d87549d759dd77ee2c1823b2c2370a1"}
Sep 10 21:20:44.608877 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:44.608817    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-e074ad-77cb745677-svk4b"
Sep 10 21:20:44.610448 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:44.610423    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-e074ad-677d855b9d-pdnt8" event={"ID":"f8e14ac8-d63e-4b43-894b-2a8d45557214","Type":"ContainerStarted","Data":"76eff523e0b21e0023f02f1408d32e103657dea608d7f8be08ca445c564e7818"}
Sep 10 21:20:44.610578 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:44.610472    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-e074ad-677d855b9d-pdnt8" event={"ID":"f8e14ac8-d63e-4b43-894b-2a8d45557214","Type":"ContainerStarted","Data":"5e086b1d8ba1e6fdb242f2334f6298b846bec48a417bf259d0e75cefb375bf18"}
Sep 10 21:20:44.610578 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:44.610524    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-e074ad-677d855b9d-pdnt8"
Sep 10 21:20:44.629516 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:44.629462    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-e074ad-77cb745677-svk4b" podStartSLOduration=1.6294474399999999 podStartE2EDuration="1.62944744s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:20:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:20:44.628543116 +0000 UTC m=+1425.315610402" watchObservedRunningTime="2026-09-10 21:20:44.62944744 +0000 UTC m=+1425.316514718"
Sep 10 21:20:44.649058 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:44.649005    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-e074ad-677d855b9d-pdnt8" podStartSLOduration=1.648986785 podStartE2EDuration="1.648986785s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:20:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:20:44.646850491 +0000 UTC m=+1425.333918051" watchObservedRunningTime="2026-09-10 21:20:44.648986785 +0000 UTC m=+1425.336054064"
Sep 10 21:20:55.619102 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:55.619021    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-e074ad-677d855b9d-pdnt8"
Sep 10 21:20:55.619484 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:20:55.619110    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-e074ad-77cb745677-svk4b"
Sep 10 21:21:00.005321 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:21:00.005287    2564 scope.go:117] "RemoveContainer" containerID="f08ffa531db7e1469c7839a4e999859d3b4f78ed947a9e93a1a0f37319c4e5be"
Sep 10 21:21:00.015880 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:21:00.015856    2564 scope.go:117] "RemoveContainer" containerID="a85b793f1a1b3823dbc88552085e606662ca95da4e21630efc7f9b09e2a368d3"
Sep 10 21:21:02.738304 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:21:02.738179    2564 generic.go:356] "Generic (PLEG): container finished" podID="f64c0f39-698d-4864-81f3-4db811d4cf54" containerID="831859cc829f2912ea79e233b8a33627c832519c87c79153ed1cab9beb82828d" exitCode=0
Sep 10 21:21:02.738304 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:21:02.738260    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m" event={"ID":"f64c0f39-698d-4864-81f3-4db811d4cf54","Type":"ContainerDied","Data":"831859cc829f2912ea79e233b8a33627c832519c87c79153ed1cab9beb82828d"}
Sep 10 21:21:02.738759 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:21:02.738739    2564 scope.go:117] "RemoveContainer" containerID="831859cc829f2912ea79e233b8a33627c832519c87c79153ed1cab9beb82828d"
Sep 10 21:21:02.739889 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:21:02.739856    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 10 21:21:02.739943 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:21:02.739931    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 10 21:21:02.739980 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:21:02.739961    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 10 21:21:03.746420 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:21:03.746385    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m" event={"ID":"f64c0f39-698d-4864-81f3-4db811d4cf54","Type":"ContainerStarted","Data":"c41bb8ce0af9d12ade5be18f478eb16b37bf2744329c1ed33c50e0ca61e07b9c"}
Sep 10 21:21:04.654666 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:21:04.654626    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m"
Sep 10 21:21:04.654859 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:21:04.654836    2564 patch_prober.go:28] interesting pod/e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Sep 10 21:21:04.654924 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:21:04.654905    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m" podUID="f64c0f39-698d-4864-81f3-4db811d4cf54" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Sep 10 21:21:05.655397 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:21:05.655361    2564 patch_prober.go:28] interesting pod/e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Sep 10 21:21:05.655809 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:21:05.655426    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m" podUID="f64c0f39-698d-4864-81f3-4db811d4cf54" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Sep 10 21:21:06.654802 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:21:06.654767    2564 patch_prober.go:28] interesting pod/e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Sep 10 21:21:06.655018 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:21:06.654827    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m" podUID="f64c0f39-698d-4864-81f3-4db811d4cf54" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Sep 10 21:21:07.654977 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:21:07.654939    2564 patch_prober.go:28] interesting pod/e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Sep 10 21:21:07.655413 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:21:07.655005    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m" podUID="f64c0f39-698d-4864-81f3-4db811d4cf54" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Sep 10 21:21:08.654478 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:21:08.654437    2564 patch_prober.go:28] interesting pod/e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Sep 10 21:21:08.654750 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:21:08.654504    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m" podUID="f64c0f39-698d-4864-81f3-4db811d4cf54" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Sep 10 21:21:09.658607 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:21:09.658569    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m"
Sep 10 21:21:09.658981 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:21:09.658861    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m"
Sep 10 21:21:09.659559 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:21:09.659540    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m"
Sep 10 21:21:43.705026 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:21:43.704982    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e074ad-dr4dq"]
Sep 10 21:21:43.708604 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:21:43.708582    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e074ad-dr4dq"
Sep 10 21:21:43.711019 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:21:43.710992    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-m5c7x\""
Sep 10 21:21:43.711145 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:21:43.710993    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 21:21:43.716264 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:21:43.716238    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e074ad-dr4dq"]
Sep 10 21:21:43.792670 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:21:43.792634    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/92b03f4e-673f-44b9-bbd2-d839087fdeb2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-e074ad-dr4dq\" (UID: \"92b03f4e-673f-44b9-bbd2-d839087fdeb2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e074ad-dr4dq"
Sep 10 21:21:43.898189 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:21:43.898151    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/92b03f4e-673f-44b9-bbd2-d839087fdeb2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-e074ad-dr4dq\" (UID: \"92b03f4e-673f-44b9-bbd2-d839087fdeb2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e074ad-dr4dq"
Sep 10 21:21:43.899222 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:21:43.899190    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/92b03f4e-673f-44b9-bbd2-d839087fdeb2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-e074ad-dr4dq\" (UID: \"92b03f4e-673f-44b9-bbd2-d839087fdeb2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e074ad-dr4dq"
Sep 10 21:21:44.021726 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:21:44.021642    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e074ad-dr4dq"
Sep 10 21:21:44.296689 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:21:44.296657    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e074ad-dr4dq"]
Sep 10 21:21:44.298273 ip-10-0-129-100 kubenswrapper[2564]: W0910 21:21:44.298248    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92b03f4e_673f_44b9_bbd2_d839087fdeb2.slice/crio-329c8916b6d39659caf75cbbdeb3a12f3ba65b02ba4da079e9e63046faf9b50f WatchSource:0}: Error finding container 329c8916b6d39659caf75cbbdeb3a12f3ba65b02ba4da079e9e63046faf9b50f: Status 404 returned error can't find the container with id 329c8916b6d39659caf75cbbdeb3a12f3ba65b02ba4da079e9e63046faf9b50f
Sep 10 21:21:44.995538 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:21:44.995497    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e074ad-dr4dq" event={"ID":"92b03f4e-673f-44b9-bbd2-d839087fdeb2","Type":"ContainerStarted","Data":"6376ad6845c96a208c01c381526255da2d582e858fbecd1810e5e7a58a847b47"}
Sep 10 21:21:44.995973 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:21:44.995555    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e074ad-dr4dq" event={"ID":"92b03f4e-673f-44b9-bbd2-d839087fdeb2","Type":"ContainerStarted","Data":"329c8916b6d39659caf75cbbdeb3a12f3ba65b02ba4da079e9e63046faf9b50f"}
Sep 10 21:21:45.015797 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:21:45.015738    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e074ad-dr4dq" podStartSLOduration=2.015721655 podStartE2EDuration="2.015721655s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:21:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:21:45.014967296 +0000 UTC m=+1485.702034588" watchObservedRunningTime="2026-09-10 21:21:45.015721655 +0000 UTC m=+1485.702788934"
Sep 10 21:21:46.003281 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:21:46.003218    2564 generic.go:356] "Generic (PLEG): container finished" podID="92b03f4e-673f-44b9-bbd2-d839087fdeb2" containerID="6376ad6845c96a208c01c381526255da2d582e858fbecd1810e5e7a58a847b47" exitCode=0
Sep 10 21:21:46.003725 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:21:46.003279    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e074ad-dr4dq" event={"ID":"92b03f4e-673f-44b9-bbd2-d839087fdeb2","Type":"ContainerDied","Data":"6376ad6845c96a208c01c381526255da2d582e858fbecd1810e5e7a58a847b47"}
Sep 10 21:21:47.141638 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:21:47.141611    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e074ad-dr4dq"
Sep 10 21:21:47.335545 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:21:47.335514    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/92b03f4e-673f-44b9-bbd2-d839087fdeb2-maas-api-service-ca\") pod \"92b03f4e-673f-44b9-bbd2-d839087fdeb2\" (UID: \"92b03f4e-673f-44b9-bbd2-d839087fdeb2\") "
Sep 10 21:21:47.335861 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:21:47.335840    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92b03f4e-673f-44b9-bbd2-d839087fdeb2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "92b03f4e-673f-44b9-bbd2-d839087fdeb2" (UID: "92b03f4e-673f-44b9-bbd2-d839087fdeb2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:21:47.436707 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:21:47.436678    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/92b03f4e-673f-44b9-bbd2-d839087fdeb2-maas-api-service-ca\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:21:48.024326 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:21:48.024286    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e074ad-dr4dq"
Sep 10 21:21:48.024518 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:21:48.024321    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e074ad-dr4dq" event={"ID":"92b03f4e-673f-44b9-bbd2-d839087fdeb2","Type":"ContainerDied","Data":"329c8916b6d39659caf75cbbdeb3a12f3ba65b02ba4da079e9e63046faf9b50f"}
Sep 10 21:21:48.024518 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:21:48.024399    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="329c8916b6d39659caf75cbbdeb3a12f3ba65b02ba4da079e9e63046faf9b50f"
Sep 10 21:22:00.043553 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:00.043518    2564 scope.go:117] "RemoveContainer" containerID="1e81daf9dd6c4edfb75767208bfb95432ef75f37181d718797bbce2e82762226"
Sep 10 21:22:00.057750 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:00.057732    2564 scope.go:117] "RemoveContainer" containerID="baae3845a3140ae4c16c75df78df08138a4f19f2cc8c874a9d39632450d6ca5e"
Sep 10 21:22:00.272794 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:00.272760    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-e074ad-77cb745677-svk4b"]
Sep 10 21:22:00.273099 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:00.273047    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-e074ad-77cb745677-svk4b" podUID="29160f73-92d3-489a-84b8-870644814e9a" containerName="payload-processing" containerID="cri-o://e78f5ea4b76af403f6616dcb54401a80cff58c83a51124c124185b550c086ceb" gracePeriod=30
Sep 10 21:22:00.281469 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:00.281444    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-e074ad-677d855b9d-pdnt8"]
Sep 10 21:22:00.281691 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:00.281651    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-e074ad-677d855b9d-pdnt8" podUID="f8e14ac8-d63e-4b43-894b-2a8d45557214" containerName="payload-pre-processing" containerID="cri-o://76eff523e0b21e0023f02f1408d32e103657dea608d7f8be08ca445c564e7818" gracePeriod=30
Sep 10 21:22:00.526329 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:00.526297    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e074ad-dr4dq"]
Sep 10 21:22:00.531376 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:00.531338    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e074ad-dr4dq"]
Sep 10 21:22:00.534135 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:00.534116    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-e074ad-77cb745677-svk4b"
Sep 10 21:22:00.560501 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:00.560475    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/29160f73-92d3-489a-84b8-870644814e9a-plugins-config-volume\") pod \"29160f73-92d3-489a-84b8-870644814e9a\" (UID: \"29160f73-92d3-489a-84b8-870644814e9a\") "
Sep 10 21:22:00.560605 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:00.560565    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qnkmf\" (UniqueName: \"kubernetes.io/projected/29160f73-92d3-489a-84b8-870644814e9a-kube-api-access-qnkmf\") pod \"29160f73-92d3-489a-84b8-870644814e9a\" (UID: \"29160f73-92d3-489a-84b8-870644814e9a\") "
Sep 10 21:22:00.560864 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:00.560840    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29160f73-92d3-489a-84b8-870644814e9a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "29160f73-92d3-489a-84b8-870644814e9a" (UID: "29160f73-92d3-489a-84b8-870644814e9a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:22:00.562847 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:00.562820    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29160f73-92d3-489a-84b8-870644814e9a-kube-api-access-qnkmf" (OuterVolumeSpecName: "kube-api-access-qnkmf") pod "29160f73-92d3-489a-84b8-870644814e9a" (UID: "29160f73-92d3-489a-84b8-870644814e9a"). InnerVolumeSpecName "kube-api-access-qnkmf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:22:00.564395 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:00.564377    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-e074ad-677d855b9d-pdnt8"
Sep 10 21:22:00.661255 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:00.661154    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nk97d\" (UniqueName: \"kubernetes.io/projected/f8e14ac8-d63e-4b43-894b-2a8d45557214-kube-api-access-nk97d\") pod \"f8e14ac8-d63e-4b43-894b-2a8d45557214\" (UID: \"f8e14ac8-d63e-4b43-894b-2a8d45557214\") "
Sep 10 21:22:00.661434 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:00.661316    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8e14ac8-d63e-4b43-894b-2a8d45557214-plugins-config-volume\") pod \"f8e14ac8-d63e-4b43-894b-2a8d45557214\" (UID: \"f8e14ac8-d63e-4b43-894b-2a8d45557214\") "
Sep 10 21:22:00.661506 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:00.661500    2564 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/29160f73-92d3-489a-84b8-870644814e9a-plugins-config-volume\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:22:00.661564 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:00.661510    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qnkmf\" (UniqueName: \"kubernetes.io/projected/29160f73-92d3-489a-84b8-870644814e9a-kube-api-access-qnkmf\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:22:00.661652 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:00.661628    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8e14ac8-d63e-4b43-894b-2a8d45557214-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f8e14ac8-d63e-4b43-894b-2a8d45557214" (UID: "f8e14ac8-d63e-4b43-894b-2a8d45557214"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:22:00.663353 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:00.663327    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8e14ac8-d63e-4b43-894b-2a8d45557214-kube-api-access-nk97d" (OuterVolumeSpecName: "kube-api-access-nk97d") pod "f8e14ac8-d63e-4b43-894b-2a8d45557214" (UID: "f8e14ac8-d63e-4b43-894b-2a8d45557214"). InnerVolumeSpecName "kube-api-access-nk97d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:22:00.762559 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:00.762527    2564 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8e14ac8-d63e-4b43-894b-2a8d45557214-plugins-config-volume\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:22:00.762559 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:00.762557    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nk97d\" (UniqueName: \"kubernetes.io/projected/f8e14ac8-d63e-4b43-894b-2a8d45557214-kube-api-access-nk97d\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:22:01.100801 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:01.100770    2564 generic.go:356] "Generic (PLEG): container finished" podID="29160f73-92d3-489a-84b8-870644814e9a" containerID="e78f5ea4b76af403f6616dcb54401a80cff58c83a51124c124185b550c086ceb" exitCode=0
Sep 10 21:22:01.100801 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:01.100814    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-e074ad-77cb745677-svk4b"
Sep 10 21:22:01.101369 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:01.100855    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-e074ad-77cb745677-svk4b" event={"ID":"29160f73-92d3-489a-84b8-870644814e9a","Type":"ContainerDied","Data":"e78f5ea4b76af403f6616dcb54401a80cff58c83a51124c124185b550c086ceb"}
Sep 10 21:22:01.101369 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:01.100909    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-e074ad-77cb745677-svk4b" event={"ID":"29160f73-92d3-489a-84b8-870644814e9a","Type":"ContainerDied","Data":"73abc963e73e412d2078bb275c4f92f30d87549d759dd77ee2c1823b2c2370a1"}
Sep 10 21:22:01.101369 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:01.100932    2564 scope.go:117] "RemoveContainer" containerID="e78f5ea4b76af403f6616dcb54401a80cff58c83a51124c124185b550c086ceb"
Sep 10 21:22:01.102555 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:01.102524    2564 generic.go:356] "Generic (PLEG): container finished" podID="f8e14ac8-d63e-4b43-894b-2a8d45557214" containerID="76eff523e0b21e0023f02f1408d32e103657dea608d7f8be08ca445c564e7818" exitCode=0
Sep 10 21:22:01.102650 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:01.102578    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-e074ad-677d855b9d-pdnt8"
Sep 10 21:22:01.102650 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:01.102598    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-e074ad-677d855b9d-pdnt8" event={"ID":"f8e14ac8-d63e-4b43-894b-2a8d45557214","Type":"ContainerDied","Data":"76eff523e0b21e0023f02f1408d32e103657dea608d7f8be08ca445c564e7818"}
Sep 10 21:22:01.102758 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:01.102650    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-e074ad-677d855b9d-pdnt8" event={"ID":"f8e14ac8-d63e-4b43-894b-2a8d45557214","Type":"ContainerDied","Data":"5e086b1d8ba1e6fdb242f2334f6298b846bec48a417bf259d0e75cefb375bf18"}
Sep 10 21:22:01.112210 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:01.112180    2564 scope.go:117] "RemoveContainer" containerID="e78f5ea4b76af403f6616dcb54401a80cff58c83a51124c124185b550c086ceb"
Sep 10 21:22:01.112547 ip-10-0-129-100 kubenswrapper[2564]: E0910 21:22:01.112525    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e78f5ea4b76af403f6616dcb54401a80cff58c83a51124c124185b550c086ceb\": container with ID starting with e78f5ea4b76af403f6616dcb54401a80cff58c83a51124c124185b550c086ceb not found: ID does not exist" containerID="e78f5ea4b76af403f6616dcb54401a80cff58c83a51124c124185b550c086ceb"
Sep 10 21:22:01.112630 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:01.112556    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e78f5ea4b76af403f6616dcb54401a80cff58c83a51124c124185b550c086ceb"} err="failed to get container status \"e78f5ea4b76af403f6616dcb54401a80cff58c83a51124c124185b550c086ceb\": rpc error: code = NotFound desc = could not find container \"e78f5ea4b76af403f6616dcb54401a80cff58c83a51124c124185b550c086ceb\": container with ID starting with e78f5ea4b76af403f6616dcb54401a80cff58c83a51124c124185b550c086ceb not found: ID does not exist"
Sep 10 21:22:01.112630 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:01.112580    2564 scope.go:117] "RemoveContainer" containerID="76eff523e0b21e0023f02f1408d32e103657dea608d7f8be08ca445c564e7818"
Sep 10 21:22:01.121081 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:01.121065    2564 scope.go:117] "RemoveContainer" containerID="76eff523e0b21e0023f02f1408d32e103657dea608d7f8be08ca445c564e7818"
Sep 10 21:22:01.121345 ip-10-0-129-100 kubenswrapper[2564]: E0910 21:22:01.121322    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76eff523e0b21e0023f02f1408d32e103657dea608d7f8be08ca445c564e7818\": container with ID starting with 76eff523e0b21e0023f02f1408d32e103657dea608d7f8be08ca445c564e7818 not found: ID does not exist" containerID="76eff523e0b21e0023f02f1408d32e103657dea608d7f8be08ca445c564e7818"
Sep 10 21:22:01.121411 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:01.121354    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76eff523e0b21e0023f02f1408d32e103657dea608d7f8be08ca445c564e7818"} err="failed to get container status \"76eff523e0b21e0023f02f1408d32e103657dea608d7f8be08ca445c564e7818\": rpc error: code = NotFound desc = could not find container \"76eff523e0b21e0023f02f1408d32e103657dea608d7f8be08ca445c564e7818\": container with ID starting with 76eff523e0b21e0023f02f1408d32e103657dea608d7f8be08ca445c564e7818 not found: ID does not exist"
Sep 10 21:22:01.124921 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:01.124899    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-e074ad-77cb745677-svk4b"]
Sep 10 21:22:01.128890 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:01.128867    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-e074ad-77cb745677-svk4b"]
Sep 10 21:22:01.139771 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:01.139745    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-e074ad-677d855b9d-pdnt8"]
Sep 10 21:22:01.142750 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:01.142727    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-e074ad-677d855b9d-pdnt8"]
Sep 10 21:22:01.233883 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:01.233853    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-cd9hp_0432bad8-86f5-4b0e-a0d4-2fdb728223f2/console-operator/2.log"
Sep 10 21:22:01.239214 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:01.239191    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-cd9hp_0432bad8-86f5-4b0e-a0d4-2fdb728223f2/console-operator/2.log"
Sep 10 21:22:01.240826 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:01.240806    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wrbhk_279e54f7-0db1-4e2d-a998-4b3ecdf992cd/ovn-acl-logging/0.log"
Sep 10 21:22:01.246011 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:01.245994    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wrbhk_279e54f7-0db1-4e2d-a998-4b3ecdf992cd/ovn-acl-logging/0.log"
Sep 10 21:22:01.873434 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:01.873398    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29160f73-92d3-489a-84b8-870644814e9a" path="/var/lib/kubelet/pods/29160f73-92d3-489a-84b8-870644814e9a/volumes"
Sep 10 21:22:01.873735 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:01.873722    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92b03f4e-673f-44b9-bbd2-d839087fdeb2" path="/var/lib/kubelet/pods/92b03f4e-673f-44b9-bbd2-d839087fdeb2/volumes"
Sep 10 21:22:01.874052 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:01.874039    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8e14ac8-d63e-4b43-894b-2a8d45557214" path="/var/lib/kubelet/pods/f8e14ac8-d63e-4b43-894b-2a8d45557214/volumes"
Sep 10 21:22:07.626806 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:07.626772    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m"]
Sep 10 21:22:07.627211 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:07.626983    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m" podUID="f64c0f39-698d-4864-81f3-4db811d4cf54" containerName="istio-proxy" containerID="cri-o://c41bb8ce0af9d12ade5be18f478eb16b37bf2744329c1ed33c50e0ca61e07b9c" gracePeriod=30
Sep 10 21:22:07.938669 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:07.938592    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d55386-ntqvq"]
Sep 10 21:22:07.938969 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:07.938956    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8e14ac8-d63e-4b43-894b-2a8d45557214" containerName="payload-pre-processing"
Sep 10 21:22:07.939017 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:07.938972    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8e14ac8-d63e-4b43-894b-2a8d45557214" containerName="payload-pre-processing"
Sep 10 21:22:07.939017 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:07.938991    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29160f73-92d3-489a-84b8-870644814e9a" containerName="payload-processing"
Sep 10 21:22:07.939017 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:07.938996    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="29160f73-92d3-489a-84b8-870644814e9a" containerName="payload-processing"
Sep 10 21:22:07.939017 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:07.939012    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92b03f4e-673f-44b9-bbd2-d839087fdeb2" containerName="revoke-keys"
Sep 10 21:22:07.939017 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:07.939018    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="92b03f4e-673f-44b9-bbd2-d839087fdeb2" containerName="revoke-keys"
Sep 10 21:22:07.939164 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:07.939072    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8e14ac8-d63e-4b43-894b-2a8d45557214" containerName="payload-pre-processing"
Sep 10 21:22:07.939164 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:07.939081    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="29160f73-92d3-489a-84b8-870644814e9a" containerName="payload-processing"
Sep 10 21:22:07.939164 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:07.939089    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="92b03f4e-673f-44b9-bbd2-d839087fdeb2" containerName="revoke-keys"
Sep 10 21:22:07.943359 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:07.943343    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d55386-ntqvq"
Sep 10 21:22:07.946016 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:07.945993    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-m5c7x\""
Sep 10 21:22:07.946128 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:07.945993    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 21:22:07.952676 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:07.952652    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d55386-ntqvq"]
Sep 10 21:22:08.034399 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:08.034365    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9d078c3-459f-41bb-8681-72f1298cdf9c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-d55386-ntqvq\" (UID: \"a9d078c3-459f-41bb-8681-72f1298cdf9c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d55386-ntqvq"
Sep 10 21:22:08.135111 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:08.135067    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9d078c3-459f-41bb-8681-72f1298cdf9c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-d55386-ntqvq\" (UID: \"a9d078c3-459f-41bb-8681-72f1298cdf9c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d55386-ntqvq"
Sep 10 21:22:08.135707 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:08.135687    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9d078c3-459f-41bb-8681-72f1298cdf9c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-d55386-ntqvq\" (UID: \"a9d078c3-459f-41bb-8681-72f1298cdf9c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d55386-ntqvq"
Sep 10 21:22:08.254689 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:08.254608    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d55386-ntqvq"
Sep 10 21:22:08.548452 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:08.548422    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d55386-ntqvq"]
Sep 10 21:22:08.549344 ip-10-0-129-100 kubenswrapper[2564]: W0910 21:22:08.549321    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9d078c3_459f_41bb_8681_72f1298cdf9c.slice/crio-572db7aa0d8236654bd03dee5a5fd12b2e8cd83db2345b7f700bd434f3aa33be WatchSource:0}: Error finding container 572db7aa0d8236654bd03dee5a5fd12b2e8cd83db2345b7f700bd434f3aa33be: Status 404 returned error can't find the container with id 572db7aa0d8236654bd03dee5a5fd12b2e8cd83db2345b7f700bd434f3aa33be
Sep 10 21:22:09.158622 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:09.158585    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d55386-ntqvq" event={"ID":"a9d078c3-459f-41bb-8681-72f1298cdf9c","Type":"ContainerStarted","Data":"fb86c2074f8d5f2001cd5bad3ebf5db446f675529e5966eb2afa002113647164"}
Sep 10 21:22:09.158983 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:09.158648    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d55386-ntqvq" event={"ID":"a9d078c3-459f-41bb-8681-72f1298cdf9c","Type":"ContainerStarted","Data":"572db7aa0d8236654bd03dee5a5fd12b2e8cd83db2345b7f700bd434f3aa33be"}
Sep 10 21:22:09.180913 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:09.180858    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d55386-ntqvq" podStartSLOduration=2.180839979 podStartE2EDuration="2.180839979s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:22:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:22:09.17848799 +0000 UTC m=+1509.865555269" watchObservedRunningTime="2026-09-10 21:22:09.180839979 +0000 UTC m=+1509.867907258"
Sep 10 21:22:09.661741 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:09.661705    2564 patch_prober.go:28] interesting pod/e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 21:22:09.661900 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:09.661774    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m" podUID="f64c0f39-698d-4864-81f3-4db811d4cf54" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 21:22:10.165510 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:10.165477    2564 generic.go:356] "Generic (PLEG): container finished" podID="a9d078c3-459f-41bb-8681-72f1298cdf9c" containerID="fb86c2074f8d5f2001cd5bad3ebf5db446f675529e5966eb2afa002113647164" exitCode=0
Sep 10 21:22:10.165890 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:10.165566    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d55386-ntqvq" event={"ID":"a9d078c3-459f-41bb-8681-72f1298cdf9c","Type":"ContainerDied","Data":"fb86c2074f8d5f2001cd5bad3ebf5db446f675529e5966eb2afa002113647164"}
Sep 10 21:22:11.299604 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:11.299581    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d55386-ntqvq"
Sep 10 21:22:11.366223 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:11.366179    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9d078c3-459f-41bb-8681-72f1298cdf9c-maas-api-service-ca\") pod \"a9d078c3-459f-41bb-8681-72f1298cdf9c\" (UID: \"a9d078c3-459f-41bb-8681-72f1298cdf9c\") "
Sep 10 21:22:11.366559 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:11.366527    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9d078c3-459f-41bb-8681-72f1298cdf9c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a9d078c3-459f-41bb-8681-72f1298cdf9c" (UID: "a9d078c3-459f-41bb-8681-72f1298cdf9c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:22:11.366662 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:11.366614    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9d078c3-459f-41bb-8681-72f1298cdf9c-maas-api-service-ca\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:22:12.179984 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:12.179906    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d55386-ntqvq"
Sep 10 21:22:12.179984 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:12.179915    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d55386-ntqvq" event={"ID":"a9d078c3-459f-41bb-8681-72f1298cdf9c","Type":"ContainerDied","Data":"572db7aa0d8236654bd03dee5a5fd12b2e8cd83db2345b7f700bd434f3aa33be"}
Sep 10 21:22:12.179984 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:12.179957    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="572db7aa0d8236654bd03dee5a5fd12b2e8cd83db2345b7f700bd434f3aa33be"
Sep 10 21:22:12.874450 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:12.874422    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m"
Sep 10 21:22:12.983214 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:12.983137    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f64c0f39-698d-4864-81f3-4db811d4cf54-workload-socket\") pod \"f64c0f39-698d-4864-81f3-4db811d4cf54\" (UID: \"f64c0f39-698d-4864-81f3-4db811d4cf54\") "
Sep 10 21:22:12.983214 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:12.983171    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f64c0f39-698d-4864-81f3-4db811d4cf54-istio-data\") pod \"f64c0f39-698d-4864-81f3-4db811d4cf54\" (UID: \"f64c0f39-698d-4864-81f3-4db811d4cf54\") "
Sep 10 21:22:12.983214 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:12.983197    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f64c0f39-698d-4864-81f3-4db811d4cf54-istio-envoy\") pod \"f64c0f39-698d-4864-81f3-4db811d4cf54\" (UID: \"f64c0f39-698d-4864-81f3-4db811d4cf54\") "
Sep 10 21:22:12.983535 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:12.983276    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f64c0f39-698d-4864-81f3-4db811d4cf54-istiod-ca-cert\") pod \"f64c0f39-698d-4864-81f3-4db811d4cf54\" (UID: \"f64c0f39-698d-4864-81f3-4db811d4cf54\") "
Sep 10 21:22:12.983535 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:12.983321    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f64c0f39-698d-4864-81f3-4db811d4cf54-istio-token\") pod \"f64c0f39-698d-4864-81f3-4db811d4cf54\" (UID: \"f64c0f39-698d-4864-81f3-4db811d4cf54\") "
Sep 10 21:22:12.983535 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:12.983362    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-whwqn\" (UniqueName: \"kubernetes.io/projected/f64c0f39-698d-4864-81f3-4db811d4cf54-kube-api-access-whwqn\") pod \"f64c0f39-698d-4864-81f3-4db811d4cf54\" (UID: \"f64c0f39-698d-4864-81f3-4db811d4cf54\") "
Sep 10 21:22:12.983535 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:12.983405    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f64c0f39-698d-4864-81f3-4db811d4cf54-istio-podinfo\") pod \"f64c0f39-698d-4864-81f3-4db811d4cf54\" (UID: \"f64c0f39-698d-4864-81f3-4db811d4cf54\") "
Sep 10 21:22:12.983535 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:12.983453    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f64c0f39-698d-4864-81f3-4db811d4cf54-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f64c0f39-698d-4864-81f3-4db811d4cf54" (UID: "f64c0f39-698d-4864-81f3-4db811d4cf54"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:22:12.983535 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:12.983472    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f64c0f39-698d-4864-81f3-4db811d4cf54-credential-socket\") pod \"f64c0f39-698d-4864-81f3-4db811d4cf54\" (UID: \"f64c0f39-698d-4864-81f3-4db811d4cf54\") "
Sep 10 21:22:12.983535 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:12.983470    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f64c0f39-698d-4864-81f3-4db811d4cf54-istio-data" (OuterVolumeSpecName: "istio-data") pod "f64c0f39-698d-4864-81f3-4db811d4cf54" (UID: "f64c0f39-698d-4864-81f3-4db811d4cf54"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:22:12.983535 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:12.983530    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f64c0f39-698d-4864-81f3-4db811d4cf54-workload-certs\") pod \"f64c0f39-698d-4864-81f3-4db811d4cf54\" (UID: \"f64c0f39-698d-4864-81f3-4db811d4cf54\") "
Sep 10 21:22:12.983932 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:12.983782    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f64c0f39-698d-4864-81f3-4db811d4cf54-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f64c0f39-698d-4864-81f3-4db811d4cf54" (UID: "f64c0f39-698d-4864-81f3-4db811d4cf54"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:22:12.983932 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:12.983846    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f64c0f39-698d-4864-81f3-4db811d4cf54-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f64c0f39-698d-4864-81f3-4db811d4cf54" (UID: "f64c0f39-698d-4864-81f3-4db811d4cf54"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:22:12.984058 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:12.984007    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f64c0f39-698d-4864-81f3-4db811d4cf54-workload-certs\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:22:12.984058 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:12.984028    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f64c0f39-698d-4864-81f3-4db811d4cf54-workload-socket\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:22:12.984058 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:12.984042    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f64c0f39-698d-4864-81f3-4db811d4cf54-istio-data\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:22:12.984058 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:12.984055    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f64c0f39-698d-4864-81f3-4db811d4cf54-istiod-ca-cert\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:22:12.984291 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:12.984271    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f64c0f39-698d-4864-81f3-4db811d4cf54-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f64c0f39-698d-4864-81f3-4db811d4cf54" (UID: "f64c0f39-698d-4864-81f3-4db811d4cf54"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:22:12.985746 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:12.985717    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f64c0f39-698d-4864-81f3-4db811d4cf54-kube-api-access-whwqn" (OuterVolumeSpecName: "kube-api-access-whwqn") pod "f64c0f39-698d-4864-81f3-4db811d4cf54" (UID: "f64c0f39-698d-4864-81f3-4db811d4cf54"). InnerVolumeSpecName "kube-api-access-whwqn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:22:12.985855 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:12.985754    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f64c0f39-698d-4864-81f3-4db811d4cf54-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f64c0f39-698d-4864-81f3-4db811d4cf54" (UID: "f64c0f39-698d-4864-81f3-4db811d4cf54"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:22:12.986002 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:12.985977    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f64c0f39-698d-4864-81f3-4db811d4cf54-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f64c0f39-698d-4864-81f3-4db811d4cf54" (UID: "f64c0f39-698d-4864-81f3-4db811d4cf54"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 21:22:12.986104 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:12.985977    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f64c0f39-698d-4864-81f3-4db811d4cf54-istio-token" (OuterVolumeSpecName: "istio-token") pod "f64c0f39-698d-4864-81f3-4db811d4cf54" (UID: "f64c0f39-698d-4864-81f3-4db811d4cf54"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:22:13.084773 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:13.084741    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f64c0f39-698d-4864-81f3-4db811d4cf54-istio-token\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:22:13.084773 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:13.084769    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-whwqn\" (UniqueName: \"kubernetes.io/projected/f64c0f39-698d-4864-81f3-4db811d4cf54-kube-api-access-whwqn\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:22:13.084773 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:13.084779    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f64c0f39-698d-4864-81f3-4db811d4cf54-istio-podinfo\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:22:13.085004 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:13.084789    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f64c0f39-698d-4864-81f3-4db811d4cf54-credential-socket\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:22:13.085004 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:13.084797    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f64c0f39-698d-4864-81f3-4db811d4cf54-istio-envoy\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:22:13.187481 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:13.187440    2564 generic.go:356] "Generic (PLEG): container finished" podID="f64c0f39-698d-4864-81f3-4db811d4cf54" containerID="c41bb8ce0af9d12ade5be18f478eb16b37bf2744329c1ed33c50e0ca61e07b9c" exitCode=0
Sep 10 21:22:13.187655 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:13.187495    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m"
Sep 10 21:22:13.187655 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:13.187524    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m" event={"ID":"f64c0f39-698d-4864-81f3-4db811d4cf54","Type":"ContainerDied","Data":"c41bb8ce0af9d12ade5be18f478eb16b37bf2744329c1ed33c50e0ca61e07b9c"}
Sep 10 21:22:13.187655 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:13.187578    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m" event={"ID":"f64c0f39-698d-4864-81f3-4db811d4cf54","Type":"ContainerDied","Data":"486ca6f55b251776df2b775d09af96445fbd1f57c6d645cf0b02a8d6e9122ceb"}
Sep 10 21:22:13.187655 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:13.187600    2564 scope.go:117] "RemoveContainer" containerID="c41bb8ce0af9d12ade5be18f478eb16b37bf2744329c1ed33c50e0ca61e07b9c"
Sep 10 21:22:13.197385 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:13.197365    2564 scope.go:117] "RemoveContainer" containerID="831859cc829f2912ea79e233b8a33627c832519c87c79153ed1cab9beb82828d"
Sep 10 21:22:13.205977 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:13.205955    2564 scope.go:117] "RemoveContainer" containerID="c41bb8ce0af9d12ade5be18f478eb16b37bf2744329c1ed33c50e0ca61e07b9c"
Sep 10 21:22:13.206284 ip-10-0-129-100 kubenswrapper[2564]: E0910 21:22:13.206263    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c41bb8ce0af9d12ade5be18f478eb16b37bf2744329c1ed33c50e0ca61e07b9c\": container with ID starting with c41bb8ce0af9d12ade5be18f478eb16b37bf2744329c1ed33c50e0ca61e07b9c not found: ID does not exist" containerID="c41bb8ce0af9d12ade5be18f478eb16b37bf2744329c1ed33c50e0ca61e07b9c"
Sep 10 21:22:13.206344 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:13.206294    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c41bb8ce0af9d12ade5be18f478eb16b37bf2744329c1ed33c50e0ca61e07b9c"} err="failed to get container status \"c41bb8ce0af9d12ade5be18f478eb16b37bf2744329c1ed33c50e0ca61e07b9c\": rpc error: code = NotFound desc = could not find container \"c41bb8ce0af9d12ade5be18f478eb16b37bf2744329c1ed33c50e0ca61e07b9c\": container with ID starting with c41bb8ce0af9d12ade5be18f478eb16b37bf2744329c1ed33c50e0ca61e07b9c not found: ID does not exist"
Sep 10 21:22:13.206344 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:13.206311    2564 scope.go:117] "RemoveContainer" containerID="831859cc829f2912ea79e233b8a33627c832519c87c79153ed1cab9beb82828d"
Sep 10 21:22:13.206590 ip-10-0-129-100 kubenswrapper[2564]: E0910 21:22:13.206573    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"831859cc829f2912ea79e233b8a33627c832519c87c79153ed1cab9beb82828d\": container with ID starting with 831859cc829f2912ea79e233b8a33627c832519c87c79153ed1cab9beb82828d not found: ID does not exist" containerID="831859cc829f2912ea79e233b8a33627c832519c87c79153ed1cab9beb82828d"
Sep 10 21:22:13.206630 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:13.206595    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"831859cc829f2912ea79e233b8a33627c832519c87c79153ed1cab9beb82828d"} err="failed to get container status \"831859cc829f2912ea79e233b8a33627c832519c87c79153ed1cab9beb82828d\": rpc error: code = NotFound desc = could not find container \"831859cc829f2912ea79e233b8a33627c832519c87c79153ed1cab9beb82828d\": container with ID starting with 831859cc829f2912ea79e233b8a33627c832519c87c79153ed1cab9beb82828d not found: ID does not exist"
Sep 10 21:22:13.211881 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:13.211856    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m"]
Sep 10 21:22:13.217382 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:13.217356    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-e074ad-openshift-default-65456547fd-q2j6m"]
Sep 10 21:22:13.806532 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:13.806501    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-7810bd/rate-test-model-7810bd-kserve-85b468d46c-ccjb8"]
Sep 10 21:22:13.806959 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:13.806941    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f64c0f39-698d-4864-81f3-4db811d4cf54" containerName="istio-proxy"
Sep 10 21:22:13.806959 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:13.806959    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f64c0f39-698d-4864-81f3-4db811d4cf54" containerName="istio-proxy"
Sep 10 21:22:13.807151 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:13.806970    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f64c0f39-698d-4864-81f3-4db811d4cf54" containerName="istio-proxy"
Sep 10 21:22:13.807151 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:13.806978    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f64c0f39-698d-4864-81f3-4db811d4cf54" containerName="istio-proxy"
Sep 10 21:22:13.807151 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:13.807009    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9d078c3-459f-41bb-8681-72f1298cdf9c" containerName="revoke-keys"
Sep 10 21:22:13.807151 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:13.807018    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9d078c3-459f-41bb-8681-72f1298cdf9c" containerName="revoke-keys"
Sep 10 21:22:13.807151 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:13.807083    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f64c0f39-698d-4864-81f3-4db811d4cf54" containerName="istio-proxy"
Sep 10 21:22:13.807151 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:13.807096    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9d078c3-459f-41bb-8681-72f1298cdf9c" containerName="revoke-keys"
Sep 10 21:22:13.812123 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:13.812098    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-7810bd/rate-test-model-7810bd-kserve-85b468d46c-ccjb8"
Sep 10 21:22:13.817481 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:13.817456    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-7810bd\"/\"kube-root-ca.crt\""
Sep 10 21:22:13.817481 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:13.817477    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-7810bd\"/\"rate-test-model-7810bd-kserve-self-signed-certs\""
Sep 10 21:22:13.817690 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:13.817525    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-7810bd\"/\"openshift-service-ca.crt\""
Sep 10 21:22:13.817690 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:13.817487    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-7810bd\"/\"default-dockercfg-lxqpv\""
Sep 10 21:22:13.824447 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:13.824424    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-7810bd/rate-test-model-7810bd-kserve-85b468d46c-ccjb8"]
Sep 10 21:22:13.873668 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:13.873635    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f64c0f39-698d-4864-81f3-4db811d4cf54" path="/var/lib/kubelet/pods/f64c0f39-698d-4864-81f3-4db811d4cf54/volumes"
Sep 10 21:22:13.892979 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:13.892946    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0bff1c2c-d709-4872-ae43-a256f3f1e808-dshm\") pod \"rate-test-model-7810bd-kserve-85b468d46c-ccjb8\" (UID: \"0bff1c2c-d709-4872-ae43-a256f3f1e808\") " pod="ai-tenant-e2e-shared-b-w3-7810bd/rate-test-model-7810bd-kserve-85b468d46c-ccjb8"
Sep 10 21:22:13.893377 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:13.893005    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vb4tg\" (UniqueName: \"kubernetes.io/projected/0bff1c2c-d709-4872-ae43-a256f3f1e808-kube-api-access-vb4tg\") pod \"rate-test-model-7810bd-kserve-85b468d46c-ccjb8\" (UID: \"0bff1c2c-d709-4872-ae43-a256f3f1e808\") " pod="ai-tenant-e2e-shared-b-w3-7810bd/rate-test-model-7810bd-kserve-85b468d46c-ccjb8"
Sep 10 21:22:13.893377 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:13.893033    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0bff1c2c-d709-4872-ae43-a256f3f1e808-tls-certs\") pod \"rate-test-model-7810bd-kserve-85b468d46c-ccjb8\" (UID: \"0bff1c2c-d709-4872-ae43-a256f3f1e808\") " pod="ai-tenant-e2e-shared-b-w3-7810bd/rate-test-model-7810bd-kserve-85b468d46c-ccjb8"
Sep 10 21:22:13.893377 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:13.893059    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0bff1c2c-d709-4872-ae43-a256f3f1e808-tmp-dir\") pod \"rate-test-model-7810bd-kserve-85b468d46c-ccjb8\" (UID: \"0bff1c2c-d709-4872-ae43-a256f3f1e808\") " pod="ai-tenant-e2e-shared-b-w3-7810bd/rate-test-model-7810bd-kserve-85b468d46c-ccjb8"
Sep 10 21:22:13.893377 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:13.893089    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0bff1c2c-d709-4872-ae43-a256f3f1e808-home\") pod \"rate-test-model-7810bd-kserve-85b468d46c-ccjb8\" (UID: \"0bff1c2c-d709-4872-ae43-a256f3f1e808\") " pod="ai-tenant-e2e-shared-b-w3-7810bd/rate-test-model-7810bd-kserve-85b468d46c-ccjb8"
Sep 10 21:22:13.893377 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:13.893176    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0bff1c2c-d709-4872-ae43-a256f3f1e808-model-cache\") pod \"rate-test-model-7810bd-kserve-85b468d46c-ccjb8\" (UID: \"0bff1c2c-d709-4872-ae43-a256f3f1e808\") " pod="ai-tenant-e2e-shared-b-w3-7810bd/rate-test-model-7810bd-kserve-85b468d46c-ccjb8"
Sep 10 21:22:13.994337 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:13.994293    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vb4tg\" (UniqueName: \"kubernetes.io/projected/0bff1c2c-d709-4872-ae43-a256f3f1e808-kube-api-access-vb4tg\") pod \"rate-test-model-7810bd-kserve-85b468d46c-ccjb8\" (UID: \"0bff1c2c-d709-4872-ae43-a256f3f1e808\") " pod="ai-tenant-e2e-shared-b-w3-7810bd/rate-test-model-7810bd-kserve-85b468d46c-ccjb8"
Sep 10 21:22:13.994337 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:13.994336    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0bff1c2c-d709-4872-ae43-a256f3f1e808-tls-certs\") pod \"rate-test-model-7810bd-kserve-85b468d46c-ccjb8\" (UID: \"0bff1c2c-d709-4872-ae43-a256f3f1e808\") " pod="ai-tenant-e2e-shared-b-w3-7810bd/rate-test-model-7810bd-kserve-85b468d46c-ccjb8"
Sep 10 21:22:13.994589 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:13.994363    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0bff1c2c-d709-4872-ae43-a256f3f1e808-tmp-dir\") pod \"rate-test-model-7810bd-kserve-85b468d46c-ccjb8\" (UID: \"0bff1c2c-d709-4872-ae43-a256f3f1e808\") " pod="ai-tenant-e2e-shared-b-w3-7810bd/rate-test-model-7810bd-kserve-85b468d46c-ccjb8"
Sep 10 21:22:13.994589 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:13.994401    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0bff1c2c-d709-4872-ae43-a256f3f1e808-home\") pod \"rate-test-model-7810bd-kserve-85b468d46c-ccjb8\" (UID: \"0bff1c2c-d709-4872-ae43-a256f3f1e808\") " pod="ai-tenant-e2e-shared-b-w3-7810bd/rate-test-model-7810bd-kserve-85b468d46c-ccjb8"
Sep 10 21:22:13.994589 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:13.994473    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0bff1c2c-d709-4872-ae43-a256f3f1e808-model-cache\") pod \"rate-test-model-7810bd-kserve-85b468d46c-ccjb8\" (UID: \"0bff1c2c-d709-4872-ae43-a256f3f1e808\") " pod="ai-tenant-e2e-shared-b-w3-7810bd/rate-test-model-7810bd-kserve-85b468d46c-ccjb8"
Sep 10 21:22:13.994589 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:13.994523    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0bff1c2c-d709-4872-ae43-a256f3f1e808-dshm\") pod \"rate-test-model-7810bd-kserve-85b468d46c-ccjb8\" (UID: \"0bff1c2c-d709-4872-ae43-a256f3f1e808\") " pod="ai-tenant-e2e-shared-b-w3-7810bd/rate-test-model-7810bd-kserve-85b468d46c-ccjb8"
Sep 10 21:22:13.994813 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:13.994778    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0bff1c2c-d709-4872-ae43-a256f3f1e808-tmp-dir\") pod \"rate-test-model-7810bd-kserve-85b468d46c-ccjb8\" (UID: \"0bff1c2c-d709-4872-ae43-a256f3f1e808\") " pod="ai-tenant-e2e-shared-b-w3-7810bd/rate-test-model-7810bd-kserve-85b468d46c-ccjb8"
Sep 10 21:22:13.994874 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:13.994820    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0bff1c2c-d709-4872-ae43-a256f3f1e808-model-cache\") pod \"rate-test-model-7810bd-kserve-85b468d46c-ccjb8\" (UID: \"0bff1c2c-d709-4872-ae43-a256f3f1e808\") " pod="ai-tenant-e2e-shared-b-w3-7810bd/rate-test-model-7810bd-kserve-85b468d46c-ccjb8"
Sep 10 21:22:13.994933 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:13.994908    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0bff1c2c-d709-4872-ae43-a256f3f1e808-home\") pod \"rate-test-model-7810bd-kserve-85b468d46c-ccjb8\" (UID: \"0bff1c2c-d709-4872-ae43-a256f3f1e808\") " pod="ai-tenant-e2e-shared-b-w3-7810bd/rate-test-model-7810bd-kserve-85b468d46c-ccjb8"
Sep 10 21:22:13.996784 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:13.996762    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0bff1c2c-d709-4872-ae43-a256f3f1e808-dshm\") pod \"rate-test-model-7810bd-kserve-85b468d46c-ccjb8\" (UID: \"0bff1c2c-d709-4872-ae43-a256f3f1e808\") " pod="ai-tenant-e2e-shared-b-w3-7810bd/rate-test-model-7810bd-kserve-85b468d46c-ccjb8"
Sep 10 21:22:13.997077 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:13.997048    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0bff1c2c-d709-4872-ae43-a256f3f1e808-tls-certs\") pod \"rate-test-model-7810bd-kserve-85b468d46c-ccjb8\" (UID: \"0bff1c2c-d709-4872-ae43-a256f3f1e808\") " pod="ai-tenant-e2e-shared-b-w3-7810bd/rate-test-model-7810bd-kserve-85b468d46c-ccjb8"
Sep 10 21:22:14.004673 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:14.004612    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vb4tg\" (UniqueName: \"kubernetes.io/projected/0bff1c2c-d709-4872-ae43-a256f3f1e808-kube-api-access-vb4tg\") pod \"rate-test-model-7810bd-kserve-85b468d46c-ccjb8\" (UID: \"0bff1c2c-d709-4872-ae43-a256f3f1e808\") " pod="ai-tenant-e2e-shared-b-w3-7810bd/rate-test-model-7810bd-kserve-85b468d46c-ccjb8"
Sep 10 21:22:14.123642 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:14.123535    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-7810bd/rate-test-model-7810bd-kserve-85b468d46c-ccjb8"
Sep 10 21:22:14.403762 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:14.403733    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-7810bd/rate-test-model-7810bd-kserve-85b468d46c-ccjb8"]
Sep 10 21:22:14.405295 ip-10-0-129-100 kubenswrapper[2564]: W0910 21:22:14.405262    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0bff1c2c_d709_4872_ae43_a256f3f1e808.slice/crio-d9656d3d902280b6a55a1c4f77c2170223d667bceba2dc202f427dca29cba8da WatchSource:0}: Error finding container d9656d3d902280b6a55a1c4f77c2170223d667bceba2dc202f427dca29cba8da: Status 404 returned error can't find the container with id d9656d3d902280b6a55a1c4f77c2170223d667bceba2dc202f427dca29cba8da
Sep 10 21:22:15.203867 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:15.203832    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-7810bd/rate-test-model-7810bd-kserve-85b468d46c-ccjb8" event={"ID":"0bff1c2c-d709-4872-ae43-a256f3f1e808","Type":"ContainerStarted","Data":"5dbb6aae859ed8fdbd28e8462252c6cc9ffb183621c9191ad966314e275346c2"}
Sep 10 21:22:15.203867 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:15.203872    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-7810bd/rate-test-model-7810bd-kserve-85b468d46c-ccjb8" event={"ID":"0bff1c2c-d709-4872-ae43-a256f3f1e808","Type":"ContainerStarted","Data":"d9656d3d902280b6a55a1c4f77c2170223d667bceba2dc202f427dca29cba8da"}
Sep 10 21:22:15.224674 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:15.224622    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-7810bd/rate-test-model-7810bd-kserve-85b468d46c-ccjb8" podStartSLOduration=2.224606626 podStartE2EDuration="2.224606626s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:22:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:22:15.221908371 +0000 UTC m=+1515.908975651" watchObservedRunningTime="2026-09-10 21:22:15.224606626 +0000 UTC m=+1515.911673904"
Sep 10 21:22:24.094512 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:24.094420    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d55386-ntqvq"]
Sep 10 21:22:24.096949 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:24.096921    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d55386-ntqvq"]
Sep 10 21:22:24.123748 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:24.123720    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-7810bd/rate-test-model-7810bd-kserve-85b468d46c-ccjb8"
Sep 10 21:22:24.123957 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:24.123932    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-7810bd/rate-test-model-7810bd-kserve-85b468d46c-ccjb8"
Sep 10 21:22:24.135914 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:24.135893    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-7810bd/rate-test-model-7810bd-kserve-85b468d46c-ccjb8"
Sep 10 21:22:24.266174 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:24.266147    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-7810bd/rate-test-model-7810bd-kserve-85b468d46c-ccjb8"
Sep 10 21:22:25.872969 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:25.872925    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9d078c3-459f-41bb-8681-72f1298cdf9c" path="/var/lib/kubelet/pods/a9d078c3-459f-41bb-8681-72f1298cdf9c/volumes"
Sep 10 21:22:31.298315 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:31.298280    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-9cce25-rcdlf"]
Sep 10 21:22:31.298777 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:31.298733    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f64c0f39-698d-4864-81f3-4db811d4cf54" containerName="istio-proxy"
Sep 10 21:22:31.301797 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:31.301780    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-9cce25-rcdlf"
Sep 10 21:22:31.304244 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:31.304217    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 21:22:31.304364 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:31.304306    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-m5c7x\""
Sep 10 21:22:31.310393 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:31.310373    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-9cce25-rcdlf"]
Sep 10 21:22:31.350510 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:31.350481    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/abebb555-0939-4d85-8894-96b8b0c2b91a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-9cce25-rcdlf\" (UID: \"abebb555-0939-4d85-8894-96b8b0c2b91a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-9cce25-rcdlf"
Sep 10 21:22:31.451026 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:31.450995    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/abebb555-0939-4d85-8894-96b8b0c2b91a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-9cce25-rcdlf\" (UID: \"abebb555-0939-4d85-8894-96b8b0c2b91a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-9cce25-rcdlf"
Sep 10 21:22:31.451717 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:31.451690    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/abebb555-0939-4d85-8894-96b8b0c2b91a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-9cce25-rcdlf\" (UID: \"abebb555-0939-4d85-8894-96b8b0c2b91a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-9cce25-rcdlf"
Sep 10 21:22:31.615002 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:31.614919    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-9cce25-rcdlf"
Sep 10 21:22:31.888775 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:31.888741    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-9cce25-rcdlf"]
Sep 10 21:22:31.889798 ip-10-0-129-100 kubenswrapper[2564]: W0910 21:22:31.889773    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabebb555_0939_4d85_8894_96b8b0c2b91a.slice/crio-bcd432ee9239e3e518b193838661e457504d7760a0e1863484a90acec8f097d4 WatchSource:0}: Error finding container bcd432ee9239e3e518b193838661e457504d7760a0e1863484a90acec8f097d4: Status 404 returned error can't find the container with id bcd432ee9239e3e518b193838661e457504d7760a0e1863484a90acec8f097d4
Sep 10 21:22:32.307554 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:32.307516    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-9cce25-rcdlf" event={"ID":"abebb555-0939-4d85-8894-96b8b0c2b91a","Type":"ContainerStarted","Data":"aa9bc2302953ea28fe8dc6fb2f55d5742dd2d92a68ca4d789ec741262120f4a1"}
Sep 10 21:22:32.307925 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:32.307577    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-9cce25-rcdlf" event={"ID":"abebb555-0939-4d85-8894-96b8b0c2b91a","Type":"ContainerStarted","Data":"bcd432ee9239e3e518b193838661e457504d7760a0e1863484a90acec8f097d4"}
Sep 10 21:22:32.324644 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:32.324598    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-9cce25-rcdlf" podStartSLOduration=1.324583949 podStartE2EDuration="1.324583949s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:22:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:22:32.323027342 +0000 UTC m=+1533.010094623" watchObservedRunningTime="2026-09-10 21:22:32.324583949 +0000 UTC m=+1533.011651227"
Sep 10 21:22:33.314948 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:33.314917    2564 generic.go:356] "Generic (PLEG): container finished" podID="abebb555-0939-4d85-8894-96b8b0c2b91a" containerID="aa9bc2302953ea28fe8dc6fb2f55d5742dd2d92a68ca4d789ec741262120f4a1" exitCode=0
Sep 10 21:22:33.315362 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:33.314964    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-9cce25-rcdlf" event={"ID":"abebb555-0939-4d85-8894-96b8b0c2b91a","Type":"ContainerDied","Data":"aa9bc2302953ea28fe8dc6fb2f55d5742dd2d92a68ca4d789ec741262120f4a1"}
Sep 10 21:22:34.467483 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:34.467455    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-9cce25-rcdlf"
Sep 10 21:22:34.478971 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:34.478945    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/abebb555-0939-4d85-8894-96b8b0c2b91a-maas-api-service-ca\") pod \"abebb555-0939-4d85-8894-96b8b0c2b91a\" (UID: \"abebb555-0939-4d85-8894-96b8b0c2b91a\") "
Sep 10 21:22:34.479367 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:34.479342    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/abebb555-0939-4d85-8894-96b8b0c2b91a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "abebb555-0939-4d85-8894-96b8b0c2b91a" (UID: "abebb555-0939-4d85-8894-96b8b0c2b91a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:22:34.580485 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:34.580402    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/abebb555-0939-4d85-8894-96b8b0c2b91a-maas-api-service-ca\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:22:35.329404 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:35.329374    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-9cce25-rcdlf"
Sep 10 21:22:35.329404 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:35.329382    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-9cce25-rcdlf" event={"ID":"abebb555-0939-4d85-8894-96b8b0c2b91a","Type":"ContainerDied","Data":"bcd432ee9239e3e518b193838661e457504d7760a0e1863484a90acec8f097d4"}
Sep 10 21:22:35.329627 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:35.329423    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bcd432ee9239e3e518b193838661e457504d7760a0e1863484a90acec8f097d4"
Sep 10 21:22:42.244174 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:42.244133    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-9cce25-79ffbcc55d-fdz2l"]
Sep 10 21:22:42.244728 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:42.244475    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-9cce25-79ffbcc55d-fdz2l" podUID="9d15cad8-cc2a-42c5-bfa7-b0230c9764b1" containerName="payload-pre-processing" containerID="cri-o://07c5e457a5fc9eb3008aff8cb18ba4c13f98ce719ac5539e05f55a30a15dabae" gracePeriod=30
Sep 10 21:22:42.372470 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:42.372436    2564 generic.go:356] "Generic (PLEG): container finished" podID="9d15cad8-cc2a-42c5-bfa7-b0230c9764b1" containerID="07c5e457a5fc9eb3008aff8cb18ba4c13f98ce719ac5539e05f55a30a15dabae" exitCode=0
Sep 10 21:22:42.372655 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:42.372576    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-9cce25-79ffbcc55d-fdz2l" event={"ID":"9d15cad8-cc2a-42c5-bfa7-b0230c9764b1","Type":"ContainerDied","Data":"07c5e457a5fc9eb3008aff8cb18ba4c13f98ce719ac5539e05f55a30a15dabae"}
Sep 10 21:22:42.445196 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:42.445159    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-9cce25-rcdlf"]
Sep 10 21:22:42.454456 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:42.454391    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-9cce25-rcdlf"]
Sep 10 21:22:42.505060 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:42.505000    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-9cce25-79ffbcc55d-fdz2l"
Sep 10 21:22:42.553515 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:42.553488    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2r4tn\" (UniqueName: \"kubernetes.io/projected/9d15cad8-cc2a-42c5-bfa7-b0230c9764b1-kube-api-access-2r4tn\") pod \"9d15cad8-cc2a-42c5-bfa7-b0230c9764b1\" (UID: \"9d15cad8-cc2a-42c5-bfa7-b0230c9764b1\") "
Sep 10 21:22:42.553672 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:42.553599    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9d15cad8-cc2a-42c5-bfa7-b0230c9764b1-plugins-config-volume\") pod \"9d15cad8-cc2a-42c5-bfa7-b0230c9764b1\" (UID: \"9d15cad8-cc2a-42c5-bfa7-b0230c9764b1\") "
Sep 10 21:22:42.553958 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:42.553938    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d15cad8-cc2a-42c5-bfa7-b0230c9764b1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9d15cad8-cc2a-42c5-bfa7-b0230c9764b1" (UID: "9d15cad8-cc2a-42c5-bfa7-b0230c9764b1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:22:42.555866 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:42.555838    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d15cad8-cc2a-42c5-bfa7-b0230c9764b1-kube-api-access-2r4tn" (OuterVolumeSpecName: "kube-api-access-2r4tn") pod "9d15cad8-cc2a-42c5-bfa7-b0230c9764b1" (UID: "9d15cad8-cc2a-42c5-bfa7-b0230c9764b1"). InnerVolumeSpecName "kube-api-access-2r4tn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:22:42.654512 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:42.654473    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2r4tn\" (UniqueName: \"kubernetes.io/projected/9d15cad8-cc2a-42c5-bfa7-b0230c9764b1-kube-api-access-2r4tn\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:22:42.654512 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:42.654506    2564 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9d15cad8-cc2a-42c5-bfa7-b0230c9764b1-plugins-config-volume\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:22:43.379902 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:43.379875    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-9cce25-79ffbcc55d-fdz2l"
Sep 10 21:22:43.380408 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:43.379863    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-9cce25-79ffbcc55d-fdz2l" event={"ID":"9d15cad8-cc2a-42c5-bfa7-b0230c9764b1","Type":"ContainerDied","Data":"d7473f54056d131e1d5c88735684d1cc62e956229eaf5a9321677cf8df9587ae"}
Sep 10 21:22:43.380408 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:43.380040    2564 scope.go:117] "RemoveContainer" containerID="07c5e457a5fc9eb3008aff8cb18ba4c13f98ce719ac5539e05f55a30a15dabae"
Sep 10 21:22:43.402788 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:43.402758    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-9cce25-79ffbcc55d-fdz2l"]
Sep 10 21:22:43.406267 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:43.406224    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-9cce25-79ffbcc55d-fdz2l"]
Sep 10 21:22:43.873957 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:43.873917    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d15cad8-cc2a-42c5-bfa7-b0230c9764b1" path="/var/lib/kubelet/pods/9d15cad8-cc2a-42c5-bfa7-b0230c9764b1/volumes"
Sep 10 21:22:43.874386 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:43.874368    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="abebb555-0939-4d85-8894-96b8b0c2b91a" path="/var/lib/kubelet/pods/abebb555-0939-4d85-8894-96b8b0c2b91a/volumes"
Sep 10 21:22:49.910270 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:49.910196    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858"]
Sep 10 21:22:49.910727 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:49.910427    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858" podUID="07031e9c-e22d-4734-83db-7c781f9f5d3c" containerName="istio-proxy" containerID="cri-o://422b24a581db7a37f1f2b290040c98ea1eb86ac3b369735414a7d66326d6df33" gracePeriod=30
Sep 10 21:22:55.166082 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:55.166053    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858"
Sep 10 21:22:55.284561 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:55.284474    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07031e9c-e22d-4734-83db-7c781f9f5d3c-workload-certs\") pod \"07031e9c-e22d-4734-83db-7c781f9f5d3c\" (UID: \"07031e9c-e22d-4734-83db-7c781f9f5d3c\") "
Sep 10 21:22:55.284561 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:55.284546    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07031e9c-e22d-4734-83db-7c781f9f5d3c-istio-envoy\") pod \"07031e9c-e22d-4734-83db-7c781f9f5d3c\" (UID: \"07031e9c-e22d-4734-83db-7c781f9f5d3c\") "
Sep 10 21:22:55.284788 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:55.284571    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07031e9c-e22d-4734-83db-7c781f9f5d3c-istio-data\") pod \"07031e9c-e22d-4734-83db-7c781f9f5d3c\" (UID: \"07031e9c-e22d-4734-83db-7c781f9f5d3c\") "
Sep 10 21:22:55.284788 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:55.284605    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l6hs7\" (UniqueName: \"kubernetes.io/projected/07031e9c-e22d-4734-83db-7c781f9f5d3c-kube-api-access-l6hs7\") pod \"07031e9c-e22d-4734-83db-7c781f9f5d3c\" (UID: \"07031e9c-e22d-4734-83db-7c781f9f5d3c\") "
Sep 10 21:22:55.284788 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:55.284643    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07031e9c-e22d-4734-83db-7c781f9f5d3c-workload-socket\") pod \"07031e9c-e22d-4734-83db-7c781f9f5d3c\" (UID: \"07031e9c-e22d-4734-83db-7c781f9f5d3c\") "
Sep 10 21:22:55.284788 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:55.284658    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07031e9c-e22d-4734-83db-7c781f9f5d3c-credential-socket\") pod \"07031e9c-e22d-4734-83db-7c781f9f5d3c\" (UID: \"07031e9c-e22d-4734-83db-7c781f9f5d3c\") "
Sep 10 21:22:55.284788 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:55.284701    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07031e9c-e22d-4734-83db-7c781f9f5d3c-istio-podinfo\") pod \"07031e9c-e22d-4734-83db-7c781f9f5d3c\" (UID: \"07031e9c-e22d-4734-83db-7c781f9f5d3c\") "
Sep 10 21:22:55.284788 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:55.284725    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07031e9c-e22d-4734-83db-7c781f9f5d3c-istiod-ca-cert\") pod \"07031e9c-e22d-4734-83db-7c781f9f5d3c\" (UID: \"07031e9c-e22d-4734-83db-7c781f9f5d3c\") "
Sep 10 21:22:55.284788 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:55.284745    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07031e9c-e22d-4734-83db-7c781f9f5d3c-istio-token\") pod \"07031e9c-e22d-4734-83db-7c781f9f5d3c\" (UID: \"07031e9c-e22d-4734-83db-7c781f9f5d3c\") "
Sep 10 21:22:55.285146 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:55.284787    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07031e9c-e22d-4734-83db-7c781f9f5d3c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "07031e9c-e22d-4734-83db-7c781f9f5d3c" (UID: "07031e9c-e22d-4734-83db-7c781f9f5d3c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:22:55.285146 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:55.284898    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07031e9c-e22d-4734-83db-7c781f9f5d3c-istio-data" (OuterVolumeSpecName: "istio-data") pod "07031e9c-e22d-4734-83db-7c781f9f5d3c" (UID: "07031e9c-e22d-4734-83db-7c781f9f5d3c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:22:55.285146 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:55.284966    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07031e9c-e22d-4734-83db-7c781f9f5d3c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "07031e9c-e22d-4734-83db-7c781f9f5d3c" (UID: "07031e9c-e22d-4734-83db-7c781f9f5d3c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:22:55.285146 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:55.285108    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07031e9c-e22d-4734-83db-7c781f9f5d3c-workload-socket\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:22:55.285146 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:55.285123    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07031e9c-e22d-4734-83db-7c781f9f5d3c-workload-certs\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:22:55.285146 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:55.285137    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07031e9c-e22d-4734-83db-7c781f9f5d3c-istio-data\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:22:55.285146 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:55.285128    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07031e9c-e22d-4734-83db-7c781f9f5d3c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "07031e9c-e22d-4734-83db-7c781f9f5d3c" (UID: "07031e9c-e22d-4734-83db-7c781f9f5d3c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:22:55.285521 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:55.285379    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07031e9c-e22d-4734-83db-7c781f9f5d3c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "07031e9c-e22d-4734-83db-7c781f9f5d3c" (UID: "07031e9c-e22d-4734-83db-7c781f9f5d3c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:22:55.286910 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:55.286873    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/07031e9c-e22d-4734-83db-7c781f9f5d3c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "07031e9c-e22d-4734-83db-7c781f9f5d3c" (UID: "07031e9c-e22d-4734-83db-7c781f9f5d3c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 21:22:55.287019 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:55.286970    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07031e9c-e22d-4734-83db-7c781f9f5d3c-istio-token" (OuterVolumeSpecName: "istio-token") pod "07031e9c-e22d-4734-83db-7c781f9f5d3c" (UID: "07031e9c-e22d-4734-83db-7c781f9f5d3c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:22:55.287198 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:55.287162    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07031e9c-e22d-4734-83db-7c781f9f5d3c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "07031e9c-e22d-4734-83db-7c781f9f5d3c" (UID: "07031e9c-e22d-4734-83db-7c781f9f5d3c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:22:55.287198 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:55.287172    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07031e9c-e22d-4734-83db-7c781f9f5d3c-kube-api-access-l6hs7" (OuterVolumeSpecName: "kube-api-access-l6hs7") pod "07031e9c-e22d-4734-83db-7c781f9f5d3c" (UID: "07031e9c-e22d-4734-83db-7c781f9f5d3c"). InnerVolumeSpecName "kube-api-access-l6hs7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:22:55.385753 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:55.385721    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07031e9c-e22d-4734-83db-7c781f9f5d3c-istio-envoy\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:22:55.385753 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:55.385750    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l6hs7\" (UniqueName: \"kubernetes.io/projected/07031e9c-e22d-4734-83db-7c781f9f5d3c-kube-api-access-l6hs7\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:22:55.385948 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:55.385762    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07031e9c-e22d-4734-83db-7c781f9f5d3c-credential-socket\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:22:55.385948 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:55.385777    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07031e9c-e22d-4734-83db-7c781f9f5d3c-istio-podinfo\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:22:55.385948 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:55.385786    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07031e9c-e22d-4734-83db-7c781f9f5d3c-istiod-ca-cert\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:22:55.385948 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:55.385794    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07031e9c-e22d-4734-83db-7c781f9f5d3c-istio-token\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:22:55.461686 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:55.461651    2564 generic.go:356] "Generic (PLEG): container finished" podID="07031e9c-e22d-4734-83db-7c781f9f5d3c" containerID="422b24a581db7a37f1f2b290040c98ea1eb86ac3b369735414a7d66326d6df33" exitCode=0
Sep 10 21:22:55.461849 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:55.461697    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858"
Sep 10 21:22:55.461849 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:55.461728    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858" event={"ID":"07031e9c-e22d-4734-83db-7c781f9f5d3c","Type":"ContainerDied","Data":"422b24a581db7a37f1f2b290040c98ea1eb86ac3b369735414a7d66326d6df33"}
Sep 10 21:22:55.461849 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:55.461817    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858" event={"ID":"07031e9c-e22d-4734-83db-7c781f9f5d3c","Type":"ContainerDied","Data":"cf1b91663022107e554870661572b341f3c65ae75d0d55bc8bb55ce32a9ed58b"}
Sep 10 21:22:55.461849 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:55.461846    2564 scope.go:117] "RemoveContainer" containerID="422b24a581db7a37f1f2b290040c98ea1eb86ac3b369735414a7d66326d6df33"
Sep 10 21:22:55.472257 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:55.472213    2564 scope.go:117] "RemoveContainer" containerID="43be1e877ec30228dd9898dab411de762045a1d1763212ccfb001808953ae767"
Sep 10 21:22:55.480454 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:55.480438    2564 scope.go:117] "RemoveContainer" containerID="422b24a581db7a37f1f2b290040c98ea1eb86ac3b369735414a7d66326d6df33"
Sep 10 21:22:55.480706 ip-10-0-129-100 kubenswrapper[2564]: E0910 21:22:55.480685    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"422b24a581db7a37f1f2b290040c98ea1eb86ac3b369735414a7d66326d6df33\": container with ID starting with 422b24a581db7a37f1f2b290040c98ea1eb86ac3b369735414a7d66326d6df33 not found: ID does not exist" containerID="422b24a581db7a37f1f2b290040c98ea1eb86ac3b369735414a7d66326d6df33"
Sep 10 21:22:55.480777 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:55.480718    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"422b24a581db7a37f1f2b290040c98ea1eb86ac3b369735414a7d66326d6df33"} err="failed to get container status \"422b24a581db7a37f1f2b290040c98ea1eb86ac3b369735414a7d66326d6df33\": rpc error: code = NotFound desc = could not find container \"422b24a581db7a37f1f2b290040c98ea1eb86ac3b369735414a7d66326d6df33\": container with ID starting with 422b24a581db7a37f1f2b290040c98ea1eb86ac3b369735414a7d66326d6df33 not found: ID does not exist"
Sep 10 21:22:55.480777 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:55.480741    2564 scope.go:117] "RemoveContainer" containerID="43be1e877ec30228dd9898dab411de762045a1d1763212ccfb001808953ae767"
Sep 10 21:22:55.481016 ip-10-0-129-100 kubenswrapper[2564]: E0910 21:22:55.480997    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43be1e877ec30228dd9898dab411de762045a1d1763212ccfb001808953ae767\": container with ID starting with 43be1e877ec30228dd9898dab411de762045a1d1763212ccfb001808953ae767 not found: ID does not exist" containerID="43be1e877ec30228dd9898dab411de762045a1d1763212ccfb001808953ae767"
Sep 10 21:22:55.481061 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:55.481022    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43be1e877ec30228dd9898dab411de762045a1d1763212ccfb001808953ae767"} err="failed to get container status \"43be1e877ec30228dd9898dab411de762045a1d1763212ccfb001808953ae767\": rpc error: code = NotFound desc = could not find container \"43be1e877ec30228dd9898dab411de762045a1d1763212ccfb001808953ae767\": container with ID starting with 43be1e877ec30228dd9898dab411de762045a1d1763212ccfb001808953ae767 not found: ID does not exist"
Sep 10 21:22:55.502533 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:55.502510    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858"]
Sep 10 21:22:55.504812 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:55.504793    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-9cce25-openshift-default-7bf44cf9b-n9858"]
Sep 10 21:22:55.872510 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:22:55.872478    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07031e9c-e22d-4734-83db-7c781f9f5d3c" path="/var/lib/kubelet/pods/07031e9c-e22d-4734-83db-7c781f9f5d3c/volumes"
Sep 10 21:23:00.821157 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:00.821117    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-7810bd/rate-test-model-7810bd-kserve-85b468d46c-ccjb8"]
Sep 10 21:23:00.956698 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:00.956665    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-95d905-6b86994766-f2kd6"]
Sep 10 21:23:01.496283 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:01.496214    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-95d905-6b86994766-f2kd6" podUID="14cb0f09-b88c-4703-af89-13ca0079b174" containerName="payload-pre-processing" containerID="cri-o://33517f49febba26176d00fcc5308b81788272fdd1922e8a4fd0836bffb6d3b40" gracePeriod=30
Sep 10 21:23:01.751431 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:01.750487    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-95d905-6b86994766-f2kd6"
Sep 10 21:23:01.843094 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:01.843059    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/14cb0f09-b88c-4703-af89-13ca0079b174-plugins-config-volume\") pod \"14cb0f09-b88c-4703-af89-13ca0079b174\" (UID: \"14cb0f09-b88c-4703-af89-13ca0079b174\") "
Sep 10 21:23:01.843571 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:01.843294    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-slpsv\" (UniqueName: \"kubernetes.io/projected/14cb0f09-b88c-4703-af89-13ca0079b174-kube-api-access-slpsv\") pod \"14cb0f09-b88c-4703-af89-13ca0079b174\" (UID: \"14cb0f09-b88c-4703-af89-13ca0079b174\") "
Sep 10 21:23:01.843571 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:01.843448    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14cb0f09-b88c-4703-af89-13ca0079b174-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "14cb0f09-b88c-4703-af89-13ca0079b174" (UID: "14cb0f09-b88c-4703-af89-13ca0079b174"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:23:01.843659 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:01.843594    2564 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/14cb0f09-b88c-4703-af89-13ca0079b174-plugins-config-volume\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:23:01.845242 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:01.845216    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14cb0f09-b88c-4703-af89-13ca0079b174-kube-api-access-slpsv" (OuterVolumeSpecName: "kube-api-access-slpsv") pod "14cb0f09-b88c-4703-af89-13ca0079b174" (UID: "14cb0f09-b88c-4703-af89-13ca0079b174"). InnerVolumeSpecName "kube-api-access-slpsv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:23:01.944722 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:01.944692    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-slpsv\" (UniqueName: \"kubernetes.io/projected/14cb0f09-b88c-4703-af89-13ca0079b174-kube-api-access-slpsv\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:23:02.502833 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:02.502795    2564 generic.go:356] "Generic (PLEG): container finished" podID="14cb0f09-b88c-4703-af89-13ca0079b174" containerID="33517f49febba26176d00fcc5308b81788272fdd1922e8a4fd0836bffb6d3b40" exitCode=0
Sep 10 21:23:02.503008 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:02.502851    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-95d905-6b86994766-f2kd6"
Sep 10 21:23:02.503008 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:02.502885    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-95d905-6b86994766-f2kd6" event={"ID":"14cb0f09-b88c-4703-af89-13ca0079b174","Type":"ContainerDied","Data":"33517f49febba26176d00fcc5308b81788272fdd1922e8a4fd0836bffb6d3b40"}
Sep 10 21:23:02.503008 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:02.502939    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-95d905-6b86994766-f2kd6" event={"ID":"14cb0f09-b88c-4703-af89-13ca0079b174","Type":"ContainerDied","Data":"45321351f219e718dcbfb01412c902d1e125c3ab491b112d5a4b0b7bf3994942"}
Sep 10 21:23:02.503008 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:02.502962    2564 scope.go:117] "RemoveContainer" containerID="33517f49febba26176d00fcc5308b81788272fdd1922e8a4fd0836bffb6d3b40"
Sep 10 21:23:02.512115 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:02.512098    2564 scope.go:117] "RemoveContainer" containerID="33517f49febba26176d00fcc5308b81788272fdd1922e8a4fd0836bffb6d3b40"
Sep 10 21:23:02.512401 ip-10-0-129-100 kubenswrapper[2564]: E0910 21:23:02.512380    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33517f49febba26176d00fcc5308b81788272fdd1922e8a4fd0836bffb6d3b40\": container with ID starting with 33517f49febba26176d00fcc5308b81788272fdd1922e8a4fd0836bffb6d3b40 not found: ID does not exist" containerID="33517f49febba26176d00fcc5308b81788272fdd1922e8a4fd0836bffb6d3b40"
Sep 10 21:23:02.512480 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:02.512407    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33517f49febba26176d00fcc5308b81788272fdd1922e8a4fd0836bffb6d3b40"} err="failed to get container status \"33517f49febba26176d00fcc5308b81788272fdd1922e8a4fd0836bffb6d3b40\": rpc error: code = NotFound desc = could not find container \"33517f49febba26176d00fcc5308b81788272fdd1922e8a4fd0836bffb6d3b40\": container with ID starting with 33517f49febba26176d00fcc5308b81788272fdd1922e8a4fd0836bffb6d3b40 not found: ID does not exist"
Sep 10 21:23:02.528067 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:02.528037    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-95d905-6b86994766-f2kd6"]
Sep 10 21:23:02.533392 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:02.533368    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-95d905-6b86994766-f2kd6"]
Sep 10 21:23:03.873193 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:03.873160    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14cb0f09-b88c-4703-af89-13ca0079b174" path="/var/lib/kubelet/pods/14cb0f09-b88c-4703-af89-13ca0079b174/volumes"
Sep 10 21:23:06.666209 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:06.666170    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-24b606-7fbf686cbf-g4255"]
Sep 10 21:23:06.666601 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:06.666535    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07031e9c-e22d-4734-83db-7c781f9f5d3c" containerName="istio-proxy"
Sep 10 21:23:06.666601 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:06.666546    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="07031e9c-e22d-4734-83db-7c781f9f5d3c" containerName="istio-proxy"
Sep 10 21:23:06.666601 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:06.666556    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14cb0f09-b88c-4703-af89-13ca0079b174" containerName="payload-pre-processing"
Sep 10 21:23:06.666601 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:06.666561    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="14cb0f09-b88c-4703-af89-13ca0079b174" containerName="payload-pre-processing"
Sep 10 21:23:06.666601 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:06.666577    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07031e9c-e22d-4734-83db-7c781f9f5d3c" containerName="istio-proxy"
Sep 10 21:23:06.666601 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:06.666584    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="07031e9c-e22d-4734-83db-7c781f9f5d3c" containerName="istio-proxy"
Sep 10 21:23:06.666601 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:06.666595    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d15cad8-cc2a-42c5-bfa7-b0230c9764b1" containerName="payload-pre-processing"
Sep 10 21:23:06.666601 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:06.666601    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d15cad8-cc2a-42c5-bfa7-b0230c9764b1" containerName="payload-pre-processing"
Sep 10 21:23:06.666873 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:06.666608    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abebb555-0939-4d85-8894-96b8b0c2b91a" containerName="revoke-keys"
Sep 10 21:23:06.666873 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:06.666613    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="abebb555-0939-4d85-8894-96b8b0c2b91a" containerName="revoke-keys"
Sep 10 21:23:06.666873 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:06.666669    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d15cad8-cc2a-42c5-bfa7-b0230c9764b1" containerName="payload-pre-processing"
Sep 10 21:23:06.666873 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:06.666675    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="14cb0f09-b88c-4703-af89-13ca0079b174" containerName="payload-pre-processing"
Sep 10 21:23:06.666873 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:06.666686    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="abebb555-0939-4d85-8894-96b8b0c2b91a" containerName="revoke-keys"
Sep 10 21:23:06.666873 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:06.666692    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="07031e9c-e22d-4734-83db-7c781f9f5d3c" containerName="istio-proxy"
Sep 10 21:23:06.666873 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:06.666697    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="07031e9c-e22d-4734-83db-7c781f9f5d3c" containerName="istio-proxy"
Sep 10 21:23:06.670950 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:06.670931    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-24b606-7fbf686cbf-g4255"
Sep 10 21:23:06.674276 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:06.674255    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-24b606\""
Sep 10 21:23:06.674504 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:06.674487    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-24b606-dockercfg-7hwq9\""
Sep 10 21:23:06.684810 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:06.684786    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-24b606-7fbf686cbf-g4255"]
Sep 10 21:23:06.689059 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:06.689038    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzwlt\" (UniqueName: \"kubernetes.io/projected/fd2d985d-6d40-4988-92f9-231cd25f6b8b-kube-api-access-dzwlt\") pod \"payload-processing-e2e-ipp-a-24b606-7fbf686cbf-g4255\" (UID: \"fd2d985d-6d40-4988-92f9-231cd25f6b8b\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-24b606-7fbf686cbf-g4255"
Sep 10 21:23:06.689155 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:06.689090    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd2d985d-6d40-4988-92f9-231cd25f6b8b-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-24b606-7fbf686cbf-g4255\" (UID: \"fd2d985d-6d40-4988-92f9-231cd25f6b8b\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-24b606-7fbf686cbf-g4255"
Sep 10 21:23:06.713902 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:06.713875    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-24b606-f6f74f8cd-ltw49"]
Sep 10 21:23:06.717144 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:06.717128    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-24b606-f6f74f8cd-ltw49"
Sep 10 21:23:06.732400 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:06.732365    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-24b606-f6f74f8cd-ltw49"]
Sep 10 21:23:06.789864 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:06.789828    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/23ad906e-1fb4-4b6d-8608-aa52c7917b31-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-24b606-f6f74f8cd-ltw49\" (UID: \"23ad906e-1fb4-4b6d-8608-aa52c7917b31\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-24b606-f6f74f8cd-ltw49"
Sep 10 21:23:06.790054 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:06.789894    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzwlt\" (UniqueName: \"kubernetes.io/projected/fd2d985d-6d40-4988-92f9-231cd25f6b8b-kube-api-access-dzwlt\") pod \"payload-processing-e2e-ipp-a-24b606-7fbf686cbf-g4255\" (UID: \"fd2d985d-6d40-4988-92f9-231cd25f6b8b\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-24b606-7fbf686cbf-g4255"
Sep 10 21:23:06.790054 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:06.789969    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd2d985d-6d40-4988-92f9-231cd25f6b8b-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-24b606-7fbf686cbf-g4255\" (UID: \"fd2d985d-6d40-4988-92f9-231cd25f6b8b\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-24b606-7fbf686cbf-g4255"
Sep 10 21:23:06.790054 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:06.790006    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ppct\" (UniqueName: \"kubernetes.io/projected/23ad906e-1fb4-4b6d-8608-aa52c7917b31-kube-api-access-9ppct\") pod \"payload-pre-processing-e2e-ipp-a-24b606-f6f74f8cd-ltw49\" (UID: \"23ad906e-1fb4-4b6d-8608-aa52c7917b31\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-24b606-f6f74f8cd-ltw49"
Sep 10 21:23:06.790726 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:06.790696    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd2d985d-6d40-4988-92f9-231cd25f6b8b-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-24b606-7fbf686cbf-g4255\" (UID: \"fd2d985d-6d40-4988-92f9-231cd25f6b8b\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-24b606-7fbf686cbf-g4255"
Sep 10 21:23:06.799219 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:06.799193    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzwlt\" (UniqueName: \"kubernetes.io/projected/fd2d985d-6d40-4988-92f9-231cd25f6b8b-kube-api-access-dzwlt\") pod \"payload-processing-e2e-ipp-a-24b606-7fbf686cbf-g4255\" (UID: \"fd2d985d-6d40-4988-92f9-231cd25f6b8b\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-24b606-7fbf686cbf-g4255"
Sep 10 21:23:06.890926 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:06.890894    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ppct\" (UniqueName: \"kubernetes.io/projected/23ad906e-1fb4-4b6d-8608-aa52c7917b31-kube-api-access-9ppct\") pod \"payload-pre-processing-e2e-ipp-a-24b606-f6f74f8cd-ltw49\" (UID: \"23ad906e-1fb4-4b6d-8608-aa52c7917b31\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-24b606-f6f74f8cd-ltw49"
Sep 10 21:23:06.891202 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:06.891171    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/23ad906e-1fb4-4b6d-8608-aa52c7917b31-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-24b606-f6f74f8cd-ltw49\" (UID: \"23ad906e-1fb4-4b6d-8608-aa52c7917b31\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-24b606-f6f74f8cd-ltw49"
Sep 10 21:23:06.891841 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:06.891822    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/23ad906e-1fb4-4b6d-8608-aa52c7917b31-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-24b606-f6f74f8cd-ltw49\" (UID: \"23ad906e-1fb4-4b6d-8608-aa52c7917b31\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-24b606-f6f74f8cd-ltw49"
Sep 10 21:23:06.899824 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:06.899804    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ppct\" (UniqueName: \"kubernetes.io/projected/23ad906e-1fb4-4b6d-8608-aa52c7917b31-kube-api-access-9ppct\") pod \"payload-pre-processing-e2e-ipp-a-24b606-f6f74f8cd-ltw49\" (UID: \"23ad906e-1fb4-4b6d-8608-aa52c7917b31\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-24b606-f6f74f8cd-ltw49"
Sep 10 21:23:06.983900 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:06.983832    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-24b606-7fbf686cbf-g4255"
Sep 10 21:23:07.026931 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:07.026893    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-24b606-f6f74f8cd-ltw49"
Sep 10 21:23:07.263242 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:07.263186    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-24b606-7fbf686cbf-g4255"]
Sep 10 21:23:07.314215 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:07.314192    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-24b606-f6f74f8cd-ltw49"]
Sep 10 21:23:07.318240 ip-10-0-129-100 kubenswrapper[2564]: W0910 21:23:07.318199    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23ad906e_1fb4_4b6d_8608_aa52c7917b31.slice/crio-530461cda11de696f0fb01795bfaac3be9469f27b5e1d41eee79b33ca20964ad WatchSource:0}: Error finding container 530461cda11de696f0fb01795bfaac3be9469f27b5e1d41eee79b33ca20964ad: Status 404 returned error can't find the container with id 530461cda11de696f0fb01795bfaac3be9469f27b5e1d41eee79b33ca20964ad
Sep 10 21:23:07.535357 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:07.535262    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-24b606-f6f74f8cd-ltw49" event={"ID":"23ad906e-1fb4-4b6d-8608-aa52c7917b31","Type":"ContainerStarted","Data":"4540f3b4a3a8189d6cdd47a457be6f05998708632c786c6080625f4f5e864f79"}
Sep 10 21:23:07.535357 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:07.535326    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-24b606-f6f74f8cd-ltw49" event={"ID":"23ad906e-1fb4-4b6d-8608-aa52c7917b31","Type":"ContainerStarted","Data":"530461cda11de696f0fb01795bfaac3be9469f27b5e1d41eee79b33ca20964ad"}
Sep 10 21:23:07.535357 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:07.535354    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-24b606-f6f74f8cd-ltw49"
Sep 10 21:23:07.536868 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:07.536842    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-24b606-7fbf686cbf-g4255" event={"ID":"fd2d985d-6d40-4988-92f9-231cd25f6b8b","Type":"ContainerStarted","Data":"044a881cd2778009dbfa2d4c3a311c0306382e7f858d5c1fe8e90daa8e4e923c"}
Sep 10 21:23:07.536963 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:07.536890    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-24b606-7fbf686cbf-g4255" event={"ID":"fd2d985d-6d40-4988-92f9-231cd25f6b8b","Type":"ContainerStarted","Data":"a0eaa3dca2fea8910b50e53892b00df478be6c468ce16be7838dd083e64433b1"}
Sep 10 21:23:07.536963 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:07.536943    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-24b606-7fbf686cbf-g4255"
Sep 10 21:23:07.560141 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:07.560093    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-24b606-f6f74f8cd-ltw49" podStartSLOduration=1.5600773559999999 podStartE2EDuration="1.560077356s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:23:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:23:07.558964787 +0000 UTC m=+1568.246032066" watchObservedRunningTime="2026-09-10 21:23:07.560077356 +0000 UTC m=+1568.247144919"
Sep 10 21:23:07.595805 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:07.595757    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-24b606-7fbf686cbf-g4255" podStartSLOduration=1.59573725 podStartE2EDuration="1.59573725s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:23:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:23:07.59258838 +0000 UTC m=+1568.279655661" watchObservedRunningTime="2026-09-10 21:23:07.59573725 +0000 UTC m=+1568.282804530"
Sep 10 21:23:09.792428 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:09.792393    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm"]
Sep 10 21:23:09.792816 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:09.792690    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm" podUID="8bdb2cf7-06eb-4025-b562-67b6558a214d" containerName="istio-proxy" containerID="cri-o://09900ee9e1192926263636beb13a957621a9d73e1f07f39ccb7ab815fd0fa4b8" gracePeriod=30
Sep 10 21:23:15.047056 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:15.047028    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm"
Sep 10 21:23:15.173575 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:15.173486    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8bdb2cf7-06eb-4025-b562-67b6558a214d-istio-data\") pod \"8bdb2cf7-06eb-4025-b562-67b6558a214d\" (UID: \"8bdb2cf7-06eb-4025-b562-67b6558a214d\") "
Sep 10 21:23:15.173575 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:15.173530    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8bdb2cf7-06eb-4025-b562-67b6558a214d-istio-envoy\") pod \"8bdb2cf7-06eb-4025-b562-67b6558a214d\" (UID: \"8bdb2cf7-06eb-4025-b562-67b6558a214d\") "
Sep 10 21:23:15.173575 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:15.173550    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8bdb2cf7-06eb-4025-b562-67b6558a214d-istio-token\") pod \"8bdb2cf7-06eb-4025-b562-67b6558a214d\" (UID: \"8bdb2cf7-06eb-4025-b562-67b6558a214d\") "
Sep 10 21:23:15.173872 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:15.173625    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8bdb2cf7-06eb-4025-b562-67b6558a214d-credential-socket\") pod \"8bdb2cf7-06eb-4025-b562-67b6558a214d\" (UID: \"8bdb2cf7-06eb-4025-b562-67b6558a214d\") "
Sep 10 21:23:15.173872 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:15.173651    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8bdb2cf7-06eb-4025-b562-67b6558a214d-workload-certs\") pod \"8bdb2cf7-06eb-4025-b562-67b6558a214d\" (UID: \"8bdb2cf7-06eb-4025-b562-67b6558a214d\") "
Sep 10 21:23:15.173872 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:15.173696    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8bdb2cf7-06eb-4025-b562-67b6558a214d-istiod-ca-cert\") pod \"8bdb2cf7-06eb-4025-b562-67b6558a214d\" (UID: \"8bdb2cf7-06eb-4025-b562-67b6558a214d\") "
Sep 10 21:23:15.173872 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:15.173733    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8bdb2cf7-06eb-4025-b562-67b6558a214d-workload-socket\") pod \"8bdb2cf7-06eb-4025-b562-67b6558a214d\" (UID: \"8bdb2cf7-06eb-4025-b562-67b6558a214d\") "
Sep 10 21:23:15.173872 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:15.173765    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8bdb2cf7-06eb-4025-b562-67b6558a214d-istio-podinfo\") pod \"8bdb2cf7-06eb-4025-b562-67b6558a214d\" (UID: \"8bdb2cf7-06eb-4025-b562-67b6558a214d\") "
Sep 10 21:23:15.173872 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:15.173776    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8bdb2cf7-06eb-4025-b562-67b6558a214d-istio-data" (OuterVolumeSpecName: "istio-data") pod "8bdb2cf7-06eb-4025-b562-67b6558a214d" (UID: "8bdb2cf7-06eb-4025-b562-67b6558a214d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:23:15.173872 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:15.173794    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-625gk\" (UniqueName: \"kubernetes.io/projected/8bdb2cf7-06eb-4025-b562-67b6558a214d-kube-api-access-625gk\") pod \"8bdb2cf7-06eb-4025-b562-67b6558a214d\" (UID: \"8bdb2cf7-06eb-4025-b562-67b6558a214d\") "
Sep 10 21:23:15.174280 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:15.173914    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8bdb2cf7-06eb-4025-b562-67b6558a214d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8bdb2cf7-06eb-4025-b562-67b6558a214d" (UID: "8bdb2cf7-06eb-4025-b562-67b6558a214d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:23:15.174280 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:15.173967    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8bdb2cf7-06eb-4025-b562-67b6558a214d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8bdb2cf7-06eb-4025-b562-67b6558a214d" (UID: "8bdb2cf7-06eb-4025-b562-67b6558a214d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:23:15.174280 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:15.174003    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8bdb2cf7-06eb-4025-b562-67b6558a214d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8bdb2cf7-06eb-4025-b562-67b6558a214d" (UID: "8bdb2cf7-06eb-4025-b562-67b6558a214d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:23:15.174280 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:15.174150    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8bdb2cf7-06eb-4025-b562-67b6558a214d-workload-socket\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:23:15.174280 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:15.174170    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8bdb2cf7-06eb-4025-b562-67b6558a214d-istio-data\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:23:15.174280 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:15.174185    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8bdb2cf7-06eb-4025-b562-67b6558a214d-credential-socket\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:23:15.174280 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:15.174200    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8bdb2cf7-06eb-4025-b562-67b6558a214d-workload-certs\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:23:15.174675 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:15.174653    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8bdb2cf7-06eb-4025-b562-67b6558a214d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8bdb2cf7-06eb-4025-b562-67b6558a214d" (UID: "8bdb2cf7-06eb-4025-b562-67b6558a214d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:23:15.175933 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:15.175903    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8bdb2cf7-06eb-4025-b562-67b6558a214d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8bdb2cf7-06eb-4025-b562-67b6558a214d" (UID: "8bdb2cf7-06eb-4025-b562-67b6558a214d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:23:15.175933 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:15.175917    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8bdb2cf7-06eb-4025-b562-67b6558a214d-istio-token" (OuterVolumeSpecName: "istio-token") pod "8bdb2cf7-06eb-4025-b562-67b6558a214d" (UID: "8bdb2cf7-06eb-4025-b562-67b6558a214d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:23:15.176273 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:15.176242    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8bdb2cf7-06eb-4025-b562-67b6558a214d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8bdb2cf7-06eb-4025-b562-67b6558a214d" (UID: "8bdb2cf7-06eb-4025-b562-67b6558a214d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 21:23:15.176273 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:15.176244    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8bdb2cf7-06eb-4025-b562-67b6558a214d-kube-api-access-625gk" (OuterVolumeSpecName: "kube-api-access-625gk") pod "8bdb2cf7-06eb-4025-b562-67b6558a214d" (UID: "8bdb2cf7-06eb-4025-b562-67b6558a214d"). InnerVolumeSpecName "kube-api-access-625gk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:23:15.275372 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:15.275341    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8bdb2cf7-06eb-4025-b562-67b6558a214d-istiod-ca-cert\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:23:15.275372 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:15.275367    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8bdb2cf7-06eb-4025-b562-67b6558a214d-istio-podinfo\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:23:15.275372 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:15.275377    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-625gk\" (UniqueName: \"kubernetes.io/projected/8bdb2cf7-06eb-4025-b562-67b6558a214d-kube-api-access-625gk\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:23:15.275611 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:15.275389    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8bdb2cf7-06eb-4025-b562-67b6558a214d-istio-envoy\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:23:15.275611 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:15.275398    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8bdb2cf7-06eb-4025-b562-67b6558a214d-istio-token\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:23:15.593585 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:15.593545    2564 generic.go:356] "Generic (PLEG): container finished" podID="8bdb2cf7-06eb-4025-b562-67b6558a214d" containerID="09900ee9e1192926263636beb13a957621a9d73e1f07f39ccb7ab815fd0fa4b8" exitCode=0
Sep 10 21:23:15.593759 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:15.593579    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm" event={"ID":"8bdb2cf7-06eb-4025-b562-67b6558a214d","Type":"ContainerDied","Data":"09900ee9e1192926263636beb13a957621a9d73e1f07f39ccb7ab815fd0fa4b8"}
Sep 10 21:23:15.593759 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:15.593621    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm"
Sep 10 21:23:15.593759 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:15.593660    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm" event={"ID":"8bdb2cf7-06eb-4025-b562-67b6558a214d","Type":"ContainerDied","Data":"22e8e7823d37bf2433b1b19429bb55627721c10d77c5e8710afb29f52632197d"}
Sep 10 21:23:15.593759 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:15.593683    2564 scope.go:117] "RemoveContainer" containerID="09900ee9e1192926263636beb13a957621a9d73e1f07f39ccb7ab815fd0fa4b8"
Sep 10 21:23:15.603563 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:15.603546    2564 scope.go:117] "RemoveContainer" containerID="1b6cb6dfaa078ac85d5159205865b95744cb1b3ce565b2a946d4b3cd845b4b5b"
Sep 10 21:23:15.611680 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:15.611660    2564 scope.go:117] "RemoveContainer" containerID="09900ee9e1192926263636beb13a957621a9d73e1f07f39ccb7ab815fd0fa4b8"
Sep 10 21:23:15.611943 ip-10-0-129-100 kubenswrapper[2564]: E0910 21:23:15.611922    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09900ee9e1192926263636beb13a957621a9d73e1f07f39ccb7ab815fd0fa4b8\": container with ID starting with 09900ee9e1192926263636beb13a957621a9d73e1f07f39ccb7ab815fd0fa4b8 not found: ID does not exist" containerID="09900ee9e1192926263636beb13a957621a9d73e1f07f39ccb7ab815fd0fa4b8"
Sep 10 21:23:15.612008 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:15.611951    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09900ee9e1192926263636beb13a957621a9d73e1f07f39ccb7ab815fd0fa4b8"} err="failed to get container status \"09900ee9e1192926263636beb13a957621a9d73e1f07f39ccb7ab815fd0fa4b8\": rpc error: code = NotFound desc = could not find container \"09900ee9e1192926263636beb13a957621a9d73e1f07f39ccb7ab815fd0fa4b8\": container with ID starting with 09900ee9e1192926263636beb13a957621a9d73e1f07f39ccb7ab815fd0fa4b8 not found: ID does not exist"
Sep 10 21:23:15.612008 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:15.611969    2564 scope.go:117] "RemoveContainer" containerID="1b6cb6dfaa078ac85d5159205865b95744cb1b3ce565b2a946d4b3cd845b4b5b"
Sep 10 21:23:15.612223 ip-10-0-129-100 kubenswrapper[2564]: E0910 21:23:15.612204    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b6cb6dfaa078ac85d5159205865b95744cb1b3ce565b2a946d4b3cd845b4b5b\": container with ID starting with 1b6cb6dfaa078ac85d5159205865b95744cb1b3ce565b2a946d4b3cd845b4b5b not found: ID does not exist" containerID="1b6cb6dfaa078ac85d5159205865b95744cb1b3ce565b2a946d4b3cd845b4b5b"
Sep 10 21:23:15.612298 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:15.612244    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b6cb6dfaa078ac85d5159205865b95744cb1b3ce565b2a946d4b3cd845b4b5b"} err="failed to get container status \"1b6cb6dfaa078ac85d5159205865b95744cb1b3ce565b2a946d4b3cd845b4b5b\": rpc error: code = NotFound desc = could not find container \"1b6cb6dfaa078ac85d5159205865b95744cb1b3ce565b2a946d4b3cd845b4b5b\": container with ID starting with 1b6cb6dfaa078ac85d5159205865b95744cb1b3ce565b2a946d4b3cd845b4b5b not found: ID does not exist"
Sep 10 21:23:15.630138 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:15.630111    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm"]
Sep 10 21:23:15.639121 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:15.639094    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-95d905-openshift-default-779c98bb88-qtmhm"]
Sep 10 21:23:15.839672 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:15.839625    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-7810bd/rate-test-model-7810bd-kserve-85b468d46c-ccjb8" podUID="0bff1c2c-d709-4872-ae43-a256f3f1e808" containerName="main" containerID="cri-o://5dbb6aae859ed8fdbd28e8462252c6cc9ffb183621c9191ad966314e275346c2" gracePeriod=45
Sep 10 21:23:15.874261 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:15.874210    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8bdb2cf7-06eb-4025-b562-67b6558a214d" path="/var/lib/kubelet/pods/8bdb2cf7-06eb-4025-b562-67b6558a214d/volumes"
Sep 10 21:23:16.080311 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:16.080287    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-7810bd/rate-test-model-7810bd-kserve-85b468d46c-ccjb8"
Sep 10 21:23:16.184612 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:16.184525    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0bff1c2c-d709-4872-ae43-a256f3f1e808-model-cache\") pod \"0bff1c2c-d709-4872-ae43-a256f3f1e808\" (UID: \"0bff1c2c-d709-4872-ae43-a256f3f1e808\") "
Sep 10 21:23:16.184612 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:16.184563    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0bff1c2c-d709-4872-ae43-a256f3f1e808-tls-certs\") pod \"0bff1c2c-d709-4872-ae43-a256f3f1e808\" (UID: \"0bff1c2c-d709-4872-ae43-a256f3f1e808\") "
Sep 10 21:23:16.184612 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:16.184600    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0bff1c2c-d709-4872-ae43-a256f3f1e808-home\") pod \"0bff1c2c-d709-4872-ae43-a256f3f1e808\" (UID: \"0bff1c2c-d709-4872-ae43-a256f3f1e808\") "
Sep 10 21:23:16.184908 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:16.184620    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vb4tg\" (UniqueName: \"kubernetes.io/projected/0bff1c2c-d709-4872-ae43-a256f3f1e808-kube-api-access-vb4tg\") pod \"0bff1c2c-d709-4872-ae43-a256f3f1e808\" (UID: \"0bff1c2c-d709-4872-ae43-a256f3f1e808\") "
Sep 10 21:23:16.184908 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:16.184737    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0bff1c2c-d709-4872-ae43-a256f3f1e808-dshm\") pod \"0bff1c2c-d709-4872-ae43-a256f3f1e808\" (UID: \"0bff1c2c-d709-4872-ae43-a256f3f1e808\") "
Sep 10 21:23:16.184908 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:16.184790    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0bff1c2c-d709-4872-ae43-a256f3f1e808-tmp-dir\") pod \"0bff1c2c-d709-4872-ae43-a256f3f1e808\" (UID: \"0bff1c2c-d709-4872-ae43-a256f3f1e808\") "
Sep 10 21:23:16.184908 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:16.184842    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0bff1c2c-d709-4872-ae43-a256f3f1e808-model-cache" (OuterVolumeSpecName: "model-cache") pod "0bff1c2c-d709-4872-ae43-a256f3f1e808" (UID: "0bff1c2c-d709-4872-ae43-a256f3f1e808"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:23:16.184908 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:16.184890    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0bff1c2c-d709-4872-ae43-a256f3f1e808-home" (OuterVolumeSpecName: "home") pod "0bff1c2c-d709-4872-ae43-a256f3f1e808" (UID: "0bff1c2c-d709-4872-ae43-a256f3f1e808"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:23:16.185108 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:16.185025    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0bff1c2c-d709-4872-ae43-a256f3f1e808-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0bff1c2c-d709-4872-ae43-a256f3f1e808" (UID: "0bff1c2c-d709-4872-ae43-a256f3f1e808"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:23:16.185166 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:16.185150    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0bff1c2c-d709-4872-ae43-a256f3f1e808-tmp-dir\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:23:16.185199 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:16.185166    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0bff1c2c-d709-4872-ae43-a256f3f1e808-model-cache\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:23:16.185199 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:16.185174    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0bff1c2c-d709-4872-ae43-a256f3f1e808-home\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:23:16.186912 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:16.186885    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0bff1c2c-d709-4872-ae43-a256f3f1e808-dshm" (OuterVolumeSpecName: "dshm") pod "0bff1c2c-d709-4872-ae43-a256f3f1e808" (UID: "0bff1c2c-d709-4872-ae43-a256f3f1e808"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:23:16.186912 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:16.186903    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0bff1c2c-d709-4872-ae43-a256f3f1e808-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0bff1c2c-d709-4872-ae43-a256f3f1e808" (UID: "0bff1c2c-d709-4872-ae43-a256f3f1e808"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:23:16.187057 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:16.186916    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0bff1c2c-d709-4872-ae43-a256f3f1e808-kube-api-access-vb4tg" (OuterVolumeSpecName: "kube-api-access-vb4tg") pod "0bff1c2c-d709-4872-ae43-a256f3f1e808" (UID: "0bff1c2c-d709-4872-ae43-a256f3f1e808"). InnerVolumeSpecName "kube-api-access-vb4tg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:23:16.286520 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:16.286485    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0bff1c2c-d709-4872-ae43-a256f3f1e808-tls-certs\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:23:16.286520 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:16.286516    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vb4tg\" (UniqueName: \"kubernetes.io/projected/0bff1c2c-d709-4872-ae43-a256f3f1e808-kube-api-access-vb4tg\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:23:16.286520 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:16.286525    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0bff1c2c-d709-4872-ae43-a256f3f1e808-dshm\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:23:16.600169 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:16.600128    2564 generic.go:356] "Generic (PLEG): container finished" podID="0bff1c2c-d709-4872-ae43-a256f3f1e808" containerID="5dbb6aae859ed8fdbd28e8462252c6cc9ffb183621c9191ad966314e275346c2" exitCode=0
Sep 10 21:23:16.600365 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:16.600175    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-7810bd/rate-test-model-7810bd-kserve-85b468d46c-ccjb8"
Sep 10 21:23:16.600365 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:16.600216    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-7810bd/rate-test-model-7810bd-kserve-85b468d46c-ccjb8" event={"ID":"0bff1c2c-d709-4872-ae43-a256f3f1e808","Type":"ContainerDied","Data":"5dbb6aae859ed8fdbd28e8462252c6cc9ffb183621c9191ad966314e275346c2"}
Sep 10 21:23:16.600365 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:16.600289    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-7810bd/rate-test-model-7810bd-kserve-85b468d46c-ccjb8" event={"ID":"0bff1c2c-d709-4872-ae43-a256f3f1e808","Type":"ContainerDied","Data":"d9656d3d902280b6a55a1c4f77c2170223d667bceba2dc202f427dca29cba8da"}
Sep 10 21:23:16.600365 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:16.600310    2564 scope.go:117] "RemoveContainer" containerID="5dbb6aae859ed8fdbd28e8462252c6cc9ffb183621c9191ad966314e275346c2"
Sep 10 21:23:16.610958 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:16.610937    2564 scope.go:117] "RemoveContainer" containerID="5dbb6aae859ed8fdbd28e8462252c6cc9ffb183621c9191ad966314e275346c2"
Sep 10 21:23:16.611253 ip-10-0-129-100 kubenswrapper[2564]: E0910 21:23:16.611205    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5dbb6aae859ed8fdbd28e8462252c6cc9ffb183621c9191ad966314e275346c2\": container with ID starting with 5dbb6aae859ed8fdbd28e8462252c6cc9ffb183621c9191ad966314e275346c2 not found: ID does not exist" containerID="5dbb6aae859ed8fdbd28e8462252c6cc9ffb183621c9191ad966314e275346c2"
Sep 10 21:23:16.611323 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:16.611250    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5dbb6aae859ed8fdbd28e8462252c6cc9ffb183621c9191ad966314e275346c2"} err="failed to get container status \"5dbb6aae859ed8fdbd28e8462252c6cc9ffb183621c9191ad966314e275346c2\": rpc error: code = NotFound desc = could not find container \"5dbb6aae859ed8fdbd28e8462252c6cc9ffb183621c9191ad966314e275346c2\": container with ID starting with 5dbb6aae859ed8fdbd28e8462252c6cc9ffb183621c9191ad966314e275346c2 not found: ID does not exist"
Sep 10 21:23:16.629748 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:16.629722    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-7810bd/rate-test-model-7810bd-kserve-85b468d46c-ccjb8"]
Sep 10 21:23:16.635013 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:16.634984    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-7810bd/rate-test-model-7810bd-kserve-85b468d46c-ccjb8"]
Sep 10 21:23:17.873438 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:17.873406    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0bff1c2c-d709-4872-ae43-a256f3f1e808" path="/var/lib/kubelet/pods/0bff1c2c-d709-4872-ae43-a256f3f1e808/volumes"
Sep 10 21:23:18.544861 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:18.544832    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-24b606-7fbf686cbf-g4255"
Sep 10 21:23:18.545041 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:18.544904    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-24b606-f6f74f8cd-ltw49"
Sep 10 21:23:35.536126 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:35.536091    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk"]
Sep 10 21:23:35.536721 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:35.536698    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8bdb2cf7-06eb-4025-b562-67b6558a214d" containerName="istio-proxy"
Sep 10 21:23:35.536797 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:35.536725    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bdb2cf7-06eb-4025-b562-67b6558a214d" containerName="istio-proxy"
Sep 10 21:23:35.536797 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:35.536750    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bff1c2c-d709-4872-ae43-a256f3f1e808" containerName="main"
Sep 10 21:23:35.536797 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:35.536760    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bff1c2c-d709-4872-ae43-a256f3f1e808" containerName="main"
Sep 10 21:23:35.536945 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:35.536882    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="0bff1c2c-d709-4872-ae43-a256f3f1e808" containerName="main"
Sep 10 21:23:35.536945 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:35.536898    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="8bdb2cf7-06eb-4025-b562-67b6558a214d" containerName="istio-proxy"
Sep 10 21:23:35.536945 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:35.536905    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="8bdb2cf7-06eb-4025-b562-67b6558a214d" containerName="istio-proxy"
Sep 10 21:23:35.539791 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:35.539769    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk"
Sep 10 21:23:35.542838 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:35.542815    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-9f1286-openshift-default-dockercfg-6vn2s\""
Sep 10 21:23:35.552087 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:35.552063    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk"]
Sep 10 21:23:35.664914 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:35.664880    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzfj9\" (UniqueName: \"kubernetes.io/projected/d08e991b-96d2-429d-8aed-3c7081b043f1-kube-api-access-wzfj9\") pod \"e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk\" (UID: \"d08e991b-96d2-429d-8aed-3c7081b043f1\") " pod="openshift-ingress/e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk"
Sep 10 21:23:35.665108 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:35.664928    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d08e991b-96d2-429d-8aed-3c7081b043f1-istio-envoy\") pod \"e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk\" (UID: \"d08e991b-96d2-429d-8aed-3c7081b043f1\") " pod="openshift-ingress/e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk"
Sep 10 21:23:35.665108 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:35.665018    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d08e991b-96d2-429d-8aed-3c7081b043f1-credential-socket\") pod \"e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk\" (UID: \"d08e991b-96d2-429d-8aed-3c7081b043f1\") " pod="openshift-ingress/e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk"
Sep 10 21:23:35.665200 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:35.665119    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d08e991b-96d2-429d-8aed-3c7081b043f1-istiod-ca-cert\") pod \"e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk\" (UID: \"d08e991b-96d2-429d-8aed-3c7081b043f1\") " pod="openshift-ingress/e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk"
Sep 10 21:23:35.665200 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:35.665172    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d08e991b-96d2-429d-8aed-3c7081b043f1-istio-data\") pod \"e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk\" (UID: \"d08e991b-96d2-429d-8aed-3c7081b043f1\") " pod="openshift-ingress/e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk"
Sep 10 21:23:35.665309 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:35.665246    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d08e991b-96d2-429d-8aed-3c7081b043f1-istio-token\") pod \"e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk\" (UID: \"d08e991b-96d2-429d-8aed-3c7081b043f1\") " pod="openshift-ingress/e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk"
Sep 10 21:23:35.665309 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:35.665283    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d08e991b-96d2-429d-8aed-3c7081b043f1-workload-socket\") pod \"e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk\" (UID: \"d08e991b-96d2-429d-8aed-3c7081b043f1\") " pod="openshift-ingress/e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk"
Sep 10 21:23:35.665384 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:35.665311    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d08e991b-96d2-429d-8aed-3c7081b043f1-istio-podinfo\") pod \"e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk\" (UID: \"d08e991b-96d2-429d-8aed-3c7081b043f1\") " pod="openshift-ingress/e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk"
Sep 10 21:23:35.665384 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:35.665342    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d08e991b-96d2-429d-8aed-3c7081b043f1-workload-certs\") pod \"e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk\" (UID: \"d08e991b-96d2-429d-8aed-3c7081b043f1\") " pod="openshift-ingress/e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk"
Sep 10 21:23:35.766304 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:35.766268    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d08e991b-96d2-429d-8aed-3c7081b043f1-istiod-ca-cert\") pod \"e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk\" (UID: \"d08e991b-96d2-429d-8aed-3c7081b043f1\") " pod="openshift-ingress/e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk"
Sep 10 21:23:35.766494 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:35.766320    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d08e991b-96d2-429d-8aed-3c7081b043f1-istio-data\") pod \"e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk\" (UID: \"d08e991b-96d2-429d-8aed-3c7081b043f1\") " pod="openshift-ingress/e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk"
Sep 10 21:23:35.766494 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:35.766350    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d08e991b-96d2-429d-8aed-3c7081b043f1-istio-token\") pod \"e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk\" (UID: \"d08e991b-96d2-429d-8aed-3c7081b043f1\") " pod="openshift-ingress/e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk"
Sep 10 21:23:35.766494 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:35.766379    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d08e991b-96d2-429d-8aed-3c7081b043f1-workload-socket\") pod \"e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk\" (UID: \"d08e991b-96d2-429d-8aed-3c7081b043f1\") " pod="openshift-ingress/e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk"
Sep 10 21:23:35.766494 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:35.766400    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d08e991b-96d2-429d-8aed-3c7081b043f1-istio-podinfo\") pod \"e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk\" (UID: \"d08e991b-96d2-429d-8aed-3c7081b043f1\") " pod="openshift-ingress/e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk"
Sep 10 21:23:35.766494 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:35.766429    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d08e991b-96d2-429d-8aed-3c7081b043f1-workload-certs\") pod \"e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk\" (UID: \"d08e991b-96d2-429d-8aed-3c7081b043f1\") " pod="openshift-ingress/e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk"
Sep 10 21:23:35.766494 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:35.766483    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzfj9\" (UniqueName: \"kubernetes.io/projected/d08e991b-96d2-429d-8aed-3c7081b043f1-kube-api-access-wzfj9\") pod \"e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk\" (UID: \"d08e991b-96d2-429d-8aed-3c7081b043f1\") " pod="openshift-ingress/e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk"
Sep 10 21:23:35.766807 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:35.766516    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d08e991b-96d2-429d-8aed-3c7081b043f1-istio-envoy\") pod \"e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk\" (UID: \"d08e991b-96d2-429d-8aed-3c7081b043f1\") " pod="openshift-ingress/e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk"
Sep 10 21:23:35.766807 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:35.766568    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d08e991b-96d2-429d-8aed-3c7081b043f1-credential-socket\") pod \"e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk\" (UID: \"d08e991b-96d2-429d-8aed-3c7081b043f1\") " pod="openshift-ingress/e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk"
Sep 10 21:23:35.766951 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:35.766925    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d08e991b-96d2-429d-8aed-3c7081b043f1-workload-certs\") pod \"e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk\" (UID: \"d08e991b-96d2-429d-8aed-3c7081b043f1\") " pod="openshift-ingress/e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk"
Sep 10 21:23:35.767070 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:35.767045    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d08e991b-96d2-429d-8aed-3c7081b043f1-istio-data\") pod \"e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk\" (UID: \"d08e991b-96d2-429d-8aed-3c7081b043f1\") " pod="openshift-ingress/e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk"
Sep 10 21:23:35.767136 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:35.767123    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d08e991b-96d2-429d-8aed-3c7081b043f1-credential-socket\") pod \"e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk\" (UID: \"d08e991b-96d2-429d-8aed-3c7081b043f1\") " pod="openshift-ingress/e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk"
Sep 10 21:23:35.767382 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:35.767353    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d08e991b-96d2-429d-8aed-3c7081b043f1-istiod-ca-cert\") pod \"e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk\" (UID: \"d08e991b-96d2-429d-8aed-3c7081b043f1\") " pod="openshift-ingress/e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk"
Sep 10 21:23:35.767608 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:35.767580    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d08e991b-96d2-429d-8aed-3c7081b043f1-workload-socket\") pod \"e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk\" (UID: \"d08e991b-96d2-429d-8aed-3c7081b043f1\") " pod="openshift-ingress/e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk"
Sep 10 21:23:35.769072 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:35.769040    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d08e991b-96d2-429d-8aed-3c7081b043f1-istio-envoy\") pod \"e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk\" (UID: \"d08e991b-96d2-429d-8aed-3c7081b043f1\") " pod="openshift-ingress/e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk"
Sep 10 21:23:35.769252 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:35.769212    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d08e991b-96d2-429d-8aed-3c7081b043f1-istio-podinfo\") pod \"e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk\" (UID: \"d08e991b-96d2-429d-8aed-3c7081b043f1\") " pod="openshift-ingress/e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk"
Sep 10 21:23:35.780431 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:35.780401    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d08e991b-96d2-429d-8aed-3c7081b043f1-istio-token\") pod \"e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk\" (UID: \"d08e991b-96d2-429d-8aed-3c7081b043f1\") " pod="openshift-ingress/e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk"
Sep 10 21:23:35.780932 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:35.780912    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzfj9\" (UniqueName: \"kubernetes.io/projected/d08e991b-96d2-429d-8aed-3c7081b043f1-kube-api-access-wzfj9\") pod \"e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk\" (UID: \"d08e991b-96d2-429d-8aed-3c7081b043f1\") " pod="openshift-ingress/e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk"
Sep 10 21:23:35.851170 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:35.851138    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk"
Sep 10 21:23:36.147932 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:36.147902    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk"]
Sep 10 21:23:36.149114 ip-10-0-129-100 kubenswrapper[2564]: W0910 21:23:36.149090    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd08e991b_96d2_429d_8aed_3c7081b043f1.slice/crio-1149a33514ed3379cff558d59714008a6d617583af83b1e8b6e9639d98b7eb5c WatchSource:0}: Error finding container 1149a33514ed3379cff558d59714008a6d617583af83b1e8b6e9639d98b7eb5c: Status 404 returned error can't find the container with id 1149a33514ed3379cff558d59714008a6d617583af83b1e8b6e9639d98b7eb5c
Sep 10 21:23:36.151351 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:36.151318    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 10 21:23:36.151425 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:36.151385    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 10 21:23:36.151425 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:36.151415    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 10 21:23:36.721137 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:36.721098    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk" event={"ID":"d08e991b-96d2-429d-8aed-3c7081b043f1","Type":"ContainerStarted","Data":"9eafac2807b593aac179cc3600e53a7500375e7b22e070eb258b95af050a3328"}
Sep 10 21:23:36.721540 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:36.721152    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk" event={"ID":"d08e991b-96d2-429d-8aed-3c7081b043f1","Type":"ContainerStarted","Data":"1149a33514ed3379cff558d59714008a6d617583af83b1e8b6e9639d98b7eb5c"}
Sep 10 21:23:36.743731 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:36.743688    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk" podStartSLOduration=1.7436686959999999 podStartE2EDuration="1.743668696s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:23:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:23:36.742412636 +0000 UTC m=+1597.429479916" watchObservedRunningTime="2026-09-10 21:23:36.743668696 +0000 UTC m=+1597.430735976"
Sep 10 21:23:36.851899 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:36.851859    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk"
Sep 10 21:23:37.856644 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:37.856608    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk"
Sep 10 21:23:38.732828 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:38.732792    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk"
Sep 10 21:23:38.733988 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:38.733963    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk"
Sep 10 21:23:41.450187 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:41.450141    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-9f1286-54ccb98c7f-hlmdt"]
Sep 10 21:23:41.450741 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:41.450720    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8bdb2cf7-06eb-4025-b562-67b6558a214d" containerName="istio-proxy"
Sep 10 21:23:41.451101 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:41.450744    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bdb2cf7-06eb-4025-b562-67b6558a214d" containerName="istio-proxy"
Sep 10 21:23:41.454531 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:41.454509    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-9f1286-54ccb98c7f-hlmdt"
Sep 10 21:23:41.460012 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:41.459984    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-9f1286-dockercfg-dzwn7\""
Sep 10 21:23:41.460980 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:41.460952    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-9f1286\""
Sep 10 21:23:41.472361 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:41.472332    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-9f1286-54ccb98c7f-hlmdt"]
Sep 10 21:23:41.627179 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:41.627143    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c7ce44eb-1fb7-44ca-a8d1-68d23fe0b724-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-9f1286-54ccb98c7f-hlmdt\" (UID: \"c7ce44eb-1fb7-44ca-a8d1-68d23fe0b724\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-9f1286-54ccb98c7f-hlmdt"
Sep 10 21:23:41.627386 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:41.627209    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-265bm\" (UniqueName: \"kubernetes.io/projected/c7ce44eb-1fb7-44ca-a8d1-68d23fe0b724-kube-api-access-265bm\") pod \"payload-processing-e2e-ipp-b-9f1286-54ccb98c7f-hlmdt\" (UID: \"c7ce44eb-1fb7-44ca-a8d1-68d23fe0b724\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-9f1286-54ccb98c7f-hlmdt"
Sep 10 21:23:41.728669 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:41.728585    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c7ce44eb-1fb7-44ca-a8d1-68d23fe0b724-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-9f1286-54ccb98c7f-hlmdt\" (UID: \"c7ce44eb-1fb7-44ca-a8d1-68d23fe0b724\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-9f1286-54ccb98c7f-hlmdt"
Sep 10 21:23:41.728804 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:41.728757    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-265bm\" (UniqueName: \"kubernetes.io/projected/c7ce44eb-1fb7-44ca-a8d1-68d23fe0b724-kube-api-access-265bm\") pod \"payload-processing-e2e-ipp-b-9f1286-54ccb98c7f-hlmdt\" (UID: \"c7ce44eb-1fb7-44ca-a8d1-68d23fe0b724\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-9f1286-54ccb98c7f-hlmdt"
Sep 10 21:23:41.729294 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:41.729278    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c7ce44eb-1fb7-44ca-a8d1-68d23fe0b724-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-9f1286-54ccb98c7f-hlmdt\" (UID: \"c7ce44eb-1fb7-44ca-a8d1-68d23fe0b724\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-9f1286-54ccb98c7f-hlmdt"
Sep 10 21:23:41.741780 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:41.741752    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-265bm\" (UniqueName: \"kubernetes.io/projected/c7ce44eb-1fb7-44ca-a8d1-68d23fe0b724-kube-api-access-265bm\") pod \"payload-processing-e2e-ipp-b-9f1286-54ccb98c7f-hlmdt\" (UID: \"c7ce44eb-1fb7-44ca-a8d1-68d23fe0b724\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-9f1286-54ccb98c7f-hlmdt"
Sep 10 21:23:41.767963 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:41.767937    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-9f1286-54ccb98c7f-hlmdt"
Sep 10 21:23:42.052253 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:42.052214    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-9f1286-54ccb98c7f-hlmdt"]
Sep 10 21:23:42.054380 ip-10-0-129-100 kubenswrapper[2564]: W0910 21:23:42.054354    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7ce44eb_1fb7_44ca_a8d1_68d23fe0b724.slice/crio-09cd681fdfd4f450f14a527dbe72cbf060cf4a7ff7364078fa8c5ef8618bb803 WatchSource:0}: Error finding container 09cd681fdfd4f450f14a527dbe72cbf060cf4a7ff7364078fa8c5ef8618bb803: Status 404 returned error can't find the container with id 09cd681fdfd4f450f14a527dbe72cbf060cf4a7ff7364078fa8c5ef8618bb803
Sep 10 21:23:42.765833 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:42.765791    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-9f1286-54ccb98c7f-hlmdt" event={"ID":"c7ce44eb-1fb7-44ca-a8d1-68d23fe0b724","Type":"ContainerStarted","Data":"a9c688a978381120a7030280163e15f2dfec69ea6c8e4c07513cec4203450403"}
Sep 10 21:23:42.766355 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:42.765890    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-9f1286-54ccb98c7f-hlmdt" event={"ID":"c7ce44eb-1fb7-44ca-a8d1-68d23fe0b724","Type":"ContainerStarted","Data":"09cd681fdfd4f450f14a527dbe72cbf060cf4a7ff7364078fa8c5ef8618bb803"}
Sep 10 21:23:42.766355 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:42.765922    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-9f1286-54ccb98c7f-hlmdt"
Sep 10 21:23:42.794145 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:42.794083    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-9f1286-54ccb98c7f-hlmdt" podStartSLOduration=1.7940643760000001 podStartE2EDuration="1.794064376s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:23:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:23:42.792431447 +0000 UTC m=+1603.479498729" watchObservedRunningTime="2026-09-10 21:23:42.794064376 +0000 UTC m=+1603.481131654"
Sep 10 21:23:53.774442 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:53.774405    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-9f1286-54ccb98c7f-hlmdt"
Sep 10 21:23:54.774449 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:54.774401    2564 patch_prober.go:28] interesting pod/e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.86:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 21:23:54.774980 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:54.774490    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk" podUID="d08e991b-96d2-429d-8aed-3c7081b043f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.86:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 21:23:56.848255 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:56.848210    2564 generic.go:356] "Generic (PLEG): container finished" podID="d08e991b-96d2-429d-8aed-3c7081b043f1" containerID="9eafac2807b593aac179cc3600e53a7500375e7b22e070eb258b95af050a3328" exitCode=0
Sep 10 21:23:56.848693 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:56.848287    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk" event={"ID":"d08e991b-96d2-429d-8aed-3c7081b043f1","Type":"ContainerDied","Data":"9eafac2807b593aac179cc3600e53a7500375e7b22e070eb258b95af050a3328"}
Sep 10 21:23:56.848693 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:56.848689    2564 scope.go:117] "RemoveContainer" containerID="9eafac2807b593aac179cc3600e53a7500375e7b22e070eb258b95af050a3328"
Sep 10 21:23:56.849859 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:56.849829    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 10 21:23:56.849930 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:56.849909    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 10 21:23:56.849980 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:56.849943    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 10 21:23:57.856696 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:57.856659    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk" event={"ID":"d08e991b-96d2-429d-8aed-3c7081b043f1","Type":"ContainerStarted","Data":"d747f5d035f74d9488ce8e1dfb82fd2f3c29bc58f4b6aaff730d4b6df8b87c40"}
Sep 10 21:23:58.852162 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:58.852119    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk"
Sep 10 21:23:58.852386 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:58.852360    2564 patch_prober.go:28] interesting pod/e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused" start-of-body=
Sep 10 21:23:58.852435 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:58.852414    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk" podUID="d08e991b-96d2-429d-8aed-3c7081b043f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused"
Sep 10 21:23:59.852204 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:59.852163    2564 patch_prober.go:28] interesting pod/e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused" start-of-body=
Sep 10 21:23:59.852627 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:23:59.852219    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk" podUID="d08e991b-96d2-429d-8aed-3c7081b043f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused"
Sep 10 21:24:00.852186 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:24:00.852148    2564 patch_prober.go:28] interesting pod/e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused" start-of-body=
Sep 10 21:24:00.852398 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:24:00.852210    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk" podUID="d08e991b-96d2-429d-8aed-3c7081b043f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused"
Sep 10 21:24:01.852341 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:24:01.852304    2564 patch_prober.go:28] interesting pod/e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused" start-of-body=
Sep 10 21:24:01.852529 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:24:01.852362    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk" podUID="d08e991b-96d2-429d-8aed-3c7081b043f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused"
Sep 10 21:24:02.851689 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:24:02.851647    2564 patch_prober.go:28] interesting pod/e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused" start-of-body=
Sep 10 21:24:02.851879 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:24:02.851708    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk" podUID="d08e991b-96d2-429d-8aed-3c7081b043f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused"
Sep 10 21:24:03.855342 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:24:03.855309    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk"
Sep 10 21:24:03.855740 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:24:03.855674    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk"
Sep 10 21:24:03.856266 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:24:03.856220    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk"
Sep 10 21:24:08.843465 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:24:08.843433    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-9f1286-54ccb98c7f-hlmdt_c7ce44eb-1fb7-44ca-a8d1-68d23fe0b724/payload-processing/0.log"
Sep 10 21:24:54.744503 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:24:54.744469    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-24b606-7fbf686cbf-g4255_fd2d985d-6d40-4988-92f9-231cd25f6b8b/payload-processing/0.log"
Sep 10 21:24:55.005519 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:24:55.005439    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-9f1286-54ccb98c7f-hlmdt_c7ce44eb-1fb7-44ca-a8d1-68d23fe0b724/payload-processing/0.log"
Sep 10 21:25:00.146010 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:00.145977    2564 scope.go:117] "RemoveContainer" containerID="de50ce30d2a5061cbc49cd4c73f32f312ade6228f73fcc880eeabb9205f971c2"
Sep 10 21:25:00.843123 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:00.843091    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-1ca93e-75799cbfbb-xffjn"]
Sep 10 21:25:00.848129 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:00.848106    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-1ca93e-75799cbfbb-xffjn"
Sep 10 21:25:00.851492 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:00.851470    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-1ca93e-dockercfg-7pxwt\""
Sep 10 21:25:00.851912 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:00.851893    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-1ca93e\""
Sep 10 21:25:00.863678 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:00.863652    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-1ca93e-75799cbfbb-xffjn"]
Sep 10 21:25:00.946926 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:00.946713    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpmcg\" (UniqueName: \"kubernetes.io/projected/e050b413-55eb-4021-a33e-9cedf87e72d5-kube-api-access-lpmcg\") pod \"payload-pre-processing-e2e-ipp-cleanup-1ca93e-75799cbfbb-xffjn\" (UID: \"e050b413-55eb-4021-a33e-9cedf87e72d5\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-1ca93e-75799cbfbb-xffjn"
Sep 10 21:25:00.946926 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:00.946777    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e050b413-55eb-4021-a33e-9cedf87e72d5-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-1ca93e-75799cbfbb-xffjn\" (UID: \"e050b413-55eb-4021-a33e-9cedf87e72d5\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-1ca93e-75799cbfbb-xffjn"
Sep 10 21:25:01.047806 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:01.047769    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpmcg\" (UniqueName: \"kubernetes.io/projected/e050b413-55eb-4021-a33e-9cedf87e72d5-kube-api-access-lpmcg\") pod \"payload-pre-processing-e2e-ipp-cleanup-1ca93e-75799cbfbb-xffjn\" (UID: \"e050b413-55eb-4021-a33e-9cedf87e72d5\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-1ca93e-75799cbfbb-xffjn"
Sep 10 21:25:01.047975 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:01.047812    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e050b413-55eb-4021-a33e-9cedf87e72d5-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-1ca93e-75799cbfbb-xffjn\" (UID: \"e050b413-55eb-4021-a33e-9cedf87e72d5\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-1ca93e-75799cbfbb-xffjn"
Sep 10 21:25:01.048510 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:01.048491    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e050b413-55eb-4021-a33e-9cedf87e72d5-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-1ca93e-75799cbfbb-xffjn\" (UID: \"e050b413-55eb-4021-a33e-9cedf87e72d5\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-1ca93e-75799cbfbb-xffjn"
Sep 10 21:25:01.056727 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:01.056698    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpmcg\" (UniqueName: \"kubernetes.io/projected/e050b413-55eb-4021-a33e-9cedf87e72d5-kube-api-access-lpmcg\") pod \"payload-pre-processing-e2e-ipp-cleanup-1ca93e-75799cbfbb-xffjn\" (UID: \"e050b413-55eb-4021-a33e-9cedf87e72d5\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-1ca93e-75799cbfbb-xffjn"
Sep 10 21:25:01.158996 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:01.158915    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-1ca93e-75799cbfbb-xffjn"
Sep 10 21:25:01.435453 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:01.435429    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-1ca93e-75799cbfbb-xffjn"]
Sep 10 21:25:01.437102 ip-10-0-129-100 kubenswrapper[2564]: W0910 21:25:01.437062    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode050b413_55eb_4021_a33e_9cedf87e72d5.slice/crio-569215edc37274435b8086e8297ebef6588dda0e34f007f34d9a713b48013ac4 WatchSource:0}: Error finding container 569215edc37274435b8086e8297ebef6588dda0e34f007f34d9a713b48013ac4: Status 404 returned error can't find the container with id 569215edc37274435b8086e8297ebef6588dda0e34f007f34d9a713b48013ac4
Sep 10 21:25:02.260157 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:02.260117    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-1ca93e-75799cbfbb-xffjn" event={"ID":"e050b413-55eb-4021-a33e-9cedf87e72d5","Type":"ContainerStarted","Data":"9a109d92db55f0db7ce02d7837249da666fdd2ea245ea2ce318756b8749b2d8e"}
Sep 10 21:25:02.260603 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:02.260276    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-1ca93e-75799cbfbb-xffjn"
Sep 10 21:25:02.260603 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:02.260301    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-1ca93e-75799cbfbb-xffjn" event={"ID":"e050b413-55eb-4021-a33e-9cedf87e72d5","Type":"ContainerStarted","Data":"569215edc37274435b8086e8297ebef6588dda0e34f007f34d9a713b48013ac4"}
Sep 10 21:25:02.278279 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:02.278211    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-1ca93e-75799cbfbb-xffjn" podStartSLOduration=2.278195861 podStartE2EDuration="2.278195861s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:25:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:25:02.277270664 +0000 UTC m=+1682.964337944" watchObservedRunningTime="2026-09-10 21:25:02.278195861 +0000 UTC m=+1682.965263140"
Sep 10 21:25:13.269746 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:13.269714    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-1ca93e-75799cbfbb-xffjn"
Sep 10 21:25:24.660105 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:24.660027    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-1ca93e-pgmb5"]
Sep 10 21:25:24.663762 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:24.663745    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-1ca93e-pgmb5"
Sep 10 21:25:24.666203 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:24.666181    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 21:25:24.666312 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:24.666292    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-m5c7x\""
Sep 10 21:25:24.672326 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:24.672306    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-1ca93e-pgmb5"]
Sep 10 21:25:24.759888 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:24.759851    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e65ad92d-f397-481b-8a6d-a8c897d00c0b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-1ca93e-pgmb5\" (UID: \"e65ad92d-f397-481b-8a6d-a8c897d00c0b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-1ca93e-pgmb5"
Sep 10 21:25:24.860769 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:24.860738    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e65ad92d-f397-481b-8a6d-a8c897d00c0b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-1ca93e-pgmb5\" (UID: \"e65ad92d-f397-481b-8a6d-a8c897d00c0b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-1ca93e-pgmb5"
Sep 10 21:25:24.861382 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:24.861365    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e65ad92d-f397-481b-8a6d-a8c897d00c0b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-1ca93e-pgmb5\" (UID: \"e65ad92d-f397-481b-8a6d-a8c897d00c0b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-1ca93e-pgmb5"
Sep 10 21:25:24.974998 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:24.974938    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-1ca93e-pgmb5"
Sep 10 21:25:25.247017 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:25.246990    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-1ca93e-pgmb5"]
Sep 10 21:25:25.249364 ip-10-0-129-100 kubenswrapper[2564]: W0910 21:25:25.249337    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode65ad92d_f397_481b_8a6d_a8c897d00c0b.slice/crio-e02bca9a813ebf9db5f01268ff303a4a296756ad626c67ca9504324462070669 WatchSource:0}: Error finding container e02bca9a813ebf9db5f01268ff303a4a296756ad626c67ca9504324462070669: Status 404 returned error can't find the container with id e02bca9a813ebf9db5f01268ff303a4a296756ad626c67ca9504324462070669
Sep 10 21:25:25.398673 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:25.398629    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-1ca93e-pgmb5" event={"ID":"e65ad92d-f397-481b-8a6d-a8c897d00c0b","Type":"ContainerStarted","Data":"e02bca9a813ebf9db5f01268ff303a4a296756ad626c67ca9504324462070669"}
Sep 10 21:25:26.406123 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:26.406089    2564 generic.go:356] "Generic (PLEG): container finished" podID="e65ad92d-f397-481b-8a6d-a8c897d00c0b" containerID="c20f5c028ce79cf6803cc4f2d920893bfdbde980674f9bf158664de3fb44bf93" exitCode=0
Sep 10 21:25:26.406627 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:26.406174    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-1ca93e-pgmb5" event={"ID":"e65ad92d-f397-481b-8a6d-a8c897d00c0b","Type":"ContainerDied","Data":"c20f5c028ce79cf6803cc4f2d920893bfdbde980674f9bf158664de3fb44bf93"}
Sep 10 21:25:27.554357 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:27.554330    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-1ca93e-pgmb5"
Sep 10 21:25:27.587872 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:27.587844    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e65ad92d-f397-481b-8a6d-a8c897d00c0b-maas-api-service-ca\") pod \"e65ad92d-f397-481b-8a6d-a8c897d00c0b\" (UID: \"e65ad92d-f397-481b-8a6d-a8c897d00c0b\") "
Sep 10 21:25:27.588158 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:27.588136    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e65ad92d-f397-481b-8a6d-a8c897d00c0b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e65ad92d-f397-481b-8a6d-a8c897d00c0b" (UID: "e65ad92d-f397-481b-8a6d-a8c897d00c0b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:25:27.689211 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:27.689156    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e65ad92d-f397-481b-8a6d-a8c897d00c0b-maas-api-service-ca\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:25:28.418988 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:28.418958    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-1ca93e-pgmb5"
Sep 10 21:25:28.418988 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:28.418977    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-1ca93e-pgmb5" event={"ID":"e65ad92d-f397-481b-8a6d-a8c897d00c0b","Type":"ContainerDied","Data":"e02bca9a813ebf9db5f01268ff303a4a296756ad626c67ca9504324462070669"}
Sep 10 21:25:28.419198 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:28.419027    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e02bca9a813ebf9db5f01268ff303a4a296756ad626c67ca9504324462070669"
Sep 10 21:25:31.043060 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:31.043029    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-1ca93e-75799cbfbb-xffjn"]
Sep 10 21:25:31.043551 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:31.043260    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-1ca93e-75799cbfbb-xffjn" podUID="e050b413-55eb-4021-a33e-9cedf87e72d5" containerName="payload-pre-processing" containerID="cri-o://9a109d92db55f0db7ce02d7837249da666fdd2ea245ea2ce318756b8749b2d8e" gracePeriod=30
Sep 10 21:25:31.270082 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:31.270045    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-1ca93e-pgmb5"]
Sep 10 21:25:31.274054 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:31.274022    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-1ca93e-pgmb5"]
Sep 10 21:25:31.316087 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:31.316064    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-1ca93e-75799cbfbb-xffjn"
Sep 10 21:25:31.433241 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:31.433210    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e050b413-55eb-4021-a33e-9cedf87e72d5-plugins-config-volume\") pod \"e050b413-55eb-4021-a33e-9cedf87e72d5\" (UID: \"e050b413-55eb-4021-a33e-9cedf87e72d5\") "
Sep 10 21:25:31.433424 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:31.433298    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lpmcg\" (UniqueName: \"kubernetes.io/projected/e050b413-55eb-4021-a33e-9cedf87e72d5-kube-api-access-lpmcg\") pod \"e050b413-55eb-4021-a33e-9cedf87e72d5\" (UID: \"e050b413-55eb-4021-a33e-9cedf87e72d5\") "
Sep 10 21:25:31.433648 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:31.433624    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e050b413-55eb-4021-a33e-9cedf87e72d5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e050b413-55eb-4021-a33e-9cedf87e72d5" (UID: "e050b413-55eb-4021-a33e-9cedf87e72d5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:25:31.435511 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:31.435484    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e050b413-55eb-4021-a33e-9cedf87e72d5-kube-api-access-lpmcg" (OuterVolumeSpecName: "kube-api-access-lpmcg") pod "e050b413-55eb-4021-a33e-9cedf87e72d5" (UID: "e050b413-55eb-4021-a33e-9cedf87e72d5"). InnerVolumeSpecName "kube-api-access-lpmcg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:25:31.437688 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:31.437396    2564 generic.go:356] "Generic (PLEG): container finished" podID="e050b413-55eb-4021-a33e-9cedf87e72d5" containerID="9a109d92db55f0db7ce02d7837249da666fdd2ea245ea2ce318756b8749b2d8e" exitCode=0
Sep 10 21:25:31.437688 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:31.437445    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-1ca93e-75799cbfbb-xffjn"
Sep 10 21:25:31.437688 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:31.437448    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-1ca93e-75799cbfbb-xffjn" event={"ID":"e050b413-55eb-4021-a33e-9cedf87e72d5","Type":"ContainerDied","Data":"9a109d92db55f0db7ce02d7837249da666fdd2ea245ea2ce318756b8749b2d8e"}
Sep 10 21:25:31.437688 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:31.437519    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-1ca93e-75799cbfbb-xffjn" event={"ID":"e050b413-55eb-4021-a33e-9cedf87e72d5","Type":"ContainerDied","Data":"569215edc37274435b8086e8297ebef6588dda0e34f007f34d9a713b48013ac4"}
Sep 10 21:25:31.437688 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:31.437551    2564 scope.go:117] "RemoveContainer" containerID="9a109d92db55f0db7ce02d7837249da666fdd2ea245ea2ce318756b8749b2d8e"
Sep 10 21:25:31.448054 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:31.448039    2564 scope.go:117] "RemoveContainer" containerID="9a109d92db55f0db7ce02d7837249da666fdd2ea245ea2ce318756b8749b2d8e"
Sep 10 21:25:31.448348 ip-10-0-129-100 kubenswrapper[2564]: E0910 21:25:31.448330    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a109d92db55f0db7ce02d7837249da666fdd2ea245ea2ce318756b8749b2d8e\": container with ID starting with 9a109d92db55f0db7ce02d7837249da666fdd2ea245ea2ce318756b8749b2d8e not found: ID does not exist" containerID="9a109d92db55f0db7ce02d7837249da666fdd2ea245ea2ce318756b8749b2d8e"
Sep 10 21:25:31.448420 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:31.448356    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a109d92db55f0db7ce02d7837249da666fdd2ea245ea2ce318756b8749b2d8e"} err="failed to get container status \"9a109d92db55f0db7ce02d7837249da666fdd2ea245ea2ce318756b8749b2d8e\": rpc error: code = NotFound desc = could not find container \"9a109d92db55f0db7ce02d7837249da666fdd2ea245ea2ce318756b8749b2d8e\": container with ID starting with 9a109d92db55f0db7ce02d7837249da666fdd2ea245ea2ce318756b8749b2d8e not found: ID does not exist"
Sep 10 21:25:31.459895 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:31.459869    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-1ca93e-75799cbfbb-xffjn"]
Sep 10 21:25:31.463952 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:31.463932    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-1ca93e-75799cbfbb-xffjn"]
Sep 10 21:25:31.534441 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:31.534420    2564 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e050b413-55eb-4021-a33e-9cedf87e72d5-plugins-config-volume\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:25:31.534441 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:31.534442    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lpmcg\" (UniqueName: \"kubernetes.io/projected/e050b413-55eb-4021-a33e-9cedf87e72d5-kube-api-access-lpmcg\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:25:31.873835 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:31.873806    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e050b413-55eb-4021-a33e-9cedf87e72d5" path="/var/lib/kubelet/pods/e050b413-55eb-4021-a33e-9cedf87e72d5/volumes"
Sep 10 21:25:31.874148 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:31.874136    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e65ad92d-f397-481b-8a6d-a8c897d00c0b" path="/var/lib/kubelet/pods/e65ad92d-f397-481b-8a6d-a8c897d00c0b/volumes"
Sep 10 21:25:41.736269 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:41.736221    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-24b606-6cf5q"]
Sep 10 21:25:41.736633 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:41.736613    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e050b413-55eb-4021-a33e-9cedf87e72d5" containerName="payload-pre-processing"
Sep 10 21:25:41.736633 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:41.736627    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e050b413-55eb-4021-a33e-9cedf87e72d5" containerName="payload-pre-processing"
Sep 10 21:25:41.736709 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:41.736639    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e65ad92d-f397-481b-8a6d-a8c897d00c0b" containerName="revoke-keys"
Sep 10 21:25:41.736709 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:41.736646    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e65ad92d-f397-481b-8a6d-a8c897d00c0b" containerName="revoke-keys"
Sep 10 21:25:41.736767 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:41.736720    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e65ad92d-f397-481b-8a6d-a8c897d00c0b" containerName="revoke-keys"
Sep 10 21:25:41.736767 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:41.736729    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e050b413-55eb-4021-a33e-9cedf87e72d5" containerName="payload-pre-processing"
Sep 10 21:25:41.740768 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:41.740748    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-24b606-6cf5q"
Sep 10 21:25:41.743424 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:41.743399    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 21:25:41.743727 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:41.743708    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-m5c7x\""
Sep 10 21:25:41.749756 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:41.749728    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-24b606-6cf5q"]
Sep 10 21:25:41.827691 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:41.827660    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a72aa46d-0c4f-47c3-829d-601de5600222-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-24b606-6cf5q\" (UID: \"a72aa46d-0c4f-47c3-829d-601de5600222\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-24b606-6cf5q"
Sep 10 21:25:41.928612 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:41.928567    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a72aa46d-0c4f-47c3-829d-601de5600222-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-24b606-6cf5q\" (UID: \"a72aa46d-0c4f-47c3-829d-601de5600222\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-24b606-6cf5q"
Sep 10 21:25:41.929196 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:41.929175    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a72aa46d-0c4f-47c3-829d-601de5600222-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-24b606-6cf5q\" (UID: \"a72aa46d-0c4f-47c3-829d-601de5600222\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-24b606-6cf5q"
Sep 10 21:25:42.052545 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:42.052515    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-24b606-6cf5q"
Sep 10 21:25:42.324340 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:42.324312    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-24b606-6cf5q"]
Sep 10 21:25:42.325514 ip-10-0-129-100 kubenswrapper[2564]: W0910 21:25:42.325489    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda72aa46d_0c4f_47c3_829d_601de5600222.slice/crio-94e2bd2c92702a3bc04956ccb1de0969259827a0e7ce97a3af801cd78015c0b8 WatchSource:0}: Error finding container 94e2bd2c92702a3bc04956ccb1de0969259827a0e7ce97a3af801cd78015c0b8: Status 404 returned error can't find the container with id 94e2bd2c92702a3bc04956ccb1de0969259827a0e7ce97a3af801cd78015c0b8
Sep 10 21:25:42.506922 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:42.506893    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-24b606-6cf5q" event={"ID":"a72aa46d-0c4f-47c3-829d-601de5600222","Type":"ContainerStarted","Data":"94e2bd2c92702a3bc04956ccb1de0969259827a0e7ce97a3af801cd78015c0b8"}
Sep 10 21:25:43.513929 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:43.513893    2564 generic.go:356] "Generic (PLEG): container finished" podID="a72aa46d-0c4f-47c3-829d-601de5600222" containerID="4c56d703e46bc96eed4cae2db0895228acc91fc97ac39c1d3de499ea263f06e4" exitCode=0
Sep 10 21:25:43.514367 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:43.513986    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-24b606-6cf5q" event={"ID":"a72aa46d-0c4f-47c3-829d-601de5600222","Type":"ContainerDied","Data":"4c56d703e46bc96eed4cae2db0895228acc91fc97ac39c1d3de499ea263f06e4"}
Sep 10 21:25:44.650837 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:44.650807    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-24b606-6cf5q"
Sep 10 21:25:44.755907 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:44.755872    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a72aa46d-0c4f-47c3-829d-601de5600222-maas-api-service-ca\") pod \"a72aa46d-0c4f-47c3-829d-601de5600222\" (UID: \"a72aa46d-0c4f-47c3-829d-601de5600222\") "
Sep 10 21:25:44.756270 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:44.756221    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a72aa46d-0c4f-47c3-829d-601de5600222-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a72aa46d-0c4f-47c3-829d-601de5600222" (UID: "a72aa46d-0c4f-47c3-829d-601de5600222"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:25:44.857287 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:44.857250    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a72aa46d-0c4f-47c3-829d-601de5600222-maas-api-service-ca\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:25:45.526448 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:45.526411    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-24b606-6cf5q"
Sep 10 21:25:45.526632 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:45.526443    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-24b606-6cf5q" event={"ID":"a72aa46d-0c4f-47c3-829d-601de5600222","Type":"ContainerDied","Data":"94e2bd2c92702a3bc04956ccb1de0969259827a0e7ce97a3af801cd78015c0b8"}
Sep 10 21:25:45.526632 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:45.526494    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="94e2bd2c92702a3bc04956ccb1de0969259827a0e7ce97a3af801cd78015c0b8"
Sep 10 21:25:57.429704 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:57.429668    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-24b606-7fbf686cbf-g4255"]
Sep 10 21:25:57.430293 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:57.429924    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-24b606-7fbf686cbf-g4255" podUID="fd2d985d-6d40-4988-92f9-231cd25f6b8b" containerName="payload-processing" containerID="cri-o://044a881cd2778009dbfa2d4c3a311c0306382e7f858d5c1fe8e90daa8e4e923c" gracePeriod=30
Sep 10 21:25:57.440692 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:57.440660    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-24b606-f6f74f8cd-ltw49"]
Sep 10 21:25:57.440937 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:57.440907    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-24b606-f6f74f8cd-ltw49" podUID="23ad906e-1fb4-4b6d-8608-aa52c7917b31" containerName="payload-pre-processing" containerID="cri-o://4540f3b4a3a8189d6cdd47a457be6f05998708632c786c6080625f4f5e864f79" gracePeriod=30
Sep 10 21:25:57.600380 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:57.600338    2564 generic.go:356] "Generic (PLEG): container finished" podID="23ad906e-1fb4-4b6d-8608-aa52c7917b31" containerID="4540f3b4a3a8189d6cdd47a457be6f05998708632c786c6080625f4f5e864f79" exitCode=0
Sep 10 21:25:57.600380 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:57.600365    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-24b606-f6f74f8cd-ltw49" event={"ID":"23ad906e-1fb4-4b6d-8608-aa52c7917b31","Type":"ContainerDied","Data":"4540f3b4a3a8189d6cdd47a457be6f05998708632c786c6080625f4f5e864f79"}
Sep 10 21:25:57.602174 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:57.602142    2564 generic.go:356] "Generic (PLEG): container finished" podID="fd2d985d-6d40-4988-92f9-231cd25f6b8b" containerID="044a881cd2778009dbfa2d4c3a311c0306382e7f858d5c1fe8e90daa8e4e923c" exitCode=0
Sep 10 21:25:57.602330 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:57.602266    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-24b606-7fbf686cbf-g4255" event={"ID":"fd2d985d-6d40-4988-92f9-231cd25f6b8b","Type":"ContainerDied","Data":"044a881cd2778009dbfa2d4c3a311c0306382e7f858d5c1fe8e90daa8e4e923c"}
Sep 10 21:25:57.703203 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:57.703169    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-24b606-7fbf686cbf-g4255"
Sep 10 21:25:57.719621 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:57.719596    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-24b606-f6f74f8cd-ltw49"
Sep 10 21:25:57.757692 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:57.757658    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-24b606-6cf5q"]
Sep 10 21:25:57.766133 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:57.766097    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-24b606-6cf5q"]
Sep 10 21:25:57.873282 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:57.873248    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a72aa46d-0c4f-47c3-829d-601de5600222" path="/var/lib/kubelet/pods/a72aa46d-0c4f-47c3-829d-601de5600222/volumes"
Sep 10 21:25:57.875605 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:57.875582    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9ppct\" (UniqueName: \"kubernetes.io/projected/23ad906e-1fb4-4b6d-8608-aa52c7917b31-kube-api-access-9ppct\") pod \"23ad906e-1fb4-4b6d-8608-aa52c7917b31\" (UID: \"23ad906e-1fb4-4b6d-8608-aa52c7917b31\") "
Sep 10 21:25:57.875768 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:57.875646    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/23ad906e-1fb4-4b6d-8608-aa52c7917b31-plugins-config-volume\") pod \"23ad906e-1fb4-4b6d-8608-aa52c7917b31\" (UID: \"23ad906e-1fb4-4b6d-8608-aa52c7917b31\") "
Sep 10 21:25:57.875768 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:57.875672    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dzwlt\" (UniqueName: \"kubernetes.io/projected/fd2d985d-6d40-4988-92f9-231cd25f6b8b-kube-api-access-dzwlt\") pod \"fd2d985d-6d40-4988-92f9-231cd25f6b8b\" (UID: \"fd2d985d-6d40-4988-92f9-231cd25f6b8b\") "
Sep 10 21:25:57.875768 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:57.875698    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd2d985d-6d40-4988-92f9-231cd25f6b8b-plugins-config-volume\") pod \"fd2d985d-6d40-4988-92f9-231cd25f6b8b\" (UID: \"fd2d985d-6d40-4988-92f9-231cd25f6b8b\") "
Sep 10 21:25:57.876061 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:57.876031    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23ad906e-1fb4-4b6d-8608-aa52c7917b31-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "23ad906e-1fb4-4b6d-8608-aa52c7917b31" (UID: "23ad906e-1fb4-4b6d-8608-aa52c7917b31"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:25:57.876338 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:57.876309    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd2d985d-6d40-4988-92f9-231cd25f6b8b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fd2d985d-6d40-4988-92f9-231cd25f6b8b" (UID: "fd2d985d-6d40-4988-92f9-231cd25f6b8b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:25:57.877796 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:57.877776    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd2d985d-6d40-4988-92f9-231cd25f6b8b-kube-api-access-dzwlt" (OuterVolumeSpecName: "kube-api-access-dzwlt") pod "fd2d985d-6d40-4988-92f9-231cd25f6b8b" (UID: "fd2d985d-6d40-4988-92f9-231cd25f6b8b"). InnerVolumeSpecName "kube-api-access-dzwlt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:25:57.877874 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:57.877817    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23ad906e-1fb4-4b6d-8608-aa52c7917b31-kube-api-access-9ppct" (OuterVolumeSpecName: "kube-api-access-9ppct") pod "23ad906e-1fb4-4b6d-8608-aa52c7917b31" (UID: "23ad906e-1fb4-4b6d-8608-aa52c7917b31"). InnerVolumeSpecName "kube-api-access-9ppct". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:25:57.976939 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:57.976856    2564 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/23ad906e-1fb4-4b6d-8608-aa52c7917b31-plugins-config-volume\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:25:57.976939 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:57.976885    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dzwlt\" (UniqueName: \"kubernetes.io/projected/fd2d985d-6d40-4988-92f9-231cd25f6b8b-kube-api-access-dzwlt\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:25:57.976939 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:57.976894    2564 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd2d985d-6d40-4988-92f9-231cd25f6b8b-plugins-config-volume\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:25:57.976939 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:57.976903    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9ppct\" (UniqueName: \"kubernetes.io/projected/23ad906e-1fb4-4b6d-8608-aa52c7917b31-kube-api-access-9ppct\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:25:58.608985 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:58.608955    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-24b606-7fbf686cbf-g4255"
Sep 10 21:25:58.609461 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:58.608997    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-24b606-7fbf686cbf-g4255" event={"ID":"fd2d985d-6d40-4988-92f9-231cd25f6b8b","Type":"ContainerDied","Data":"a0eaa3dca2fea8910b50e53892b00df478be6c468ce16be7838dd083e64433b1"}
Sep 10 21:25:58.609461 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:58.609069    2564 scope.go:117] "RemoveContainer" containerID="044a881cd2778009dbfa2d4c3a311c0306382e7f858d5c1fe8e90daa8e4e923c"
Sep 10 21:25:58.610658 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:58.610631    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-24b606-f6f74f8cd-ltw49" event={"ID":"23ad906e-1fb4-4b6d-8608-aa52c7917b31","Type":"ContainerDied","Data":"530461cda11de696f0fb01795bfaac3be9469f27b5e1d41eee79b33ca20964ad"}
Sep 10 21:25:58.610745 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:58.610663    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-24b606-f6f74f8cd-ltw49"
Sep 10 21:25:58.618472 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:58.618452    2564 scope.go:117] "RemoveContainer" containerID="4540f3b4a3a8189d6cdd47a457be6f05998708632c786c6080625f4f5e864f79"
Sep 10 21:25:58.641014 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:58.640986    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-24b606-7fbf686cbf-g4255"]
Sep 10 21:25:58.643885 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:58.643863    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-24b606-7fbf686cbf-g4255"]
Sep 10 21:25:58.659993 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:58.659972    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-24b606-f6f74f8cd-ltw49"]
Sep 10 21:25:58.667111 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:58.667091    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-24b606-f6f74f8cd-ltw49"]
Sep 10 21:25:59.874524 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:59.874486    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23ad906e-1fb4-4b6d-8608-aa52c7917b31" path="/var/lib/kubelet/pods/23ad906e-1fb4-4b6d-8608-aa52c7917b31/volumes"
Sep 10 21:25:59.874992 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:25:59.874856    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd2d985d-6d40-4988-92f9-231cd25f6b8b" path="/var/lib/kubelet/pods/fd2d985d-6d40-4988-92f9-231cd25f6b8b/volumes"
Sep 10 21:26:48.872658 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:26:48.872620    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9f1286-6g5m2"]
Sep 10 21:26:48.873146 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:26:48.872990    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd2d985d-6d40-4988-92f9-231cd25f6b8b" containerName="payload-processing"
Sep 10 21:26:48.873146 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:26:48.873002    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd2d985d-6d40-4988-92f9-231cd25f6b8b" containerName="payload-processing"
Sep 10 21:26:48.873146 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:26:48.873012    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a72aa46d-0c4f-47c3-829d-601de5600222" containerName="revoke-keys"
Sep 10 21:26:48.873146 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:26:48.873017    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a72aa46d-0c4f-47c3-829d-601de5600222" containerName="revoke-keys"
Sep 10 21:26:48.873146 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:26:48.873027    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23ad906e-1fb4-4b6d-8608-aa52c7917b31" containerName="payload-pre-processing"
Sep 10 21:26:48.873146 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:26:48.873034    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="23ad906e-1fb4-4b6d-8608-aa52c7917b31" containerName="payload-pre-processing"
Sep 10 21:26:48.873146 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:26:48.873085    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a72aa46d-0c4f-47c3-829d-601de5600222" containerName="revoke-keys"
Sep 10 21:26:48.873146 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:26:48.873096    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd2d985d-6d40-4988-92f9-231cd25f6b8b" containerName="payload-processing"
Sep 10 21:26:48.873146 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:26:48.873103    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="23ad906e-1fb4-4b6d-8608-aa52c7917b31" containerName="payload-pre-processing"
Sep 10 21:26:48.876218 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:26:48.876194    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9f1286-6g5m2"
Sep 10 21:26:48.879362 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:26:48.879334    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 21:26:48.879463 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:26:48.879359    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-m5c7x\""
Sep 10 21:26:48.889567 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:26:48.889540    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9f1286-6g5m2"]
Sep 10 21:26:49.044165 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:26:49.044127    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eaf93130-6733-4405-a8df-09d7478fcbb7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-9f1286-6g5m2\" (UID: \"eaf93130-6733-4405-a8df-09d7478fcbb7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9f1286-6g5m2"
Sep 10 21:26:49.145554 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:26:49.145458    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eaf93130-6733-4405-a8df-09d7478fcbb7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-9f1286-6g5m2\" (UID: \"eaf93130-6733-4405-a8df-09d7478fcbb7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9f1286-6g5m2"
Sep 10 21:26:49.146094 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:26:49.146073    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eaf93130-6733-4405-a8df-09d7478fcbb7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-9f1286-6g5m2\" (UID: \"eaf93130-6733-4405-a8df-09d7478fcbb7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9f1286-6g5m2"
Sep 10 21:26:49.187010 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:26:49.186961    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9f1286-6g5m2"
Sep 10 21:26:49.486759 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:26:49.486127    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9f1286-6g5m2"]
Sep 10 21:26:49.492946 ip-10-0-129-100 kubenswrapper[2564]: W0910 21:26:49.492907    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeaf93130_6733_4405_a8df_09d7478fcbb7.slice/crio-4f4332c48c1f37443d4fb9fa91f94be591ffc9b723b3ead22cfbd616716a3f64 WatchSource:0}: Error finding container 4f4332c48c1f37443d4fb9fa91f94be591ffc9b723b3ead22cfbd616716a3f64: Status 404 returned error can't find the container with id 4f4332c48c1f37443d4fb9fa91f94be591ffc9b723b3ead22cfbd616716a3f64
Sep 10 21:26:49.900419 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:26:49.900378    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9f1286-6g5m2" event={"ID":"eaf93130-6733-4405-a8df-09d7478fcbb7","Type":"ContainerStarted","Data":"49f09043676652401022bb8aa71a42d21ec699f19d5f32e3aa034ab4df5fcc7c"}
Sep 10 21:26:49.900816 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:26:49.900436    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9f1286-6g5m2" event={"ID":"eaf93130-6733-4405-a8df-09d7478fcbb7","Type":"ContainerStarted","Data":"4f4332c48c1f37443d4fb9fa91f94be591ffc9b723b3ead22cfbd616716a3f64"}
Sep 10 21:26:49.941977 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:26:49.941918    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9f1286-6g5m2" podStartSLOduration=1.941902153 podStartE2EDuration="1.941902153s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:26:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:26:49.939896356 +0000 UTC m=+1790.626963636" watchObservedRunningTime="2026-09-10 21:26:49.941902153 +0000 UTC m=+1790.628969488"
Sep 10 21:26:50.907338 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:26:50.907303    2564 generic.go:356] "Generic (PLEG): container finished" podID="eaf93130-6733-4405-a8df-09d7478fcbb7" containerID="49f09043676652401022bb8aa71a42d21ec699f19d5f32e3aa034ab4df5fcc7c" exitCode=0
Sep 10 21:26:50.907722 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:26:50.907393    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9f1286-6g5m2" event={"ID":"eaf93130-6733-4405-a8df-09d7478fcbb7","Type":"ContainerDied","Data":"49f09043676652401022bb8aa71a42d21ec699f19d5f32e3aa034ab4df5fcc7c"}
Sep 10 21:26:52.048714 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:26:52.048687    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9f1286-6g5m2"
Sep 10 21:26:52.068304 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:26:52.068274    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eaf93130-6733-4405-a8df-09d7478fcbb7-maas-api-service-ca\") pod \"eaf93130-6733-4405-a8df-09d7478fcbb7\" (UID: \"eaf93130-6733-4405-a8df-09d7478fcbb7\") "
Sep 10 21:26:52.068644 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:26:52.068617    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eaf93130-6733-4405-a8df-09d7478fcbb7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "eaf93130-6733-4405-a8df-09d7478fcbb7" (UID: "eaf93130-6733-4405-a8df-09d7478fcbb7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:26:52.169185 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:26:52.169095    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eaf93130-6733-4405-a8df-09d7478fcbb7-maas-api-service-ca\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:26:52.920071 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:26:52.920039    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9f1286-6g5m2"
Sep 10 21:26:52.920071 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:26:52.920056    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9f1286-6g5m2" event={"ID":"eaf93130-6733-4405-a8df-09d7478fcbb7","Type":"ContainerDied","Data":"4f4332c48c1f37443d4fb9fa91f94be591ffc9b723b3ead22cfbd616716a3f64"}
Sep 10 21:26:52.920366 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:26:52.920098    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4f4332c48c1f37443d4fb9fa91f94be591ffc9b723b3ead22cfbd616716a3f64"
Sep 10 21:27:00.024997 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:00.024960    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-9f1286-54ccb98c7f-hlmdt"]
Sep 10 21:27:00.025505 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:00.025176    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-9f1286-54ccb98c7f-hlmdt" podUID="c7ce44eb-1fb7-44ca-a8d1-68d23fe0b724" containerName="payload-processing" containerID="cri-o://a9c688a978381120a7030280163e15f2dfec69ea6c8e4c07513cec4203450403" gracePeriod=30
Sep 10 21:27:00.287666 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:00.287601    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-9f1286-54ccb98c7f-hlmdt"
Sep 10 21:27:00.334000 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:00.333970    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c7ce44eb-1fb7-44ca-a8d1-68d23fe0b724-plugins-config-volume\") pod \"c7ce44eb-1fb7-44ca-a8d1-68d23fe0b724\" (UID: \"c7ce44eb-1fb7-44ca-a8d1-68d23fe0b724\") "
Sep 10 21:27:00.334193 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:00.334024    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-265bm\" (UniqueName: \"kubernetes.io/projected/c7ce44eb-1fb7-44ca-a8d1-68d23fe0b724-kube-api-access-265bm\") pod \"c7ce44eb-1fb7-44ca-a8d1-68d23fe0b724\" (UID: \"c7ce44eb-1fb7-44ca-a8d1-68d23fe0b724\") "
Sep 10 21:27:00.336316 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:00.334821    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7ce44eb-1fb7-44ca-a8d1-68d23fe0b724-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c7ce44eb-1fb7-44ca-a8d1-68d23fe0b724" (UID: "c7ce44eb-1fb7-44ca-a8d1-68d23fe0b724"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:27:00.341979 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:00.341850    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7ce44eb-1fb7-44ca-a8d1-68d23fe0b724-kube-api-access-265bm" (OuterVolumeSpecName: "kube-api-access-265bm") pod "c7ce44eb-1fb7-44ca-a8d1-68d23fe0b724" (UID: "c7ce44eb-1fb7-44ca-a8d1-68d23fe0b724"). InnerVolumeSpecName "kube-api-access-265bm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:27:00.435736 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:00.435695    2564 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c7ce44eb-1fb7-44ca-a8d1-68d23fe0b724-plugins-config-volume\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:27:00.435736 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:00.435726    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-265bm\" (UniqueName: \"kubernetes.io/projected/c7ce44eb-1fb7-44ca-a8d1-68d23fe0b724-kube-api-access-265bm\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:27:00.467152 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:00.467116    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9f1286-6g5m2"]
Sep 10 21:27:00.474746 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:00.474713    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9f1286-6g5m2"]
Sep 10 21:27:00.965437 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:00.965398    2564 generic.go:356] "Generic (PLEG): container finished" podID="c7ce44eb-1fb7-44ca-a8d1-68d23fe0b724" containerID="a9c688a978381120a7030280163e15f2dfec69ea6c8e4c07513cec4203450403" exitCode=0
Sep 10 21:27:00.965632 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:00.965454    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-9f1286-54ccb98c7f-hlmdt"
Sep 10 21:27:00.965632 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:00.965501    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-9f1286-54ccb98c7f-hlmdt" event={"ID":"c7ce44eb-1fb7-44ca-a8d1-68d23fe0b724","Type":"ContainerDied","Data":"a9c688a978381120a7030280163e15f2dfec69ea6c8e4c07513cec4203450403"}
Sep 10 21:27:00.965632 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:00.965567    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-9f1286-54ccb98c7f-hlmdt" event={"ID":"c7ce44eb-1fb7-44ca-a8d1-68d23fe0b724","Type":"ContainerDied","Data":"09cd681fdfd4f450f14a527dbe72cbf060cf4a7ff7364078fa8c5ef8618bb803"}
Sep 10 21:27:00.965632 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:00.965597    2564 scope.go:117] "RemoveContainer" containerID="a9c688a978381120a7030280163e15f2dfec69ea6c8e4c07513cec4203450403"
Sep 10 21:27:00.977118 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:00.977094    2564 scope.go:117] "RemoveContainer" containerID="a9c688a978381120a7030280163e15f2dfec69ea6c8e4c07513cec4203450403"
Sep 10 21:27:00.977455 ip-10-0-129-100 kubenswrapper[2564]: E0910 21:27:00.977428    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9c688a978381120a7030280163e15f2dfec69ea6c8e4c07513cec4203450403\": container with ID starting with a9c688a978381120a7030280163e15f2dfec69ea6c8e4c07513cec4203450403 not found: ID does not exist" containerID="a9c688a978381120a7030280163e15f2dfec69ea6c8e4c07513cec4203450403"
Sep 10 21:27:00.977550 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:00.977470    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9c688a978381120a7030280163e15f2dfec69ea6c8e4c07513cec4203450403"} err="failed to get container status \"a9c688a978381120a7030280163e15f2dfec69ea6c8e4c07513cec4203450403\": rpc error: code = NotFound desc = could not find container \"a9c688a978381120a7030280163e15f2dfec69ea6c8e4c07513cec4203450403\": container with ID starting with a9c688a978381120a7030280163e15f2dfec69ea6c8e4c07513cec4203450403 not found: ID does not exist"
Sep 10 21:27:00.995790 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:00.995759    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-9f1286-54ccb98c7f-hlmdt"]
Sep 10 21:27:00.999184 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:00.999160    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-9f1286-54ccb98c7f-hlmdt"]
Sep 10 21:27:01.273519 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:01.273432    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-cd9hp_0432bad8-86f5-4b0e-a0d4-2fdb728223f2/console-operator/2.log"
Sep 10 21:27:01.280277 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:01.280222    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-cd9hp_0432bad8-86f5-4b0e-a0d4-2fdb728223f2/console-operator/2.log"
Sep 10 21:27:01.280761 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:01.280738    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wrbhk_279e54f7-0db1-4e2d-a998-4b3ecdf992cd/ovn-acl-logging/0.log"
Sep 10 21:27:01.286915 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:01.286896    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wrbhk_279e54f7-0db1-4e2d-a998-4b3ecdf992cd/ovn-acl-logging/0.log"
Sep 10 21:27:01.874691 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:01.874654    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7ce44eb-1fb7-44ca-a8d1-68d23fe0b724" path="/var/lib/kubelet/pods/c7ce44eb-1fb7-44ca-a8d1-68d23fe0b724/volumes"
Sep 10 21:27:01.874992 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:01.874979    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eaf93130-6733-4405-a8df-09d7478fcbb7" path="/var/lib/kubelet/pods/eaf93130-6733-4405-a8df-09d7478fcbb7/volumes"
Sep 10 21:27:07.895963 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:07.895931    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk"]
Sep 10 21:27:07.896384 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:07.896133    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk" podUID="d08e991b-96d2-429d-8aed-3c7081b043f1" containerName="istio-proxy" containerID="cri-o://d747f5d035f74d9488ce8e1dfb82fd2f3c29bc58f4b6aaff730d4b6df8b87c40" gracePeriod=30
Sep 10 21:27:08.303137 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:08.303104    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-af7150-nm9t5"]
Sep 10 21:27:08.303486 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:08.303472    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7ce44eb-1fb7-44ca-a8d1-68d23fe0b724" containerName="payload-processing"
Sep 10 21:27:08.303534 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:08.303488    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7ce44eb-1fb7-44ca-a8d1-68d23fe0b724" containerName="payload-processing"
Sep 10 21:27:08.303534 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:08.303512    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eaf93130-6733-4405-a8df-09d7478fcbb7" containerName="revoke-keys"
Sep 10 21:27:08.303534 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:08.303517    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="eaf93130-6733-4405-a8df-09d7478fcbb7" containerName="revoke-keys"
Sep 10 21:27:08.303636 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:08.303582    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="eaf93130-6733-4405-a8df-09d7478fcbb7" containerName="revoke-keys"
Sep 10 21:27:08.303636 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:08.303590    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7ce44eb-1fb7-44ca-a8d1-68d23fe0b724" containerName="payload-processing"
Sep 10 21:27:08.306680 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:08.306662    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-af7150-nm9t5"
Sep 10 21:27:08.311092 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:08.311069    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-m5c7x\""
Sep 10 21:27:08.311222 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:08.311110    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 21:27:08.325250 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:08.325207    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-af7150-nm9t5"]
Sep 10 21:27:08.414615 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:08.414578    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1fe2b899-0c3c-4540-bd3f-46c48e900613-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-af7150-nm9t5\" (UID: \"1fe2b899-0c3c-4540-bd3f-46c48e900613\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-af7150-nm9t5"
Sep 10 21:27:08.515910 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:08.515869    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1fe2b899-0c3c-4540-bd3f-46c48e900613-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-af7150-nm9t5\" (UID: \"1fe2b899-0c3c-4540-bd3f-46c48e900613\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-af7150-nm9t5"
Sep 10 21:27:08.516552 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:08.516534    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1fe2b899-0c3c-4540-bd3f-46c48e900613-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-af7150-nm9t5\" (UID: \"1fe2b899-0c3c-4540-bd3f-46c48e900613\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-af7150-nm9t5"
Sep 10 21:27:08.617193 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:08.617161    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-af7150-nm9t5"
Sep 10 21:27:08.904005 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:08.903976    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-af7150-nm9t5"]
Sep 10 21:27:08.904670 ip-10-0-129-100 kubenswrapper[2564]: W0910 21:27:08.904632    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fe2b899_0c3c_4540_bd3f_46c48e900613.slice/crio-15f3d71417b76a1a73b9fe3abf3f00d3b16b10e06efa64e83358cce406c97ac2 WatchSource:0}: Error finding container 15f3d71417b76a1a73b9fe3abf3f00d3b16b10e06efa64e83358cce406c97ac2: Status 404 returned error can't find the container with id 15f3d71417b76a1a73b9fe3abf3f00d3b16b10e06efa64e83358cce406c97ac2
Sep 10 21:27:09.017309 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:09.017270    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-af7150-nm9t5" event={"ID":"1fe2b899-0c3c-4540-bd3f-46c48e900613","Type":"ContainerStarted","Data":"15f3d71417b76a1a73b9fe3abf3f00d3b16b10e06efa64e83358cce406c97ac2"}
Sep 10 21:27:10.025419 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:10.025320    2564 generic.go:356] "Generic (PLEG): container finished" podID="1fe2b899-0c3c-4540-bd3f-46c48e900613" containerID="f0f42f52bed377e95a8a2378302c6c012329d9f8e025a9ba43759c5b526dc845" exitCode=0
Sep 10 21:27:10.025419 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:10.025357    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-af7150-nm9t5" event={"ID":"1fe2b899-0c3c-4540-bd3f-46c48e900613","Type":"ContainerDied","Data":"f0f42f52bed377e95a8a2378302c6c012329d9f8e025a9ba43759c5b526dc845"}
Sep 10 21:27:11.160982 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:11.160958    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-af7150-nm9t5"
Sep 10 21:27:11.240829 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:11.240794    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1fe2b899-0c3c-4540-bd3f-46c48e900613-maas-api-service-ca\") pod \"1fe2b899-0c3c-4540-bd3f-46c48e900613\" (UID: \"1fe2b899-0c3c-4540-bd3f-46c48e900613\") "
Sep 10 21:27:11.241200 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:11.241180    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1fe2b899-0c3c-4540-bd3f-46c48e900613-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1fe2b899-0c3c-4540-bd3f-46c48e900613" (UID: "1fe2b899-0c3c-4540-bd3f-46c48e900613"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:27:11.341647 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:11.341617    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1fe2b899-0c3c-4540-bd3f-46c48e900613-maas-api-service-ca\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:27:12.039403 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:12.039365    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-af7150-nm9t5" event={"ID":"1fe2b899-0c3c-4540-bd3f-46c48e900613","Type":"ContainerDied","Data":"15f3d71417b76a1a73b9fe3abf3f00d3b16b10e06efa64e83358cce406c97ac2"}
Sep 10 21:27:12.039607 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:12.039428    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="15f3d71417b76a1a73b9fe3abf3f00d3b16b10e06efa64e83358cce406c97ac2"
Sep 10 21:27:12.039607 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:12.039385    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-af7150-nm9t5"
Sep 10 21:27:13.048750 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:13.048720    2564 generic.go:356] "Generic (PLEG): container finished" podID="d08e991b-96d2-429d-8aed-3c7081b043f1" containerID="d747f5d035f74d9488ce8e1dfb82fd2f3c29bc58f4b6aaff730d4b6df8b87c40" exitCode=0
Sep 10 21:27:13.049279 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:13.048775    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk" event={"ID":"d08e991b-96d2-429d-8aed-3c7081b043f1","Type":"ContainerDied","Data":"d747f5d035f74d9488ce8e1dfb82fd2f3c29bc58f4b6aaff730d4b6df8b87c40"}
Sep 10 21:27:13.049279 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:13.048828    2564 scope.go:117] "RemoveContainer" containerID="9eafac2807b593aac179cc3600e53a7500375e7b22e070eb258b95af050a3328"
Sep 10 21:27:13.142936 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:13.142908    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk"
Sep 10 21:27:13.261146 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:13.261061    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d08e991b-96d2-429d-8aed-3c7081b043f1-istio-podinfo\") pod \"d08e991b-96d2-429d-8aed-3c7081b043f1\" (UID: \"d08e991b-96d2-429d-8aed-3c7081b043f1\") "
Sep 10 21:27:13.261146 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:13.261120    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d08e991b-96d2-429d-8aed-3c7081b043f1-istio-token\") pod \"d08e991b-96d2-429d-8aed-3c7081b043f1\" (UID: \"d08e991b-96d2-429d-8aed-3c7081b043f1\") "
Sep 10 21:27:13.261146 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:13.261142    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d08e991b-96d2-429d-8aed-3c7081b043f1-istio-envoy\") pod \"d08e991b-96d2-429d-8aed-3c7081b043f1\" (UID: \"d08e991b-96d2-429d-8aed-3c7081b043f1\") "
Sep 10 21:27:13.261471 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:13.261271    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d08e991b-96d2-429d-8aed-3c7081b043f1-istiod-ca-cert\") pod \"d08e991b-96d2-429d-8aed-3c7081b043f1\" (UID: \"d08e991b-96d2-429d-8aed-3c7081b043f1\") "
Sep 10 21:27:13.261471 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:13.261324    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d08e991b-96d2-429d-8aed-3c7081b043f1-credential-socket\") pod \"d08e991b-96d2-429d-8aed-3c7081b043f1\" (UID: \"d08e991b-96d2-429d-8aed-3c7081b043f1\") "
Sep 10 21:27:13.261471 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:13.261404    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wzfj9\" (UniqueName: \"kubernetes.io/projected/d08e991b-96d2-429d-8aed-3c7081b043f1-kube-api-access-wzfj9\") pod \"d08e991b-96d2-429d-8aed-3c7081b043f1\" (UID: \"d08e991b-96d2-429d-8aed-3c7081b043f1\") "
Sep 10 21:27:13.261471 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:13.261432    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d08e991b-96d2-429d-8aed-3c7081b043f1-workload-socket\") pod \"d08e991b-96d2-429d-8aed-3c7081b043f1\" (UID: \"d08e991b-96d2-429d-8aed-3c7081b043f1\") "
Sep 10 21:27:13.261471 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:13.261468    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d08e991b-96d2-429d-8aed-3c7081b043f1-workload-certs\") pod \"d08e991b-96d2-429d-8aed-3c7081b043f1\" (UID: \"d08e991b-96d2-429d-8aed-3c7081b043f1\") "
Sep 10 21:27:13.261716 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:13.261639    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d08e991b-96d2-429d-8aed-3c7081b043f1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d08e991b-96d2-429d-8aed-3c7081b043f1" (UID: "d08e991b-96d2-429d-8aed-3c7081b043f1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:27:13.261773 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:13.261739    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d08e991b-96d2-429d-8aed-3c7081b043f1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d08e991b-96d2-429d-8aed-3c7081b043f1" (UID: "d08e991b-96d2-429d-8aed-3c7081b043f1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:27:13.261773 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:13.261756    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d08e991b-96d2-429d-8aed-3c7081b043f1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d08e991b-96d2-429d-8aed-3c7081b043f1" (UID: "d08e991b-96d2-429d-8aed-3c7081b043f1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:27:13.261867 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:13.261774    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d08e991b-96d2-429d-8aed-3c7081b043f1-istio-data\") pod \"d08e991b-96d2-429d-8aed-3c7081b043f1\" (UID: \"d08e991b-96d2-429d-8aed-3c7081b043f1\") "
Sep 10 21:27:13.261867 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:13.261774    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d08e991b-96d2-429d-8aed-3c7081b043f1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d08e991b-96d2-429d-8aed-3c7081b043f1" (UID: "d08e991b-96d2-429d-8aed-3c7081b043f1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:27:13.261973 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:13.261953    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d08e991b-96d2-429d-8aed-3c7081b043f1-istio-data" (OuterVolumeSpecName: "istio-data") pod "d08e991b-96d2-429d-8aed-3c7081b043f1" (UID: "d08e991b-96d2-429d-8aed-3c7081b043f1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:27:13.262142 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:13.262123    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d08e991b-96d2-429d-8aed-3c7081b043f1-workload-socket\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:27:13.262181 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:13.262152    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d08e991b-96d2-429d-8aed-3c7081b043f1-workload-certs\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:27:13.262181 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:13.262167    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d08e991b-96d2-429d-8aed-3c7081b043f1-istio-data\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:27:13.262275 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:13.262181    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d08e991b-96d2-429d-8aed-3c7081b043f1-istiod-ca-cert\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:27:13.262275 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:13.262194    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d08e991b-96d2-429d-8aed-3c7081b043f1-credential-socket\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:27:13.263466 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:13.263446    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d08e991b-96d2-429d-8aed-3c7081b043f1-istio-token" (OuterVolumeSpecName: "istio-token") pod "d08e991b-96d2-429d-8aed-3c7081b043f1" (UID: "d08e991b-96d2-429d-8aed-3c7081b043f1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:27:13.263713 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:13.263681    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d08e991b-96d2-429d-8aed-3c7081b043f1-kube-api-access-wzfj9" (OuterVolumeSpecName: "kube-api-access-wzfj9") pod "d08e991b-96d2-429d-8aed-3c7081b043f1" (UID: "d08e991b-96d2-429d-8aed-3c7081b043f1"). InnerVolumeSpecName "kube-api-access-wzfj9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:27:13.263713 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:13.263701    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d08e991b-96d2-429d-8aed-3c7081b043f1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d08e991b-96d2-429d-8aed-3c7081b043f1" (UID: "d08e991b-96d2-429d-8aed-3c7081b043f1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:27:13.264014 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:13.263995    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d08e991b-96d2-429d-8aed-3c7081b043f1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d08e991b-96d2-429d-8aed-3c7081b043f1" (UID: "d08e991b-96d2-429d-8aed-3c7081b043f1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 21:27:13.363340 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:13.363306    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d08e991b-96d2-429d-8aed-3c7081b043f1-istio-podinfo\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:27:13.363340 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:13.363335    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d08e991b-96d2-429d-8aed-3c7081b043f1-istio-token\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:27:13.363340 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:13.363344    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d08e991b-96d2-429d-8aed-3c7081b043f1-istio-envoy\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:27:13.363570 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:13.363351    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wzfj9\" (UniqueName: \"kubernetes.io/projected/d08e991b-96d2-429d-8aed-3c7081b043f1-kube-api-access-wzfj9\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:27:14.056162 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:14.056129    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk"
Sep 10 21:27:14.056585 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:14.056161    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk" event={"ID":"d08e991b-96d2-429d-8aed-3c7081b043f1","Type":"ContainerDied","Data":"1149a33514ed3379cff558d59714008a6d617583af83b1e8b6e9639d98b7eb5c"}
Sep 10 21:27:14.056585 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:14.056218    2564 scope.go:117] "RemoveContainer" containerID="d747f5d035f74d9488ce8e1dfb82fd2f3c29bc58f4b6aaff730d4b6df8b87c40"
Sep 10 21:27:14.076288 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:14.076259    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk"]
Sep 10 21:27:14.081221 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:14.081196    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-9f1286-openshift-default-657dc65b68-ntdgk"]
Sep 10 21:27:15.872378 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:15.872348    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d08e991b-96d2-429d-8aed-3c7081b043f1" path="/var/lib/kubelet/pods/d08e991b-96d2-429d-8aed-3c7081b043f1/volumes"
Sep 10 21:27:19.311912 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:19.311876    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-af7150-nm9t5"]
Sep 10 21:27:19.321030 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:19.320997    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-af7150-nm9t5"]
Sep 10 21:27:19.873150 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:19.873120    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1fe2b899-0c3c-4540-bd3f-46c48e900613" path="/var/lib/kubelet/pods/1fe2b899-0c3c-4540-bd3f-46c48e900613/volumes"
Sep 10 21:27:27.651635 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:27.651601    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx"]
Sep 10 21:27:27.652035 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:27.651854    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx" podUID="3008517c-ea98-4f07-85a7-c711e23cd25a" containerName="istio-proxy" containerID="cri-o://57bb67b8950065ad5bffb18f251bd6e24769fb3eb3a7be9842abb77a474dc053" gracePeriod=30
Sep 10 21:27:32.896061 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:32.896030    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx"
Sep 10 21:27:33.041097 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:33.041003    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rg98j\" (UniqueName: \"kubernetes.io/projected/3008517c-ea98-4f07-85a7-c711e23cd25a-kube-api-access-rg98j\") pod \"3008517c-ea98-4f07-85a7-c711e23cd25a\" (UID: \"3008517c-ea98-4f07-85a7-c711e23cd25a\") "
Sep 10 21:27:33.041097 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:33.041048    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3008517c-ea98-4f07-85a7-c711e23cd25a-istio-data\") pod \"3008517c-ea98-4f07-85a7-c711e23cd25a\" (UID: \"3008517c-ea98-4f07-85a7-c711e23cd25a\") "
Sep 10 21:27:33.041097 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:33.041084    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3008517c-ea98-4f07-85a7-c711e23cd25a-istio-envoy\") pod \"3008517c-ea98-4f07-85a7-c711e23cd25a\" (UID: \"3008517c-ea98-4f07-85a7-c711e23cd25a\") "
Sep 10 21:27:33.041425 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:33.041183    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3008517c-ea98-4f07-85a7-c711e23cd25a-istio-token\") pod \"3008517c-ea98-4f07-85a7-c711e23cd25a\" (UID: \"3008517c-ea98-4f07-85a7-c711e23cd25a\") "
Sep 10 21:27:33.041425 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:33.041253    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3008517c-ea98-4f07-85a7-c711e23cd25a-workload-socket\") pod \"3008517c-ea98-4f07-85a7-c711e23cd25a\" (UID: \"3008517c-ea98-4f07-85a7-c711e23cd25a\") "
Sep 10 21:27:33.041425 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:33.041280    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3008517c-ea98-4f07-85a7-c711e23cd25a-istiod-ca-cert\") pod \"3008517c-ea98-4f07-85a7-c711e23cd25a\" (UID: \"3008517c-ea98-4f07-85a7-c711e23cd25a\") "
Sep 10 21:27:33.041425 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:33.041308    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3008517c-ea98-4f07-85a7-c711e23cd25a-credential-socket\") pod \"3008517c-ea98-4f07-85a7-c711e23cd25a\" (UID: \"3008517c-ea98-4f07-85a7-c711e23cd25a\") "
Sep 10 21:27:33.041425 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:33.041337    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3008517c-ea98-4f07-85a7-c711e23cd25a-istio-podinfo\") pod \"3008517c-ea98-4f07-85a7-c711e23cd25a\" (UID: \"3008517c-ea98-4f07-85a7-c711e23cd25a\") "
Sep 10 21:27:33.041425 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:33.041361    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3008517c-ea98-4f07-85a7-c711e23cd25a-workload-certs\") pod \"3008517c-ea98-4f07-85a7-c711e23cd25a\" (UID: \"3008517c-ea98-4f07-85a7-c711e23cd25a\") "
Sep 10 21:27:33.041771 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:33.041444    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3008517c-ea98-4f07-85a7-c711e23cd25a-istio-data" (OuterVolumeSpecName: "istio-data") pod "3008517c-ea98-4f07-85a7-c711e23cd25a" (UID: "3008517c-ea98-4f07-85a7-c711e23cd25a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:27:33.041771 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:33.041604    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3008517c-ea98-4f07-85a7-c711e23cd25a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3008517c-ea98-4f07-85a7-c711e23cd25a" (UID: "3008517c-ea98-4f07-85a7-c711e23cd25a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:27:33.041771 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:33.041699    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3008517c-ea98-4f07-85a7-c711e23cd25a-istio-data\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:27:33.041771 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:33.041681    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3008517c-ea98-4f07-85a7-c711e23cd25a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3008517c-ea98-4f07-85a7-c711e23cd25a" (UID: "3008517c-ea98-4f07-85a7-c711e23cd25a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:27:33.041771 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:33.041703    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3008517c-ea98-4f07-85a7-c711e23cd25a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3008517c-ea98-4f07-85a7-c711e23cd25a" (UID: "3008517c-ea98-4f07-85a7-c711e23cd25a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:27:33.042484 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:33.041980    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3008517c-ea98-4f07-85a7-c711e23cd25a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3008517c-ea98-4f07-85a7-c711e23cd25a" (UID: "3008517c-ea98-4f07-85a7-c711e23cd25a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:27:33.043496 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:33.043469    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3008517c-ea98-4f07-85a7-c711e23cd25a-kube-api-access-rg98j" (OuterVolumeSpecName: "kube-api-access-rg98j") pod "3008517c-ea98-4f07-85a7-c711e23cd25a" (UID: "3008517c-ea98-4f07-85a7-c711e23cd25a"). InnerVolumeSpecName "kube-api-access-rg98j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:27:33.043798 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:33.043777    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3008517c-ea98-4f07-85a7-c711e23cd25a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3008517c-ea98-4f07-85a7-c711e23cd25a" (UID: "3008517c-ea98-4f07-85a7-c711e23cd25a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:27:33.043983 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:33.043961    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3008517c-ea98-4f07-85a7-c711e23cd25a-istio-token" (OuterVolumeSpecName: "istio-token") pod "3008517c-ea98-4f07-85a7-c711e23cd25a" (UID: "3008517c-ea98-4f07-85a7-c711e23cd25a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:27:33.044068 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:33.044011    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3008517c-ea98-4f07-85a7-c711e23cd25a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3008517c-ea98-4f07-85a7-c711e23cd25a" (UID: "3008517c-ea98-4f07-85a7-c711e23cd25a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 21:27:33.143078 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:33.143041    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3008517c-ea98-4f07-85a7-c711e23cd25a-istio-token\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:27:33.143078 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:33.143070    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3008517c-ea98-4f07-85a7-c711e23cd25a-workload-socket\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:27:33.143078 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:33.143080    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3008517c-ea98-4f07-85a7-c711e23cd25a-istiod-ca-cert\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:27:33.143339 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:33.143090    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3008517c-ea98-4f07-85a7-c711e23cd25a-credential-socket\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:27:33.143339 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:33.143099    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3008517c-ea98-4f07-85a7-c711e23cd25a-istio-podinfo\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:27:33.143339 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:33.143107    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3008517c-ea98-4f07-85a7-c711e23cd25a-workload-certs\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:27:33.143339 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:33.143116    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rg98j\" (UniqueName: \"kubernetes.io/projected/3008517c-ea98-4f07-85a7-c711e23cd25a-kube-api-access-rg98j\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:27:33.143339 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:33.143124    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3008517c-ea98-4f07-85a7-c711e23cd25a-istio-envoy\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:27:33.173381 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:33.173347    2564 generic.go:356] "Generic (PLEG): container finished" podID="3008517c-ea98-4f07-85a7-c711e23cd25a" containerID="57bb67b8950065ad5bffb18f251bd6e24769fb3eb3a7be9842abb77a474dc053" exitCode=0
Sep 10 21:27:33.173573 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:33.173390    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx"
Sep 10 21:27:33.173573 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:33.173432    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx" event={"ID":"3008517c-ea98-4f07-85a7-c711e23cd25a","Type":"ContainerDied","Data":"57bb67b8950065ad5bffb18f251bd6e24769fb3eb3a7be9842abb77a474dc053"}
Sep 10 21:27:33.173573 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:33.173493    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx" event={"ID":"3008517c-ea98-4f07-85a7-c711e23cd25a","Type":"ContainerDied","Data":"971da780919c8516bf671245affa0652d9683cdcfe6191e81b5209818171d321"}
Sep 10 21:27:33.173573 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:33.173517    2564 scope.go:117] "RemoveContainer" containerID="57bb67b8950065ad5bffb18f251bd6e24769fb3eb3a7be9842abb77a474dc053"
Sep 10 21:27:33.182853 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:33.182835    2564 scope.go:117] "RemoveContainer" containerID="6c93003deab05ec59f150175c4573f3fbd4ef6326190db84a8ac612d57ccd5b2"
Sep 10 21:27:33.191286 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:33.191260    2564 scope.go:117] "RemoveContainer" containerID="57bb67b8950065ad5bffb18f251bd6e24769fb3eb3a7be9842abb77a474dc053"
Sep 10 21:27:33.191562 ip-10-0-129-100 kubenswrapper[2564]: E0910 21:27:33.191543    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57bb67b8950065ad5bffb18f251bd6e24769fb3eb3a7be9842abb77a474dc053\": container with ID starting with 57bb67b8950065ad5bffb18f251bd6e24769fb3eb3a7be9842abb77a474dc053 not found: ID does not exist" containerID="57bb67b8950065ad5bffb18f251bd6e24769fb3eb3a7be9842abb77a474dc053"
Sep 10 21:27:33.191608 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:33.191573    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57bb67b8950065ad5bffb18f251bd6e24769fb3eb3a7be9842abb77a474dc053"} err="failed to get container status \"57bb67b8950065ad5bffb18f251bd6e24769fb3eb3a7be9842abb77a474dc053\": rpc error: code = NotFound desc = could not find container \"57bb67b8950065ad5bffb18f251bd6e24769fb3eb3a7be9842abb77a474dc053\": container with ID starting with 57bb67b8950065ad5bffb18f251bd6e24769fb3eb3a7be9842abb77a474dc053 not found: ID does not exist"
Sep 10 21:27:33.191608 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:33.191591    2564 scope.go:117] "RemoveContainer" containerID="6c93003deab05ec59f150175c4573f3fbd4ef6326190db84a8ac612d57ccd5b2"
Sep 10 21:27:33.191837 ip-10-0-129-100 kubenswrapper[2564]: E0910 21:27:33.191821    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c93003deab05ec59f150175c4573f3fbd4ef6326190db84a8ac612d57ccd5b2\": container with ID starting with 6c93003deab05ec59f150175c4573f3fbd4ef6326190db84a8ac612d57ccd5b2 not found: ID does not exist" containerID="6c93003deab05ec59f150175c4573f3fbd4ef6326190db84a8ac612d57ccd5b2"
Sep 10 21:27:33.191875 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:33.191840    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c93003deab05ec59f150175c4573f3fbd4ef6326190db84a8ac612d57ccd5b2"} err="failed to get container status \"6c93003deab05ec59f150175c4573f3fbd4ef6326190db84a8ac612d57ccd5b2\": rpc error: code = NotFound desc = could not find container \"6c93003deab05ec59f150175c4573f3fbd4ef6326190db84a8ac612d57ccd5b2\": container with ID starting with 6c93003deab05ec59f150175c4573f3fbd4ef6326190db84a8ac612d57ccd5b2 not found: ID does not exist"
Sep 10 21:27:33.215242 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:33.215199    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx"]
Sep 10 21:27:33.222005 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:33.221977    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-af7150-openshift-default-6f764448d4-26lwx"]
Sep 10 21:27:33.872918 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:33.872884    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3008517c-ea98-4f07-85a7-c711e23cd25a" path="/var/lib/kubelet/pods/3008517c-ea98-4f07-85a7-c711e23cd25a/volumes"
Sep 10 21:27:49.610894 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:49.610860    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq"]
Sep 10 21:27:49.611375 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:49.611087    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq" podUID="f497ebed-8418-49b5-ac33-1153d0ead2ab" containerName="istio-proxy" containerID="cri-o://30bf3f187fd8d43aff1f5115c1b49c6e58dcaaf97c12eda1f7195304dac81998" gracePeriod=30
Sep 10 21:27:54.873286 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:54.873254    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq"
Sep 10 21:27:54.943460 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:54.943374    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f497ebed-8418-49b5-ac33-1153d0ead2ab-istio-data\") pod \"f497ebed-8418-49b5-ac33-1153d0ead2ab\" (UID: \"f497ebed-8418-49b5-ac33-1153d0ead2ab\") "
Sep 10 21:27:54.943460 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:54.943431    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f497ebed-8418-49b5-ac33-1153d0ead2ab-istio-podinfo\") pod \"f497ebed-8418-49b5-ac33-1153d0ead2ab\" (UID: \"f497ebed-8418-49b5-ac33-1153d0ead2ab\") "
Sep 10 21:27:54.943460 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:54.943456    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f497ebed-8418-49b5-ac33-1153d0ead2ab-workload-socket\") pod \"f497ebed-8418-49b5-ac33-1153d0ead2ab\" (UID: \"f497ebed-8418-49b5-ac33-1153d0ead2ab\") "
Sep 10 21:27:54.943695 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:54.943477    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f497ebed-8418-49b5-ac33-1153d0ead2ab-istio-token\") pod \"f497ebed-8418-49b5-ac33-1153d0ead2ab\" (UID: \"f497ebed-8418-49b5-ac33-1153d0ead2ab\") "
Sep 10 21:27:54.943695 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:54.943521    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f497ebed-8418-49b5-ac33-1153d0ead2ab-istiod-ca-cert\") pod \"f497ebed-8418-49b5-ac33-1153d0ead2ab\" (UID: \"f497ebed-8418-49b5-ac33-1153d0ead2ab\") "
Sep 10 21:27:54.943695 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:54.943574    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f497ebed-8418-49b5-ac33-1153d0ead2ab-istio-envoy\") pod \"f497ebed-8418-49b5-ac33-1153d0ead2ab\" (UID: \"f497ebed-8418-49b5-ac33-1153d0ead2ab\") "
Sep 10 21:27:54.943695 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:54.943600    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2wp2h\" (UniqueName: \"kubernetes.io/projected/f497ebed-8418-49b5-ac33-1153d0ead2ab-kube-api-access-2wp2h\") pod \"f497ebed-8418-49b5-ac33-1153d0ead2ab\" (UID: \"f497ebed-8418-49b5-ac33-1153d0ead2ab\") "
Sep 10 21:27:54.943900 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:54.943693    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f497ebed-8418-49b5-ac33-1153d0ead2ab-istio-data" (OuterVolumeSpecName: "istio-data") pod "f497ebed-8418-49b5-ac33-1153d0ead2ab" (UID: "f497ebed-8418-49b5-ac33-1153d0ead2ab"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:27:54.943900 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:54.943749    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f497ebed-8418-49b5-ac33-1153d0ead2ab-workload-certs\") pod \"f497ebed-8418-49b5-ac33-1153d0ead2ab\" (UID: \"f497ebed-8418-49b5-ac33-1153d0ead2ab\") "
Sep 10 21:27:54.943900 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:54.943802    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f497ebed-8418-49b5-ac33-1153d0ead2ab-credential-socket\") pod \"f497ebed-8418-49b5-ac33-1153d0ead2ab\" (UID: \"f497ebed-8418-49b5-ac33-1153d0ead2ab\") "
Sep 10 21:27:54.943900 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:54.943843    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f497ebed-8418-49b5-ac33-1153d0ead2ab-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f497ebed-8418-49b5-ac33-1153d0ead2ab" (UID: "f497ebed-8418-49b5-ac33-1153d0ead2ab"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:27:54.944128 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:54.944063    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f497ebed-8418-49b5-ac33-1153d0ead2ab-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f497ebed-8418-49b5-ac33-1153d0ead2ab" (UID: "f497ebed-8418-49b5-ac33-1153d0ead2ab"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:27:54.944128 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:54.943996    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f497ebed-8418-49b5-ac33-1153d0ead2ab-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f497ebed-8418-49b5-ac33-1153d0ead2ab" (UID: "f497ebed-8418-49b5-ac33-1153d0ead2ab"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:27:54.944288 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:54.944268    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f497ebed-8418-49b5-ac33-1153d0ead2ab-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f497ebed-8418-49b5-ac33-1153d0ead2ab" (UID: "f497ebed-8418-49b5-ac33-1153d0ead2ab"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:27:54.944449 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:54.944431    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f497ebed-8418-49b5-ac33-1153d0ead2ab-workload-certs\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:27:54.944529 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:54.944468    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f497ebed-8418-49b5-ac33-1153d0ead2ab-credential-socket\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:27:54.944529 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:54.944488    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f497ebed-8418-49b5-ac33-1153d0ead2ab-istio-data\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:27:54.944529 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:54.944504    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f497ebed-8418-49b5-ac33-1153d0ead2ab-workload-socket\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:27:54.944529 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:54.944518    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f497ebed-8418-49b5-ac33-1153d0ead2ab-istiod-ca-cert\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:27:54.945768 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:54.945736    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f497ebed-8418-49b5-ac33-1153d0ead2ab-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f497ebed-8418-49b5-ac33-1153d0ead2ab" (UID: "f497ebed-8418-49b5-ac33-1153d0ead2ab"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 21:27:54.945906 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:54.945882    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f497ebed-8418-49b5-ac33-1153d0ead2ab-kube-api-access-2wp2h" (OuterVolumeSpecName: "kube-api-access-2wp2h") pod "f497ebed-8418-49b5-ac33-1153d0ead2ab" (UID: "f497ebed-8418-49b5-ac33-1153d0ead2ab"). InnerVolumeSpecName "kube-api-access-2wp2h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:27:54.946136 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:54.946116    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f497ebed-8418-49b5-ac33-1153d0ead2ab-istio-token" (OuterVolumeSpecName: "istio-token") pod "f497ebed-8418-49b5-ac33-1153d0ead2ab" (UID: "f497ebed-8418-49b5-ac33-1153d0ead2ab"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:27:54.946182 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:54.946145    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f497ebed-8418-49b5-ac33-1153d0ead2ab-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f497ebed-8418-49b5-ac33-1153d0ead2ab" (UID: "f497ebed-8418-49b5-ac33-1153d0ead2ab"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:27:55.045884 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:55.045854    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f497ebed-8418-49b5-ac33-1153d0ead2ab-istio-podinfo\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:27:55.045884 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:55.045879    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f497ebed-8418-49b5-ac33-1153d0ead2ab-istio-token\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:27:55.045884 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:55.045888    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f497ebed-8418-49b5-ac33-1153d0ead2ab-istio-envoy\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:27:55.046122 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:55.045896    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2wp2h\" (UniqueName: \"kubernetes.io/projected/f497ebed-8418-49b5-ac33-1153d0ead2ab-kube-api-access-2wp2h\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:27:55.296679 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:55.296642    2564 generic.go:356] "Generic (PLEG): container finished" podID="f497ebed-8418-49b5-ac33-1153d0ead2ab" containerID="30bf3f187fd8d43aff1f5115c1b49c6e58dcaaf97c12eda1f7195304dac81998" exitCode=0
Sep 10 21:27:55.296843 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:55.296691    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq"
Sep 10 21:27:55.296843 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:55.296728    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq" event={"ID":"f497ebed-8418-49b5-ac33-1153d0ead2ab","Type":"ContainerDied","Data":"30bf3f187fd8d43aff1f5115c1b49c6e58dcaaf97c12eda1f7195304dac81998"}
Sep 10 21:27:55.296843 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:55.296783    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq" event={"ID":"f497ebed-8418-49b5-ac33-1153d0ead2ab","Type":"ContainerDied","Data":"463dc4dab3cfd0ab413382dfffc166a372ef7ed1b94fe5f13e8858905fcbd618"}
Sep 10 21:27:55.296843 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:55.296805    2564 scope.go:117] "RemoveContainer" containerID="30bf3f187fd8d43aff1f5115c1b49c6e58dcaaf97c12eda1f7195304dac81998"
Sep 10 21:27:55.311890 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:55.311853    2564 scope.go:117] "RemoveContainer" containerID="7fe466b7a44b46accf5a6449a87556e82ef146581d3d5ab3a9e060a8c1e02069"
Sep 10 21:27:55.320372 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:55.320348    2564 scope.go:117] "RemoveContainer" containerID="30bf3f187fd8d43aff1f5115c1b49c6e58dcaaf97c12eda1f7195304dac81998"
Sep 10 21:27:55.320669 ip-10-0-129-100 kubenswrapper[2564]: E0910 21:27:55.320645    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30bf3f187fd8d43aff1f5115c1b49c6e58dcaaf97c12eda1f7195304dac81998\": container with ID starting with 30bf3f187fd8d43aff1f5115c1b49c6e58dcaaf97c12eda1f7195304dac81998 not found: ID does not exist" containerID="30bf3f187fd8d43aff1f5115c1b49c6e58dcaaf97c12eda1f7195304dac81998"
Sep 10 21:27:55.320726 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:55.320681    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30bf3f187fd8d43aff1f5115c1b49c6e58dcaaf97c12eda1f7195304dac81998"} err="failed to get container status \"30bf3f187fd8d43aff1f5115c1b49c6e58dcaaf97c12eda1f7195304dac81998\": rpc error: code = NotFound desc = could not find container \"30bf3f187fd8d43aff1f5115c1b49c6e58dcaaf97c12eda1f7195304dac81998\": container with ID starting with 30bf3f187fd8d43aff1f5115c1b49c6e58dcaaf97c12eda1f7195304dac81998 not found: ID does not exist"
Sep 10 21:27:55.320726 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:55.320704    2564 scope.go:117] "RemoveContainer" containerID="7fe466b7a44b46accf5a6449a87556e82ef146581d3d5ab3a9e060a8c1e02069"
Sep 10 21:27:55.320988 ip-10-0-129-100 kubenswrapper[2564]: E0910 21:27:55.320967    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7fe466b7a44b46accf5a6449a87556e82ef146581d3d5ab3a9e060a8c1e02069\": container with ID starting with 7fe466b7a44b46accf5a6449a87556e82ef146581d3d5ab3a9e060a8c1e02069 not found: ID does not exist" containerID="7fe466b7a44b46accf5a6449a87556e82ef146581d3d5ab3a9e060a8c1e02069"
Sep 10 21:27:55.321045 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:55.320995    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7fe466b7a44b46accf5a6449a87556e82ef146581d3d5ab3a9e060a8c1e02069"} err="failed to get container status \"7fe466b7a44b46accf5a6449a87556e82ef146581d3d5ab3a9e060a8c1e02069\": rpc error: code = NotFound desc = could not find container \"7fe466b7a44b46accf5a6449a87556e82ef146581d3d5ab3a9e060a8c1e02069\": container with ID starting with 7fe466b7a44b46accf5a6449a87556e82ef146581d3d5ab3a9e060a8c1e02069 not found: ID does not exist"
Sep 10 21:27:55.348362 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:55.348337    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq"]
Sep 10 21:27:55.358062 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:55.358038    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-7810bd-openshift-default-7657b7c6f4-r5bsq"]
Sep 10 21:27:55.872829 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:27:55.872784    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f497ebed-8418-49b5-ac33-1153d0ead2ab" path="/var/lib/kubelet/pods/f497ebed-8418-49b5-ac33-1153d0ead2ab/volumes"
Sep 10 21:28:00.200638 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:28:00.200601    2564 scope.go:117] "RemoveContainer" containerID="6376ad6845c96a208c01c381526255da2d582e858fbecd1810e5e7a58a847b47"
Sep 10 21:29:00.238540 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:29:00.238509    2564 scope.go:117] "RemoveContainer" containerID="fb86c2074f8d5f2001cd5bad3ebf5db446f675529e5966eb2afa002113647164"
Sep 10 21:29:00.246959 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:29:00.246937    2564 scope.go:117] "RemoveContainer" containerID="aa9bc2302953ea28fe8dc6fb2f55d5742dd2d92a68ca4d789ec741262120f4a1"
Sep 10 21:30:31.510319 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:30:31.510242    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5xz89"]
Sep 10 21:30:31.510808 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:30:31.510493    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5xz89" podUID="f04fe38d-a7a2-486f-9042-755d80c46efe" containerName="manager" containerID="cri-o://e274fd40f58b1c3f0c484e7d636b60726750e5f2d3dceb2ededfe3b55d8730c7" gracePeriod=10
Sep 10 21:30:31.853352 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:30:31.853329    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5xz89"
Sep 10 21:30:31.959844 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:30:31.959809    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vg85l\" (UniqueName: \"kubernetes.io/projected/f04fe38d-a7a2-486f-9042-755d80c46efe-kube-api-access-vg85l\") pod \"f04fe38d-a7a2-486f-9042-755d80c46efe\" (UID: \"f04fe38d-a7a2-486f-9042-755d80c46efe\") "
Sep 10 21:30:31.960025 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:30:31.959852    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f04fe38d-a7a2-486f-9042-755d80c46efe-extensions-socket-volume\") pod \"f04fe38d-a7a2-486f-9042-755d80c46efe\" (UID: \"f04fe38d-a7a2-486f-9042-755d80c46efe\") "
Sep 10 21:30:31.960262 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:30:31.960219    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f04fe38d-a7a2-486f-9042-755d80c46efe-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f04fe38d-a7a2-486f-9042-755d80c46efe" (UID: "f04fe38d-a7a2-486f-9042-755d80c46efe"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 21:30:31.961808 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:30:31.961787    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f04fe38d-a7a2-486f-9042-755d80c46efe-kube-api-access-vg85l" (OuterVolumeSpecName: "kube-api-access-vg85l") pod "f04fe38d-a7a2-486f-9042-755d80c46efe" (UID: "f04fe38d-a7a2-486f-9042-755d80c46efe"). InnerVolumeSpecName "kube-api-access-vg85l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:30:32.060684 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:30:32.060640    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vg85l\" (UniqueName: \"kubernetes.io/projected/f04fe38d-a7a2-486f-9042-755d80c46efe-kube-api-access-vg85l\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:30:32.060684 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:30:32.060681    2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f04fe38d-a7a2-486f-9042-755d80c46efe-extensions-socket-volume\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:30:32.163032 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:30:32.163001    2564 generic.go:356] "Generic (PLEG): container finished" podID="f04fe38d-a7a2-486f-9042-755d80c46efe" containerID="e274fd40f58b1c3f0c484e7d636b60726750e5f2d3dceb2ededfe3b55d8730c7" exitCode=0
Sep 10 21:30:32.163202 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:30:32.163038    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5xz89"
Sep 10 21:30:32.163202 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:30:32.163087    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5xz89" event={"ID":"f04fe38d-a7a2-486f-9042-755d80c46efe","Type":"ContainerDied","Data":"e274fd40f58b1c3f0c484e7d636b60726750e5f2d3dceb2ededfe3b55d8730c7"}
Sep 10 21:30:32.163202 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:30:32.163136    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5xz89" event={"ID":"f04fe38d-a7a2-486f-9042-755d80c46efe","Type":"ContainerDied","Data":"acb3932e2785ff8179abbfbc49aa01d0d4a9a480dfee4074e95591cb0529db98"}
Sep 10 21:30:32.163202 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:30:32.163157    2564 scope.go:117] "RemoveContainer" containerID="e274fd40f58b1c3f0c484e7d636b60726750e5f2d3dceb2ededfe3b55d8730c7"
Sep 10 21:30:32.172974 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:30:32.172957    2564 scope.go:117] "RemoveContainer" containerID="e274fd40f58b1c3f0c484e7d636b60726750e5f2d3dceb2ededfe3b55d8730c7"
Sep 10 21:30:32.173267 ip-10-0-129-100 kubenswrapper[2564]: E0910 21:30:32.173247    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e274fd40f58b1c3f0c484e7d636b60726750e5f2d3dceb2ededfe3b55d8730c7\": container with ID starting with e274fd40f58b1c3f0c484e7d636b60726750e5f2d3dceb2ededfe3b55d8730c7 not found: ID does not exist" containerID="e274fd40f58b1c3f0c484e7d636b60726750e5f2d3dceb2ededfe3b55d8730c7"
Sep 10 21:30:32.173317 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:30:32.173276    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e274fd40f58b1c3f0c484e7d636b60726750e5f2d3dceb2ededfe3b55d8730c7"} err="failed to get container status \"e274fd40f58b1c3f0c484e7d636b60726750e5f2d3dceb2ededfe3b55d8730c7\": rpc error: code = NotFound desc = could not find container \"e274fd40f58b1c3f0c484e7d636b60726750e5f2d3dceb2ededfe3b55d8730c7\": container with ID starting with e274fd40f58b1c3f0c484e7d636b60726750e5f2d3dceb2ededfe3b55d8730c7 not found: ID does not exist"
Sep 10 21:30:32.190562 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:30:32.190535    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5xz89"]
Sep 10 21:30:32.199896 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:30:32.199873    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5xz89"]
Sep 10 21:30:33.872701 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:30:33.872673    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f04fe38d-a7a2-486f-9042-755d80c46efe" path="/var/lib/kubelet/pods/f04fe38d-a7a2-486f-9042-755d80c46efe/volumes"
Sep 10 21:31:32.200983 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:31:32.200895    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-ww2lm"]
Sep 10 21:31:32.201509 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:31:32.201316    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f497ebed-8418-49b5-ac33-1153d0ead2ab" containerName="istio-proxy"
Sep 10 21:31:32.201509 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:31:32.201333    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f497ebed-8418-49b5-ac33-1153d0ead2ab" containerName="istio-proxy"
Sep 10 21:31:32.201509 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:31:32.201342    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f497ebed-8418-49b5-ac33-1153d0ead2ab" containerName="istio-proxy"
Sep 10 21:31:32.201509 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:31:32.201348    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f497ebed-8418-49b5-ac33-1153d0ead2ab" containerName="istio-proxy"
Sep 10 21:31:32.201509 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:31:32.201357    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3008517c-ea98-4f07-85a7-c711e23cd25a" containerName="istio-proxy"
Sep 10 21:31:32.201509 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:31:32.201364    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3008517c-ea98-4f07-85a7-c711e23cd25a" containerName="istio-proxy"
Sep 10 21:31:32.201509 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:31:32.201375    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d08e991b-96d2-429d-8aed-3c7081b043f1" containerName="istio-proxy"
Sep 10 21:31:32.201509 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:31:32.201380    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d08e991b-96d2-429d-8aed-3c7081b043f1" containerName="istio-proxy"
Sep 10 21:31:32.201509 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:31:32.201387    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f04fe38d-a7a2-486f-9042-755d80c46efe" containerName="manager"
Sep 10 21:31:32.201509 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:31:32.201392    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f04fe38d-a7a2-486f-9042-755d80c46efe" containerName="manager"
Sep 10 21:31:32.201509 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:31:32.201398    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fe2b899-0c3c-4540-bd3f-46c48e900613" containerName="revoke-keys"
Sep 10 21:31:32.201509 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:31:32.201403    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fe2b899-0c3c-4540-bd3f-46c48e900613" containerName="revoke-keys"
Sep 10 21:31:32.201509 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:31:32.201413    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d08e991b-96d2-429d-8aed-3c7081b043f1" containerName="istio-proxy"
Sep 10 21:31:32.201509 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:31:32.201419    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d08e991b-96d2-429d-8aed-3c7081b043f1" containerName="istio-proxy"
Sep 10 21:31:32.201509 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:31:32.201426    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3008517c-ea98-4f07-85a7-c711e23cd25a" containerName="istio-proxy"
Sep 10 21:31:32.201509 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:31:32.201431    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3008517c-ea98-4f07-85a7-c711e23cd25a" containerName="istio-proxy"
Sep 10 21:31:32.201509 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:31:32.201486    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f497ebed-8418-49b5-ac33-1153d0ead2ab" containerName="istio-proxy"
Sep 10 21:31:32.201509 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:31:32.201493    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f497ebed-8418-49b5-ac33-1153d0ead2ab" containerName="istio-proxy"
Sep 10 21:31:32.201509 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:31:32.201500    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d08e991b-96d2-429d-8aed-3c7081b043f1" containerName="istio-proxy"
Sep 10 21:31:32.201509 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:31:32.201506    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="3008517c-ea98-4f07-85a7-c711e23cd25a" containerName="istio-proxy"
Sep 10 21:31:32.201509 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:31:32.201512    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f04fe38d-a7a2-486f-9042-755d80c46efe" containerName="manager"
Sep 10 21:31:32.201509 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:31:32.201518    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d08e991b-96d2-429d-8aed-3c7081b043f1" containerName="istio-proxy"
Sep 10 21:31:32.202171 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:31:32.201524    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="1fe2b899-0c3c-4540-bd3f-46c48e900613" containerName="revoke-keys"
Sep 10 21:31:32.202171 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:31:32.201530    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="3008517c-ea98-4f07-85a7-c711e23cd25a" containerName="istio-proxy"
Sep 10 21:31:32.204423 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:31:32.204405    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-ww2lm"
Sep 10 21:31:32.207552 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:31:32.207535    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-vlnlh\""
Sep 10 21:31:32.221063 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:31:32.221033    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-ww2lm"]
Sep 10 21:31:32.264113 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:31:32.264072    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5b7q5\" (UniqueName: \"kubernetes.io/projected/a768e075-70b9-4315-bbde-c10df13f0f46-kube-api-access-5b7q5\") pod \"kuadrant-operator-controller-manager-5769f99d9f-ww2lm\" (UID: \"a768e075-70b9-4315-bbde-c10df13f0f46\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-ww2lm"
Sep 10 21:31:32.264301 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:31:32.264147    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a768e075-70b9-4315-bbde-c10df13f0f46-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-ww2lm\" (UID: \"a768e075-70b9-4315-bbde-c10df13f0f46\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-ww2lm"
Sep 10 21:31:32.365581 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:31:32.365537    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a768e075-70b9-4315-bbde-c10df13f0f46-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-ww2lm\" (UID: \"a768e075-70b9-4315-bbde-c10df13f0f46\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-ww2lm"
Sep 10 21:31:32.365794 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:31:32.365644    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5b7q5\" (UniqueName: \"kubernetes.io/projected/a768e075-70b9-4315-bbde-c10df13f0f46-kube-api-access-5b7q5\") pod \"kuadrant-operator-controller-manager-5769f99d9f-ww2lm\" (UID: \"a768e075-70b9-4315-bbde-c10df13f0f46\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-ww2lm"
Sep 10 21:31:32.365961 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:31:32.365938    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a768e075-70b9-4315-bbde-c10df13f0f46-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-ww2lm\" (UID: \"a768e075-70b9-4315-bbde-c10df13f0f46\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-ww2lm"
Sep 10 21:31:32.379107 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:31:32.379074    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5b7q5\" (UniqueName: \"kubernetes.io/projected/a768e075-70b9-4315-bbde-c10df13f0f46-kube-api-access-5b7q5\") pod \"kuadrant-operator-controller-manager-5769f99d9f-ww2lm\" (UID: \"a768e075-70b9-4315-bbde-c10df13f0f46\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-ww2lm"
Sep 10 21:31:32.514929 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:31:32.514830    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-ww2lm"
Sep 10 21:31:32.816769 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:31:32.816738    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-ww2lm"]
Sep 10 21:31:32.816884 ip-10-0-129-100 kubenswrapper[2564]: W0910 21:31:32.816796    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda768e075_70b9_4315_bbde_c10df13f0f46.slice/crio-c352e4f20b12daec9347475caf2322d01d67be2f34dab25b8c72177728899306 WatchSource:0}: Error finding container c352e4f20b12daec9347475caf2322d01d67be2f34dab25b8c72177728899306: Status 404 returned error can't find the container with id c352e4f20b12daec9347475caf2322d01d67be2f34dab25b8c72177728899306
Sep 10 21:31:33.495596 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:31:33.495557    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-ww2lm" event={"ID":"a768e075-70b9-4315-bbde-c10df13f0f46","Type":"ContainerStarted","Data":"91fa9268cf9b9795d0f3bfeba78ad155c2cda5206cb1cf5e27ccd948b3397497"}
Sep 10 21:31:33.495989 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:31:33.495617    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-ww2lm" event={"ID":"a768e075-70b9-4315-bbde-c10df13f0f46","Type":"ContainerStarted","Data":"c352e4f20b12daec9347475caf2322d01d67be2f34dab25b8c72177728899306"}
Sep 10 21:31:33.495989 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:31:33.495638    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-ww2lm"
Sep 10 21:31:33.521440 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:31:33.521385    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-ww2lm" podStartSLOduration=1.52136755 podStartE2EDuration="1.52136755s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:31:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:31:33.519359742 +0000 UTC m=+2074.206427021" watchObservedRunningTime="2026-09-10 21:31:33.52136755 +0000 UTC m=+2074.208434829"
Sep 10 21:31:44.503396 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:31:44.503358    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-ww2lm"
Sep 10 21:32:00.294686 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:32:00.294652    2564 scope.go:117] "RemoveContainer" containerID="c20f5c028ce79cf6803cc4f2d920893bfdbde980674f9bf158664de3fb44bf93"
Sep 10 21:32:00.303085 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:32:00.303063    2564 scope.go:117] "RemoveContainer" containerID="4c56d703e46bc96eed4cae2db0895228acc91fc97ac39c1d3de499ea263f06e4"
Sep 10 21:32:01.309076 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:32:01.309049    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-cd9hp_0432bad8-86f5-4b0e-a0d4-2fdb728223f2/console-operator/2.log"
Sep 10 21:32:01.315454 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:32:01.315433    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wrbhk_279e54f7-0db1-4e2d-a998-4b3ecdf992cd/ovn-acl-logging/0.log"
Sep 10 21:32:01.317273 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:32:01.317252    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-cd9hp_0432bad8-86f5-4b0e-a0d4-2fdb728223f2/console-operator/2.log"
Sep 10 21:32:01.323587 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:32:01.323570    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wrbhk_279e54f7-0db1-4e2d-a998-4b3ecdf992cd/ovn-acl-logging/0.log"
Sep 10 21:32:57.995219 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:32:57.995139    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7b78667ccb-6bcqz"]
Sep 10 21:32:57.998418 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:32:57.998400    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7b78667ccb-6bcqz"
Sep 10 21:32:58.001021 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:32:58.000996    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 10 21:32:58.002376 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:32:58.002199    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 10 21:32:58.002376 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:32:58.002257    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 10 21:32:58.002376 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:32:58.002273    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 21:32:58.002376 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:32:58.002265    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-9ckhj\""
Sep 10 21:32:58.010784 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:32:58.010755    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7b78667ccb-6bcqz"]
Sep 10 21:32:58.022237 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:32:58.022197    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c7d48a63-385a-434e-aa18-c718c9de15bc-maas-api-tls\") pod \"maas-api-7b78667ccb-6bcqz\" (UID: \"c7d48a63-385a-434e-aa18-c718c9de15bc\") " pod="odh-ai-gateway-infra/maas-api-7b78667ccb-6bcqz"
Sep 10 21:32:58.022418 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:32:58.022371    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7d48a63-385a-434e-aa18-c718c9de15bc-metrics-certs\") pod \"maas-api-7b78667ccb-6bcqz\" (UID: \"c7d48a63-385a-434e-aa18-c718c9de15bc\") " pod="odh-ai-gateway-infra/maas-api-7b78667ccb-6bcqz"
Sep 10 21:32:58.022418 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:32:58.022406    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7d48a63-385a-434e-aa18-c718c9de15bc-openshift-service-ca\") pod \"maas-api-7b78667ccb-6bcqz\" (UID: \"c7d48a63-385a-434e-aa18-c718c9de15bc\") " pod="odh-ai-gateway-infra/maas-api-7b78667ccb-6bcqz"
Sep 10 21:32:58.022550 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:32:58.022511    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44q5n\" (UniqueName: \"kubernetes.io/projected/c7d48a63-385a-434e-aa18-c718c9de15bc-kube-api-access-44q5n\") pod \"maas-api-7b78667ccb-6bcqz\" (UID: \"c7d48a63-385a-434e-aa18-c718c9de15bc\") " pod="odh-ai-gateway-infra/maas-api-7b78667ccb-6bcqz"
Sep 10 21:32:58.123707 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:32:58.123664    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44q5n\" (UniqueName: \"kubernetes.io/projected/c7d48a63-385a-434e-aa18-c718c9de15bc-kube-api-access-44q5n\") pod \"maas-api-7b78667ccb-6bcqz\" (UID: \"c7d48a63-385a-434e-aa18-c718c9de15bc\") " pod="odh-ai-gateway-infra/maas-api-7b78667ccb-6bcqz"
Sep 10 21:32:58.123884 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:32:58.123716    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c7d48a63-385a-434e-aa18-c718c9de15bc-maas-api-tls\") pod \"maas-api-7b78667ccb-6bcqz\" (UID: \"c7d48a63-385a-434e-aa18-c718c9de15bc\") " pod="odh-ai-gateway-infra/maas-api-7b78667ccb-6bcqz"
Sep 10 21:32:58.123884 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:32:58.123783    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7d48a63-385a-434e-aa18-c718c9de15bc-metrics-certs\") pod \"maas-api-7b78667ccb-6bcqz\" (UID: \"c7d48a63-385a-434e-aa18-c718c9de15bc\") " pod="odh-ai-gateway-infra/maas-api-7b78667ccb-6bcqz"
Sep 10 21:32:58.123884 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:32:58.123806    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7d48a63-385a-434e-aa18-c718c9de15bc-openshift-service-ca\") pod \"maas-api-7b78667ccb-6bcqz\" (UID: \"c7d48a63-385a-434e-aa18-c718c9de15bc\") " pod="odh-ai-gateway-infra/maas-api-7b78667ccb-6bcqz"
Sep 10 21:32:58.124536 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:32:58.124515    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7d48a63-385a-434e-aa18-c718c9de15bc-openshift-service-ca\") pod \"maas-api-7b78667ccb-6bcqz\" (UID: \"c7d48a63-385a-434e-aa18-c718c9de15bc\") " pod="odh-ai-gateway-infra/maas-api-7b78667ccb-6bcqz"
Sep 10 21:32:58.126333 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:32:58.126306    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7d48a63-385a-434e-aa18-c718c9de15bc-metrics-certs\") pod \"maas-api-7b78667ccb-6bcqz\" (UID: \"c7d48a63-385a-434e-aa18-c718c9de15bc\") " pod="odh-ai-gateway-infra/maas-api-7b78667ccb-6bcqz"
Sep 10 21:32:58.126333 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:32:58.126322    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c7d48a63-385a-434e-aa18-c718c9de15bc-maas-api-tls\") pod \"maas-api-7b78667ccb-6bcqz\" (UID: \"c7d48a63-385a-434e-aa18-c718c9de15bc\") " pod="odh-ai-gateway-infra/maas-api-7b78667ccb-6bcqz"
Sep 10 21:32:58.134553 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:32:58.134527    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-44q5n\" (UniqueName: \"kubernetes.io/projected/c7d48a63-385a-434e-aa18-c718c9de15bc-kube-api-access-44q5n\") pod \"maas-api-7b78667ccb-6bcqz\" (UID: \"c7d48a63-385a-434e-aa18-c718c9de15bc\") " pod="odh-ai-gateway-infra/maas-api-7b78667ccb-6bcqz"
Sep 10 21:32:58.310771 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:32:58.310739    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7b78667ccb-6bcqz"
Sep 10 21:32:58.589602 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:32:58.589539    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7b78667ccb-6bcqz"]
Sep 10 21:32:58.591906 ip-10-0-129-100 kubenswrapper[2564]: W0910 21:32:58.591868    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7d48a63_385a_434e_aa18_c718c9de15bc.slice/crio-2f4bb06526ce61b93f3f727781f40169d22da71b1816685bc5b9bc79a51b3537 WatchSource:0}: Error finding container 2f4bb06526ce61b93f3f727781f40169d22da71b1816685bc5b9bc79a51b3537: Status 404 returned error can't find the container with id 2f4bb06526ce61b93f3f727781f40169d22da71b1816685bc5b9bc79a51b3537
Sep 10 21:32:58.593111 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:32:58.593093    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 21:32:58.945656 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:32:58.945570    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7b78667ccb-6bcqz" event={"ID":"c7d48a63-385a-434e-aa18-c718c9de15bc","Type":"ContainerStarted","Data":"2f4bb06526ce61b93f3f727781f40169d22da71b1816685bc5b9bc79a51b3537"}
Sep 10 21:33:00.327938 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:33:00.327902    2564 scope.go:117] "RemoveContainer" containerID="49f09043676652401022bb8aa71a42d21ec699f19d5f32e3aa034ab4df5fcc7c"
Sep 10 21:33:00.957757 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:33:00.957721    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7b78667ccb-6bcqz" event={"ID":"c7d48a63-385a-434e-aa18-c718c9de15bc","Type":"ContainerStarted","Data":"ef4b79a6be6a23aca6f2bff1f98ab828d0a5cf093602c649e38dae7c488c395f"}
Sep 10 21:33:00.957935 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:33:00.957855    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7b78667ccb-6bcqz"
Sep 10 21:33:00.977728 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:33:00.977671    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7b78667ccb-6bcqz" podStartSLOduration=1.784509895 podStartE2EDuration="3.977652997s" totalImagesPullingTime="2.193143102s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 21:32:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:33:00.976823988 +0000 UTC m=+2161.663891267" watchObservedRunningTime="2026-09-10 21:33:00.977652997 +0000 UTC m=+2161.664720276"
Sep 10 21:33:06.012482 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:33:06.012450    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-7b78667ccb-6bcqz"]
Sep 10 21:33:06.012885 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:33:06.012642    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-7b78667ccb-6bcqz" podUID="c7d48a63-385a-434e-aa18-c718c9de15bc" containerName="maas-api" containerID="cri-o://ef4b79a6be6a23aca6f2bff1f98ab828d0a5cf093602c649e38dae7c488c395f" gracePeriod=30
Sep 10 21:33:06.017553 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:33:06.017527    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7b78667ccb-6bcqz"
Sep 10 21:33:06.255493 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:33:06.255469    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7b78667ccb-6bcqz"
Sep 10 21:33:06.299565 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:33:06.299532    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7d48a63-385a-434e-aa18-c718c9de15bc-openshift-service-ca\") pod \"c7d48a63-385a-434e-aa18-c718c9de15bc\" (UID: \"c7d48a63-385a-434e-aa18-c718c9de15bc\") "
Sep 10 21:33:06.300182 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:33:06.299601    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-44q5n\" (UniqueName: \"kubernetes.io/projected/c7d48a63-385a-434e-aa18-c718c9de15bc-kube-api-access-44q5n\") pod \"c7d48a63-385a-434e-aa18-c718c9de15bc\" (UID: \"c7d48a63-385a-434e-aa18-c718c9de15bc\") "
Sep 10 21:33:06.300182 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:33:06.299673    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7d48a63-385a-434e-aa18-c718c9de15bc-metrics-certs\") pod \"c7d48a63-385a-434e-aa18-c718c9de15bc\" (UID: \"c7d48a63-385a-434e-aa18-c718c9de15bc\") "
Sep 10 21:33:06.300182 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:33:06.299723    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c7d48a63-385a-434e-aa18-c718c9de15bc-maas-api-tls\") pod \"c7d48a63-385a-434e-aa18-c718c9de15bc\" (UID: \"c7d48a63-385a-434e-aa18-c718c9de15bc\") "
Sep 10 21:33:06.300182 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:33:06.299988    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7d48a63-385a-434e-aa18-c718c9de15bc-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c7d48a63-385a-434e-aa18-c718c9de15bc" (UID: "c7d48a63-385a-434e-aa18-c718c9de15bc"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 21:33:06.302669 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:33:06.302640    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c7d48a63-385a-434e-aa18-c718c9de15bc-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c7d48a63-385a-434e-aa18-c718c9de15bc" (UID: "c7d48a63-385a-434e-aa18-c718c9de15bc"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:33:06.302935 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:33:06.302912    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c7d48a63-385a-434e-aa18-c718c9de15bc-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c7d48a63-385a-434e-aa18-c718c9de15bc" (UID: "c7d48a63-385a-434e-aa18-c718c9de15bc"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 21:33:06.302935 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:33:06.302918    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7d48a63-385a-434e-aa18-c718c9de15bc-kube-api-access-44q5n" (OuterVolumeSpecName: "kube-api-access-44q5n") pod "c7d48a63-385a-434e-aa18-c718c9de15bc" (UID: "c7d48a63-385a-434e-aa18-c718c9de15bc"). InnerVolumeSpecName "kube-api-access-44q5n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 21:33:06.400932 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:33:06.400892    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7d48a63-385a-434e-aa18-c718c9de15bc-metrics-certs\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:33:06.400932 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:33:06.400923    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c7d48a63-385a-434e-aa18-c718c9de15bc-maas-api-tls\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:33:06.400932 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:33:06.400936    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7d48a63-385a-434e-aa18-c718c9de15bc-openshift-service-ca\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:33:06.401175 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:33:06.400949    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-44q5n\" (UniqueName: \"kubernetes.io/projected/c7d48a63-385a-434e-aa18-c718c9de15bc-kube-api-access-44q5n\") on node \"ip-10-0-129-100.ec2.internal\" DevicePath \"\""
Sep 10 21:33:06.991571 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:33:06.991526    2564 generic.go:356] "Generic (PLEG): container finished" podID="c7d48a63-385a-434e-aa18-c718c9de15bc" containerID="ef4b79a6be6a23aca6f2bff1f98ab828d0a5cf093602c649e38dae7c488c395f" exitCode=0
Sep 10 21:33:06.991756 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:33:06.991587    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7b78667ccb-6bcqz"
Sep 10 21:33:06.991756 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:33:06.991612    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7b78667ccb-6bcqz" event={"ID":"c7d48a63-385a-434e-aa18-c718c9de15bc","Type":"ContainerDied","Data":"ef4b79a6be6a23aca6f2bff1f98ab828d0a5cf093602c649e38dae7c488c395f"}
Sep 10 21:33:06.991756 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:33:06.991667    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7b78667ccb-6bcqz" event={"ID":"c7d48a63-385a-434e-aa18-c718c9de15bc","Type":"ContainerDied","Data":"2f4bb06526ce61b93f3f727781f40169d22da71b1816685bc5b9bc79a51b3537"}
Sep 10 21:33:06.991756 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:33:06.991691    2564 scope.go:117] "RemoveContainer" containerID="ef4b79a6be6a23aca6f2bff1f98ab828d0a5cf093602c649e38dae7c488c395f"
Sep 10 21:33:07.001358 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:33:07.001323    2564 scope.go:117] "RemoveContainer" containerID="ef4b79a6be6a23aca6f2bff1f98ab828d0a5cf093602c649e38dae7c488c395f"
Sep 10 21:33:07.001613 ip-10-0-129-100 kubenswrapper[2564]: E0910 21:33:07.001596    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef4b79a6be6a23aca6f2bff1f98ab828d0a5cf093602c649e38dae7c488c395f\": container with ID starting with ef4b79a6be6a23aca6f2bff1f98ab828d0a5cf093602c649e38dae7c488c395f not found: ID does not exist" containerID="ef4b79a6be6a23aca6f2bff1f98ab828d0a5cf093602c649e38dae7c488c395f"
Sep 10 21:33:07.001663 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:33:07.001621    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef4b79a6be6a23aca6f2bff1f98ab828d0a5cf093602c649e38dae7c488c395f"} err="failed to get container status \"ef4b79a6be6a23aca6f2bff1f98ab828d0a5cf093602c649e38dae7c488c395f\": rpc error: code = NotFound desc = could not find container \"ef4b79a6be6a23aca6f2bff1f98ab828d0a5cf093602c649e38dae7c488c395f\": container with ID starting with ef4b79a6be6a23aca6f2bff1f98ab828d0a5cf093602c649e38dae7c488c395f not found: ID does not exist"
Sep 10 21:33:07.013288 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:33:07.013266    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-7b78667ccb-6bcqz"]
Sep 10 21:33:07.017359 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:33:07.017339    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-7b78667ccb-6bcqz"]
Sep 10 21:33:07.874272 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:33:07.874215    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7d48a63-385a-434e-aa18-c718c9de15bc" path="/var/lib/kubelet/pods/c7d48a63-385a-434e-aa18-c718c9de15bc/volumes"
Sep 10 21:33:34.519658 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:33:34.519630    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-769bdd6b4-4w25p_32a7c0c7-3e70-46c0-a59f-68a66599268d/copy-manifests/0.log"
Sep 10 21:33:34.526458 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:33:34.526437    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-769bdd6b4-4w25p_32a7c0c7-3e70-46c0-a59f-68a66599268d/manager/0.log"
Sep 10 21:33:36.509451 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:33:36.509422    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-kf794_f6ce88a4-29a8-4cb2-96ac-c0bda5cf5d28/manager/0.log"
Sep 10 21:33:36.861040 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:33:36.861010    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-ww2lm_a768e075-70b9-4315-bbde-c10df13f0f46/manager/0.log"
Sep 10 21:33:37.116895 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:33:37.116819    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-t5p2c_f8ad85fd-15fe-474f-bceb-c40d90f9eeba/manager/0.log"
Sep 10 21:33:37.602832 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:33:37.602806    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-tb9xl_e68a64c9-ede8-4fd8-9ca6-c5a498436133/discovery/0.log"
Sep 10 21:33:37.716683 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:33:37.716656    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-98c4dbc44-cqktq_a116643c-dd31-4836-9d92-20875ee44512/kube-auth-proxy/0.log"
Sep 10 21:33:38.313406 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:33:38.313375    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6c999c4888-wrq4b_c1c5af58-1a57-4208-b8ac-0a37ef4efd70/router/0.log"
Sep 10 21:33:38.802983 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:33:38.802959    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-87zd7_2d3046f2-199e-4540-84e6-212ff2c21614/main/0.log"
Sep 10 21:33:39.046195 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:33:39.046154    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-zbnnd_abb3b426-5dca-4c3d-8cfb-774ceaed77f0/main/0.log"
Sep 10 21:33:39.161435 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:33:39.161350    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh4bgf_3d508514-a070-4b5c-bca5-b0fd59b66893/main/0.log"
Sep 10 21:33:48.397391 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:33:48.397353    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-gzgtl_170f8023-6b23-45c5-b7bf-6da8b42be3cd/global-pull-secret-syncer/0.log"
Sep 10 21:33:48.611690 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:33:48.611656    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-v6rs4_fb41bc68-2c7c-442e-8260-26cbf842f702/konnectivity-agent/0.log"
Sep 10 21:33:48.631942 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:33:48.631916    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-100.ec2.internal_39d7ad530ef8927e7726fb19029c9345/haproxy/0.log"
Sep 10 21:33:52.795529 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:33:52.795500    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-kf794_f6ce88a4-29a8-4cb2-96ac-c0bda5cf5d28/manager/0.log"
Sep 10 21:33:52.920929 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:33:52.920897    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-ww2lm_a768e075-70b9-4315-bbde-c10df13f0f46/manager/0.log"
Sep 10 21:33:53.072879 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:33:53.072801    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-t5p2c_f8ad85fd-15fe-474f-bceb-c40d90f9eeba/manager/0.log"
Sep 10 21:33:54.928122 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:33:54.928093    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5nr82_06642a12-af0d-4d45-889b-42e99b721de9/node-exporter/0.log"
Sep 10 21:33:54.952240 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:33:54.952215    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5nr82_06642a12-af0d-4d45-889b-42e99b721de9/kube-rbac-proxy/0.log"
Sep 10 21:33:54.974364 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:33:54.974337    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5nr82_06642a12-af0d-4d45-889b-42e99b721de9/init-textfile/0.log"
Sep 10 21:33:58.007845 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:33:58.007810    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-cd9hp_0432bad8-86f5-4b0e-a0d4-2fdb728223f2/console-operator/2.log"
Sep 10 21:33:58.011591 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:33:58.011564    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-cd9hp_0432bad8-86f5-4b0e-a0d4-2fdb728223f2/console-operator/3.log"
Sep 10 21:33:58.542980 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:33:58.542951    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5d956c944c-2h59z_3c5b12bf-34c9-4e32-bad4-7d4d9ab44ab1/console/0.log"
Sep 10 21:33:58.732258 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:33:58.732211    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2hcpt/perf-node-gather-daemonset-hmklv"]
Sep 10 21:33:58.732568 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:33:58.732555    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7d48a63-385a-434e-aa18-c718c9de15bc" containerName="maas-api"
Sep 10 21:33:58.732614 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:33:58.732569    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7d48a63-385a-434e-aa18-c718c9de15bc" containerName="maas-api"
Sep 10 21:33:58.732648 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:33:58.732636    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7d48a63-385a-434e-aa18-c718c9de15bc" containerName="maas-api"
Sep 10 21:33:58.735805 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:33:58.735784    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2hcpt/perf-node-gather-daemonset-hmklv"
Sep 10 21:33:58.738356 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:33:58.738336    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2hcpt\"/\"kube-root-ca.crt\""
Sep 10 21:33:58.738500 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:33:58.738480    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-2hcpt\"/\"default-dockercfg-w8z8c\""
Sep 10 21:33:58.739284 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:33:58.739269    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2hcpt\"/\"openshift-service-ca.crt\""
Sep 10 21:33:58.750296 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:33:58.750276    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2hcpt/perf-node-gather-daemonset-hmklv"]
Sep 10 21:33:58.850300 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:33:58.850267    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b6a895c2-0cac-426c-b0f6-5005ebee089d-podres\") pod \"perf-node-gather-daemonset-hmklv\" (UID: \"b6a895c2-0cac-426c-b0f6-5005ebee089d\") " pod="openshift-must-gather-2hcpt/perf-node-gather-daemonset-hmklv"
Sep 10 21:33:58.850300 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:33:58.850304    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5fw2\" (UniqueName: \"kubernetes.io/projected/b6a895c2-0cac-426c-b0f6-5005ebee089d-kube-api-access-q5fw2\") pod \"perf-node-gather-daemonset-hmklv\" (UID: \"b6a895c2-0cac-426c-b0f6-5005ebee089d\") " pod="openshift-must-gather-2hcpt/perf-node-gather-daemonset-hmklv"
Sep 10 21:33:58.850520 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:33:58.850337    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b6a895c2-0cac-426c-b0f6-5005ebee089d-sys\") pod \"perf-node-gather-daemonset-hmklv\" (UID: \"b6a895c2-0cac-426c-b0f6-5005ebee089d\") " pod="openshift-must-gather-2hcpt/perf-node-gather-daemonset-hmklv"
Sep 10 21:33:58.850520 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:33:58.850393    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b6a895c2-0cac-426c-b0f6-5005ebee089d-lib-modules\") pod \"perf-node-gather-daemonset-hmklv\" (UID: \"b6a895c2-0cac-426c-b0f6-5005ebee089d\") " pod="openshift-must-gather-2hcpt/perf-node-gather-daemonset-hmklv"
Sep 10 21:33:58.850520 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:33:58.850431    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b6a895c2-0cac-426c-b0f6-5005ebee089d-proc\") pod \"perf-node-gather-daemonset-hmklv\" (UID: \"b6a895c2-0cac-426c-b0f6-5005ebee089d\") " pod="openshift-must-gather-2hcpt/perf-node-gather-daemonset-hmklv"
Sep 10 21:33:58.951852 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:33:58.951807    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b6a895c2-0cac-426c-b0f6-5005ebee089d-proc\") pod \"perf-node-gather-daemonset-hmklv\" (UID: \"b6a895c2-0cac-426c-b0f6-5005ebee089d\") " pod="openshift-must-gather-2hcpt/perf-node-gather-daemonset-hmklv"
Sep 10 21:33:58.952062 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:33:58.951891    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b6a895c2-0cac-426c-b0f6-5005ebee089d-podres\") pod \"perf-node-gather-daemonset-hmklv\" (UID: \"b6a895c2-0cac-426c-b0f6-5005ebee089d\") " pod="openshift-must-gather-2hcpt/perf-node-gather-daemonset-hmklv"
Sep 10 21:33:58.952062 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:33:58.951920    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5fw2\" (UniqueName: \"kubernetes.io/projected/b6a895c2-0cac-426c-b0f6-5005ebee089d-kube-api-access-q5fw2\") pod \"perf-node-gather-daemonset-hmklv\" (UID: \"b6a895c2-0cac-426c-b0f6-5005ebee089d\") " pod="openshift-must-gather-2hcpt/perf-node-gather-daemonset-hmklv"
Sep 10 21:33:58.952062 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:33:58.951942    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b6a895c2-0cac-426c-b0f6-5005ebee089d-proc\") pod \"perf-node-gather-daemonset-hmklv\" (UID: \"b6a895c2-0cac-426c-b0f6-5005ebee089d\") " pod="openshift-must-gather-2hcpt/perf-node-gather-daemonset-hmklv"
Sep 10 21:33:58.952062 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:33:58.951967    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b6a895c2-0cac-426c-b0f6-5005ebee089d-sys\") pod \"perf-node-gather-daemonset-hmklv\" (UID: \"b6a895c2-0cac-426c-b0f6-5005ebee089d\") " pod="openshift-must-gather-2hcpt/perf-node-gather-daemonset-hmklv"
Sep 10 21:33:58.952062 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:33:58.951999    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b6a895c2-0cac-426c-b0f6-5005ebee089d-lib-modules\") pod \"perf-node-gather-daemonset-hmklv\" (UID: \"b6a895c2-0cac-426c-b0f6-5005ebee089d\") " pod="openshift-must-gather-2hcpt/perf-node-gather-daemonset-hmklv"
Sep 10 21:33:58.952326 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:33:58.952067    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b6a895c2-0cac-426c-b0f6-5005ebee089d-sys\") pod \"perf-node-gather-daemonset-hmklv\" (UID: \"b6a895c2-0cac-426c-b0f6-5005ebee089d\") " pod="openshift-must-gather-2hcpt/perf-node-gather-daemonset-hmklv"
Sep 10 21:33:58.952326 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:33:58.952077    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b6a895c2-0cac-426c-b0f6-5005ebee089d-podres\") pod \"perf-node-gather-daemonset-hmklv\" (UID: \"b6a895c2-0cac-426c-b0f6-5005ebee089d\") " pod="openshift-must-gather-2hcpt/perf-node-gather-daemonset-hmklv"
Sep 10 21:33:58.952326 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:33:58.952140    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b6a895c2-0cac-426c-b0f6-5005ebee089d-lib-modules\") pod \"perf-node-gather-daemonset-hmklv\" (UID: \"b6a895c2-0cac-426c-b0f6-5005ebee089d\") " pod="openshift-must-gather-2hcpt/perf-node-gather-daemonset-hmklv"
Sep 10 21:33:58.960562 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:33:58.960542    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5fw2\" (UniqueName: \"kubernetes.io/projected/b6a895c2-0cac-426c-b0f6-5005ebee089d-kube-api-access-q5fw2\") pod \"perf-node-gather-daemonset-hmklv\" (UID: \"b6a895c2-0cac-426c-b0f6-5005ebee089d\") " pod="openshift-must-gather-2hcpt/perf-node-gather-daemonset-hmklv"
Sep 10 21:33:59.045792 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:33:59.045759    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2hcpt/perf-node-gather-daemonset-hmklv"
Sep 10 21:33:59.317238 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:33:59.317199    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2hcpt/perf-node-gather-daemonset-hmklv"]
Sep 10 21:33:59.319876 ip-10-0-129-100 kubenswrapper[2564]: W0910 21:33:59.319839    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb6a895c2_0cac_426c_b0f6_5005ebee089d.slice/crio-33dcdc57b1bfa9a1bf769af87fcc0fe941196da786c7f7723bad02fd70b5f82c WatchSource:0}: Error finding container 33dcdc57b1bfa9a1bf769af87fcc0fe941196da786c7f7723bad02fd70b5f82c: Status 404 returned error can't find the container with id 33dcdc57b1bfa9a1bf769af87fcc0fe941196da786c7f7723bad02fd70b5f82c
Sep 10 21:34:00.272024 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:34:00.271903    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2hcpt/perf-node-gather-daemonset-hmklv" event={"ID":"b6a895c2-0cac-426c-b0f6-5005ebee089d","Type":"ContainerStarted","Data":"341f6dfaad92f5475af7e2c6194ee43bac5592c1e46a1c74f0a6f974a0ffbe8e"}
Sep 10 21:34:00.272024 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:34:00.271954    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2hcpt/perf-node-gather-daemonset-hmklv" event={"ID":"b6a895c2-0cac-426c-b0f6-5005ebee089d","Type":"ContainerStarted","Data":"33dcdc57b1bfa9a1bf769af87fcc0fe941196da786c7f7723bad02fd70b5f82c"}
Sep 10 21:34:00.272024 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:34:00.271981    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-2hcpt/perf-node-gather-daemonset-hmklv"
Sep 10 21:34:00.292131 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:34:00.292080    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-2hcpt/perf-node-gather-daemonset-hmklv" podStartSLOduration=2.292064113 podStartE2EDuration="2.292064113s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 21:33:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 21:34:00.289349555 +0000 UTC m=+2220.976416836" watchObservedRunningTime="2026-09-10 21:34:00.292064113 +0000 UTC m=+2220.979131391"
Sep 10 21:34:00.543918 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:34:00.543833    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kr6rh_a3b44ac1-2723-46ab-92b2-c92e3512b2d7/dns/0.log"
Sep 10 21:34:00.564042 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:34:00.564016    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kr6rh_a3b44ac1-2723-46ab-92b2-c92e3512b2d7/kube-rbac-proxy/0.log"
Sep 10 21:34:00.687975 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:34:00.687946    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-q7mfg_d9d4569d-ce78-4eaa-b2d1-22c69fb1f3bf/dns-node-resolver/0.log"
Sep 10 21:34:00.744240 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:34:00.744209    2564 scope.go:117] "RemoveContainer" containerID="f0f42f52bed377e95a8a2378302c6c012329d9f8e025a9ba43759c5b526dc845"
Sep 10 21:34:01.332181 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:34:01.332150    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nwx8r_5b37372b-e18e-4c13-abff-11909b3192fb/node-ca/0.log"
Sep 10 21:34:02.511368 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:34:02.511335    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-tb9xl_e68a64c9-ede8-4fd8-9ca6-c5a498436133/discovery/0.log"
Sep 10 21:34:02.535356 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:34:02.535329    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-98c4dbc44-cqktq_a116643c-dd31-4836-9d92-20875ee44512/kube-auth-proxy/0.log"
Sep 10 21:34:02.705277 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:34:02.705251    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6c999c4888-wrq4b_c1c5af58-1a57-4208-b8ac-0a37ef4efd70/router/0.log"
Sep 10 21:34:03.564596 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:34:03.564568    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mv4zr_9d1aef14-c1f3-402c-8232-a212f2354624/serve-healthcheck-canary/0.log"
Sep 10 21:34:04.067480 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:34:04.067445    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-6bmfj_113738d6-eb6e-43ad-919c-53f9fd812a66/insights-operator/0.log"
Sep 10 21:34:04.067707 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:34:04.067690    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-6bmfj_113738d6-eb6e-43ad-919c-53f9fd812a66/insights-operator/1.log"
Sep 10 21:34:04.234323 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:34:04.234286    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-sn6kv_7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5/kube-rbac-proxy/0.log"
Sep 10 21:34:04.258647 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:34:04.258620    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-sn6kv_7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5/exporter/0.log"
Sep 10 21:34:04.280817 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:34:04.280797    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-sn6kv_7b37b5e7-c60d-48a5-bcb5-e6b92d804dd5/extractor/0.log"
Sep 10 21:34:06.286352 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:34:06.286326    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-2hcpt/perf-node-gather-daemonset-hmklv"
Sep 10 21:34:06.755113 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:34:06.755082    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-769bdd6b4-4w25p_32a7c0c7-3e70-46c0-a59f-68a66599268d/manager/0.log"
Sep 10 21:34:06.773882 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:34:06.773861    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-769bdd6b4-4w25p_32a7c0c7-3e70-46c0-a59f-68a66599268d/copy-manifests/0.log"
Sep 10 21:34:09.034525 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:34:09.034442    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-tb9xl_e68a64c9-ede8-4fd8-9ca6-c5a498436133/discovery/0.log"
Sep 10 21:34:09.046167 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:34:09.046146    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-98c4dbc44-cqktq_a116643c-dd31-4836-9d92-20875ee44512/kube-auth-proxy/0.log"
Sep 10 21:34:09.150131 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:34:09.150096    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6c999c4888-wrq4b_c1c5af58-1a57-4208-b8ac-0a37ef4efd70/router/0.log"
Sep 10 21:34:10.845222 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:34:10.845183    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-tb9xl_e68a64c9-ede8-4fd8-9ca6-c5a498436133/discovery/0.log"
Sep 10 21:34:10.860853 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:34:10.860831    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-98c4dbc44-cqktq_a116643c-dd31-4836-9d92-20875ee44512/kube-auth-proxy/0.log"
Sep 10 21:34:10.977834 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:34:10.977806    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6c999c4888-wrq4b_c1c5af58-1a57-4208-b8ac-0a37ef4efd70/router/0.log"
Sep 10 21:34:13.977158 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:34:13.977129    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-vhb8c_5e15b3b7-d93d-42fa-85a5-2a2f529e5649/kube-storage-version-migrator-operator/1.log"
Sep 10 21:34:13.977991 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:34:13.977971    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-vhb8c_5e15b3b7-d93d-42fa-85a5-2a2f529e5649/kube-storage-version-migrator-operator/0.log"
Sep 10 21:34:15.152681 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:34:15.152652    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b5t78_1100e6a5-d621-4dd1-b855-13eb97c00682/kube-multus-additional-cni-plugins/0.log"
Sep 10 21:34:15.173672 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:34:15.173646    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b5t78_1100e6a5-d621-4dd1-b855-13eb97c00682/egress-router-binary-copy/0.log"
Sep 10 21:34:15.193785 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:34:15.193763    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b5t78_1100e6a5-d621-4dd1-b855-13eb97c00682/cni-plugins/0.log"
Sep 10 21:34:15.214276 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:34:15.214255    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b5t78_1100e6a5-d621-4dd1-b855-13eb97c00682/bond-cni-plugin/0.log"
Sep 10 21:34:15.235630 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:34:15.235593    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b5t78_1100e6a5-d621-4dd1-b855-13eb97c00682/routeoverride-cni/0.log"
Sep 10 21:34:15.256161 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:34:15.256134    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b5t78_1100e6a5-d621-4dd1-b855-13eb97c00682/whereabouts-cni-bincopy/0.log"
Sep 10 21:34:15.276310 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:34:15.276286    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b5t78_1100e6a5-d621-4dd1-b855-13eb97c00682/whereabouts-cni/0.log"
Sep 10 21:34:15.485905 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:34:15.485834    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-g9h2b_982ffbde-1f2c-4786-86e2-095af29ab25b/kube-multus/0.log"
Sep 10 21:34:15.690975 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:34:15.690950    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zbw7p_27227947-500c-4146-a89f-798ea3bce890/network-metrics-daemon/0.log"
Sep 10 21:34:15.712343 ip-10-0-129-100 kubenswrapper[2564]: I0910 21:34:15.712318    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zbw7p_27227947-500c-4146-a89f-798ea3bce890/kube-rbac-proxy/0.log"