Sep 08 07:02:21.155336 ip-10-0-133-164 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 08 07:02:21.155347 ip-10-0-133-164 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 08 07:02:21.155356 ip-10-0-133-164 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 08 07:02:21.155772 ip-10-0-133-164 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 08 07:02:30.667104 ip-10-0-133-164 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 08 07:02:30.667115 ip-10-0-133-164 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot f8f6ebad63e84dc18fc1252415eba3c9 --
Sep 08 07:04:10.653456 ip-10-0-133-164 systemd[1]: Starting Kubernetes Kubelet...
Sep 08 07:04:11.102503 ip-10-0-133-164 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 08 07:04:11.102503 ip-10-0-133-164 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 08 07:04:11.102503 ip-10-0-133-164 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 08 07:04:11.102503 ip-10-0-133-164 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 08 07:04:11.102503 ip-10-0-133-164 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 08 07:04:11.103185 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.102520    2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 08 07:04:11.109598 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109581    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 07:04:11.109598 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109596    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 07:04:11.109598 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109600    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 07:04:11.109690 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109603    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 07:04:11.109690 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109606    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 07:04:11.109690 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109609    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 07:04:11.109690 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109612    2564 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 07:04:11.109690 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109615    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 07:04:11.109690 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109618    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 07:04:11.109690 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109631    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 07:04:11.109690 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109634    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 07:04:11.109690 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109637    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 07:04:11.109690 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109639    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 07:04:11.109690 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109642    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 07:04:11.109690 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109647    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 07:04:11.109690 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109650    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 07:04:11.109690 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109652    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 07:04:11.109690 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109655    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 07:04:11.109690 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109658    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 07:04:11.109690 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109661    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 07:04:11.109690 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109664    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 07:04:11.109690 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109667    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 07:04:11.109690 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109669    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 07:04:11.110181 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109672    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 07:04:11.110181 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109675    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 07:04:11.110181 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109677    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 07:04:11.110181 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109680    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 07:04:11.110181 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109683    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 07:04:11.110181 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109685    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 07:04:11.110181 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109688    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 07:04:11.110181 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109691    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 07:04:11.110181 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109693    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 07:04:11.110181 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109696    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 07:04:11.110181 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109699    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 07:04:11.110181 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109702    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 07:04:11.110181 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109705    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 07:04:11.110181 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109707    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 07:04:11.110181 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109710    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 07:04:11.110181 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109713    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 07:04:11.110181 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109716    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 07:04:11.110181 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109719    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 07:04:11.110181 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109722    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 07:04:11.110181 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109724    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 07:04:11.110663 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109727    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 07:04:11.110663 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109732    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 07:04:11.110663 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109736    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 07:04:11.110663 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109739    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 07:04:11.110663 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109741    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 07:04:11.110663 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109744    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 07:04:11.110663 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109747    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 07:04:11.110663 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109749    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 07:04:11.110663 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109752    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 07:04:11.110663 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109754    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 07:04:11.110663 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109757    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 07:04:11.110663 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109759    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 07:04:11.110663 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109763    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 07:04:11.110663 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109766    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 07:04:11.110663 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109769    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 07:04:11.110663 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109773    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 07:04:11.110663 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109777    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 07:04:11.110663 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109780    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 07:04:11.110663 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109783    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 07:04:11.111140 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109786    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 07:04:11.111140 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109790    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 07:04:11.111140 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109792    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 07:04:11.111140 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109795    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 07:04:11.111140 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109798    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 07:04:11.111140 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109800    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 07:04:11.111140 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109803    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 07:04:11.111140 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109806    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 07:04:11.111140 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109808    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 07:04:11.111140 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109812    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 07:04:11.111140 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109815    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 07:04:11.111140 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109820    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 07:04:11.111140 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109823    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 07:04:11.111140 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109826    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 07:04:11.111140 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109829    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 07:04:11.111140 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109832    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 07:04:11.111140 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109835    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 07:04:11.111140 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109838    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 07:04:11.111140 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109840    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 07:04:11.111598 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109843    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 07:04:11.111598 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109846    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 07:04:11.111598 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109849    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 07:04:11.111598 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109851    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 07:04:11.111598 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109854    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 07:04:11.111598 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109857    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 07:04:11.111598 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109860    2564 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 07:04:11.111598 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109863    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 07:04:11.111598 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109866    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 07:04:11.111598 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109868    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 07:04:11.111598 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109871    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 07:04:11.111598 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109873    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 07:04:11.111598 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109876    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 07:04:11.111598 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109879    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 07:04:11.111598 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109882    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 07:04:11.111598 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109884    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 07:04:11.111598 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109887    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 07:04:11.111598 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.109889    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 07:04:11.111598 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110573    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 07:04:11.111598 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110579    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 07:04:11.112152 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110582    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 07:04:11.112152 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110585    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 07:04:11.112152 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110587    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 07:04:11.112152 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110593    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 07:04:11.112152 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110597    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 07:04:11.112152 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110601    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 07:04:11.112152 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110604    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 07:04:11.112152 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110607    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 07:04:11.112152 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110609    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 07:04:11.112152 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110612    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 07:04:11.112152 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110615    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 07:04:11.112152 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110617    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 07:04:11.112152 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110620    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 07:04:11.112152 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110622    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 07:04:11.112152 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110625    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 07:04:11.112152 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110627    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 07:04:11.112152 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110630    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 07:04:11.112152 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110633    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 07:04:11.112152 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110635    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 07:04:11.112637 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110639    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 07:04:11.112637 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110642    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 07:04:11.112637 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110645    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 07:04:11.112637 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110647    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 07:04:11.112637 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110650    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 07:04:11.112637 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110652    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 07:04:11.112637 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110655    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 07:04:11.112637 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110658    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 07:04:11.112637 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110660    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 07:04:11.112637 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110663    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 07:04:11.112637 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110666    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 07:04:11.112637 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110668    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 07:04:11.112637 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110671    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 07:04:11.112637 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110673    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 07:04:11.112637 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110676    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 07:04:11.112637 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110679    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 07:04:11.112637 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110682    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 07:04:11.112637 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110686    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 07:04:11.112637 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110689    2564 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 07:04:11.112637 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110691    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 07:04:11.113144 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110695    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 07:04:11.113144 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110699    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 07:04:11.113144 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110702    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 07:04:11.113144 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110704    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 07:04:11.113144 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110707    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 07:04:11.113144 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110710    2564 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 07:04:11.113144 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110713    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 07:04:11.113144 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110716    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 07:04:11.113144 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110719    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 07:04:11.113144 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110721    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 07:04:11.113144 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110724    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 07:04:11.113144 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110727    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 07:04:11.113144 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110730    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 07:04:11.113144 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110732    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 07:04:11.113144 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110735    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 07:04:11.113144 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110737    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 07:04:11.113144 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110740    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 07:04:11.113144 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110743    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 07:04:11.113144 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110745    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 07:04:11.113649 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110748    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 07:04:11.113649 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110750    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 07:04:11.113649 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110753    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 07:04:11.113649 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110755    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 07:04:11.113649 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110758    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 07:04:11.113649 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110760    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 07:04:11.113649 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110763    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 07:04:11.113649 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110765    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 07:04:11.113649 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110768    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 07:04:11.113649 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110770    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 07:04:11.113649 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110773    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 07:04:11.113649 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110776    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 07:04:11.113649 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110779    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 07:04:11.113649 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110781    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 07:04:11.113649 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110785    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 07:04:11.113649 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110787    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 07:04:11.113649 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110790    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 07:04:11.113649 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110792    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 07:04:11.113649 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110795    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 07:04:11.113649 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110797    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 07:04:11.114159 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110801    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 07:04:11.114159 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110803    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 07:04:11.114159 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110805    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 07:04:11.114159 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110808    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 07:04:11.114159 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110814    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 07:04:11.114159 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110818    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 07:04:11.114159 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110822    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 07:04:11.114159 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110825    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 07:04:11.114159 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110828    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 07:04:11.114159 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110831    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 07:04:11.114159 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110834    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 07:04:11.114159 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110837    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 07:04:11.114159 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110839    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 07:04:11.114159 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110842    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 07:04:11.114159 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110845    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 07:04:11.114159 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110847    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 07:04:11.114159 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110850    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 07:04:11.114159 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110852    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 07:04:11.114159 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.110855    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 07:04:11.114159 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111258    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 07:04:11.114661 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111264    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 07:04:11.114661 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111267    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 07:04:11.114661 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111270    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 07:04:11.114661 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111276    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 07:04:11.114661 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111279    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 07:04:11.114661 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111283    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 07:04:11.114661 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111286    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 07:04:11.114661 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111289    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 07:04:11.114661 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111292    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 07:04:11.114661 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111294    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 07:04:11.114661 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111297    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 07:04:11.114661 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111300    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 07:04:11.114661 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111302    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 07:04:11.114661 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111305    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 07:04:11.114661 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111308    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 07:04:11.114661 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111310    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 07:04:11.114661 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111315    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 07:04:11.114661 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111317    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 07:04:11.114661 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111320    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 07:04:11.114661 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111322    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 07:04:11.115169 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111325    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 07:04:11.115169 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111328    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 07:04:11.115169 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111330    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 07:04:11.115169 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111333    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 07:04:11.115169 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111337    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 07:04:11.115169 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111340    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 07:04:11.115169 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111343    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 07:04:11.115169 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111346    2564 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 07:04:11.115169 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111348    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 07:04:11.115169 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111352    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 07:04:11.115169 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111354    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 07:04:11.115169 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111357    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 07:04:11.115169 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111359    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 07:04:11.115169 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111362    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 07:04:11.115169 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111364    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 07:04:11.115169 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111367    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 07:04:11.115169 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111370    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 07:04:11.115169 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111373    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 07:04:11.115169 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111375    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 07:04:11.115169 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111378    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 07:04:11.115659 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111380    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 07:04:11.115659 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111383    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 07:04:11.115659 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111385    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 07:04:11.115659 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111388    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 07:04:11.115659 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111390    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 07:04:11.115659 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111392    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 07:04:11.115659 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111396    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 07:04:11.115659 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111399    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 07:04:11.115659 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111402    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 07:04:11.115659 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111405    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 07:04:11.115659 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111408    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 07:04:11.115659 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111410    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 07:04:11.115659 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111413    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 07:04:11.115659 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111415    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 07:04:11.115659 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111418    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 07:04:11.115659 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111422    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 07:04:11.115659 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111425    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 07:04:11.115659 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111428    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 07:04:11.115659 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111430    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 07:04:11.115659 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111433    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 07:04:11.116150 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111435    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 07:04:11.116150 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111438    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 07:04:11.116150 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111442    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 07:04:11.116150 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111446    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 07:04:11.116150 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111449    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 07:04:11.116150 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111452    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 07:04:11.116150 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111455    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 07:04:11.116150 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111457    2564 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 07:04:11.116150 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111463    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 07:04:11.116150 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111467    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 07:04:11.116150 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111470    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 07:04:11.116150 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111473    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 07:04:11.116150 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111475    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 07:04:11.116150 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111478    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 07:04:11.116150 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111481    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 07:04:11.116150 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111483    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 07:04:11.116150 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111486    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 07:04:11.116150 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111488    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 07:04:11.116150 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111493    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 07:04:11.116621 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111495    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 07:04:11.116621 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111499    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 07:04:11.116621 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111502    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 07:04:11.116621 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111504    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 07:04:11.116621 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111507    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 07:04:11.116621 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111509    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 07:04:11.116621 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111512    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 07:04:11.116621 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111514    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 07:04:11.116621 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111517    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 07:04:11.116621 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111519    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 07:04:11.116621 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111522    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 07:04:11.116621 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111525    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 07:04:11.116621 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111527    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 07:04:11.116621 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111530    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 07:04:11.116621 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111532    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 07:04:11.116621 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111535    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 07:04:11.116621 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111537    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 07:04:11.116621 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111539    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 07:04:11.116621 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.111542    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 07:04:11.116621 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111608    2564 flags.go:64] FLAG: --address="0.0.0.0"
Sep 08 07:04:11.117159 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111642    2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 08 07:04:11.117159 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111648    2564 flags.go:64] FLAG: --anonymous-auth="true"
Sep 08 07:04:11.117159 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111653    2564 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 08 07:04:11.117159 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111657    2564 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 08 07:04:11.117159 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111660    2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 08 07:04:11.117159 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111664    2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 08 07:04:11.117159 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111668    2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 08 07:04:11.117159 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111671    2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 08 07:04:11.117159 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111674    2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 08 07:04:11.117159 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111677    2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 08 07:04:11.117159 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111681    2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 08 07:04:11.117159 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111685    2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 08 07:04:11.117159 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111688    2564 flags.go:64] FLAG: --cgroup-root=""
Sep 08 07:04:11.117159 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111692    2564 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 08 07:04:11.117159 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111695    2564 flags.go:64] FLAG: --client-ca-file=""
Sep 08 07:04:11.117159 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111698    2564 flags.go:64] FLAG: --cloud-provider="external"
Sep 08 07:04:11.117159 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111701    2564 flags.go:64] FLAG: --cluster-dns="[]"
Sep 08 07:04:11.117159 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111705    2564 flags.go:64] FLAG: --cluster-domain=""
Sep 08 07:04:11.117159 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111708    2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 08 07:04:11.117159 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111711    2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 08 07:04:11.117159 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111714    2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 08 07:04:11.117159 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111718    2564 flags.go:64] FLAG: --container-log-max-files="5"
Sep 08 07:04:11.117159 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111722    2564 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 08 07:04:11.117159 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111724    2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 08 07:04:11.117767 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111727    2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 08 07:04:11.117767 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111731    2564 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 08 07:04:11.117767 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111734    2564 flags.go:64] FLAG: --contention-profiling="false"
Sep 08 07:04:11.117767 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111737    2564 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 08 07:04:11.117767 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111740    2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 08 07:04:11.117767 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111743    2564 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 08 07:04:11.117767 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111746    2564 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 08 07:04:11.117767 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111749    2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 08 07:04:11.117767 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111752    2564 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 08 07:04:11.117767 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111755    2564 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 08 07:04:11.117767 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111758    2564 flags.go:64] FLAG: --enable-load-reader="false"
Sep 08 07:04:11.117767 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111761    2564 flags.go:64] FLAG: --enable-server="true"
Sep 08 07:04:11.117767 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111764    2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 08 07:04:11.117767 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111770    2564 flags.go:64] FLAG: --event-burst="100"
Sep 08 07:04:11.117767 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111773    2564 flags.go:64] FLAG: --event-qps="50"
Sep 08 07:04:11.117767 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111775    2564 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 08 07:04:11.117767 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111778    2564 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 08 07:04:11.117767 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111781    2564 flags.go:64] FLAG: --eviction-hard=""
Sep 08 07:04:11.117767 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111785    2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 08 07:04:11.117767 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111788    2564 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 08 07:04:11.117767 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111791    2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 08 07:04:11.117767 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111795    2564 flags.go:64] FLAG: --eviction-soft=""
Sep 08 07:04:11.117767 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111798    2564 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 08 07:04:11.117767 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111801    2564 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 08 07:04:11.117767 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111804    2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 08 07:04:11.118412 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111807    2564 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 08 07:04:11.118412 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111810    2564 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 08 07:04:11.118412 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111813    2564 flags.go:64] FLAG: --fail-swap-on="true"
Sep 08 07:04:11.118412 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111816    2564 flags.go:64] FLAG: --feature-gates=""
Sep 08 07:04:11.118412 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111820    2564 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 08 07:04:11.118412 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111823    2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 08 07:04:11.118412 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111826    2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 08 07:04:11.118412 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111829    2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 08 07:04:11.118412 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111832    2564 flags.go:64] FLAG: --healthz-port="10248"
Sep 08 07:04:11.118412 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111835    2564 flags.go:64] FLAG: --help="false"
Sep 08 07:04:11.118412 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111838    2564 flags.go:64] FLAG: --hostname-override="ip-10-0-133-164.ec2.internal"
Sep 08 07:04:11.118412 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111841    2564 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 08 07:04:11.118412 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111844    2564 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 08 07:04:11.118412 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111847    2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 08 07:04:11.118412 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111851    2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 08 07:04:11.118412 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111854    2564 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 08 07:04:11.118412 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111857    2564 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 08 07:04:11.118412 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111860    2564 flags.go:64] FLAG: --image-service-endpoint=""
Sep 08 07:04:11.118412 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111862    2564 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 08 07:04:11.118412 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111865    2564 flags.go:64] FLAG: --kube-api-burst="100"
Sep 08 07:04:11.118412 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111868    2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 08 07:04:11.118412 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111872    2564 flags.go:64] FLAG: --kube-api-qps="50"
Sep 08 07:04:11.118412 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111874    2564 flags.go:64] FLAG: --kube-reserved=""
Sep 08 07:04:11.118412 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111877    2564 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 08 07:04:11.119004 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111880    2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 08 07:04:11.119004 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111883    2564 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 08 07:04:11.119004 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111886    2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 08 07:04:11.119004 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111889    2564 flags.go:64] FLAG: --lock-file=""
Sep 08 07:04:11.119004 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111893    2564 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 08 07:04:11.119004 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111896    2564 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 08 07:04:11.119004 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111899    2564 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 08 07:04:11.119004 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111905    2564 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 08 07:04:11.119004 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111907    2564 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 08 07:04:11.119004 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111910    2564 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 08 07:04:11.119004 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111914    2564 flags.go:64] FLAG: --logging-format="text"
Sep 08 07:04:11.119004 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111916    2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 08 07:04:11.119004 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111920    2564 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 08 07:04:11.119004 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111923    2564 flags.go:64] FLAG: --manifest-url=""
Sep 08 07:04:11.119004 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111926    2564 flags.go:64] FLAG: --manifest-url-header=""
Sep 08 07:04:11.119004 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111930    2564 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 08 07:04:11.119004 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111933    2564 flags.go:64] FLAG: --max-open-files="1000000"
Sep 08 07:04:11.119004 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111937    2564 flags.go:64] FLAG: --max-pods="110"
Sep 08 07:04:11.119004 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111940    2564 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 08 07:04:11.119004 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111943    2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 08 07:04:11.119004 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111945    2564 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 08 07:04:11.119004 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111948    2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 08 07:04:11.119004 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111951    2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 08 07:04:11.119004 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111954    2564 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 08 07:04:11.119004 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111957    2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 08 07:04:11.119656 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111965    2564 flags.go:64] FLAG: --node-status-max-images="50"
Sep 08 07:04:11.119656 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111968    2564 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 08 07:04:11.119656 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111971    2564 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 08 07:04:11.119656 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111974    2564 flags.go:64] FLAG: --pod-cidr=""
Sep 08 07:04:11.119656 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111977    2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 08 07:04:11.119656 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111983    2564 flags.go:64] FLAG: --pod-manifest-path=""
Sep 08 07:04:11.119656 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111986    2564 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 08 07:04:11.119656 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111989    2564 flags.go:64] FLAG: --pods-per-core="0"
Sep 08 07:04:11.119656 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111991    2564 flags.go:64] FLAG: --port="10250"
Sep 08 07:04:11.119656 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111995    2564 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 08 07:04:11.119656 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.111997    2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0cc66c2140f2476ba"
Sep 08 07:04:11.119656 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.112001    2564 flags.go:64] FLAG: --qos-reserved=""
Sep 08 07:04:11.119656 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.112005    2564 flags.go:64] FLAG: --read-only-port="10255"
Sep 08 07:04:11.119656 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.112008    2564 flags.go:64] FLAG: --register-node="true"
Sep 08 07:04:11.119656 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.112011    2564 flags.go:64] FLAG: --register-with-taints=""
Sep 08 07:04:11.119656 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.112014    2564 flags.go:64] FLAG: --registry-burst="10"
Sep 08 07:04:11.119656 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.112017    2564 flags.go:64] FLAG: --registry-qps="5"
Sep 08 07:04:11.119656 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.112020    2564 flags.go:64] FLAG: --reserved-cpus=""
Sep 08 07:04:11.119656 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.112023    2564 flags.go:64] FLAG: --reserved-memory=""
Sep 08 07:04:11.119656 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.112026    2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 08 07:04:11.119656 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.112030    2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 08 07:04:11.119656 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.112033    2564 flags.go:64] FLAG: --rotate-certificates="false"
Sep 08 07:04:11.119656 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.112036    2564 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 08 07:04:11.119656 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.112039    2564 flags.go:64] FLAG: --runonce="false"
Sep 08 07:04:11.119656 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.112042    2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 08 07:04:11.120285 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.112045    2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 08 07:04:11.120285 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.112048    2564 flags.go:64] FLAG: --seccomp-default="false"
Sep 08 07:04:11.120285 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.112051    2564 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 08 07:04:11.120285 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.112054    2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 08 07:04:11.120285 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.112056    2564 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 08 07:04:11.120285 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.112059    2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 08 07:04:11.120285 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.112062    2564 flags.go:64] FLAG: --storage-driver-password="root"
Sep 08 07:04:11.120285 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.112065    2564 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 08 07:04:11.120285 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.112068    2564 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 08 07:04:11.120285 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.112071    2564 flags.go:64] FLAG: --storage-driver-user="root"
Sep 08 07:04:11.120285 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.112074    2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 08 07:04:11.120285 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.112077    2564 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 08 07:04:11.120285 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.112095    2564 flags.go:64] FLAG: --system-cgroups=""
Sep 08 07:04:11.120285 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.112098    2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 08 07:04:11.120285 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.112104    2564 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 08 07:04:11.120285 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.112106    2564 flags.go:64] FLAG: --tls-cert-file=""
Sep 08 07:04:11.120285 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.112110    2564 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 08 07:04:11.120285 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.112115    2564 flags.go:64] FLAG: --tls-min-version=""
Sep 08 07:04:11.120285 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.112117    2564 flags.go:64] FLAG: --tls-private-key-file=""
Sep 08 07:04:11.120285 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.112122    2564 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 08 07:04:11.120285 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.112125    2564 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 08 07:04:11.120285 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.112128    2564 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 08 07:04:11.120285 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.112131    2564 flags.go:64] FLAG: --v="2"
Sep 08 07:04:11.120285 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.112136    2564 flags.go:64] FLAG: --version="false"
Sep 08 07:04:11.120285 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.112157    2564 flags.go:64] FLAG: --vmodule=""
Sep 08 07:04:11.120932 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.112162    2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 08 07:04:11.120932 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.112165    2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 08 07:04:11.120932 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112277    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 07:04:11.120932 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112282    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 07:04:11.120932 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112286    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 07:04:11.120932 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112289    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 07:04:11.120932 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112293    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 07:04:11.120932 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112296    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 07:04:11.120932 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112299    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 07:04:11.120932 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112302    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 07:04:11.120932 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112304    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 07:04:11.120932 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112307    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 07:04:11.120932 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112310    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 07:04:11.120932 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112312    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 07:04:11.120932 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112315    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 07:04:11.120932 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112318    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 07:04:11.120932 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112321    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 07:04:11.120932 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112323    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 07:04:11.120932 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112326    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 07:04:11.121398 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112329    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 07:04:11.121398 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112332    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 07:04:11.121398 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112335    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 07:04:11.121398 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112338    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 07:04:11.121398 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112342    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 07:04:11.121398 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112344    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 07:04:11.121398 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112347    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 07:04:11.121398 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112350    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 07:04:11.121398 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112353    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 07:04:11.121398 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112356    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 07:04:11.121398 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112358    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 07:04:11.121398 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112361    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 07:04:11.121398 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112363    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 07:04:11.121398 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112366    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 07:04:11.121398 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112369    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 07:04:11.121398 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112371    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 07:04:11.121398 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112374    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 07:04:11.121398 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112376    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 07:04:11.121398 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112380    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 07:04:11.121398 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112384    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 07:04:11.121915 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112387    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 07:04:11.121915 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112390    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 07:04:11.121915 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112392    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 07:04:11.121915 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112395    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 07:04:11.121915 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112398    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 07:04:11.121915 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112401    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 07:04:11.121915 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112404    2564 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 07:04:11.121915 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112407    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 07:04:11.121915 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112410    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 07:04:11.121915 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112412    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 07:04:11.121915 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112415    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 07:04:11.121915 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112417    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 07:04:11.121915 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112420    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 07:04:11.121915 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112423    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 07:04:11.121915 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112426    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 07:04:11.121915 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112428    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 07:04:11.121915 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112432    2564 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 07:04:11.121915 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112434    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 07:04:11.121915 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112437    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 07:04:11.121915 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112440    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 07:04:11.122548 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112442    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 07:04:11.122548 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112445    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 07:04:11.122548 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112447    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 07:04:11.122548 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112450    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 07:04:11.122548 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112452    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 07:04:11.122548 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112455    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 07:04:11.122548 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112458    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 07:04:11.122548 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112460    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 07:04:11.122548 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112463    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 07:04:11.122548 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112466    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 07:04:11.122548 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112468    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 07:04:11.122548 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112470    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 07:04:11.122548 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112473    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 07:04:11.122548 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112476    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 07:04:11.122548 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112478    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 07:04:11.122548 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112481    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 07:04:11.122548 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112484    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 07:04:11.122548 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112486    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 07:04:11.122548 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112489    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 07:04:11.123318 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112491    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 07:04:11.123318 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112494    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 07:04:11.123318 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112496    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 07:04:11.123318 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112499    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 07:04:11.123318 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112501    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 07:04:11.123318 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112504    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 07:04:11.123318 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112506    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 07:04:11.123318 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112509    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 07:04:11.123318 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112514    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 07:04:11.123318 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112519    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 07:04:11.123318 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112522    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 07:04:11.123318 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112526    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 07:04:11.123318 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112528    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 07:04:11.123318 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112531    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 07:04:11.123318 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112534    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 07:04:11.123318 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112536    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 07:04:11.123318 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112539    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 07:04:11.123318 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112541    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 07:04:11.123318 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112544    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 07:04:11.123864 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112546    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 07:04:11.123864 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112549    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 07:04:11.123864 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112551    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 07:04:11.123864 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.112554    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 07:04:11.123864 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.113179    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 08 07:04:11.123864 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.121139    2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 08 07:04:11.123864 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.121156    2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 08 07:04:11.123864 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.121169    2564 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 08 07:04:11.123864 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.121175    2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 08 07:04:11.123864 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121240    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 07:04:11.123864 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121244    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 07:04:11.123864 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121248    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 07:04:11.123864 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121251    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 07:04:11.123864 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121254    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 07:04:11.123864 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121257    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 07:04:11.124268 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121260    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 07:04:11.124268 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121263    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 07:04:11.124268 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121266    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 07:04:11.124268 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121269    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 07:04:11.124268 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121272    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 07:04:11.124268 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121274    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 07:04:11.124268 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121277    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 07:04:11.124268 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121279    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 07:04:11.124268 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121282    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 07:04:11.124268 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121285    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 07:04:11.124268 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121289    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 07:04:11.124268 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121293    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 07:04:11.124268 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121296    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 07:04:11.124268 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121299    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 07:04:11.124268 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121301    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 07:04:11.124268 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121304    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 07:04:11.124268 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121307    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 07:04:11.124268 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121310    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 07:04:11.124268 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121312    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 07:04:11.124786 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121316    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 07:04:11.124786 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121319    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 07:04:11.124786 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121321    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 07:04:11.124786 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121324    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 07:04:11.124786 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121333    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 07:04:11.124786 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121335    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 07:04:11.124786 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121339    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 07:04:11.124786 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121343    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 07:04:11.124786 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121346    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 07:04:11.124786 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121349    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 07:04:11.124786 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121351    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 07:04:11.124786 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121354    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 07:04:11.124786 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121357    2564 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 07:04:11.124786 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121359    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 07:04:11.124786 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121362    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 07:04:11.124786 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121365    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 07:04:11.124786 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121367    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 07:04:11.124786 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121370    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 07:04:11.124786 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121373    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 07:04:11.125274 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121375    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 07:04:11.125274 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121378    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 07:04:11.125274 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121381    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 07:04:11.125274 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121383    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 07:04:11.125274 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121386    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 07:04:11.125274 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121389    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 07:04:11.125274 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121392    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 07:04:11.125274 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121394    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 07:04:11.125274 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121397    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 07:04:11.125274 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121400    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 07:04:11.125274 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121403    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 07:04:11.125274 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121406    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 07:04:11.125274 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121408    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 07:04:11.125274 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121411    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 07:04:11.125274 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121414    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 07:04:11.125274 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121417    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 07:04:11.125274 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121420    2564 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 07:04:11.125274 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121422    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 07:04:11.125274 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121430    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 07:04:11.125274 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121433    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 07:04:11.125274 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121436    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 07:04:11.125799 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121438    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 07:04:11.125799 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121441    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 07:04:11.125799 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121445    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 07:04:11.125799 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121448    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 07:04:11.125799 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121451    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 07:04:11.125799 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121454    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 07:04:11.125799 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121456    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 07:04:11.125799 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121459    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 07:04:11.125799 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121462    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 07:04:11.125799 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121465    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 07:04:11.125799 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121467    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 07:04:11.125799 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121470    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 07:04:11.125799 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121473    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 07:04:11.125799 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121476    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 07:04:11.125799 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121478    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 07:04:11.125799 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121481    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 07:04:11.125799 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121484    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 07:04:11.125799 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121486    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 07:04:11.125799 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121489    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 07:04:11.126271 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121492    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 07:04:11.126271 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121494    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 07:04:11.126271 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121497    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 07:04:11.126271 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121500    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 07:04:11.126271 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121502    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 07:04:11.126271 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121505    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 07:04:11.126271 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121507    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 07:04:11.126271 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121510    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 07:04:11.126271 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121512    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 07:04:11.126271 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121515    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 07:04:11.126271 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121517    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 07:04:11.126271 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121525    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 07:04:11.126271 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121528    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 07:04:11.126271 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121531    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 07:04:11.126271 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121533    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 07:04:11.126679 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.121538    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 08 07:04:11.126679 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121695    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 07:04:11.126679 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121700    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 07:04:11.126679 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121704    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 07:04:11.126679 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121707    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 07:04:11.126679 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121709    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 07:04:11.126679 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121712    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 07:04:11.126679 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121715    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 07:04:11.126679 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121718    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 07:04:11.126679 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121721    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 07:04:11.126679 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121724    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 07:04:11.126679 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121728    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 07:04:11.126679 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121732    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 07:04:11.126679 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121735    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 07:04:11.127025 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121738    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 07:04:11.127025 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121741    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 07:04:11.127025 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121744    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 07:04:11.127025 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121746    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 07:04:11.127025 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121749    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 07:04:11.127025 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121753    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 07:04:11.127025 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121755    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 07:04:11.127025 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121758    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 07:04:11.127025 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121761    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 07:04:11.127025 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121764    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 07:04:11.127025 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121767    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 07:04:11.127025 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121769    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 07:04:11.127025 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121772    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 07:04:11.127025 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121774    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 07:04:11.127025 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121777    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 07:04:11.127025 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121786    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 07:04:11.127025 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121789    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 07:04:11.127025 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121792    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 07:04:11.127025 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121794    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 07:04:11.127025 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121797    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 07:04:11.127523 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121799    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 07:04:11.127523 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121802    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 07:04:11.127523 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121805    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 07:04:11.127523 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121807    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 07:04:11.127523 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121810    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 07:04:11.127523 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121812    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 07:04:11.127523 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121815    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 07:04:11.127523 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121818    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 07:04:11.127523 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121820    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 07:04:11.127523 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121823    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 07:04:11.127523 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121825    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 07:04:11.127523 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121828    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 07:04:11.127523 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121830    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 07:04:11.127523 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121833    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 07:04:11.127523 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121835    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 07:04:11.127523 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121838    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 07:04:11.127523 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121840    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 07:04:11.127523 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121843    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 07:04:11.127523 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121845    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 07:04:11.127523 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121848    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 07:04:11.128008 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121851    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 07:04:11.128008 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121853    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 07:04:11.128008 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121856    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 07:04:11.128008 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121858    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 07:04:11.128008 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121861    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 07:04:11.128008 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121865    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 07:04:11.128008 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121868    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 07:04:11.128008 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121871    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 07:04:11.128008 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121879    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 07:04:11.128008 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121882    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 07:04:11.128008 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121884    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 07:04:11.128008 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121887    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 07:04:11.128008 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121889    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 07:04:11.128008 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121892    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 07:04:11.128008 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121894    2564 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 07:04:11.128008 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121897    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 07:04:11.128008 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121899    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 07:04:11.128008 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121902    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 07:04:11.128008 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121904    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 07:04:11.128008 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121907    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 07:04:11.128606 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121910    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 07:04:11.128606 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121912    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 07:04:11.128606 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121914    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 07:04:11.128606 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121917    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 07:04:11.128606 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121920    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 07:04:11.128606 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121922    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 07:04:11.128606 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121925    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 07:04:11.128606 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121928    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 07:04:11.128606 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121931    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 07:04:11.128606 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121934    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 07:04:11.128606 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121936    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 07:04:11.128606 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121939    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 07:04:11.128606 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121941    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 07:04:11.128606 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121944    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 07:04:11.128606 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121948    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 07:04:11.128606 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121951    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 07:04:11.128606 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121954    2564 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 07:04:11.128606 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121957    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 07:04:11.128606 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121960    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 07:04:11.128606 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121963    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 07:04:11.129110 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121965    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 07:04:11.129110 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121974    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 07:04:11.129110 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121978    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 07:04:11.129110 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121980    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 07:04:11.129110 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121983    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 07:04:11.129110 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:11.121986    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 07:04:11.129110 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.121991    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 08 07:04:11.129110 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.122125    2564 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 08 07:04:11.129110 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.124754    2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 08 07:04:11.129110 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.128567    2564 server.go:1019] "Starting client certificate rotation"
Sep 08 07:04:11.129110 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.128660    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 08 07:04:11.129110 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.128697    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 08 07:04:11.131551 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.131537    2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 08 07:04:11.132665 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.132648    2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 08 07:04:11.141299 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.141283    2564 log.go:25] "Validated CRI v1 runtime API"
Sep 08 07:04:11.144774 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.144761    2564 log.go:25] "Validated CRI v1 image API"
Sep 08 07:04:11.149559 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.149532    2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 08 07:04:11.153234 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.153202    2564 fs.go:135] Filesystem UUIDs: map[12a9872c-ee71-4e60-8760-f9920e0bfba2:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 da1a304a-abe0-4753-8794-6145000125af:/dev/nvme0n1p3]
Sep 08 07:04:11.153283 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.153234    2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 08 07:04:11.159920 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.159815    2564 manager.go:216] Machine: {Timestamp:2026-09-08 07:04:11.158429749 +0000 UTC m=+0.377354617 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3093251 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec229b39855663af18240154abc401c7 SystemUUID:ec229b39-8556-63af-1824-0154abc401c7 BootID:f8f6ebad-63e8-4dc1-8fc1-252415eba3c9 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:51:19:f6:72:65 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:51:19:f6:72:65 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0e:52:c1:b9:76:67 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 08 07:04:11.159920 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.159917    2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 08 07:04:11.160043 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.160031    2564 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 08 07:04:11.160762 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.160747    2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 08 07:04:11.163828 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.163800    2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 08 07:04:11.163960 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.163832    2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-164.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 08 07:04:11.164675 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.164665    2564 topology_manager.go:138] "Creating topology manager with none policy"
Sep 08 07:04:11.164711 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.164678    2564 container_manager_linux.go:309] "Creating device plugin manager"
Sep 08 07:04:11.164711 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.164685    2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 08 07:04:11.165359 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.165349    2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 08 07:04:11.166614 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.166604    2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 08 07:04:11.171197 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.171186    2564 state_mem.go:36] "Initialized new in-memory state store"
Sep 08 07:04:11.171318 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.171309    2564 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 08 07:04:11.171350 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.171341    2564 kubelet.go:486] "Attempting to sync node with API server"
Sep 08 07:04:11.171377 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.171359    2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 08 07:04:11.171377 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.171373    2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 08 07:04:11.171426 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.171385    2564 kubelet.go:398] "Adding apiserver pod source"
Sep 08 07:04:11.171426 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.171410    2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 08 07:04:11.171922 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.171910    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 08 07:04:11.172013 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.171929    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 08 07:04:11.175548 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.175524    2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 08 07:04:11.178265 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.178250    2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 08 07:04:11.178338 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.178314    2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 08 07:04:11.179121 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.179111    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 08 07:04:11.179162 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.179126    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 08 07:04:11.179162 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.179132    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 08 07:04:11.179162 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.179143    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 08 07:04:11.179162 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.179151    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 08 07:04:11.179162 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.179157    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 08 07:04:11.179299 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.179170    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 08 07:04:11.179299 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.179175    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 08 07:04:11.179299 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.179182    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 08 07:04:11.179299 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.179187    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 08 07:04:11.179299 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.179195    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 08 07:04:11.179299 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.179200    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 08 07:04:11.180999 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.180985    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 08 07:04:11.180999 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.180997    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 08 07:04:11.182953 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.182935    2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-164.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 08 07:04:11.183768 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:11.183746    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 08 07:04:11.183829 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:11.183748    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-164.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 08 07:04:11.184807 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.184794    2564 server.go:1268] "Started kubelet"
Sep 08 07:04:11.184895 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.184870    2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 08 07:04:11.185467 ip-10-0-133-164 systemd[1]: Started Kubernetes Kubelet.
Sep 08 07:04:11.185624 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.185531    2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 08 07:04:11.185624 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.185615    2564 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 08 07:04:11.186933 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.186917    2564 server.go:310] "Adding debug handlers to kubelet server"
Sep 08 07:04:11.188220 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.188077    2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 08 07:04:11.191542 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:11.191524    2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 08 07:04:11.193706 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.193686    2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 08 07:04:11.193706 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.193694    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 08 07:04:11.193852 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:11.193783    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-164.ec2.internal\" not found"
Sep 08 07:04:11.194008 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:11.192847    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-164.ec2.internal.18d3468da5f3c066  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-164.ec2.internal,UID:ip-10-0-133-164.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-164.ec2.internal,},FirstTimestamp:2026-09-08 07:04:11.184767078 +0000 UTC m=+0.403691936,LastTimestamp:2026-09-08 07:04:11.184767078 +0000 UTC m=+0.403691936,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-164.ec2.internal,}"
Sep 08 07:04:11.194457 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.194440    2564 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 08 07:04:11.194727 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.194460    2564 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 08 07:04:11.194727 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.194443    2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 08 07:04:11.194727 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.194619    2564 reconstruct.go:97] "Volume reconstruction finished"
Sep 08 07:04:11.194727 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.194631    2564 reconciler.go:29] "Reconciler: start to sync state"
Sep 08 07:04:11.194937 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.194741    2564 factory.go:55] Registering systemd factory
Sep 08 07:04:11.194937 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.194754    2564 factory.go:223] Registration of the systemd container factory successfully
Sep 08 07:04:11.195015 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.195002    2564 factory.go:153] Registering CRI-O factory
Sep 08 07:04:11.195057 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.195012    2564 factory.go:223] Registration of the crio container factory successfully
Sep 08 07:04:11.195120 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.195065    2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 08 07:04:11.195120 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.195078    2564 factory.go:103] Registering Raw factory
Sep 08 07:04:11.195120 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.195109    2564 manager.go:1196] Started watching for new ooms in manager
Sep 08 07:04:11.195676 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.195661    2564 manager.go:349] Starting recovery of all containers
Sep 08 07:04:11.198163 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:11.198137    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 08 07:04:11.199519 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:11.198850    2564 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-164.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 08 07:04:11.207828 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.207807    2564 manager.go:354] Recovery completed
Sep 08 07:04:11.209853 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:11.209834    2564 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Sep 08 07:04:11.210346 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.210320    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ldr78"
Sep 08 07:04:11.213235 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.213219    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 07:04:11.215128 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.215111    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-164.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 07:04:11.215224 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.215145    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-164.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 07:04:11.215224 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.215161    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-164.ec2.internal" event="NodeHasSufficientPID"
Sep 08 07:04:11.215749 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.215734    2564 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 08 07:04:11.215749 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.215747    2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 08 07:04:11.215884 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.215753    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 07:04:11.215884 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.215766    2564 state_mem.go:36] "Initialized new in-memory state store"
Sep 08 07:04:11.216447 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.216433    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-164.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 07:04:11.216534 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.216458    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-164.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 07:04:11.216534 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.216467    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-164.ec2.internal" event="NodeHasSufficientPID"
Sep 08 07:04:11.217204 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:11.217138    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-164.ec2.internal.18d3468da7c30ac2  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-164.ec2.internal,UID:ip-10-0-133-164.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-164.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-164.ec2.internal,},FirstTimestamp:2026-09-08 07:04:11.215129282 +0000 UTC m=+0.434054134,LastTimestamp:2026-09-08 07:04:11.215129282 +0000 UTC m=+0.434054134,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-164.ec2.internal,}"
Sep 08 07:04:11.217738 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.217722    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ldr78"
Sep 08 07:04:11.219072 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.219058    2564 policy_none.go:49] "None policy: Start"
Sep 08 07:04:11.219136 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.219078    2564 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 08 07:04:11.219136 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.219109    2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 08 07:04:11.221049 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.221038    2564 policy_none.go:47] "Start"
Sep 08 07:04:11.258691 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.258674    2564 manager.go:337] "Starting Device Plugin manager"
Sep 08 07:04:11.274194 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:11.258715    2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 08 07:04:11.274194 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.258727    2564 server.go:87] "Starting device plugin registration server"
Sep 08 07:04:11.274194 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.259044    2564 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 08 07:04:11.274194 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.259059    2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 08 07:04:11.274194 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.259244    2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 08 07:04:11.274194 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.259329    2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 08 07:04:11.274194 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.259341    2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 08 07:04:11.274194 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:11.260650    2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 08 07:04:11.274194 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:11.260693    2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-164.ec2.internal\" not found"
Sep 08 07:04:11.274194 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.263738    2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 08 07:04:11.274194 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.264880    2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 08 07:04:11.274194 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.264926    2564 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 08 07:04:11.274194 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.264949    2564 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 08 07:04:11.274194 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:11.264992    2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 08 07:04:11.274194 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.267337    2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 07:04:11.359921 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.359853    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 07:04:11.360728 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.360713    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-164.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 07:04:11.360823 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.360740    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-164.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 07:04:11.360823 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.360750    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-164.ec2.internal" event="NodeHasSufficientPID"
Sep 08 07:04:11.360823 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.360772    2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-164.ec2.internal"
Sep 08 07:04:11.365541 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.365517    2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-164.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-164.ec2.internal"]
Sep 08 07:04:11.365634 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.365584    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 07:04:11.366300 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.366283    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-164.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 07:04:11.366376 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.366311    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-164.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 07:04:11.366376 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.366324    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-164.ec2.internal" event="NodeHasSufficientPID"
Sep 08 07:04:11.368651 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.368640    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 07:04:11.368773 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.368761    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-164.ec2.internal"
Sep 08 07:04:11.368812 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.368787    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 07:04:11.369373 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.369354    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-164.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 07:04:11.369445 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.369381    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-164.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 07:04:11.369445 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.369395    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-164.ec2.internal" event="NodeHasSufficientPID"
Sep 08 07:04:11.369445 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.369357    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-164.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 07:04:11.369538 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.369455    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-164.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 07:04:11.369538 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.369469    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-164.ec2.internal" event="NodeHasSufficientPID"
Sep 08 07:04:11.370247 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.370233    2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-164.ec2.internal"
Sep 08 07:04:11.370324 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:11.370251    2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-164.ec2.internal\": node \"ip-10-0-133-164.ec2.internal\" not found"
Sep 08 07:04:11.371623 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.371611    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-164.ec2.internal"
Sep 08 07:04:11.371673 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.371633    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 07:04:11.372275 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.372258    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-164.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 07:04:11.372354 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.372286    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-164.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 07:04:11.372354 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.372298    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-164.ec2.internal" event="NodeHasSufficientPID"
Sep 08 07:04:11.395779 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.395757    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/abab780c8e86f24b0bc03b6d3983dc3c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-164.ec2.internal\" (UID: \"abab780c8e86f24b0bc03b6d3983dc3c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-164.ec2.internal"
Sep 08 07:04:11.395858 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.395784    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/abab780c8e86f24b0bc03b6d3983dc3c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-164.ec2.internal\" (UID: \"abab780c8e86f24b0bc03b6d3983dc3c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-164.ec2.internal"
Sep 08 07:04:11.395858 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.395798    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/31090b38892b0b01dc7d44dd99f13608-config\") pod \"kube-apiserver-proxy-ip-10-0-133-164.ec2.internal\" (UID: \"31090b38892b0b01dc7d44dd99f13608\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-164.ec2.internal"
Sep 08 07:04:11.396870 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:11.396856    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-164.ec2.internal\" not found"
Sep 08 07:04:11.399607 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:11.399594    2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-164.ec2.internal\" not found" node="ip-10-0-133-164.ec2.internal"
Sep 08 07:04:11.403817 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:11.403802    2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-164.ec2.internal\" not found" node="ip-10-0-133-164.ec2.internal"
Sep 08 07:04:11.496471 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.496441    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/abab780c8e86f24b0bc03b6d3983dc3c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-164.ec2.internal\" (UID: \"abab780c8e86f24b0bc03b6d3983dc3c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-164.ec2.internal"
Sep 08 07:04:11.496613 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.496475    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/abab780c8e86f24b0bc03b6d3983dc3c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-164.ec2.internal\" (UID: \"abab780c8e86f24b0bc03b6d3983dc3c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-164.ec2.internal"
Sep 08 07:04:11.496613 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.496499    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/31090b38892b0b01dc7d44dd99f13608-config\") pod \"kube-apiserver-proxy-ip-10-0-133-164.ec2.internal\" (UID: \"31090b38892b0b01dc7d44dd99f13608\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-164.ec2.internal"
Sep 08 07:04:11.496613 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.496541    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/31090b38892b0b01dc7d44dd99f13608-config\") pod \"kube-apiserver-proxy-ip-10-0-133-164.ec2.internal\" (UID: \"31090b38892b0b01dc7d44dd99f13608\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-164.ec2.internal"
Sep 08 07:04:11.496613 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.496542    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/abab780c8e86f24b0bc03b6d3983dc3c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-164.ec2.internal\" (UID: \"abab780c8e86f24b0bc03b6d3983dc3c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-164.ec2.internal"
Sep 08 07:04:11.496613 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.496542    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/abab780c8e86f24b0bc03b6d3983dc3c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-164.ec2.internal\" (UID: \"abab780c8e86f24b0bc03b6d3983dc3c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-164.ec2.internal"
Sep 08 07:04:11.497493 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:11.497476    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-164.ec2.internal\" not found"
Sep 08 07:04:11.597923 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:11.597886    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-164.ec2.internal\" not found"
Sep 08 07:04:11.698671 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:11.698613    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-164.ec2.internal\" not found"
Sep 08 07:04:11.701775 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.701757    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-164.ec2.internal"
Sep 08 07:04:11.708109 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:11.708093    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-164.ec2.internal"
Sep 08 07:04:13.037548 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:13.037518    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-164.ec2.internal\" not found"
Sep 08 07:04:13.137951 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:13.137923    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-164.ec2.internal\" not found"
Sep 08 07:04:13.238475 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:13.238402    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-164.ec2.internal\" not found"
Sep 08 07:04:13.338979 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:13.338935    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-164.ec2.internal\" not found"
Sep 08 07:04:13.366102 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:13.366078    2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 08 07:04:13.366475 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:13.366207    2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 08 07:04:13.439932 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:13.439901    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-164.ec2.internal\" not found"
Sep 08 07:04:13.462106 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:13.462070    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-07 06:59:12 +0000 UTC" deadline="2028-05-25 00:56:39.44037038 +0000 UTC"
Sep 08 07:04:13.462106 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:13.462101    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14993h52m25.978274646s"
Sep 08 07:04:13.541052 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:13.540842    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-164.ec2.internal\" not found"
Sep 08 07:04:13.607518 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:13.607487    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31090b38892b0b01dc7d44dd99f13608.slice/crio-6ca9e045bc711c9ddcb916c33a0aa135c3a894d4dedd882de9e3e4e7c1ac2e69 WatchSource:0}: Error finding container 6ca9e045bc711c9ddcb916c33a0aa135c3a894d4dedd882de9e3e4e7c1ac2e69: Status 404 returned error can't find the container with id 6ca9e045bc711c9ddcb916c33a0aa135c3a894d4dedd882de9e3e4e7c1ac2e69
Sep 08 07:04:13.610693 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:13.610677    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 07:04:13.641953 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:13.641930    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-164.ec2.internal\" not found"
Sep 08 07:04:13.742453 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:13.742417    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-164.ec2.internal\" not found"
Sep 08 07:04:13.842908 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:13.842838    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-164.ec2.internal\" not found"
Sep 08 07:04:13.927073 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:13.927049    2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 07:04:13.943238 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:13.943216    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-164.ec2.internal\" not found"
Sep 08 07:04:13.967707 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:13.967687    2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 07:04:14.020408 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.020388    2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 07:04:14.032289 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.032260    2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-164.ec2.internal"
Sep 08 07:04:14.045357 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.045335    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 08 07:04:14.046492 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.046474    2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-164.ec2.internal"
Sep 08 07:04:14.053861 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.053829    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 08 07:04:14.295173 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:14.295138    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabab780c8e86f24b0bc03b6d3983dc3c.slice/crio-ddde7980e62cc0d6b7340efcd7ba7b804fb2bedb99f7da34d4ba10aeb0f26e03 WatchSource:0}: Error finding container ddde7980e62cc0d6b7340efcd7ba7b804fb2bedb99f7da34d4ba10aeb0f26e03: Status 404 returned error can't find the container with id ddde7980e62cc0d6b7340efcd7ba7b804fb2bedb99f7da34d4ba10aeb0f26e03
Sep 08 07:04:14.410842 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.410813    2564 apiserver.go:52] "Watching apiserver"
Sep 08 07:04:14.418963 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.418934    2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 08 07:04:14.419356 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.419329    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwjp2","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-164.ec2.internal","openshift-multus/multus-additional-cni-plugins-gj5rb","openshift-multus/multus-dnzfq","openshift-multus/network-metrics-daemon-jhq6t","openshift-network-diagnostics/network-check-target-bf6vx","kube-system/global-pull-secret-syncer-8lgmv","kube-system/kube-apiserver-proxy-ip-10-0-133-164.ec2.internal","openshift-cluster-node-tuning-operator/tuned-nmx6z","openshift-dns/node-resolver-4cwpb","openshift-image-registry/node-ca-qllkn","openshift-network-operator/iptables-alerter-hnw92","openshift-ovn-kubernetes/ovnkube-node-kjppj","kube-system/konnectivity-agent-ddrdv"]
Sep 08 07:04:14.421748 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.421726    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8lgmv"
Sep 08 07:04:14.421881 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:14.421855    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8lgmv" podUID="5ddb3084-72df-467e-9cb5-0cf05725de6f"
Sep 08 07:04:14.424031 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.424008    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kjppj"
Sep 08 07:04:14.426280 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.426121    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 08 07:04:14.426280 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.426140    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-78gfd\""
Sep 08 07:04:14.426445 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.426429    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 08 07:04:14.426496 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.426467    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 08 07:04:14.426540 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.426470    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 08 07:04:14.426891 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.426855    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 08 07:04:14.427082 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.427069    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 08 07:04:14.427349 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.427330    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gj5rb"
Sep 08 07:04:14.429621 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.429334    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 08 07:04:14.429621 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.429336    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 08 07:04:14.429621 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.429544    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-n8wtf\""
Sep 08 07:04:14.429621 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.429571    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 08 07:04:14.429848 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.429642    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dnzfq"
Sep 08 07:04:14.429848 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.429795    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 08 07:04:14.429945 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.429886    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 08 07:04:14.431861 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.431846    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jhq6t"
Sep 08 07:04:14.431933 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:14.431905    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jhq6t" podUID="fb65d52f-d619-46f8-b86a-fc6261a24eb3"
Sep 08 07:04:14.431992 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.431938    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 08 07:04:14.432549 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.432531    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 08 07:04:14.432856 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.432726    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-bv9m8\""
Sep 08 07:04:14.434155 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.434140    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bf6vx"
Sep 08 07:04:14.434241 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:14.434190    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bf6vx" podUID="ed95682c-c73e-47a2-9931-adc1417cf25c"
Sep 08 07:04:14.436717 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.436702    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nmx6z"
Sep 08 07:04:14.438863 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.438846    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwjp2"
Sep 08 07:04:14.440363 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.440347    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 08 07:04:14.440442 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.440352    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 08 07:04:14.440520 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.440506    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-wmv2r\""
Sep 08 07:04:14.441916 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.441897    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ddrdv"
Sep 08 07:04:14.442776 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.442742    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 08 07:04:14.442776 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.442765    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-kjbvg\""
Sep 08 07:04:14.442930 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.442747    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 08 07:04:14.443239 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.443108    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 08 07:04:14.444391 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.444375    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hnw92"
Sep 08 07:04:14.444710 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.444689    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/642e9fc0-d86d-4bbc-9190-c18b87b8a7ae-etc-openvswitch\") pod \"ovnkube-node-kjppj\" (UID: \"642e9fc0-d86d-4bbc-9190-c18b87b8a7ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjppj"
Sep 08 07:04:14.444792 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.444720    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/642e9fc0-d86d-4bbc-9190-c18b87b8a7ae-run-openvswitch\") pod \"ovnkube-node-kjppj\" (UID: \"642e9fc0-d86d-4bbc-9190-c18b87b8a7ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjppj"
Sep 08 07:04:14.444792 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.444744    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/642e9fc0-d86d-4bbc-9190-c18b87b8a7ae-log-socket\") pod \"ovnkube-node-kjppj\" (UID: \"642e9fc0-d86d-4bbc-9190-c18b87b8a7ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjppj"
Sep 08 07:04:14.444792 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.444786    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6fc4c1f5-eff0-4e2d-a5f8-0b21b412535b-cni-binary-copy\") pod \"multus-additional-cni-plugins-gj5rb\" (UID: \"6fc4c1f5-eff0-4e2d-a5f8-0b21b412535b\") " pod="openshift-multus/multus-additional-cni-plugins-gj5rb"
Sep 08 07:04:14.444926 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.444831    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6fc4c1f5-eff0-4e2d-a5f8-0b21b412535b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gj5rb\" (UID: \"6fc4c1f5-eff0-4e2d-a5f8-0b21b412535b\") " pod="openshift-multus/multus-additional-cni-plugins-gj5rb"
Sep 08 07:04:14.444926 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.444858    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/02e6967e-7fbd-46bb-a192-5adc50bed8fa-host-run-multus-certs\") pod \"multus-dnzfq\" (UID: \"02e6967e-7fbd-46bb-a192-5adc50bed8fa\") " pod="openshift-multus/multus-dnzfq"
Sep 08 07:04:14.444926 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.444884    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rp6tj\" (UniqueName: \"kubernetes.io/projected/fb65d52f-d619-46f8-b86a-fc6261a24eb3-kube-api-access-rp6tj\") pod \"network-metrics-daemon-jhq6t\" (UID: \"fb65d52f-d619-46f8-b86a-fc6261a24eb3\") " pod="openshift-multus/network-metrics-daemon-jhq6t"
Sep 08 07:04:14.444926 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.444907    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/642e9fc0-d86d-4bbc-9190-c18b87b8a7ae-systemd-units\") pod \"ovnkube-node-kjppj\" (UID: \"642e9fc0-d86d-4bbc-9190-c18b87b8a7ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjppj"
Sep 08 07:04:14.445139 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.444944    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/642e9fc0-d86d-4bbc-9190-c18b87b8a7ae-ovnkube-config\") pod \"ovnkube-node-kjppj\" (UID: \"642e9fc0-d86d-4bbc-9190-c18b87b8a7ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjppj"
Sep 08 07:04:14.445139 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.444990    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6fc4c1f5-eff0-4e2d-a5f8-0b21b412535b-system-cni-dir\") pod \"multus-additional-cni-plugins-gj5rb\" (UID: \"6fc4c1f5-eff0-4e2d-a5f8-0b21b412535b\") " pod="openshift-multus/multus-additional-cni-plugins-gj5rb"
Sep 08 07:04:14.445139 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.445013    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/02e6967e-7fbd-46bb-a192-5adc50bed8fa-multus-cni-dir\") pod \"multus-dnzfq\" (UID: \"02e6967e-7fbd-46bb-a192-5adc50bed8fa\") " pod="openshift-multus/multus-dnzfq"
Sep 08 07:04:14.445139 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.445037    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/02e6967e-7fbd-46bb-a192-5adc50bed8fa-host-run-k8s-cni-cncf-io\") pod \"multus-dnzfq\" (UID: \"02e6967e-7fbd-46bb-a192-5adc50bed8fa\") " pod="openshift-multus/multus-dnzfq"
Sep 08 07:04:14.445139 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.445075    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/02e6967e-7fbd-46bb-a192-5adc50bed8fa-host-run-netns\") pod \"multus-dnzfq\" (UID: \"02e6967e-7fbd-46bb-a192-5adc50bed8fa\") " pod="openshift-multus/multus-dnzfq"
Sep 08 07:04:14.445139 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.445098    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/02e6967e-7fbd-46bb-a192-5adc50bed8fa-host-var-lib-cni-multus\") pod \"multus-dnzfq\" (UID: \"02e6967e-7fbd-46bb-a192-5adc50bed8fa\") " pod="openshift-multus/multus-dnzfq"
Sep 08 07:04:14.445139 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.445123    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rvmt\" (UniqueName: \"kubernetes.io/projected/ed95682c-c73e-47a2-9931-adc1417cf25c-kube-api-access-8rvmt\") pod \"network-check-target-bf6vx\" (UID: \"ed95682c-c73e-47a2-9931-adc1417cf25c\") " pod="openshift-network-diagnostics/network-check-target-bf6vx"
Sep 08 07:04:14.445463 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.445146    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/642e9fc0-d86d-4bbc-9190-c18b87b8a7ae-host-run-netns\") pod \"ovnkube-node-kjppj\" (UID: \"642e9fc0-d86d-4bbc-9190-c18b87b8a7ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjppj"
Sep 08 07:04:14.445463 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.445169    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/642e9fc0-d86d-4bbc-9190-c18b87b8a7ae-ovnkube-script-lib\") pod \"ovnkube-node-kjppj\" (UID: \"642e9fc0-d86d-4bbc-9190-c18b87b8a7ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjppj"
Sep 08 07:04:14.445463 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.445200    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwhg9\" (UniqueName: \"kubernetes.io/projected/642e9fc0-d86d-4bbc-9190-c18b87b8a7ae-kube-api-access-zwhg9\") pod \"ovnkube-node-kjppj\" (UID: \"642e9fc0-d86d-4bbc-9190-c18b87b8a7ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjppj"
Sep 08 07:04:14.445463 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.445228    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/02e6967e-7fbd-46bb-a192-5adc50bed8fa-hostroot\") pod \"multus-dnzfq\" (UID: \"02e6967e-7fbd-46bb-a192-5adc50bed8fa\") " pod="openshift-multus/multus-dnzfq"
Sep 08 07:04:14.445463 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.445260    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/02e6967e-7fbd-46bb-a192-5adc50bed8fa-multus-conf-dir\") pod \"multus-dnzfq\" (UID: \"02e6967e-7fbd-46bb-a192-5adc50bed8fa\") " pod="openshift-multus/multus-dnzfq"
Sep 08 07:04:14.445463 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.445285    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/02e6967e-7fbd-46bb-a192-5adc50bed8fa-multus-daemon-config\") pod \"multus-dnzfq\" (UID: \"02e6967e-7fbd-46bb-a192-5adc50bed8fa\") " pod="openshift-multus/multus-dnzfq"
Sep 08 07:04:14.445463 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.445306    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/02e6967e-7fbd-46bb-a192-5adc50bed8fa-etc-kubernetes\") pod \"multus-dnzfq\" (UID: \"02e6967e-7fbd-46bb-a192-5adc50bed8fa\") " pod="openshift-multus/multus-dnzfq"
Sep 08 07:04:14.445463 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.445333    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/642e9fc0-d86d-4bbc-9190-c18b87b8a7ae-host-run-ovn-kubernetes\") pod \"ovnkube-node-kjppj\" (UID: \"642e9fc0-d86d-4bbc-9190-c18b87b8a7ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjppj"
Sep 08 07:04:14.445463 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.445390    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/642e9fc0-d86d-4bbc-9190-c18b87b8a7ae-host-cni-netd\") pod \"ovnkube-node-kjppj\" (UID: \"642e9fc0-d86d-4bbc-9190-c18b87b8a7ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjppj"
Sep 08 07:04:14.445463 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.445414    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/642e9fc0-d86d-4bbc-9190-c18b87b8a7ae-ovn-node-metrics-cert\") pod \"ovnkube-node-kjppj\" (UID: \"642e9fc0-d86d-4bbc-9190-c18b87b8a7ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjppj"
Sep 08 07:04:14.445463 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.445439    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/642e9fc0-d86d-4bbc-9190-c18b87b8a7ae-run-systemd\") pod \"ovnkube-node-kjppj\" (UID: \"642e9fc0-d86d-4bbc-9190-c18b87b8a7ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjppj"
Sep 08 07:04:14.445911 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.445475    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/642e9fc0-d86d-4bbc-9190-c18b87b8a7ae-var-lib-openvswitch\") pod \"ovnkube-node-kjppj\" (UID: \"642e9fc0-d86d-4bbc-9190-c18b87b8a7ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjppj"
Sep 08 07:04:14.445911 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.445532    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/642e9fc0-d86d-4bbc-9190-c18b87b8a7ae-run-ovn\") pod \"ovnkube-node-kjppj\" (UID: \"642e9fc0-d86d-4bbc-9190-c18b87b8a7ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjppj"
Sep 08 07:04:14.445911 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.445545    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-n5zqc\""
Sep 08 07:04:14.445911 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.445564    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6fc4c1f5-eff0-4e2d-a5f8-0b21b412535b-cnibin\") pod \"multus-additional-cni-plugins-gj5rb\" (UID: \"6fc4c1f5-eff0-4e2d-a5f8-0b21b412535b\") " pod="openshift-multus/multus-additional-cni-plugins-gj5rb"
Sep 08 07:04:14.445911 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.445570    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 08 07:04:14.445911 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.445589    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6fc4c1f5-eff0-4e2d-a5f8-0b21b412535b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gj5rb\" (UID: \"6fc4c1f5-eff0-4e2d-a5f8-0b21b412535b\") " pod="openshift-multus/multus-additional-cni-plugins-gj5rb"
Sep 08 07:04:14.445911 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.445566    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 08 07:04:14.445911 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.445692    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6fc4c1f5-eff0-4e2d-a5f8-0b21b412535b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gj5rb\" (UID: \"6fc4c1f5-eff0-4e2d-a5f8-0b21b412535b\") " pod="openshift-multus/multus-additional-cni-plugins-gj5rb"
Sep 08 07:04:14.445911 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.445721    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/02e6967e-7fbd-46bb-a192-5adc50bed8fa-host-var-lib-kubelet\") pod \"multus-dnzfq\" (UID: \"02e6967e-7fbd-46bb-a192-5adc50bed8fa\") " pod="openshift-multus/multus-dnzfq"
Sep 08 07:04:14.445911 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.445769    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb65d52f-d619-46f8-b86a-fc6261a24eb3-metrics-certs\") pod \"network-metrics-daemon-jhq6t\" (UID: \"fb65d52f-d619-46f8-b86a-fc6261a24eb3\") " pod="openshift-multus/network-metrics-daemon-jhq6t"
Sep 08 07:04:14.445911 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.445797    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5ddb3084-72df-467e-9cb5-0cf05725de6f-kubelet-config\") pod \"global-pull-secret-syncer-8lgmv\" (UID: \"5ddb3084-72df-467e-9cb5-0cf05725de6f\") " pod="kube-system/global-pull-secret-syncer-8lgmv"
Sep 08 07:04:14.445911 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.445824    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/642e9fc0-d86d-4bbc-9190-c18b87b8a7ae-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kjppj\" (UID: \"642e9fc0-d86d-4bbc-9190-c18b87b8a7ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjppj"
Sep 08 07:04:14.445911 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.445844    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zktbd\" (UniqueName: \"kubernetes.io/projected/6fc4c1f5-eff0-4e2d-a5f8-0b21b412535b-kube-api-access-zktbd\") pod \"multus-additional-cni-plugins-gj5rb\" (UID: \"6fc4c1f5-eff0-4e2d-a5f8-0b21b412535b\") " pod="openshift-multus/multus-additional-cni-plugins-gj5rb"
Sep 08 07:04:14.445911 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.445863    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/02e6967e-7fbd-46bb-a192-5adc50bed8fa-system-cni-dir\") pod \"multus-dnzfq\" (UID: \"02e6967e-7fbd-46bb-a192-5adc50bed8fa\") " pod="openshift-multus/multus-dnzfq"
Sep 08 07:04:14.445911 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.445877    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/02e6967e-7fbd-46bb-a192-5adc50bed8fa-cnibin\") pod \"multus-dnzfq\" (UID: \"02e6967e-7fbd-46bb-a192-5adc50bed8fa\") " pod="openshift-multus/multus-dnzfq"
Sep 08 07:04:14.445911 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.445895    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/02e6967e-7fbd-46bb-a192-5adc50bed8fa-multus-socket-dir-parent\") pod \"multus-dnzfq\" (UID: \"02e6967e-7fbd-46bb-a192-5adc50bed8fa\") " pod="openshift-multus/multus-dnzfq"
Sep 08 07:04:14.446471 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.445922    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5ddb3084-72df-467e-9cb5-0cf05725de6f-dbus\") pod \"global-pull-secret-syncer-8lgmv\" (UID: \"5ddb3084-72df-467e-9cb5-0cf05725de6f\") " pod="kube-system/global-pull-secret-syncer-8lgmv"
Sep 08 07:04:14.446471 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.445944    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/642e9fc0-d86d-4bbc-9190-c18b87b8a7ae-host-kubelet\") pod \"ovnkube-node-kjppj\" (UID: \"642e9fc0-d86d-4bbc-9190-c18b87b8a7ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjppj"
Sep 08 07:04:14.446471 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.445989    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/642e9fc0-d86d-4bbc-9190-c18b87b8a7ae-node-log\") pod \"ovnkube-node-kjppj\" (UID: \"642e9fc0-d86d-4bbc-9190-c18b87b8a7ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjppj"
Sep 08 07:04:14.446471 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.446029    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/642e9fc0-d86d-4bbc-9190-c18b87b8a7ae-host-cni-bin\") pod \"ovnkube-node-kjppj\" (UID: \"642e9fc0-d86d-4bbc-9190-c18b87b8a7ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjppj"
Sep 08 07:04:14.446471 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.446052    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/642e9fc0-d86d-4bbc-9190-c18b87b8a7ae-env-overrides\") pod \"ovnkube-node-kjppj\" (UID: \"642e9fc0-d86d-4bbc-9190-c18b87b8a7ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjppj"
Sep 08 07:04:14.446471 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.446075    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/02e6967e-7fbd-46bb-a192-5adc50bed8fa-host-var-lib-cni-bin\") pod \"multus-dnzfq\" (UID: \"02e6967e-7fbd-46bb-a192-5adc50bed8fa\") " pod="openshift-multus/multus-dnzfq"
Sep 08 07:04:14.446471 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.446099    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvlg5\" (UniqueName: \"kubernetes.io/projected/02e6967e-7fbd-46bb-a192-5adc50bed8fa-kube-api-access-bvlg5\") pod \"multus-dnzfq\" (UID: \"02e6967e-7fbd-46bb-a192-5adc50bed8fa\") " pod="openshift-multus/multus-dnzfq"
Sep 08 07:04:14.446471 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.446120    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/642e9fc0-d86d-4bbc-9190-c18b87b8a7ae-host-slash\") pod \"ovnkube-node-kjppj\" (UID: \"642e9fc0-d86d-4bbc-9190-c18b87b8a7ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjppj"
Sep 08 07:04:14.446471 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.446146    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/02e6967e-7fbd-46bb-a192-5adc50bed8fa-cni-binary-copy\") pod \"multus-dnzfq\" (UID: \"02e6967e-7fbd-46bb-a192-5adc50bed8fa\") " pod="openshift-multus/multus-dnzfq"
Sep 08 07:04:14.446471 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.446168    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ddb3084-72df-467e-9cb5-0cf05725de6f-original-pull-secret\") pod \"global-pull-secret-syncer-8lgmv\" (UID: \"5ddb3084-72df-467e-9cb5-0cf05725de6f\") " pod="kube-system/global-pull-secret-syncer-8lgmv"
Sep 08 07:04:14.446923 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.446909    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qllkn"
Sep 08 07:04:14.448379 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.448360    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 08 07:04:14.448517 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.448446    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 08 07:04:14.448579 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.448551    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 08 07:04:14.448960 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.448944    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-n8jxb\""
Sep 08 07:04:14.449182 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.449168    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4cwpb"
Sep 08 07:04:14.451612 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.451492    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 08 07:04:14.452114 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.452044    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 08 07:04:14.452421 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.452398    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 08 07:04:14.452838 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.452820    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7g8gw\""
Sep 08 07:04:14.453029 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.452825    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 08 07:04:14.453029 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.453033    2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 08 07:04:14.454612 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.454073    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 08 07:04:14.454612 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.454283    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-7rwxn\""
Sep 08 07:04:14.472690 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.472670    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-vsv6p"
Sep 08 07:04:14.478694 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.478675    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-vsv6p"
Sep 08 07:04:14.508994 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.508901    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-164.ec2.internal" event={"ID":"abab780c8e86f24b0bc03b6d3983dc3c","Type":"ContainerStarted","Data":"ddde7980e62cc0d6b7340efcd7ba7b804fb2bedb99f7da34d4ba10aeb0f26e03"}
Sep 08 07:04:14.510145 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.510119    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-164.ec2.internal" event={"ID":"31090b38892b0b01dc7d44dd99f13608","Type":"ContainerStarted","Data":"6ca9e045bc711c9ddcb916c33a0aa135c3a894d4dedd882de9e3e4e7c1ac2e69"}
Sep 08 07:04:14.533896 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.533872    2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 08 07:04:14.546649 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.546595    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e5671dec-e643-4b9e-849c-42faa0159b25-lib-modules\") pod \"tuned-nmx6z\" (UID: \"e5671dec-e643-4b9e-849c-42faa0159b25\") " pod="openshift-cluster-node-tuning-operator/tuned-nmx6z"
Sep 08 07:04:14.546649 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.546633    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e5671dec-e643-4b9e-849c-42faa0159b25-host\") pod \"tuned-nmx6z\" (UID: \"e5671dec-e643-4b9e-849c-42faa0159b25\") " pod="openshift-cluster-node-tuning-operator/tuned-nmx6z"
Sep 08 07:04:14.546777 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.546658    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/913589e8-903e-4e3a-9495-a17f0bd93fcc-socket-dir\") pod \"aws-ebs-csi-driver-node-gwjp2\" (UID: \"913589e8-903e-4e3a-9495-a17f0bd93fcc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwjp2"
Sep 08 07:04:14.546777 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.546684    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b2f51d59-90ee-4464-924a-cfc1d12484ad-host-slash\") pod \"iptables-alerter-hnw92\" (UID: \"b2f51d59-90ee-4464-924a-cfc1d12484ad\") " pod="openshift-network-operator/iptables-alerter-hnw92"
Sep 08 07:04:14.546777 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.546713    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/642e9fc0-d86d-4bbc-9190-c18b87b8a7ae-ovnkube-script-lib\") pod \"ovnkube-node-kjppj\" (UID: \"642e9fc0-d86d-4bbc-9190-c18b87b8a7ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjppj"
Sep 08 07:04:14.546777 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.546774    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwhg9\" (UniqueName: \"kubernetes.io/projected/642e9fc0-d86d-4bbc-9190-c18b87b8a7ae-kube-api-access-zwhg9\") pod \"ovnkube-node-kjppj\" (UID: \"642e9fc0-d86d-4bbc-9190-c18b87b8a7ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjppj"
Sep 08 07:04:14.547019 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.546801    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hspcv\" (UniqueName: \"kubernetes.io/projected/5b60264a-f3fc-4640-a51a-d556e505482a-kube-api-access-hspcv\") pod \"node-ca-qllkn\" (UID: \"5b60264a-f3fc-4640-a51a-d556e505482a\") " pod="openshift-image-registry/node-ca-qllkn"
Sep 08 07:04:14.547019 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.546824    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/890fab40-3e97-456c-88ed-01de5ff6c541-tmp-dir\") pod \"node-resolver-4cwpb\" (UID: \"890fab40-3e97-456c-88ed-01de5ff6c541\") " pod="openshift-dns/node-resolver-4cwpb"
Sep 08 07:04:14.547019 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.546868    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/642e9fc0-d86d-4bbc-9190-c18b87b8a7ae-host-cni-netd\") pod \"ovnkube-node-kjppj\" (UID: \"642e9fc0-d86d-4bbc-9190-c18b87b8a7ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjppj"
Sep 08 07:04:14.547019 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.546893    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e5671dec-e643-4b9e-849c-42faa0159b25-etc-sysctl-d\") pod \"tuned-nmx6z\" (UID: \"e5671dec-e643-4b9e-849c-42faa0159b25\") " pod="openshift-cluster-node-tuning-operator/tuned-nmx6z"
Sep 08 07:04:14.547019 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.546988    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/642e9fc0-d86d-4bbc-9190-c18b87b8a7ae-host-cni-netd\") pod \"ovnkube-node-kjppj\" (UID: \"642e9fc0-d86d-4bbc-9190-c18b87b8a7ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjppj"
Sep 08 07:04:14.547286 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.547029    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e5671dec-e643-4b9e-849c-42faa0159b25-etc-systemd\") pod \"tuned-nmx6z\" (UID: \"e5671dec-e643-4b9e-849c-42faa0159b25\") " pod="openshift-cluster-node-tuning-operator/tuned-nmx6z"
Sep 08 07:04:14.547286 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.547052    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e5671dec-e643-4b9e-849c-42faa0159b25-var-lib-kubelet\") pod \"tuned-nmx6z\" (UID: \"e5671dec-e643-4b9e-849c-42faa0159b25\") " pod="openshift-cluster-node-tuning-operator/tuned-nmx6z"
Sep 08 07:04:14.547286 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.547073    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e5671dec-e643-4b9e-849c-42faa0159b25-etc-tuned\") pod \"tuned-nmx6z\" (UID: \"e5671dec-e643-4b9e-849c-42faa0159b25\") " pod="openshift-cluster-node-tuning-operator/tuned-nmx6z"
Sep 08 07:04:14.547286 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.547098    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/913589e8-903e-4e3a-9495-a17f0bd93fcc-registration-dir\") pod \"aws-ebs-csi-driver-node-gwjp2\" (UID: \"913589e8-903e-4e3a-9495-a17f0bd93fcc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwjp2"
Sep 08 07:04:14.547286 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.547132    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e5671dec-e643-4b9e-849c-42faa0159b25-etc-kubernetes\") pod \"tuned-nmx6z\" (UID: \"e5671dec-e643-4b9e-849c-42faa0159b25\") " pod="openshift-cluster-node-tuning-operator/tuned-nmx6z"
Sep 08 07:04:14.547286 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.547193    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/642e9fc0-d86d-4bbc-9190-c18b87b8a7ae-run-systemd\") pod \"ovnkube-node-kjppj\" (UID: \"642e9fc0-d86d-4bbc-9190-c18b87b8a7ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjppj"
Sep 08 07:04:14.547286 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.547219    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/642e9fc0-d86d-4bbc-9190-c18b87b8a7ae-var-lib-openvswitch\") pod \"ovnkube-node-kjppj\" (UID: \"642e9fc0-d86d-4bbc-9190-c18b87b8a7ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjppj"
Sep 08 07:04:14.547286 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.547256    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6fc4c1f5-eff0-4e2d-a5f8-0b21b412535b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gj5rb\" (UID: \"6fc4c1f5-eff0-4e2d-a5f8-0b21b412535b\") " pod="openshift-multus/multus-additional-cni-plugins-gj5rb"
Sep 08 07:04:14.547655 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.547296    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/642e9fc0-d86d-4bbc-9190-c18b87b8a7ae-run-systemd\") pod \"ovnkube-node-kjppj\" (UID: \"642e9fc0-d86d-4bbc-9190-c18b87b8a7ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjppj"
Sep 08 07:04:14.547655 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.547303    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/642e9fc0-d86d-4bbc-9190-c18b87b8a7ae-var-lib-openvswitch\") pod \"ovnkube-node-kjppj\" (UID: \"642e9fc0-d86d-4bbc-9190-c18b87b8a7ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjppj"
Sep 08 07:04:14.547655 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.547327    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb65d52f-d619-46f8-b86a-fc6261a24eb3-metrics-certs\") pod \"network-metrics-daemon-jhq6t\" (UID: \"fb65d52f-d619-46f8-b86a-fc6261a24eb3\") " pod="openshift-multus/network-metrics-daemon-jhq6t"
Sep 08 07:04:14.547655 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.547360    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/02e6967e-7fbd-46bb-a192-5adc50bed8fa-multus-socket-dir-parent\") pod \"multus-dnzfq\" (UID: \"02e6967e-7fbd-46bb-a192-5adc50bed8fa\") " pod="openshift-multus/multus-dnzfq"
Sep 08 07:04:14.547655 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.547378    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/02e6967e-7fbd-46bb-a192-5adc50bed8fa-host-var-lib-cni-bin\") pod \"multus-dnzfq\" (UID: \"02e6967e-7fbd-46bb-a192-5adc50bed8fa\") " pod="openshift-multus/multus-dnzfq"
Sep 08 07:04:14.547655 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.547394    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/642e9fc0-d86d-4bbc-9190-c18b87b8a7ae-ovnkube-script-lib\") pod \"ovnkube-node-kjppj\" (UID: \"642e9fc0-d86d-4bbc-9190-c18b87b8a7ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjppj"
Sep 08 07:04:14.547655 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.547450    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/02e6967e-7fbd-46bb-a192-5adc50bed8fa-host-var-lib-cni-bin\") pod \"multus-dnzfq\" (UID: \"02e6967e-7fbd-46bb-a192-5adc50bed8fa\") " pod="openshift-multus/multus-dnzfq"
Sep 08 07:04:14.547655 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:14.547399    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 07:04:14.547655 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:14.547539    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb65d52f-d619-46f8-b86a-fc6261a24eb3-metrics-certs podName:fb65d52f-d619-46f8-b86a-fc6261a24eb3 nodeName:}" failed. No retries permitted until 2026-09-08 07:04:15.047516778 +0000 UTC m=+3.028556082 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fb65d52f-d619-46f8-b86a-fc6261a24eb3-metrics-certs") pod "network-metrics-daemon-jhq6t" (UID: "fb65d52f-d619-46f8-b86a-fc6261a24eb3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 07:04:14.547655 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.547396    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvlg5\" (UniqueName: \"kubernetes.io/projected/02e6967e-7fbd-46bb-a192-5adc50bed8fa-kube-api-access-bvlg5\") pod \"multus-dnzfq\" (UID: \"02e6967e-7fbd-46bb-a192-5adc50bed8fa\") " pod="openshift-multus/multus-dnzfq"
Sep 08 07:04:14.547655 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.547581    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5671dec-e643-4b9e-849c-42faa0159b25-tmp\") pod \"tuned-nmx6z\" (UID: \"e5671dec-e643-4b9e-849c-42faa0159b25\") " pod="openshift-cluster-node-tuning-operator/tuned-nmx6z"
Sep 08 07:04:14.547655 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.547584    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/02e6967e-7fbd-46bb-a192-5adc50bed8fa-multus-socket-dir-parent\") pod \"multus-dnzfq\" (UID: \"02e6967e-7fbd-46bb-a192-5adc50bed8fa\") " pod="openshift-multus/multus-dnzfq"
Sep 08 07:04:14.547655 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.547607    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gjw4\" (UniqueName: \"kubernetes.io/projected/e5671dec-e643-4b9e-849c-42faa0159b25-kube-api-access-9gjw4\") pod \"tuned-nmx6z\" (UID: \"e5671dec-e643-4b9e-849c-42faa0159b25\") " pod="openshift-cluster-node-tuning-operator/tuned-nmx6z"
Sep 08 07:04:14.547655 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.547632    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpd4h\" (UniqueName: \"kubernetes.io/projected/913589e8-903e-4e3a-9495-a17f0bd93fcc-kube-api-access-cpd4h\") pod \"aws-ebs-csi-driver-node-gwjp2\" (UID: \"913589e8-903e-4e3a-9495-a17f0bd93fcc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwjp2"
Sep 08 07:04:14.547655 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.547661    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/642e9fc0-d86d-4bbc-9190-c18b87b8a7ae-node-log\") pod \"ovnkube-node-kjppj\" (UID: \"642e9fc0-d86d-4bbc-9190-c18b87b8a7ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjppj"
Sep 08 07:04:14.548325 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.547683    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/642e9fc0-d86d-4bbc-9190-c18b87b8a7ae-host-cni-bin\") pod \"ovnkube-node-kjppj\" (UID: \"642e9fc0-d86d-4bbc-9190-c18b87b8a7ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjppj"
Sep 08 07:04:14.548325 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.547707    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/642e9fc0-d86d-4bbc-9190-c18b87b8a7ae-node-log\") pod \"ovnkube-node-kjppj\" (UID: \"642e9fc0-d86d-4bbc-9190-c18b87b8a7ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjppj"
Sep 08 07:04:14.548325 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.547708    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/913589e8-903e-4e3a-9495-a17f0bd93fcc-device-dir\") pod \"aws-ebs-csi-driver-node-gwjp2\" (UID: \"913589e8-903e-4e3a-9495-a17f0bd93fcc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwjp2"
Sep 08 07:04:14.548325 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.547742    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/913589e8-903e-4e3a-9495-a17f0bd93fcc-etc-selinux\") pod \"aws-ebs-csi-driver-node-gwjp2\" (UID: \"913589e8-903e-4e3a-9495-a17f0bd93fcc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwjp2"
Sep 08 07:04:14.548325 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.547755    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/642e9fc0-d86d-4bbc-9190-c18b87b8a7ae-host-cni-bin\") pod \"ovnkube-node-kjppj\" (UID: \"642e9fc0-d86d-4bbc-9190-c18b87b8a7ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjppj"
Sep 08 07:04:14.548325 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.547766    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/02e6967e-7fbd-46bb-a192-5adc50bed8fa-cni-binary-copy\") pod \"multus-dnzfq\" (UID: \"02e6967e-7fbd-46bb-a192-5adc50bed8fa\") " pod="openshift-multus/multus-dnzfq"
Sep 08 07:04:14.548325 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.547789    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6fc4c1f5-eff0-4e2d-a5f8-0b21b412535b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gj5rb\" (UID: \"6fc4c1f5-eff0-4e2d-a5f8-0b21b412535b\") " pod="openshift-multus/multus-additional-cni-plugins-gj5rb"
Sep 08 07:04:14.548325 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.547800    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e5671dec-e643-4b9e-849c-42faa0159b25-sys\") pod \"tuned-nmx6z\" (UID: \"e5671dec-e643-4b9e-849c-42faa0159b25\") " pod="openshift-cluster-node-tuning-operator/tuned-nmx6z"
Sep 08 07:04:14.548325 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.547837    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ddb3084-72df-467e-9cb5-0cf05725de6f-original-pull-secret\") pod \"global-pull-secret-syncer-8lgmv\" (UID: \"5ddb3084-72df-467e-9cb5-0cf05725de6f\") " pod="kube-system/global-pull-secret-syncer-8lgmv"
Sep 08 07:04:14.548325 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.547866    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/642e9fc0-d86d-4bbc-9190-c18b87b8a7ae-etc-openvswitch\") pod \"ovnkube-node-kjppj\" (UID: \"642e9fc0-d86d-4bbc-9190-c18b87b8a7ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjppj"
Sep 08 07:04:14.548325 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.547911    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/642e9fc0-d86d-4bbc-9190-c18b87b8a7ae-run-openvswitch\") pod \"ovnkube-node-kjppj\" (UID: \"642e9fc0-d86d-4bbc-9190-c18b87b8a7ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjppj"
Sep 08 07:04:14.548325 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:14.547926    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 07:04:14.548325 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.547937    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/642e9fc0-d86d-4bbc-9190-c18b87b8a7ae-log-socket\") pod \"ovnkube-node-kjppj\" (UID: \"642e9fc0-d86d-4bbc-9190-c18b87b8a7ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjppj"
Sep 08 07:04:14.548325 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.547962    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6fc4c1f5-eff0-4e2d-a5f8-0b21b412535b-cni-binary-copy\") pod \"multus-additional-cni-plugins-gj5rb\" (UID: \"6fc4c1f5-eff0-4e2d-a5f8-0b21b412535b\") " pod="openshift-multus/multus-additional-cni-plugins-gj5rb"
Sep 08 07:04:14.548325 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:14.547989    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ddb3084-72df-467e-9cb5-0cf05725de6f-original-pull-secret podName:5ddb3084-72df-467e-9cb5-0cf05725de6f nodeName:}" failed. No retries permitted until 2026-09-08 07:04:15.047957725 +0000 UTC m=+3.028997024 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5ddb3084-72df-467e-9cb5-0cf05725de6f-original-pull-secret") pod "global-pull-secret-syncer-8lgmv" (UID: "5ddb3084-72df-467e-9cb5-0cf05725de6f") : object "kube-system"/"original-pull-secret" not registered
Sep 08 07:04:14.548325 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.548016    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6fc4c1f5-eff0-4e2d-a5f8-0b21b412535b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gj5rb\" (UID: \"6fc4c1f5-eff0-4e2d-a5f8-0b21b412535b\") " pod="openshift-multus/multus-additional-cni-plugins-gj5rb"
Sep 08 07:04:14.548325 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.548024    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/642e9fc0-d86d-4bbc-9190-c18b87b8a7ae-log-socket\") pod \"ovnkube-node-kjppj\" (UID: \"642e9fc0-d86d-4bbc-9190-c18b87b8a7ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjppj"
Sep 08 07:04:14.549184 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.548024    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/642e9fc0-d86d-4bbc-9190-c18b87b8a7ae-run-openvswitch\") pod \"ovnkube-node-kjppj\" (UID: \"642e9fc0-d86d-4bbc-9190-c18b87b8a7ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjppj"
Sep 08 07:04:14.549184 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.548033    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/642e9fc0-d86d-4bbc-9190-c18b87b8a7ae-etc-openvswitch\") pod \"ovnkube-node-kjppj\" (UID: \"642e9fc0-d86d-4bbc-9190-c18b87b8a7ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjppj"
Sep 08 07:04:14.549184 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.548040    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/02e6967e-7fbd-46bb-a192-5adc50bed8fa-host-run-multus-certs\") pod \"multus-dnzfq\" (UID: \"02e6967e-7fbd-46bb-a192-5adc50bed8fa\") " pod="openshift-multus/multus-dnzfq"
Sep 08 07:04:14.549184 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.548075    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/02e6967e-7fbd-46bb-a192-5adc50bed8fa-host-run-multus-certs\") pod \"multus-dnzfq\" (UID: \"02e6967e-7fbd-46bb-a192-5adc50bed8fa\") " pod="openshift-multus/multus-dnzfq"
Sep 08 07:04:14.549184 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.548076    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2ddc39aa-5d19-45db-9990-5c0b33f0fa81-konnectivity-ca\") pod \"konnectivity-agent-ddrdv\" (UID: \"2ddc39aa-5d19-45db-9990-5c0b33f0fa81\") " pod="kube-system/konnectivity-agent-ddrdv"
Sep 08 07:04:14.549184 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.548114    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rp6tj\" (UniqueName: \"kubernetes.io/projected/fb65d52f-d619-46f8-b86a-fc6261a24eb3-kube-api-access-rp6tj\") pod \"network-metrics-daemon-jhq6t\" (UID: \"fb65d52f-d619-46f8-b86a-fc6261a24eb3\") " pod="openshift-multus/network-metrics-daemon-jhq6t"
Sep 08 07:04:14.549184 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.548137    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/642e9fc0-d86d-4bbc-9190-c18b87b8a7ae-systemd-units\") pod \"ovnkube-node-kjppj\" (UID: \"642e9fc0-d86d-4bbc-9190-c18b87b8a7ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjppj"
Sep 08 07:04:14.549184 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.548160    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/02e6967e-7fbd-46bb-a192-5adc50bed8fa-multus-cni-dir\") pod \"multus-dnzfq\" (UID: \"02e6967e-7fbd-46bb-a192-5adc50bed8fa\") " pod="openshift-multus/multus-dnzfq"
Sep 08 07:04:14.549184 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.548183    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/02e6967e-7fbd-46bb-a192-5adc50bed8fa-host-run-k8s-cni-cncf-io\") pod \"multus-dnzfq\" (UID: \"02e6967e-7fbd-46bb-a192-5adc50bed8fa\") " pod="openshift-multus/multus-dnzfq"
Sep 08 07:04:14.549184 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.548187    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6fc4c1f5-eff0-4e2d-a5f8-0b21b412535b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gj5rb\" (UID: \"6fc4c1f5-eff0-4e2d-a5f8-0b21b412535b\") " pod="openshift-multus/multus-additional-cni-plugins-gj5rb"
Sep 08 07:04:14.549184 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.548208    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/02e6967e-7fbd-46bb-a192-5adc50bed8fa-host-run-netns\") pod \"multus-dnzfq\" (UID: \"02e6967e-7fbd-46bb-a192-5adc50bed8fa\") " pod="openshift-multus/multus-dnzfq"
Sep 08 07:04:14.549184 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.548230    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/02e6967e-7fbd-46bb-a192-5adc50bed8fa-hostroot\") pod \"multus-dnzfq\" (UID: \"02e6967e-7fbd-46bb-a192-5adc50bed8fa\") " pod="openshift-multus/multus-dnzfq"
Sep 08 07:04:14.549184 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.548244    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/02e6967e-7fbd-46bb-a192-5adc50bed8fa-multus-cni-dir\") pod \"multus-dnzfq\" (UID: \"02e6967e-7fbd-46bb-a192-5adc50bed8fa\") " pod="openshift-multus/multus-dnzfq"
Sep 08 07:04:14.549184 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.548243    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/02e6967e-7fbd-46bb-a192-5adc50bed8fa-cni-binary-copy\") pod \"multus-dnzfq\" (UID: \"02e6967e-7fbd-46bb-a192-5adc50bed8fa\") " pod="openshift-multus/multus-dnzfq"
Sep 08 07:04:14.549184 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.548271    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/642e9fc0-d86d-4bbc-9190-c18b87b8a7ae-systemd-units\") pod \"ovnkube-node-kjppj\" (UID: \"642e9fc0-d86d-4bbc-9190-c18b87b8a7ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjppj"
Sep 08 07:04:14.549184 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.548290    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/02e6967e-7fbd-46bb-a192-5adc50bed8fa-host-run-k8s-cni-cncf-io\") pod \"multus-dnzfq\" (UID: \"02e6967e-7fbd-46bb-a192-5adc50bed8fa\") " pod="openshift-multus/multus-dnzfq"
Sep 08 07:04:14.549184 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.548302    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/02e6967e-7fbd-46bb-a192-5adc50bed8fa-host-run-netns\") pod \"multus-dnzfq\" (UID: \"02e6967e-7fbd-46bb-a192-5adc50bed8fa\") " pod="openshift-multus/multus-dnzfq"
Sep 08 07:04:14.549184 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.548254    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/02e6967e-7fbd-46bb-a192-5adc50bed8fa-multus-daemon-config\") pod \"multus-dnzfq\" (UID: \"02e6967e-7fbd-46bb-a192-5adc50bed8fa\") " pod="openshift-multus/multus-dnzfq"
Sep 08 07:04:14.549929 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.548325    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/02e6967e-7fbd-46bb-a192-5adc50bed8fa-hostroot\") pod \"multus-dnzfq\" (UID: \"02e6967e-7fbd-46bb-a192-5adc50bed8fa\") " pod="openshift-multus/multus-dnzfq"
Sep 08 07:04:14.549929 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.548331    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/913589e8-903e-4e3a-9495-a17f0bd93fcc-sys-fs\") pod \"aws-ebs-csi-driver-node-gwjp2\" (UID: \"913589e8-903e-4e3a-9495-a17f0bd93fcc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwjp2"
Sep 08 07:04:14.549929 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.548353    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rvmt\" (UniqueName: \"kubernetes.io/projected/ed95682c-c73e-47a2-9931-adc1417cf25c-kube-api-access-8rvmt\") pod \"network-check-target-bf6vx\" (UID: \"ed95682c-c73e-47a2-9931-adc1417cf25c\") " pod="openshift-network-diagnostics/network-check-target-bf6vx"
Sep 08 07:04:14.549929 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.548369    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/642e9fc0-d86d-4bbc-9190-c18b87b8a7ae-host-run-netns\") pod \"ovnkube-node-kjppj\" (UID: \"642e9fc0-d86d-4bbc-9190-c18b87b8a7ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjppj"
Sep 08 07:04:14.549929 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.548383    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/02e6967e-7fbd-46bb-a192-5adc50bed8fa-multus-conf-dir\") pod \"multus-dnzfq\" (UID: \"02e6967e-7fbd-46bb-a192-5adc50bed8fa\") " pod="openshift-multus/multus-dnzfq"
Sep 08 07:04:14.549929 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.548402    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e5671dec-e643-4b9e-849c-42faa0159b25-etc-sysctl-conf\") pod \"tuned-nmx6z\" (UID: \"e5671dec-e643-4b9e-849c-42faa0159b25\") " pod="openshift-cluster-node-tuning-operator/tuned-nmx6z"
Sep 08 07:04:14.549929 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.548422    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/890fab40-3e97-456c-88ed-01de5ff6c541-hosts-file\") pod \"node-resolver-4cwpb\" (UID: \"890fab40-3e97-456c-88ed-01de5ff6c541\") " pod="openshift-dns/node-resolver-4cwpb"
Sep 08 07:04:14.549929 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.548443    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/642e9fc0-d86d-4bbc-9190-c18b87b8a7ae-host-run-ovn-kubernetes\") pod \"ovnkube-node-kjppj\" (UID: \"642e9fc0-d86d-4bbc-9190-c18b87b8a7ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjppj"
Sep 08 07:04:14.549929 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.548458    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/642e9fc0-d86d-4bbc-9190-c18b87b8a7ae-ovn-node-metrics-cert\") pod \"ovnkube-node-kjppj\" (UID: \"642e9fc0-d86d-4bbc-9190-c18b87b8a7ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjppj"
Sep 08 07:04:14.549929 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.548473    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e5671dec-e643-4b9e-849c-42faa0159b25-run\") pod \"tuned-nmx6z\" (UID: \"e5671dec-e643-4b9e-849c-42faa0159b25\") " pod="openshift-cluster-node-tuning-operator/tuned-nmx6z"
Sep 08 07:04:14.549929 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.548511    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2ddc39aa-5d19-45db-9990-5c0b33f0fa81-agent-certs\") pod \"konnectivity-agent-ddrdv\" (UID: \"2ddc39aa-5d19-45db-9990-5c0b33f0fa81\") " pod="kube-system/konnectivity-agent-ddrdv"
Sep 08 07:04:14.549929 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.548506    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6fc4c1f5-eff0-4e2d-a5f8-0b21b412535b-cni-binary-copy\") pod \"multus-additional-cni-plugins-gj5rb\" (UID: \"6fc4c1f5-eff0-4e2d-a5f8-0b21b412535b\") " pod="openshift-multus/multus-additional-cni-plugins-gj5rb"
Sep 08 07:04:14.549929 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.548531    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cbwk\" (UniqueName: \"kubernetes.io/projected/890fab40-3e97-456c-88ed-01de5ff6c541-kube-api-access-9cbwk\") pod \"node-resolver-4cwpb\" (UID: \"890fab40-3e97-456c-88ed-01de5ff6c541\") " pod="openshift-dns/node-resolver-4cwpb"
Sep 08 07:04:14.549929 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.548549    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e5671dec-e643-4b9e-849c-42faa0159b25-etc-modprobe-d\") pod \"tuned-nmx6z\" (UID: \"e5671dec-e643-4b9e-849c-42faa0159b25\") " pod="openshift-cluster-node-tuning-operator/tuned-nmx6z"
Sep 08 07:04:14.549929 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.548583    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/642e9fc0-d86d-4bbc-9190-c18b87b8a7ae-host-run-netns\") pod \"ovnkube-node-kjppj\" (UID: \"642e9fc0-d86d-4bbc-9190-c18b87b8a7ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjppj"
Sep 08 07:04:14.549929 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.548585    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/642e9fc0-d86d-4bbc-9190-c18b87b8a7ae-run-ovn\") pod \"ovnkube-node-kjppj\" (UID: \"642e9fc0-d86d-4bbc-9190-c18b87b8a7ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjppj"
Sep 08 07:04:14.549929 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.548597    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/642e9fc0-d86d-4bbc-9190-c18b87b8a7ae-host-run-ovn-kubernetes\") pod \"ovnkube-node-kjppj\" (UID: \"642e9fc0-d86d-4bbc-9190-c18b87b8a7ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjppj"
Sep 08 07:04:14.550450 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.548613    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6fc4c1f5-eff0-4e2d-a5f8-0b21b412535b-cnibin\") pod \"multus-additional-cni-plugins-gj5rb\" (UID: \"6fc4c1f5-eff0-4e2d-a5f8-0b21b412535b\") " pod="openshift-multus/multus-additional-cni-plugins-gj5rb"
Sep 08 07:04:14.550450 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.548640    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6fc4c1f5-eff0-4e2d-a5f8-0b21b412535b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gj5rb\" (UID: \"6fc4c1f5-eff0-4e2d-a5f8-0b21b412535b\") " pod="openshift-multus/multus-additional-cni-plugins-gj5rb"
Sep 08 07:04:14.550450 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.548651    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/02e6967e-7fbd-46bb-a192-5adc50bed8fa-multus-daemon-config\") pod \"multus-dnzfq\" (UID: \"02e6967e-7fbd-46bb-a192-5adc50bed8fa\") " pod="openshift-multus/multus-dnzfq"
Sep 08 07:04:14.550450 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.548664    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/02e6967e-7fbd-46bb-a192-5adc50bed8fa-host-var-lib-kubelet\") pod \"multus-dnzfq\" (UID: \"02e6967e-7fbd-46bb-a192-5adc50bed8fa\") " pod="openshift-multus/multus-dnzfq"
Sep 08 07:04:14.550450 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.548698    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/02e6967e-7fbd-46bb-a192-5adc50bed8fa-multus-conf-dir\") pod \"multus-dnzfq\" (UID: \"02e6967e-7fbd-46bb-a192-5adc50bed8fa\") " pod="openshift-multus/multus-dnzfq"
Sep 08 07:04:14.550450 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.548703    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6fc4c1f5-eff0-4e2d-a5f8-0b21b412535b-cnibin\") pod \"multus-additional-cni-plugins-gj5rb\" (UID: \"6fc4c1f5-eff0-4e2d-a5f8-0b21b412535b\") " pod="openshift-multus/multus-additional-cni-plugins-gj5rb"
Sep 08 07:04:14.550450 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.548707    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/913589e8-903e-4e3a-9495-a17f0bd93fcc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gwjp2\" (UID: \"913589e8-903e-4e3a-9495-a17f0bd93fcc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwjp2"
Sep 08 07:04:14.550450 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.548731    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/642e9fc0-d86d-4bbc-9190-c18b87b8a7ae-run-ovn\") pod \"ovnkube-node-kjppj\" (UID: \"642e9fc0-d86d-4bbc-9190-c18b87b8a7ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjppj"
Sep 08 07:04:14.550450 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.548733    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5ddb3084-72df-467e-9cb5-0cf05725de6f-kubelet-config\") pod \"global-pull-secret-syncer-8lgmv\" (UID: \"5ddb3084-72df-467e-9cb5-0cf05725de6f\") " pod="kube-system/global-pull-secret-syncer-8lgmv"
Sep 08 07:04:14.550450 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.548787    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5ddb3084-72df-467e-9cb5-0cf05725de6f-kubelet-config\") pod \"global-pull-secret-syncer-8lgmv\" (UID: \"5ddb3084-72df-467e-9cb5-0cf05725de6f\") " pod="kube-system/global-pull-secret-syncer-8lgmv"
Sep 08 07:04:14.550450 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.548808    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/02e6967e-7fbd-46bb-a192-5adc50bed8fa-host-var-lib-kubelet\") pod \"multus-dnzfq\" (UID: \"02e6967e-7fbd-46bb-a192-5adc50bed8fa\") " pod="openshift-multus/multus-dnzfq"
Sep 08 07:04:14.550450 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.548829    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/642e9fc0-d86d-4bbc-9190-c18b87b8a7ae-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kjppj\" (UID: \"642e9fc0-d86d-4bbc-9190-c18b87b8a7ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjppj"
Sep 08 07:04:14.550450 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.548841    2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 08 07:04:14.550450 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.548863    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zktbd\" (UniqueName: \"kubernetes.io/projected/6fc4c1f5-eff0-4e2d-a5f8-0b21b412535b-kube-api-access-zktbd\") pod \"multus-additional-cni-plugins-gj5rb\" (UID: \"6fc4c1f5-eff0-4e2d-a5f8-0b21b412535b\") " pod="openshift-multus/multus-additional-cni-plugins-gj5rb"
Sep 08 07:04:14.550450 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.548874    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/642e9fc0-d86d-4bbc-9190-c18b87b8a7ae-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kjppj\" (UID: \"642e9fc0-d86d-4bbc-9190-c18b87b8a7ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjppj"
Sep 08 07:04:14.550450 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.548889    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/02e6967e-7fbd-46bb-a192-5adc50bed8fa-system-cni-dir\") pod \"multus-dnzfq\" (UID: \"02e6967e-7fbd-46bb-a192-5adc50bed8fa\") " pod="openshift-multus/multus-dnzfq"
Sep 08 07:04:14.550450 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.548912    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/02e6967e-7fbd-46bb-a192-5adc50bed8fa-cnibin\") pod \"multus-dnzfq\" (UID: \"02e6967e-7fbd-46bb-a192-5adc50bed8fa\") " pod="openshift-multus/multus-dnzfq"
Sep 08 07:04:14.551091 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.548937    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5ddb3084-72df-467e-9cb5-0cf05725de6f-dbus\") pod \"global-pull-secret-syncer-8lgmv\" (UID: \"5ddb3084-72df-467e-9cb5-0cf05725de6f\") " pod="kube-system/global-pull-secret-syncer-8lgmv"
Sep 08 07:04:14.551091 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.548959    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/642e9fc0-d86d-4bbc-9190-c18b87b8a7ae-host-kubelet\") pod \"ovnkube-node-kjppj\" (UID: \"642e9fc0-d86d-4bbc-9190-c18b87b8a7ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjppj"
Sep 08 07:04:14.551091 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.549004    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/642e9fc0-d86d-4bbc-9190-c18b87b8a7ae-env-overrides\") pod \"ovnkube-node-kjppj\" (UID: \"642e9fc0-d86d-4bbc-9190-c18b87b8a7ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjppj"
Sep 08 07:04:14.551091 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.549046    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nh9hc\" (UniqueName: \"kubernetes.io/projected/b2f51d59-90ee-4464-924a-cfc1d12484ad-kube-api-access-nh9hc\") pod \"iptables-alerter-hnw92\" (UID: \"b2f51d59-90ee-4464-924a-cfc1d12484ad\") " pod="openshift-network-operator/iptables-alerter-hnw92"
Sep 08 07:04:14.551091 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.549071    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5b60264a-f3fc-4640-a51a-d556e505482a-serviceca\") pod \"node-ca-qllkn\" (UID: \"5b60264a-f3fc-4640-a51a-d556e505482a\") " pod="openshift-image-registry/node-ca-qllkn"
Sep 08 07:04:14.551091 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.549095    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/642e9fc0-d86d-4bbc-9190-c18b87b8a7ae-host-slash\") pod \"ovnkube-node-kjppj\" (UID: \"642e9fc0-d86d-4bbc-9190-c18b87b8a7ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjppj"
Sep 08 07:04:14.551091 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.549101    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6fc4c1f5-eff0-4e2d-a5f8-0b21b412535b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gj5rb\" (UID: \"6fc4c1f5-eff0-4e2d-a5f8-0b21b412535b\") " pod="openshift-multus/multus-additional-cni-plugins-gj5rb"
Sep 08 07:04:14.551091 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.549102    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/02e6967e-7fbd-46bb-a192-5adc50bed8fa-cnibin\") pod \"multus-dnzfq\" (UID: \"02e6967e-7fbd-46bb-a192-5adc50bed8fa\") " pod="openshift-multus/multus-dnzfq"
Sep 08 07:04:14.551091 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.549143    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5b60264a-f3fc-4640-a51a-d556e505482a-host\") pod \"node-ca-qllkn\" (UID: \"5b60264a-f3fc-4640-a51a-d556e505482a\") " pod="openshift-image-registry/node-ca-qllkn"
Sep 08 07:04:14.551091 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.549168    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e5671dec-e643-4b9e-849c-42faa0159b25-etc-sysconfig\") pod \"tuned-nmx6z\" (UID: \"e5671dec-e643-4b9e-849c-42faa0159b25\") " pod="openshift-cluster-node-tuning-operator/tuned-nmx6z"
Sep 08 07:04:14.551091 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.549172    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/642e9fc0-d86d-4bbc-9190-c18b87b8a7ae-host-slash\") pod \"ovnkube-node-kjppj\" (UID: \"642e9fc0-d86d-4bbc-9190-c18b87b8a7ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjppj"
Sep 08 07:04:14.551091 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.549204    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/642e9fc0-d86d-4bbc-9190-c18b87b8a7ae-host-kubelet\") pod \"ovnkube-node-kjppj\" (UID: \"642e9fc0-d86d-4bbc-9190-c18b87b8a7ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjppj"
Sep 08 07:04:14.551091 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.549207    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/02e6967e-7fbd-46bb-a192-5adc50bed8fa-system-cni-dir\") pod \"multus-dnzfq\" (UID: \"02e6967e-7fbd-46bb-a192-5adc50bed8fa\") " pod="openshift-multus/multus-dnzfq"
Sep 08 07:04:14.551091 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.549211    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b2f51d59-90ee-4464-924a-cfc1d12484ad-iptables-alerter-script\") pod \"iptables-alerter-hnw92\" (UID: \"b2f51d59-90ee-4464-924a-cfc1d12484ad\") " pod="openshift-network-operator/iptables-alerter-hnw92"
Sep 08 07:04:14.551091 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.549246    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/642e9fc0-d86d-4bbc-9190-c18b87b8a7ae-ovnkube-config\") pod \"ovnkube-node-kjppj\" (UID: \"642e9fc0-d86d-4bbc-9190-c18b87b8a7ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjppj"
Sep 08 07:04:14.551091 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.549274    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6fc4c1f5-eff0-4e2d-a5f8-0b21b412535b-system-cni-dir\") pod \"multus-additional-cni-plugins-gj5rb\" (UID: \"6fc4c1f5-eff0-4e2d-a5f8-0b21b412535b\") " pod="openshift-multus/multus-additional-cni-plugins-gj5rb"
Sep 08 07:04:14.551091 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.549305    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/02e6967e-7fbd-46bb-a192-5adc50bed8fa-host-var-lib-cni-multus\") pod \"multus-dnzfq\" (UID: \"02e6967e-7fbd-46bb-a192-5adc50bed8fa\") " pod="openshift-multus/multus-dnzfq"
Sep 08 07:04:14.551855 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.549320    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6fc4c1f5-eff0-4e2d-a5f8-0b21b412535b-system-cni-dir\") pod \"multus-additional-cni-plugins-gj5rb\" (UID: \"6fc4c1f5-eff0-4e2d-a5f8-0b21b412535b\") " pod="openshift-multus/multus-additional-cni-plugins-gj5rb"
Sep 08 07:04:14.551855 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.549329    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/02e6967e-7fbd-46bb-a192-5adc50bed8fa-etc-kubernetes\") pod \"multus-dnzfq\" (UID: \"02e6967e-7fbd-46bb-a192-5adc50bed8fa\") " pod="openshift-multus/multus-dnzfq"
Sep 08 07:04:14.551855 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.549358    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/02e6967e-7fbd-46bb-a192-5adc50bed8fa-host-var-lib-cni-multus\") pod \"multus-dnzfq\" (UID: \"02e6967e-7fbd-46bb-a192-5adc50bed8fa\") " pod="openshift-multus/multus-dnzfq"
Sep 08 07:04:14.551855 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.549375    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5ddb3084-72df-467e-9cb5-0cf05725de6f-dbus\") pod \"global-pull-secret-syncer-8lgmv\" (UID: \"5ddb3084-72df-467e-9cb5-0cf05725de6f\") " pod="kube-system/global-pull-secret-syncer-8lgmv"
Sep 08 07:04:14.551855 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.549409    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/02e6967e-7fbd-46bb-a192-5adc50bed8fa-etc-kubernetes\") pod \"multus-dnzfq\" (UID: \"02e6967e-7fbd-46bb-a192-5adc50bed8fa\") " pod="openshift-multus/multus-dnzfq"
Sep 08 07:04:14.551855 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.549737    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/642e9fc0-d86d-4bbc-9190-c18b87b8a7ae-ovnkube-config\") pod \"ovnkube-node-kjppj\" (UID: \"642e9fc0-d86d-4bbc-9190-c18b87b8a7ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjppj"
Sep 08 07:04:14.551855 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.549738    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/642e9fc0-d86d-4bbc-9190-c18b87b8a7ae-env-overrides\") pod \"ovnkube-node-kjppj\" (UID: \"642e9fc0-d86d-4bbc-9190-c18b87b8a7ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjppj"
Sep 08 07:04:14.552942 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.552922    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/642e9fc0-d86d-4bbc-9190-c18b87b8a7ae-ovn-node-metrics-cert\") pod \"ovnkube-node-kjppj\" (UID: \"642e9fc0-d86d-4bbc-9190-c18b87b8a7ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjppj"
Sep 08 07:04:14.554748 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:14.554727    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 07:04:14.554748 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:14.554753    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 07:04:14.554748 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:14.554766    2564 projected.go:196] Error preparing data for projected volume kube-api-access-8rvmt for pod openshift-network-diagnostics/network-check-target-bf6vx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 07:04:14.555028 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:14.554822    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ed95682c-c73e-47a2-9931-adc1417cf25c-kube-api-access-8rvmt podName:ed95682c-c73e-47a2-9931-adc1417cf25c nodeName:}" failed. No retries permitted until 2026-09-08 07:04:15.054805223 +0000 UTC m=+3.035844523 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-8rvmt" (UniqueName: "kubernetes.io/projected/ed95682c-c73e-47a2-9931-adc1417cf25c-kube-api-access-8rvmt") pod "network-check-target-bf6vx" (UID: "ed95682c-c73e-47a2-9931-adc1417cf25c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 07:04:14.556407 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.556344    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwhg9\" (UniqueName: \"kubernetes.io/projected/642e9fc0-d86d-4bbc-9190-c18b87b8a7ae-kube-api-access-zwhg9\") pod \"ovnkube-node-kjppj\" (UID: \"642e9fc0-d86d-4bbc-9190-c18b87b8a7ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-kjppj"
Sep 08 07:04:14.557273 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.557233    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvlg5\" (UniqueName: \"kubernetes.io/projected/02e6967e-7fbd-46bb-a192-5adc50bed8fa-kube-api-access-bvlg5\") pod \"multus-dnzfq\" (UID: \"02e6967e-7fbd-46bb-a192-5adc50bed8fa\") " pod="openshift-multus/multus-dnzfq"
Sep 08 07:04:14.557774 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.557747    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zktbd\" (UniqueName: \"kubernetes.io/projected/6fc4c1f5-eff0-4e2d-a5f8-0b21b412535b-kube-api-access-zktbd\") pod \"multus-additional-cni-plugins-gj5rb\" (UID: \"6fc4c1f5-eff0-4e2d-a5f8-0b21b412535b\") " pod="openshift-multus/multus-additional-cni-plugins-gj5rb"
Sep 08 07:04:14.558135 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.558114    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rp6tj\" (UniqueName: \"kubernetes.io/projected/fb65d52f-d619-46f8-b86a-fc6261a24eb3-kube-api-access-rp6tj\") pod \"network-metrics-daemon-jhq6t\" (UID: \"fb65d52f-d619-46f8-b86a-fc6261a24eb3\") " pod="openshift-multus/network-metrics-daemon-jhq6t"
Sep 08 07:04:14.650400 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.650369    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e5671dec-e643-4b9e-849c-42faa0159b25-etc-modprobe-d\") pod \"tuned-nmx6z\" (UID: \"e5671dec-e643-4b9e-849c-42faa0159b25\") " pod="openshift-cluster-node-tuning-operator/tuned-nmx6z"
Sep 08 07:04:14.650400 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.650404    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/913589e8-903e-4e3a-9495-a17f0bd93fcc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gwjp2\" (UID: \"913589e8-903e-4e3a-9495-a17f0bd93fcc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwjp2"
Sep 08 07:04:14.650635 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.650424    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nh9hc\" (UniqueName: \"kubernetes.io/projected/b2f51d59-90ee-4464-924a-cfc1d12484ad-kube-api-access-nh9hc\") pod \"iptables-alerter-hnw92\" (UID: \"b2f51d59-90ee-4464-924a-cfc1d12484ad\") " pod="openshift-network-operator/iptables-alerter-hnw92"
Sep 08 07:04:14.650635 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.650439    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5b60264a-f3fc-4640-a51a-d556e505482a-serviceca\") pod \"node-ca-qllkn\" (UID: \"5b60264a-f3fc-4640-a51a-d556e505482a\") " pod="openshift-image-registry/node-ca-qllkn"
Sep 08 07:04:14.650635 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.650459    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5b60264a-f3fc-4640-a51a-d556e505482a-host\") pod \"node-ca-qllkn\" (UID: \"5b60264a-f3fc-4640-a51a-d556e505482a\") " pod="openshift-image-registry/node-ca-qllkn"
Sep 08 07:04:14.650635 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.650503    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5b60264a-f3fc-4640-a51a-d556e505482a-host\") pod \"node-ca-qllkn\" (UID: \"5b60264a-f3fc-4640-a51a-d556e505482a\") " pod="openshift-image-registry/node-ca-qllkn"
Sep 08 07:04:14.650635 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.650500    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/913589e8-903e-4e3a-9495-a17f0bd93fcc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gwjp2\" (UID: \"913589e8-903e-4e3a-9495-a17f0bd93fcc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwjp2"
Sep 08 07:04:14.650635 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.650541    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e5671dec-e643-4b9e-849c-42faa0159b25-etc-modprobe-d\") pod \"tuned-nmx6z\" (UID: \"e5671dec-e643-4b9e-849c-42faa0159b25\") " pod="openshift-cluster-node-tuning-operator/tuned-nmx6z"
Sep 08 07:04:14.650635 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.650625    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e5671dec-e643-4b9e-849c-42faa0159b25-etc-sysconfig\") pod \"tuned-nmx6z\" (UID: \"e5671dec-e643-4b9e-849c-42faa0159b25\") " pod="openshift-cluster-node-tuning-operator/tuned-nmx6z"
Sep 08 07:04:14.651005 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.650674    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b2f51d59-90ee-4464-924a-cfc1d12484ad-iptables-alerter-script\") pod \"iptables-alerter-hnw92\" (UID: \"b2f51d59-90ee-4464-924a-cfc1d12484ad\") " pod="openshift-network-operator/iptables-alerter-hnw92"
Sep 08 07:04:14.651005 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.650704    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e5671dec-e643-4b9e-849c-42faa0159b25-lib-modules\") pod \"tuned-nmx6z\" (UID: \"e5671dec-e643-4b9e-849c-42faa0159b25\") " pod="openshift-cluster-node-tuning-operator/tuned-nmx6z"
Sep 08 07:04:14.651005 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.650726    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e5671dec-e643-4b9e-849c-42faa0159b25-etc-sysconfig\") pod \"tuned-nmx6z\" (UID: \"e5671dec-e643-4b9e-849c-42faa0159b25\") " pod="openshift-cluster-node-tuning-operator/tuned-nmx6z"
Sep 08 07:04:14.651005 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.650728    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e5671dec-e643-4b9e-849c-42faa0159b25-host\") pod \"tuned-nmx6z\" (UID: \"e5671dec-e643-4b9e-849c-42faa0159b25\") " pod="openshift-cluster-node-tuning-operator/tuned-nmx6z"
Sep 08 07:04:14.651005 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.650786    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/913589e8-903e-4e3a-9495-a17f0bd93fcc-socket-dir\") pod \"aws-ebs-csi-driver-node-gwjp2\" (UID: \"913589e8-903e-4e3a-9495-a17f0bd93fcc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwjp2"
Sep 08 07:04:14.651005 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.650812    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b2f51d59-90ee-4464-924a-cfc1d12484ad-host-slash\") pod \"iptables-alerter-hnw92\" (UID: \"b2f51d59-90ee-4464-924a-cfc1d12484ad\") " pod="openshift-network-operator/iptables-alerter-hnw92"
Sep 08 07:04:14.651005 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.650832    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e5671dec-e643-4b9e-849c-42faa0159b25-lib-modules\") pod \"tuned-nmx6z\" (UID: \"e5671dec-e643-4b9e-849c-42faa0159b25\") " pod="openshift-cluster-node-tuning-operator/tuned-nmx6z"
Sep 08 07:04:14.651005 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.650872    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e5671dec-e643-4b9e-849c-42faa0159b25-host\") pod \"tuned-nmx6z\" (UID: \"e5671dec-e643-4b9e-849c-42faa0159b25\") " pod="openshift-cluster-node-tuning-operator/tuned-nmx6z"
Sep 08 07:04:14.651005 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.650915    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hspcv\" (UniqueName: \"kubernetes.io/projected/5b60264a-f3fc-4640-a51a-d556e505482a-kube-api-access-hspcv\") pod \"node-ca-qllkn\" (UID: \"5b60264a-f3fc-4640-a51a-d556e505482a\") " pod="openshift-image-registry/node-ca-qllkn"
Sep 08 07:04:14.651005 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.650947    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/890fab40-3e97-456c-88ed-01de5ff6c541-tmp-dir\") pod \"node-resolver-4cwpb\" (UID: \"890fab40-3e97-456c-88ed-01de5ff6c541\") " pod="openshift-dns/node-resolver-4cwpb"
Sep 08 07:04:14.651005 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.650982    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e5671dec-e643-4b9e-849c-42faa0159b25-etc-sysctl-d\") pod \"tuned-nmx6z\" (UID: \"e5671dec-e643-4b9e-849c-42faa0159b25\") " pod="openshift-cluster-node-tuning-operator/tuned-nmx6z"
Sep 08 07:04:14.651005 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.650915    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5b60264a-f3fc-4640-a51a-d556e505482a-serviceca\") pod \"node-ca-qllkn\" (UID: \"5b60264a-f3fc-4640-a51a-d556e505482a\") " pod="openshift-image-registry/node-ca-qllkn"
Sep 08 07:04:14.651005 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.651004    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e5671dec-e643-4b9e-849c-42faa0159b25-etc-systemd\") pod \"tuned-nmx6z\" (UID: \"e5671dec-e643-4b9e-849c-42faa0159b25\") " pod="openshift-cluster-node-tuning-operator/tuned-nmx6z"
Sep 08 07:04:14.651611 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.651027    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e5671dec-e643-4b9e-849c-42faa0159b25-var-lib-kubelet\") pod \"tuned-nmx6z\" (UID: \"e5671dec-e643-4b9e-849c-42faa0159b25\") " pod="openshift-cluster-node-tuning-operator/tuned-nmx6z"
Sep 08 07:04:14.651611 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.651049    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e5671dec-e643-4b9e-849c-42faa0159b25-etc-tuned\") pod \"tuned-nmx6z\" (UID: \"e5671dec-e643-4b9e-849c-42faa0159b25\") " pod="openshift-cluster-node-tuning-operator/tuned-nmx6z"
Sep 08 07:04:14.651611 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.651068    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/913589e8-903e-4e3a-9495-a17f0bd93fcc-registration-dir\") pod \"aws-ebs-csi-driver-node-gwjp2\" (UID: \"913589e8-903e-4e3a-9495-a17f0bd93fcc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwjp2"
Sep 08 07:04:14.651611 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.651071    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/913589e8-903e-4e3a-9495-a17f0bd93fcc-socket-dir\") pod \"aws-ebs-csi-driver-node-gwjp2\" (UID: \"913589e8-903e-4e3a-9495-a17f0bd93fcc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwjp2"
Sep 08 07:04:14.651611 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.651086    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e5671dec-e643-4b9e-849c-42faa0159b25-etc-kubernetes\") pod \"tuned-nmx6z\" (UID: \"e5671dec-e643-4b9e-849c-42faa0159b25\") " pod="openshift-cluster-node-tuning-operator/tuned-nmx6z"
Sep 08 07:04:14.651611 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.651129    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5671dec-e643-4b9e-849c-42faa0159b25-tmp\") pod \"tuned-nmx6z\" (UID: \"e5671dec-e643-4b9e-849c-42faa0159b25\") " pod="openshift-cluster-node-tuning-operator/tuned-nmx6z"
Sep 08 07:04:14.651611 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.651129    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e5671dec-e643-4b9e-849c-42faa0159b25-var-lib-kubelet\") pod \"tuned-nmx6z\" (UID: \"e5671dec-e643-4b9e-849c-42faa0159b25\") " pod="openshift-cluster-node-tuning-operator/tuned-nmx6z"
Sep 08 07:04:14.651611 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.651129    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e5671dec-e643-4b9e-849c-42faa0159b25-etc-sysctl-d\") pod \"tuned-nmx6z\" (UID: \"e5671dec-e643-4b9e-849c-42faa0159b25\") " pod="openshift-cluster-node-tuning-operator/tuned-nmx6z"
Sep 08 07:04:14.651611 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.650947    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b2f51d59-90ee-4464-924a-cfc1d12484ad-host-slash\") pod \"iptables-alerter-hnw92\" (UID: \"b2f51d59-90ee-4464-924a-cfc1d12484ad\") " pod="openshift-network-operator/iptables-alerter-hnw92"
Sep 08 07:04:14.651611 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.651181    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e5671dec-e643-4b9e-849c-42faa0159b25-etc-systemd\") pod \"tuned-nmx6z\" (UID: \"e5671dec-e643-4b9e-849c-42faa0159b25\") " pod="openshift-cluster-node-tuning-operator/tuned-nmx6z"
Sep 08 07:04:14.651611 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.651197    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e5671dec-e643-4b9e-849c-42faa0159b25-etc-kubernetes\") pod \"tuned-nmx6z\" (UID: \"e5671dec-e643-4b9e-849c-42faa0159b25\") " pod="openshift-cluster-node-tuning-operator/tuned-nmx6z"
Sep 08 07:04:14.651611 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.651210    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b2f51d59-90ee-4464-924a-cfc1d12484ad-iptables-alerter-script\") pod \"iptables-alerter-hnw92\" (UID: \"b2f51d59-90ee-4464-924a-cfc1d12484ad\") " pod="openshift-network-operator/iptables-alerter-hnw92"
Sep 08 07:04:14.651611 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.651212    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gjw4\" (UniqueName: \"kubernetes.io/projected/e5671dec-e643-4b9e-849c-42faa0159b25-kube-api-access-9gjw4\") pod \"tuned-nmx6z\" (UID: \"e5671dec-e643-4b9e-849c-42faa0159b25\") " pod="openshift-cluster-node-tuning-operator/tuned-nmx6z"
Sep 08 07:04:14.651611 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.651251    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/890fab40-3e97-456c-88ed-01de5ff6c541-tmp-dir\") pod \"node-resolver-4cwpb\" (UID: \"890fab40-3e97-456c-88ed-01de5ff6c541\") " pod="openshift-dns/node-resolver-4cwpb"
Sep 08 07:04:14.651611 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.651298    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpd4h\" (UniqueName: \"kubernetes.io/projected/913589e8-903e-4e3a-9495-a17f0bd93fcc-kube-api-access-cpd4h\") pod \"aws-ebs-csi-driver-node-gwjp2\" (UID: \"913589e8-903e-4e3a-9495-a17f0bd93fcc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwjp2"
Sep 08 07:04:14.651611 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.651337    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/913589e8-903e-4e3a-9495-a17f0bd93fcc-device-dir\") pod \"aws-ebs-csi-driver-node-gwjp2\" (UID: \"913589e8-903e-4e3a-9495-a17f0bd93fcc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwjp2"
Sep 08 07:04:14.651611 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.651242    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/913589e8-903e-4e3a-9495-a17f0bd93fcc-registration-dir\") pod \"aws-ebs-csi-driver-node-gwjp2\" (UID: \"913589e8-903e-4e3a-9495-a17f0bd93fcc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwjp2"
Sep 08 07:04:14.652396 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.651363    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/913589e8-903e-4e3a-9495-a17f0bd93fcc-etc-selinux\") pod \"aws-ebs-csi-driver-node-gwjp2\" (UID: \"913589e8-903e-4e3a-9495-a17f0bd93fcc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwjp2"
Sep 08 07:04:14.652396 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.651390    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e5671dec-e643-4b9e-849c-42faa0159b25-sys\") pod \"tuned-nmx6z\" (UID: \"e5671dec-e643-4b9e-849c-42faa0159b25\") " pod="openshift-cluster-node-tuning-operator/tuned-nmx6z"
Sep 08 07:04:14.652396 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.651447    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2ddc39aa-5d19-45db-9990-5c0b33f0fa81-konnectivity-ca\") pod \"konnectivity-agent-ddrdv\" (UID: \"2ddc39aa-5d19-45db-9990-5c0b33f0fa81\") " pod="kube-system/konnectivity-agent-ddrdv"
Sep 08 07:04:14.652396 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.651457    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/913589e8-903e-4e3a-9495-a17f0bd93fcc-device-dir\") pod \"aws-ebs-csi-driver-node-gwjp2\" (UID: \"913589e8-903e-4e3a-9495-a17f0bd93fcc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwjp2"
Sep 08 07:04:14.652396 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.651494    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/913589e8-903e-4e3a-9495-a17f0bd93fcc-sys-fs\") pod \"aws-ebs-csi-driver-node-gwjp2\" (UID: \"913589e8-903e-4e3a-9495-a17f0bd93fcc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwjp2"
Sep 08 07:04:14.652396 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.651508    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/913589e8-903e-4e3a-9495-a17f0bd93fcc-etc-selinux\") pod \"aws-ebs-csi-driver-node-gwjp2\" (UID: \"913589e8-903e-4e3a-9495-a17f0bd93fcc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwjp2"
Sep 08 07:04:14.652396 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.651523    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e5671dec-e643-4b9e-849c-42faa0159b25-sys\") pod \"tuned-nmx6z\" (UID: \"e5671dec-e643-4b9e-849c-42faa0159b25\") " pod="openshift-cluster-node-tuning-operator/tuned-nmx6z"
Sep 08 07:04:14.652396 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.651569    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/913589e8-903e-4e3a-9495-a17f0bd93fcc-sys-fs\") pod \"aws-ebs-csi-driver-node-gwjp2\" (UID: \"913589e8-903e-4e3a-9495-a17f0bd93fcc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwjp2"
Sep 08 07:04:14.652396 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.651628    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e5671dec-e643-4b9e-849c-42faa0159b25-etc-sysctl-conf\") pod \"tuned-nmx6z\" (UID: \"e5671dec-e643-4b9e-849c-42faa0159b25\") " pod="openshift-cluster-node-tuning-operator/tuned-nmx6z"
Sep 08 07:04:14.652396 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.651656    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/890fab40-3e97-456c-88ed-01de5ff6c541-hosts-file\") pod \"node-resolver-4cwpb\" (UID: \"890fab40-3e97-456c-88ed-01de5ff6c541\") " pod="openshift-dns/node-resolver-4cwpb"
Sep 08 07:04:14.652396 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.651681    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e5671dec-e643-4b9e-849c-42faa0159b25-run\") pod \"tuned-nmx6z\" (UID: \"e5671dec-e643-4b9e-849c-42faa0159b25\") " pod="openshift-cluster-node-tuning-operator/tuned-nmx6z"
Sep 08 07:04:14.652396 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.651705    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2ddc39aa-5d19-45db-9990-5c0b33f0fa81-agent-certs\") pod \"konnectivity-agent-ddrdv\" (UID: \"2ddc39aa-5d19-45db-9990-5c0b33f0fa81\") " pod="kube-system/konnectivity-agent-ddrdv"
Sep 08 07:04:14.652396 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.651729    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cbwk\" (UniqueName: \"kubernetes.io/projected/890fab40-3e97-456c-88ed-01de5ff6c541-kube-api-access-9cbwk\") pod \"node-resolver-4cwpb\" (UID: \"890fab40-3e97-456c-88ed-01de5ff6c541\") " pod="openshift-dns/node-resolver-4cwpb"
Sep 08 07:04:14.652396 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.651768    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e5671dec-e643-4b9e-849c-42faa0159b25-etc-sysctl-conf\") pod \"tuned-nmx6z\" (UID: \"e5671dec-e643-4b9e-849c-42faa0159b25\") " pod="openshift-cluster-node-tuning-operator/tuned-nmx6z"
Sep 08 07:04:14.652396 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.651819    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e5671dec-e643-4b9e-849c-42faa0159b25-run\") pod \"tuned-nmx6z\" (UID: \"e5671dec-e643-4b9e-849c-42faa0159b25\") " pod="openshift-cluster-node-tuning-operator/tuned-nmx6z"
Sep 08 07:04:14.652396 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.652056    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/890fab40-3e97-456c-88ed-01de5ff6c541-hosts-file\") pod \"node-resolver-4cwpb\" (UID: \"890fab40-3e97-456c-88ed-01de5ff6c541\") " pod="openshift-dns/node-resolver-4cwpb"
Sep 08 07:04:14.652396 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.652110    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2ddc39aa-5d19-45db-9990-5c0b33f0fa81-konnectivity-ca\") pod \"konnectivity-agent-ddrdv\" (UID: \"2ddc39aa-5d19-45db-9990-5c0b33f0fa81\") " pod="kube-system/konnectivity-agent-ddrdv"
Sep 08 07:04:14.653671 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.653648    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e5671dec-e643-4b9e-849c-42faa0159b25-etc-tuned\") pod \"tuned-nmx6z\" (UID: \"e5671dec-e643-4b9e-849c-42faa0159b25\") " pod="openshift-cluster-node-tuning-operator/tuned-nmx6z"
Sep 08 07:04:14.653796 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.653709    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e5671dec-e643-4b9e-849c-42faa0159b25-tmp\") pod \"tuned-nmx6z\" (UID: \"e5671dec-e643-4b9e-849c-42faa0159b25\") " pod="openshift-cluster-node-tuning-operator/tuned-nmx6z"
Sep 08 07:04:14.654250 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.654232    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2ddc39aa-5d19-45db-9990-5c0b33f0fa81-agent-certs\") pod \"konnectivity-agent-ddrdv\" (UID: \"2ddc39aa-5d19-45db-9990-5c0b33f0fa81\") " pod="kube-system/konnectivity-agent-ddrdv"
Sep 08 07:04:14.659126 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.659099    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpd4h\" (UniqueName: \"kubernetes.io/projected/913589e8-903e-4e3a-9495-a17f0bd93fcc-kube-api-access-cpd4h\") pod \"aws-ebs-csi-driver-node-gwjp2\" (UID: \"913589e8-903e-4e3a-9495-a17f0bd93fcc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwjp2"
Sep 08 07:04:14.659295 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.659270    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gjw4\" (UniqueName: \"kubernetes.io/projected/e5671dec-e643-4b9e-849c-42faa0159b25-kube-api-access-9gjw4\") pod \"tuned-nmx6z\" (UID: \"e5671dec-e643-4b9e-849c-42faa0159b25\") " pod="openshift-cluster-node-tuning-operator/tuned-nmx6z"
Sep 08 07:04:14.659435 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.659412    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nh9hc\" (UniqueName: \"kubernetes.io/projected/b2f51d59-90ee-4464-924a-cfc1d12484ad-kube-api-access-nh9hc\") pod \"iptables-alerter-hnw92\" (UID: \"b2f51d59-90ee-4464-924a-cfc1d12484ad\") " pod="openshift-network-operator/iptables-alerter-hnw92"
Sep 08 07:04:14.659911 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.659891    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hspcv\" (UniqueName: \"kubernetes.io/projected/5b60264a-f3fc-4640-a51a-d556e505482a-kube-api-access-hspcv\") pod \"node-ca-qllkn\" (UID: \"5b60264a-f3fc-4640-a51a-d556e505482a\") " pod="openshift-image-registry/node-ca-qllkn"
Sep 08 07:04:14.660147 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.660124    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cbwk\" (UniqueName: \"kubernetes.io/projected/890fab40-3e97-456c-88ed-01de5ff6c541-kube-api-access-9cbwk\") pod \"node-resolver-4cwpb\" (UID: \"890fab40-3e97-456c-88ed-01de5ff6c541\") " pod="openshift-dns/node-resolver-4cwpb"
Sep 08 07:04:14.736158 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.736129    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kjppj"
Sep 08 07:04:14.740130 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.740103    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gj5rb"
Sep 08 07:04:14.749772 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.749748    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dnzfq"
Sep 08 07:04:14.763526 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.763504    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nmx6z"
Sep 08 07:04:14.771281 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.771259    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwjp2"
Sep 08 07:04:14.776801 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.776782    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ddrdv"
Sep 08 07:04:14.784894 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.784876    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hnw92"
Sep 08 07:04:14.793523 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.793504    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qllkn"
Sep 08 07:04:14.798054 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.798006    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4cwpb"
Sep 08 07:04:14.904158 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:14.904124    2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 07:04:15.053627 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:15.053553    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb65d52f-d619-46f8-b86a-fc6261a24eb3-metrics-certs\") pod \"network-metrics-daemon-jhq6t\" (UID: \"fb65d52f-d619-46f8-b86a-fc6261a24eb3\") " pod="openshift-multus/network-metrics-daemon-jhq6t"
Sep 08 07:04:15.053627 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:15.053599    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ddb3084-72df-467e-9cb5-0cf05725de6f-original-pull-secret\") pod \"global-pull-secret-syncer-8lgmv\" (UID: \"5ddb3084-72df-467e-9cb5-0cf05725de6f\") " pod="kube-system/global-pull-secret-syncer-8lgmv"
Sep 08 07:04:15.053810 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:15.053711    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 07:04:15.053810 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:15.053722    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 07:04:15.053810 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:15.053791    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ddb3084-72df-467e-9cb5-0cf05725de6f-original-pull-secret podName:5ddb3084-72df-467e-9cb5-0cf05725de6f nodeName:}" failed. No retries permitted until 2026-09-08 07:04:16.05376145 +0000 UTC m=+4.034800734 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5ddb3084-72df-467e-9cb5-0cf05725de6f-original-pull-secret") pod "global-pull-secret-syncer-8lgmv" (UID: "5ddb3084-72df-467e-9cb5-0cf05725de6f") : object "kube-system"/"original-pull-secret" not registered
Sep 08 07:04:15.053810 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:15.053806    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb65d52f-d619-46f8-b86a-fc6261a24eb3-metrics-certs podName:fb65d52f-d619-46f8-b86a-fc6261a24eb3 nodeName:}" failed. No retries permitted until 2026-09-08 07:04:16.053799068 +0000 UTC m=+4.034838351 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fb65d52f-d619-46f8-b86a-fc6261a24eb3-metrics-certs") pod "network-metrics-daemon-jhq6t" (UID: "fb65d52f-d619-46f8-b86a-fc6261a24eb3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 07:04:15.124121 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:15.124092    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5671dec_e643_4b9e_849c_42faa0159b25.slice/crio-9b1b88c9c20b5261c9bc1b1c8cebbca17f0dfd37cc62d677eeee6bf8c2531511 WatchSource:0}: Error finding container 9b1b88c9c20b5261c9bc1b1c8cebbca17f0dfd37cc62d677eeee6bf8c2531511: Status 404 returned error can't find the container with id 9b1b88c9c20b5261c9bc1b1c8cebbca17f0dfd37cc62d677eeee6bf8c2531511
Sep 08 07:04:15.124862 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:15.124821    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod913589e8_903e_4e3a_9495_a17f0bd93fcc.slice/crio-a7b3e4f5176dd71a520e9d9942686f97fe86f80afb10683e8ceb744f52839f30 WatchSource:0}: Error finding container a7b3e4f5176dd71a520e9d9942686f97fe86f80afb10683e8ceb744f52839f30: Status 404 returned error can't find the container with id a7b3e4f5176dd71a520e9d9942686f97fe86f80afb10683e8ceb744f52839f30
Sep 08 07:04:15.127679 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:15.127546    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02e6967e_7fbd_46bb_a192_5adc50bed8fa.slice/crio-0da1c86efcd1dc77f676b182bcc91699b135eb1e9a324d0d323d25be16a0cfaa WatchSource:0}: Error finding container 0da1c86efcd1dc77f676b182bcc91699b135eb1e9a324d0d323d25be16a0cfaa: Status 404 returned error can't find the container with id 0da1c86efcd1dc77f676b182bcc91699b135eb1e9a324d0d323d25be16a0cfaa
Sep 08 07:04:15.129783 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:15.129760    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fc4c1f5_eff0_4e2d_a5f8_0b21b412535b.slice/crio-e6b821a926e712369401cd3e980f7250105e26450021bbd831d8d2718e69a27e WatchSource:0}: Error finding container e6b821a926e712369401cd3e980f7250105e26450021bbd831d8d2718e69a27e: Status 404 returned error can't find the container with id e6b821a926e712369401cd3e980f7250105e26450021bbd831d8d2718e69a27e
Sep 08 07:04:15.130457 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:15.130427    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod890fab40_3e97_456c_88ed_01de5ff6c541.slice/crio-b69a03b0db5a781424869584c32513301ae50d0e3ec773499e8a0fe002cb3c52 WatchSource:0}: Error finding container b69a03b0db5a781424869584c32513301ae50d0e3ec773499e8a0fe002cb3c52: Status 404 returned error can't find the container with id b69a03b0db5a781424869584c32513301ae50d0e3ec773499e8a0fe002cb3c52
Sep 08 07:04:15.131355 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:15.131245    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod642e9fc0_d86d_4bbc_9190_c18b87b8a7ae.slice/crio-0e7167c8854af7cc800008e7fa09ed421b9a84466bedeef0a57663b8308bd15b WatchSource:0}: Error finding container 0e7167c8854af7cc800008e7fa09ed421b9a84466bedeef0a57663b8308bd15b: Status 404 returned error can't find the container with id 0e7167c8854af7cc800008e7fa09ed421b9a84466bedeef0a57663b8308bd15b
Sep 08 07:04:15.153368 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:15.153344    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2f51d59_90ee_4464_924a_cfc1d12484ad.slice/crio-8484b957ed5afb2cd5d12efd59530408c0d01d646f7e3b71957e98b48916eae9 WatchSource:0}: Error finding container 8484b957ed5afb2cd5d12efd59530408c0d01d646f7e3b71957e98b48916eae9: Status 404 returned error can't find the container with id 8484b957ed5afb2cd5d12efd59530408c0d01d646f7e3b71957e98b48916eae9
Sep 08 07:04:15.154162 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:15.154139    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rvmt\" (UniqueName: \"kubernetes.io/projected/ed95682c-c73e-47a2-9931-adc1417cf25c-kube-api-access-8rvmt\") pod \"network-check-target-bf6vx\" (UID: \"ed95682c-c73e-47a2-9931-adc1417cf25c\") " pod="openshift-network-diagnostics/network-check-target-bf6vx"
Sep 08 07:04:15.154268 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:15.154228    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b60264a_f3fc_4640_a51a_d556e505482a.slice/crio-adf031fe7bf6df358edfa96fcfae92d3140c5fbe21ad8ec2624364419e9a21a1 WatchSource:0}: Error finding container adf031fe7bf6df358edfa96fcfae92d3140c5fbe21ad8ec2624364419e9a21a1: Status 404 returned error can't find the container with id adf031fe7bf6df358edfa96fcfae92d3140c5fbe21ad8ec2624364419e9a21a1
Sep 08 07:04:15.154319 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:15.154274    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 07:04:15.154319 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:15.154290    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 07:04:15.154319 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:15.154299    2564 projected.go:196] Error preparing data for projected volume kube-api-access-8rvmt for pod openshift-network-diagnostics/network-check-target-bf6vx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 07:04:15.154434 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:15.154342    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ed95682c-c73e-47a2-9931-adc1417cf25c-kube-api-access-8rvmt podName:ed95682c-c73e-47a2-9931-adc1417cf25c nodeName:}" failed. No retries permitted until 2026-09-08 07:04:16.15432719 +0000 UTC m=+4.135366478 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-8rvmt" (UniqueName: "kubernetes.io/projected/ed95682c-c73e-47a2-9931-adc1417cf25c-kube-api-access-8rvmt") pod "network-check-target-bf6vx" (UID: "ed95682c-c73e-47a2-9931-adc1417cf25c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 07:04:15.155788 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:15.155766    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ddc39aa_5d19_45db_9990_5c0b33f0fa81.slice/crio-d3850fafe96c096342de8d6f5fab5b07f056ebc43244ad9512a031ba6a0fc3cb WatchSource:0}: Error finding container d3850fafe96c096342de8d6f5fab5b07f056ebc43244ad9512a031ba6a0fc3cb: Status 404 returned error can't find the container with id d3850fafe96c096342de8d6f5fab5b07f056ebc43244ad9512a031ba6a0fc3cb
Sep 08 07:04:15.482259 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:15.482183    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-07 06:59:14 +0000 UTC" deadline="2028-03-08 16:46:53.058021963 +0000 UTC"
Sep 08 07:04:15.482259 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:15.482209    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13137h42m37.575815637s"
Sep 08 07:04:15.513408 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:15.513378    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kjppj" event={"ID":"642e9fc0-d86d-4bbc-9190-c18b87b8a7ae","Type":"ContainerStarted","Data":"0e7167c8854af7cc800008e7fa09ed421b9a84466bedeef0a57663b8308bd15b"}
Sep 08 07:04:15.514685 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:15.514660    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gj5rb" event={"ID":"6fc4c1f5-eff0-4e2d-a5f8-0b21b412535b","Type":"ContainerStarted","Data":"e6b821a926e712369401cd3e980f7250105e26450021bbd831d8d2718e69a27e"}
Sep 08 07:04:15.517022 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:15.516995    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-164.ec2.internal" event={"ID":"31090b38892b0b01dc7d44dd99f13608","Type":"ContainerStarted","Data":"9da2eea3bbdeb5cb02237973ce8df0bf7a773bf1ecadf9cb6b7fe9d744e20454"}
Sep 08 07:04:15.518310 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:15.518286    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ddrdv" event={"ID":"2ddc39aa-5d19-45db-9990-5c0b33f0fa81","Type":"ContainerStarted","Data":"d3850fafe96c096342de8d6f5fab5b07f056ebc43244ad9512a031ba6a0fc3cb"}
Sep 08 07:04:15.519498 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:15.519473    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hnw92" event={"ID":"b2f51d59-90ee-4464-924a-cfc1d12484ad","Type":"ContainerStarted","Data":"8484b957ed5afb2cd5d12efd59530408c0d01d646f7e3b71957e98b48916eae9"}
Sep 08 07:04:15.520682 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:15.520642    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4cwpb" event={"ID":"890fab40-3e97-456c-88ed-01de5ff6c541","Type":"ContainerStarted","Data":"b69a03b0db5a781424869584c32513301ae50d0e3ec773499e8a0fe002cb3c52"}
Sep 08 07:04:15.521830 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:15.521812    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dnzfq" event={"ID":"02e6967e-7fbd-46bb-a192-5adc50bed8fa","Type":"ContainerStarted","Data":"0da1c86efcd1dc77f676b182bcc91699b135eb1e9a324d0d323d25be16a0cfaa"}
Sep 08 07:04:15.523011 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:15.522991    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwjp2" event={"ID":"913589e8-903e-4e3a-9495-a17f0bd93fcc","Type":"ContainerStarted","Data":"a7b3e4f5176dd71a520e9d9942686f97fe86f80afb10683e8ceb744f52839f30"}
Sep 08 07:04:15.524210 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:15.524188    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nmx6z" event={"ID":"e5671dec-e643-4b9e-849c-42faa0159b25","Type":"ContainerStarted","Data":"9b1b88c9c20b5261c9bc1b1c8cebbca17f0dfd37cc62d677eeee6bf8c2531511"}
Sep 08 07:04:15.525356 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:15.525332    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qllkn" event={"ID":"5b60264a-f3fc-4640-a51a-d556e505482a","Type":"ContainerStarted","Data":"adf031fe7bf6df358edfa96fcfae92d3140c5fbe21ad8ec2624364419e9a21a1"}
Sep 08 07:04:15.531679 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:15.531640    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-164.ec2.internal" podStartSLOduration=1.531628365 podStartE2EDuration="1.531628365s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 07:04:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:04:15.53133768 +0000 UTC m=+3.512377012" watchObservedRunningTime="2026-09-08 07:04:15.531628365 +0000 UTC m=+3.512667671"
Sep 08 07:04:16.059884 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:16.059842    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ddb3084-72df-467e-9cb5-0cf05725de6f-original-pull-secret\") pod \"global-pull-secret-syncer-8lgmv\" (UID: \"5ddb3084-72df-467e-9cb5-0cf05725de6f\") " pod="kube-system/global-pull-secret-syncer-8lgmv"
Sep 08 07:04:16.060095 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:16.059948    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb65d52f-d619-46f8-b86a-fc6261a24eb3-metrics-certs\") pod \"network-metrics-daemon-jhq6t\" (UID: \"fb65d52f-d619-46f8-b86a-fc6261a24eb3\") " pod="openshift-multus/network-metrics-daemon-jhq6t"
Sep 08 07:04:16.060095 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:16.060088    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 07:04:16.060208 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:16.060170    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb65d52f-d619-46f8-b86a-fc6261a24eb3-metrics-certs podName:fb65d52f-d619-46f8-b86a-fc6261a24eb3 nodeName:}" failed. No retries permitted until 2026-09-08 07:04:18.060151145 +0000 UTC m=+6.041190434 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fb65d52f-d619-46f8-b86a-fc6261a24eb3-metrics-certs") pod "network-metrics-daemon-jhq6t" (UID: "fb65d52f-d619-46f8-b86a-fc6261a24eb3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 07:04:16.060577 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:16.060559    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 07:04:16.060658 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:16.060613    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ddb3084-72df-467e-9cb5-0cf05725de6f-original-pull-secret podName:5ddb3084-72df-467e-9cb5-0cf05725de6f nodeName:}" failed. No retries permitted until 2026-09-08 07:04:18.060598135 +0000 UTC m=+6.041637461 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5ddb3084-72df-467e-9cb5-0cf05725de6f-original-pull-secret") pod "global-pull-secret-syncer-8lgmv" (UID: "5ddb3084-72df-467e-9cb5-0cf05725de6f") : object "kube-system"/"original-pull-secret" not registered
Sep 08 07:04:16.161218 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:16.161176    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rvmt\" (UniqueName: \"kubernetes.io/projected/ed95682c-c73e-47a2-9931-adc1417cf25c-kube-api-access-8rvmt\") pod \"network-check-target-bf6vx\" (UID: \"ed95682c-c73e-47a2-9931-adc1417cf25c\") " pod="openshift-network-diagnostics/network-check-target-bf6vx"
Sep 08 07:04:16.161395 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:16.161339    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 07:04:16.161395 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:16.161362    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 07:04:16.161395 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:16.161377    2564 projected.go:196] Error preparing data for projected volume kube-api-access-8rvmt for pod openshift-network-diagnostics/network-check-target-bf6vx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 07:04:16.161564 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:16.161434    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ed95682c-c73e-47a2-9931-adc1417cf25c-kube-api-access-8rvmt podName:ed95682c-c73e-47a2-9931-adc1417cf25c nodeName:}" failed. No retries permitted until 2026-09-08 07:04:18.161416243 +0000 UTC m=+6.142455545 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-8rvmt" (UniqueName: "kubernetes.io/projected/ed95682c-c73e-47a2-9931-adc1417cf25c-kube-api-access-8rvmt") pod "network-check-target-bf6vx" (UID: "ed95682c-c73e-47a2-9931-adc1417cf25c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 07:04:16.482845 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:16.482699    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-07 06:59:14 +0000 UTC" deadline="2028-03-25 06:57:22.211431008 +0000 UTC"
Sep 08 07:04:16.482845 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:16.482761    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13535h53m5.728674542s"
Sep 08 07:04:16.505503 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:16.505473    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8lgmv"
Sep 08 07:04:16.505663 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:16.505601    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8lgmv" podUID="5ddb3084-72df-467e-9cb5-0cf05725de6f"
Sep 08 07:04:16.506232 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:16.505959    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jhq6t"
Sep 08 07:04:16.506232 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:16.506101    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jhq6t" podUID="fb65d52f-d619-46f8-b86a-fc6261a24eb3"
Sep 08 07:04:16.506232 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:16.506131    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bf6vx"
Sep 08 07:04:16.506232 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:16.506198    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bf6vx" podUID="ed95682c-c73e-47a2-9931-adc1417cf25c"
Sep 08 07:04:17.537860 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:17.536607    2564 generic.go:356] "Generic (PLEG): container finished" podID="abab780c8e86f24b0bc03b6d3983dc3c" containerID="fdf771c26a3fa59d9a4ad8f3b7cf551aaeaeaa7ba50ba08f2afd166093228d65" exitCode=0
Sep 08 07:04:17.537860 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:17.536845    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-164.ec2.internal" event={"ID":"abab780c8e86f24b0bc03b6d3983dc3c","Type":"ContainerDied","Data":"fdf771c26a3fa59d9a4ad8f3b7cf551aaeaeaa7ba50ba08f2afd166093228d65"}
Sep 08 07:04:18.081160 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:18.081121    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb65d52f-d619-46f8-b86a-fc6261a24eb3-metrics-certs\") pod \"network-metrics-daemon-jhq6t\" (UID: \"fb65d52f-d619-46f8-b86a-fc6261a24eb3\") " pod="openshift-multus/network-metrics-daemon-jhq6t"
Sep 08 07:04:18.081333 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:18.081184    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ddb3084-72df-467e-9cb5-0cf05725de6f-original-pull-secret\") pod \"global-pull-secret-syncer-8lgmv\" (UID: \"5ddb3084-72df-467e-9cb5-0cf05725de6f\") " pod="kube-system/global-pull-secret-syncer-8lgmv"
Sep 08 07:04:18.081333 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:18.081320    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 07:04:18.081454 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:18.081377    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ddb3084-72df-467e-9cb5-0cf05725de6f-original-pull-secret podName:5ddb3084-72df-467e-9cb5-0cf05725de6f nodeName:}" failed. No retries permitted until 2026-09-08 07:04:22.08136131 +0000 UTC m=+10.062400598 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5ddb3084-72df-467e-9cb5-0cf05725de6f-original-pull-secret") pod "global-pull-secret-syncer-8lgmv" (UID: "5ddb3084-72df-467e-9cb5-0cf05725de6f") : object "kube-system"/"original-pull-secret" not registered
Sep 08 07:04:18.081768 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:18.081749    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 07:04:18.081840 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:18.081803    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb65d52f-d619-46f8-b86a-fc6261a24eb3-metrics-certs podName:fb65d52f-d619-46f8-b86a-fc6261a24eb3 nodeName:}" failed. No retries permitted until 2026-09-08 07:04:22.081788826 +0000 UTC m=+10.062828116 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fb65d52f-d619-46f8-b86a-fc6261a24eb3-metrics-certs") pod "network-metrics-daemon-jhq6t" (UID: "fb65d52f-d619-46f8-b86a-fc6261a24eb3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 07:04:18.182999 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:18.182376    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rvmt\" (UniqueName: \"kubernetes.io/projected/ed95682c-c73e-47a2-9931-adc1417cf25c-kube-api-access-8rvmt\") pod \"network-check-target-bf6vx\" (UID: \"ed95682c-c73e-47a2-9931-adc1417cf25c\") " pod="openshift-network-diagnostics/network-check-target-bf6vx"
Sep 08 07:04:18.182999 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:18.182551    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 07:04:18.182999 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:18.182572    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 07:04:18.182999 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:18.182584    2564 projected.go:196] Error preparing data for projected volume kube-api-access-8rvmt for pod openshift-network-diagnostics/network-check-target-bf6vx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 07:04:18.182999 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:18.182641    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ed95682c-c73e-47a2-9931-adc1417cf25c-kube-api-access-8rvmt podName:ed95682c-c73e-47a2-9931-adc1417cf25c nodeName:}" failed. No retries permitted until 2026-09-08 07:04:22.18262292 +0000 UTC m=+10.163662222 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-8rvmt" (UniqueName: "kubernetes.io/projected/ed95682c-c73e-47a2-9931-adc1417cf25c-kube-api-access-8rvmt") pod "network-check-target-bf6vx" (UID: "ed95682c-c73e-47a2-9931-adc1417cf25c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 07:04:18.506717 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:18.505949    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jhq6t"
Sep 08 07:04:18.506717 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:18.506098    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jhq6t" podUID="fb65d52f-d619-46f8-b86a-fc6261a24eb3"
Sep 08 07:04:18.506717 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:18.506154    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bf6vx"
Sep 08 07:04:18.506717 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:18.506219    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bf6vx" podUID="ed95682c-c73e-47a2-9931-adc1417cf25c"
Sep 08 07:04:18.506717 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:18.506261    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8lgmv"
Sep 08 07:04:18.506717 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:18.506332    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8lgmv" podUID="5ddb3084-72df-467e-9cb5-0cf05725de6f"
Sep 08 07:04:20.504259 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:20.503803    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8lgmv"
Sep 08 07:04:20.504259 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:20.503807    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jhq6t"
Sep 08 07:04:20.504259 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:20.503995    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bf6vx"
Sep 08 07:04:20.504259 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:20.504014    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8lgmv" podUID="5ddb3084-72df-467e-9cb5-0cf05725de6f"
Sep 08 07:04:20.504259 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:20.504111    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bf6vx" podUID="ed95682c-c73e-47a2-9931-adc1417cf25c"
Sep 08 07:04:20.504259 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:20.504201    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jhq6t" podUID="fb65d52f-d619-46f8-b86a-fc6261a24eb3"
Sep 08 07:04:22.111059 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:22.111017    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb65d52f-d619-46f8-b86a-fc6261a24eb3-metrics-certs\") pod \"network-metrics-daemon-jhq6t\" (UID: \"fb65d52f-d619-46f8-b86a-fc6261a24eb3\") " pod="openshift-multus/network-metrics-daemon-jhq6t"
Sep 08 07:04:22.111523 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:22.111078    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ddb3084-72df-467e-9cb5-0cf05725de6f-original-pull-secret\") pod \"global-pull-secret-syncer-8lgmv\" (UID: \"5ddb3084-72df-467e-9cb5-0cf05725de6f\") " pod="kube-system/global-pull-secret-syncer-8lgmv"
Sep 08 07:04:22.111523 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:22.111201    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 07:04:22.111523 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:22.111265    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ddb3084-72df-467e-9cb5-0cf05725de6f-original-pull-secret podName:5ddb3084-72df-467e-9cb5-0cf05725de6f nodeName:}" failed. No retries permitted until 2026-09-08 07:04:30.111245811 +0000 UTC m=+18.092285096 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5ddb3084-72df-467e-9cb5-0cf05725de6f-original-pull-secret") pod "global-pull-secret-syncer-8lgmv" (UID: "5ddb3084-72df-467e-9cb5-0cf05725de6f") : object "kube-system"/"original-pull-secret" not registered
Sep 08 07:04:22.111523 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:22.111358    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 07:04:22.111523 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:22.111426    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb65d52f-d619-46f8-b86a-fc6261a24eb3-metrics-certs podName:fb65d52f-d619-46f8-b86a-fc6261a24eb3 nodeName:}" failed. No retries permitted until 2026-09-08 07:04:30.111403497 +0000 UTC m=+18.092442786 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fb65d52f-d619-46f8-b86a-fc6261a24eb3-metrics-certs") pod "network-metrics-daemon-jhq6t" (UID: "fb65d52f-d619-46f8-b86a-fc6261a24eb3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 07:04:22.212293 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:22.212257    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rvmt\" (UniqueName: \"kubernetes.io/projected/ed95682c-c73e-47a2-9931-adc1417cf25c-kube-api-access-8rvmt\") pod \"network-check-target-bf6vx\" (UID: \"ed95682c-c73e-47a2-9931-adc1417cf25c\") " pod="openshift-network-diagnostics/network-check-target-bf6vx"
Sep 08 07:04:22.212464 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:22.212444    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 07:04:22.212523 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:22.212475    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 07:04:22.212523 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:22.212488    2564 projected.go:196] Error preparing data for projected volume kube-api-access-8rvmt for pod openshift-network-diagnostics/network-check-target-bf6vx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 07:04:22.212621 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:22.212548    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ed95682c-c73e-47a2-9931-adc1417cf25c-kube-api-access-8rvmt podName:ed95682c-c73e-47a2-9931-adc1417cf25c nodeName:}" failed. No retries permitted until 2026-09-08 07:04:30.212529576 +0000 UTC m=+18.193568867 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-8rvmt" (UniqueName: "kubernetes.io/projected/ed95682c-c73e-47a2-9931-adc1417cf25c-kube-api-access-8rvmt") pod "network-check-target-bf6vx" (UID: "ed95682c-c73e-47a2-9931-adc1417cf25c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 07:04:22.504000 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:22.503935    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8lgmv"
Sep 08 07:04:22.504181 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:22.504053    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8lgmv" podUID="5ddb3084-72df-467e-9cb5-0cf05725de6f"
Sep 08 07:04:22.504243 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:22.504194    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jhq6t"
Sep 08 07:04:22.504297 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:22.504271    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bf6vx"
Sep 08 07:04:22.504398 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:22.504374    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bf6vx" podUID="ed95682c-c73e-47a2-9931-adc1417cf25c"
Sep 08 07:04:22.504545 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:22.504521    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jhq6t" podUID="fb65d52f-d619-46f8-b86a-fc6261a24eb3"
Sep 08 07:04:24.503648 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:24.503614    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bf6vx"
Sep 08 07:04:24.504127 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:24.503733    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bf6vx" podUID="ed95682c-c73e-47a2-9931-adc1417cf25c"
Sep 08 07:04:24.504127 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:24.503614    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jhq6t"
Sep 08 07:04:24.504127 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:24.503839    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jhq6t" podUID="fb65d52f-d619-46f8-b86a-fc6261a24eb3"
Sep 08 07:04:24.504127 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:24.503614    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8lgmv"
Sep 08 07:04:24.504127 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:24.503917    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8lgmv" podUID="5ddb3084-72df-467e-9cb5-0cf05725de6f"
Sep 08 07:04:26.503291 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:26.503257    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8lgmv"
Sep 08 07:04:26.503740 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:26.503257    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bf6vx"
Sep 08 07:04:26.503740 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:26.503393    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8lgmv" podUID="5ddb3084-72df-467e-9cb5-0cf05725de6f"
Sep 08 07:04:26.503740 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:26.503428    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jhq6t"
Sep 08 07:04:26.503740 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:26.503503    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bf6vx" podUID="ed95682c-c73e-47a2-9931-adc1417cf25c"
Sep 08 07:04:26.503740 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:26.503559    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jhq6t" podUID="fb65d52f-d619-46f8-b86a-fc6261a24eb3"
Sep 08 07:04:28.504329 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:28.503977    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8lgmv"
Sep 08 07:04:28.504329 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:28.504185    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8lgmv" podUID="5ddb3084-72df-467e-9cb5-0cf05725de6f"
Sep 08 07:04:28.504843 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:28.504529    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bf6vx"
Sep 08 07:04:28.504843 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:28.504622    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jhq6t"
Sep 08 07:04:28.507065 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:28.505390    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bf6vx" podUID="ed95682c-c73e-47a2-9931-adc1417cf25c"
Sep 08 07:04:28.507065 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:28.505540    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jhq6t" podUID="fb65d52f-d619-46f8-b86a-fc6261a24eb3"
Sep 08 07:04:30.168432 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:30.168397    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb65d52f-d619-46f8-b86a-fc6261a24eb3-metrics-certs\") pod \"network-metrics-daemon-jhq6t\" (UID: \"fb65d52f-d619-46f8-b86a-fc6261a24eb3\") " pod="openshift-multus/network-metrics-daemon-jhq6t"
Sep 08 07:04:30.168432 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:30.168439    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ddb3084-72df-467e-9cb5-0cf05725de6f-original-pull-secret\") pod \"global-pull-secret-syncer-8lgmv\" (UID: \"5ddb3084-72df-467e-9cb5-0cf05725de6f\") " pod="kube-system/global-pull-secret-syncer-8lgmv"
Sep 08 07:04:30.169000 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:30.168558    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 07:04:30.169000 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:30.168564    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 07:04:30.169000 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:30.168620    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ddb3084-72df-467e-9cb5-0cf05725de6f-original-pull-secret podName:5ddb3084-72df-467e-9cb5-0cf05725de6f nodeName:}" failed. No retries permitted until 2026-09-08 07:04:46.168604495 +0000 UTC m=+34.149643781 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5ddb3084-72df-467e-9cb5-0cf05725de6f-original-pull-secret") pod "global-pull-secret-syncer-8lgmv" (UID: "5ddb3084-72df-467e-9cb5-0cf05725de6f") : object "kube-system"/"original-pull-secret" not registered
Sep 08 07:04:30.169000 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:30.168635    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb65d52f-d619-46f8-b86a-fc6261a24eb3-metrics-certs podName:fb65d52f-d619-46f8-b86a-fc6261a24eb3 nodeName:}" failed. No retries permitted until 2026-09-08 07:04:46.168628409 +0000 UTC m=+34.149667692 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fb65d52f-d619-46f8-b86a-fc6261a24eb3-metrics-certs") pod "network-metrics-daemon-jhq6t" (UID: "fb65d52f-d619-46f8-b86a-fc6261a24eb3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 07:04:30.269385 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:30.269348    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rvmt\" (UniqueName: \"kubernetes.io/projected/ed95682c-c73e-47a2-9931-adc1417cf25c-kube-api-access-8rvmt\") pod \"network-check-target-bf6vx\" (UID: \"ed95682c-c73e-47a2-9931-adc1417cf25c\") " pod="openshift-network-diagnostics/network-check-target-bf6vx"
Sep 08 07:04:30.269556 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:30.269536    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 07:04:30.269599 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:30.269561    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 07:04:30.269599 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:30.269570    2564 projected.go:196] Error preparing data for projected volume kube-api-access-8rvmt for pod openshift-network-diagnostics/network-check-target-bf6vx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 07:04:30.269697 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:30.269619    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ed95682c-c73e-47a2-9931-adc1417cf25c-kube-api-access-8rvmt podName:ed95682c-c73e-47a2-9931-adc1417cf25c nodeName:}" failed. No retries permitted until 2026-09-08 07:04:46.26960501 +0000 UTC m=+34.250644294 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-8rvmt" (UniqueName: "kubernetes.io/projected/ed95682c-c73e-47a2-9931-adc1417cf25c-kube-api-access-8rvmt") pod "network-check-target-bf6vx" (UID: "ed95682c-c73e-47a2-9931-adc1417cf25c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 07:04:30.503925 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:30.503843    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8lgmv"
Sep 08 07:04:30.504088 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:30.503989    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jhq6t"
Sep 08 07:04:30.504088 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:30.504038    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8lgmv" podUID="5ddb3084-72df-467e-9cb5-0cf05725de6f"
Sep 08 07:04:30.504195 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:30.504082    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jhq6t" podUID="fb65d52f-d619-46f8-b86a-fc6261a24eb3"
Sep 08 07:04:30.504195 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:30.504106    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bf6vx"
Sep 08 07:04:30.504195 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:30.504153    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bf6vx" podUID="ed95682c-c73e-47a2-9931-adc1417cf25c"
Sep 08 07:04:32.504305 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:32.504264    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8lgmv"
Sep 08 07:04:32.504716 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:32.504371    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8lgmv" podUID="5ddb3084-72df-467e-9cb5-0cf05725de6f"
Sep 08 07:04:32.504716 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:32.504438    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jhq6t"
Sep 08 07:04:32.504716 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:32.504533    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jhq6t" podUID="fb65d52f-d619-46f8-b86a-fc6261a24eb3"
Sep 08 07:04:32.504716 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:32.504572    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bf6vx"
Sep 08 07:04:32.504716 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:32.504632    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bf6vx" podUID="ed95682c-c73e-47a2-9931-adc1417cf25c"
Sep 08 07:04:33.567536 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:33.567277    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dnzfq" event={"ID":"02e6967e-7fbd-46bb-a192-5adc50bed8fa","Type":"ContainerStarted","Data":"14a7aa9990b3373a9a94b72243d8ca4fdc9a77edaf21f1143ed21e73221124a0"}
Sep 08 07:04:33.569150 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:33.569128    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwjp2" event={"ID":"913589e8-903e-4e3a-9495-a17f0bd93fcc","Type":"ContainerStarted","Data":"9bfef12c44ddf5fe2a739e8200c607dfcc606720631316ce3da28717f2e9c1e6"}
Sep 08 07:04:33.570566 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:33.570530    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nmx6z" event={"ID":"e5671dec-e643-4b9e-849c-42faa0159b25","Type":"ContainerStarted","Data":"162f3a1c9184737e7d318550259da04de379490f758d2d23a9d5911ae7655330"}
Sep 08 07:04:33.573394 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:33.573369    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qllkn" event={"ID":"5b60264a-f3fc-4640-a51a-d556e505482a","Type":"ContainerStarted","Data":"b21fb3e682a124d9b55b409873fb62569b88726a914af1cf2798606bfef53920"}
Sep 08 07:04:33.575864 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:33.575845    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kjppj" event={"ID":"642e9fc0-d86d-4bbc-9190-c18b87b8a7ae","Type":"ContainerStarted","Data":"ae43dc0e3de98b6e81bdbb2c9811836412f442f332bd6be1254d83580b8e4308"}
Sep 08 07:04:33.575944 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:33.575900    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kjppj" event={"ID":"642e9fc0-d86d-4bbc-9190-c18b87b8a7ae","Type":"ContainerStarted","Data":"dce57e653c617ee696aad8a22c552ec3f546861350cefeae0209efbdaf7deece"}
Sep 08 07:04:33.576025 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:33.575943    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kjppj" event={"ID":"642e9fc0-d86d-4bbc-9190-c18b87b8a7ae","Type":"ContainerStarted","Data":"2339a5b1f7bafeb394b88a396ddce1bbec0618bb3ccfabbf6ba22f11c47df93b"}
Sep 08 07:04:33.577247 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:33.577224    2564 generic.go:356] "Generic (PLEG): container finished" podID="6fc4c1f5-eff0-4e2d-a5f8-0b21b412535b" containerID="aeb7c448b455eb88aa761157829ca03351853f069699dbcda56d314c52843e83" exitCode=0
Sep 08 07:04:33.577317 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:33.577289    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gj5rb" event={"ID":"6fc4c1f5-eff0-4e2d-a5f8-0b21b412535b","Type":"ContainerDied","Data":"aeb7c448b455eb88aa761157829ca03351853f069699dbcda56d314c52843e83"}
Sep 08 07:04:33.579267 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:33.579248    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-164.ec2.internal" event={"ID":"abab780c8e86f24b0bc03b6d3983dc3c","Type":"ContainerStarted","Data":"c7409b2c252d8fda9c64a55b04037804e3a2dbd46873a0f31ccab4a871cbbf2e"}
Sep 08 07:04:33.580668 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:33.580648    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ddrdv" event={"ID":"2ddc39aa-5d19-45db-9990-5c0b33f0fa81","Type":"ContainerStarted","Data":"859ee16efa6b3857a65e1dcc483012a0222b888d8b94133d39e04bf021a9f505"}
Sep 08 07:04:33.581951 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:33.581929    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4cwpb" event={"ID":"890fab40-3e97-456c-88ed-01de5ff6c541","Type":"ContainerStarted","Data":"d397a990d401f723198750f55b91515fe658deed1153401b13dfbfdb5e4e835b"}
Sep 08 07:04:33.585916 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:33.584891    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-dnzfq" podStartSLOduration=3.524385129 podStartE2EDuration="21.584874033s" totalImagesPullingTime="18.060488904s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 07:04:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:04:33.583882067 +0000 UTC m=+21.564921397" watchObservedRunningTime="2026-09-08 07:04:33.584874033 +0000 UTC m=+21.565913340"
Sep 08 07:04:33.618441 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:33.618405    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-nmx6z" podStartSLOduration=3.602077033 podStartE2EDuration="21.618393299s" totalImagesPullingTime="18.016316266s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 07:04:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:04:33.617901493 +0000 UTC m=+21.598940798" watchObservedRunningTime="2026-09-08 07:04:33.618393299 +0000 UTC m=+21.599432605"
Sep 08 07:04:33.656488 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:33.656455    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-qllkn" podStartSLOduration=3.682019909 podStartE2EDuration="21.656441579s" totalImagesPullingTime="17.97442167s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 07:04:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:04:33.632226271 +0000 UTC m=+21.613265577" watchObservedRunningTime="2026-09-08 07:04:33.656441579 +0000 UTC m=+21.637480922"
Sep 08 07:04:33.656847 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:33.656820    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-164.ec2.internal" podStartSLOduration=19.6568124 podStartE2EDuration="19.6568124s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 07:04:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:04:33.65668089 +0000 UTC m=+21.637720225" watchObservedRunningTime="2026-09-08 07:04:33.6568124 +0000 UTC m=+21.637851707"
Sep 08 07:04:33.673818 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:33.673788    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-ddrdv" podStartSLOduration=3.688519137 podStartE2EDuration="21.673775598s" totalImagesPullingTime="17.985256461s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:04:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:04:33.673555856 +0000 UTC m=+21.654595163" watchObservedRunningTime="2026-09-08 07:04:33.673775598 +0000 UTC m=+21.654814903"
Sep 08 07:04:33.686412 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:33.686380    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-4cwpb" podStartSLOduration=6.630616756 podStartE2EDuration="20.686371653s" totalImagesPullingTime="14.055754897s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 07:04:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:04:33.686155436 +0000 UTC m=+21.667194778" watchObservedRunningTime="2026-09-08 07:04:33.686371653 +0000 UTC m=+21.667410958"
Sep 08 07:04:34.504077 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:34.504055    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jhq6t"
Sep 08 07:04:34.504186 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:34.504154    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8lgmv"
Sep 08 07:04:34.504254 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:34.504236    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8lgmv" podUID="5ddb3084-72df-467e-9cb5-0cf05725de6f"
Sep 08 07:04:34.504254 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:34.504251    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bf6vx"
Sep 08 07:04:34.504367 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:34.504296    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bf6vx" podUID="ed95682c-c73e-47a2-9931-adc1417cf25c"
Sep 08 07:04:34.504367 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:34.504156    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jhq6t" podUID="fb65d52f-d619-46f8-b86a-fc6261a24eb3"
Sep 08 07:04:34.587311 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:34.587273    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hnw92" event={"ID":"b2f51d59-90ee-4464-924a-cfc1d12484ad","Type":"ContainerStarted","Data":"83c394a070e6772671318c86a9243ffb99bebe1aedfd7361273da13febf68553"}
Sep 08 07:04:34.590335 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:34.590308    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwjp2" event={"ID":"913589e8-903e-4e3a-9495-a17f0bd93fcc","Type":"ContainerStarted","Data":"33a25ffed64ea44ba039e163cd5442d878e672dc354a8f690ad0f5576db8a84f"}
Sep 08 07:04:34.592506 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:34.592487    2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 08 07:04:34.594830 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:34.594792    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kjppj" event={"ID":"642e9fc0-d86d-4bbc-9190-c18b87b8a7ae","Type":"ContainerStarted","Data":"40cc20807ab6642eab5cbe8706dd655acd52dc32df7760f0a486ff6d197be83c"}
Sep 08 07:04:34.594938 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:34.594889    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kjppj" event={"ID":"642e9fc0-d86d-4bbc-9190-c18b87b8a7ae","Type":"ContainerStarted","Data":"8f7c5c6fd66645a910bc13a6d60b0b9fc93b62170ea8a9a13c6ed7545a4b3239"}
Sep 08 07:04:34.595022 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:34.594944    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kjppj" event={"ID":"642e9fc0-d86d-4bbc-9190-c18b87b8a7ae","Type":"ContainerStarted","Data":"23332b18615b882fcd7152f6570f34511a99720b156089cd70d3a9d1be3cca90"}
Sep 08 07:04:34.602528 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:34.602479    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hnw92" podStartSLOduration=8.552043433 podStartE2EDuration="22.602466652s" totalImagesPullingTime="14.050423219s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 07:04:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:04:34.601959049 +0000 UTC m=+22.582998373" watchObservedRunningTime="2026-09-08 07:04:34.602466652 +0000 UTC m=+22.583505958"
Sep 08 07:04:35.509276 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:35.509175    2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-08T07:04:34.592501762Z","UUID":"2147cdb8-8e42-49fe-a33b-3ae1df6055cb","Handler":null,"Name":"","Endpoint":""}
Sep 08 07:04:35.510798 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:35.510772    2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 08 07:04:35.510944 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:35.510811    2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 08 07:04:36.231771 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:36.231733    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-ddrdv"
Sep 08 07:04:36.232456 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:36.232437    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-ddrdv"
Sep 08 07:04:36.503735 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:36.503704    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bf6vx"
Sep 08 07:04:36.503901 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:36.503704    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jhq6t"
Sep 08 07:04:36.503901 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:36.503803    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bf6vx" podUID="ed95682c-c73e-47a2-9931-adc1417cf25c"
Sep 08 07:04:36.503901 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:36.503708    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8lgmv"
Sep 08 07:04:36.504076 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:36.503898    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jhq6t" podUID="fb65d52f-d619-46f8-b86a-fc6261a24eb3"
Sep 08 07:04:36.504076 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:36.503987    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8lgmv" podUID="5ddb3084-72df-467e-9cb5-0cf05725de6f"
Sep 08 07:04:36.602008 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:36.601903    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwjp2" event={"ID":"913589e8-903e-4e3a-9495-a17f0bd93fcc","Type":"ContainerStarted","Data":"f50b9abbd09ca8a59515b5038fc0a688c22d9c10be2e9c55eda0f721d4814a74"}
Sep 08 07:04:36.605846 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:36.605800    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kjppj" event={"ID":"642e9fc0-d86d-4bbc-9190-c18b87b8a7ae","Type":"ContainerStarted","Data":"e8311af8ea2308db2d2d143454aea6e960c49bcc72657d6193e71f0fe3fe5993"}
Sep 08 07:04:36.606036 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:36.605902    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-ddrdv"
Sep 08 07:04:36.606406 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:36.606388    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-ddrdv"
Sep 08 07:04:36.617932 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:36.617892    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gwjp2" podStartSLOduration=3.807027775 podStartE2EDuration="24.617879556s" totalImagesPullingTime="20.810851781s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 07:04:12 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:04:36.617637317 +0000 UTC m=+24.598676647" watchObservedRunningTime="2026-09-08 07:04:36.617879556 +0000 UTC m=+24.598918862"
Sep 08 07:04:38.503594 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:38.503349    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8lgmv"
Sep 08 07:04:38.504025 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:38.503364    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jhq6t"
Sep 08 07:04:38.504025 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:38.503639    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8lgmv" podUID="5ddb3084-72df-467e-9cb5-0cf05725de6f"
Sep 08 07:04:38.504025 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:38.503760    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jhq6t" podUID="fb65d52f-d619-46f8-b86a-fc6261a24eb3"
Sep 08 07:04:38.504025 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:38.503434    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bf6vx"
Sep 08 07:04:38.504025 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:38.503887    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bf6vx" podUID="ed95682c-c73e-47a2-9931-adc1417cf25c"
Sep 08 07:04:39.616307 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:39.616111    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kjppj" event={"ID":"642e9fc0-d86d-4bbc-9190-c18b87b8a7ae","Type":"ContainerStarted","Data":"c57d5eed3f6f37a974112ee0ec6c1bfbcb14f4aa5e2589aaa002c097fc2d6b58"}
Sep 08 07:04:39.617073 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:39.616351    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kjppj"
Sep 08 07:04:39.618121 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:39.618099    2564 generic.go:356] "Generic (PLEG): container finished" podID="6fc4c1f5-eff0-4e2d-a5f8-0b21b412535b" containerID="e39cfd0e674a97a7365a6d108ee55ba15d4e02f5386fcdbed9b69a7a89439e24" exitCode=0
Sep 08 07:04:39.618227 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:39.618130    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gj5rb" event={"ID":"6fc4c1f5-eff0-4e2d-a5f8-0b21b412535b","Type":"ContainerDied","Data":"e39cfd0e674a97a7365a6d108ee55ba15d4e02f5386fcdbed9b69a7a89439e24"}
Sep 08 07:04:39.632615 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:39.632594    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kjppj"
Sep 08 07:04:39.643872 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:39.643831    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-kjppj" podStartSLOduration=9.582991852 podStartE2EDuration="27.643819043s" totalImagesPullingTime="18.060827191s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 07:04:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:04:39.643512488 +0000 UTC m=+27.624551806" watchObservedRunningTime="2026-09-08 07:04:39.643819043 +0000 UTC m=+27.624858349"
Sep 08 07:04:40.108348 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:40.108309    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kjppj"
Sep 08 07:04:40.503557 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:40.503531    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8lgmv"
Sep 08 07:04:40.503675 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:40.503566    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jhq6t"
Sep 08 07:04:40.503675 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:40.503650    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8lgmv" podUID="5ddb3084-72df-467e-9cb5-0cf05725de6f"
Sep 08 07:04:40.503757 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:40.503690    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jhq6t" podUID="fb65d52f-d619-46f8-b86a-fc6261a24eb3"
Sep 08 07:04:40.503757 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:40.503710    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bf6vx"
Sep 08 07:04:40.503825 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:40.503778    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bf6vx" podUID="ed95682c-c73e-47a2-9931-adc1417cf25c"
Sep 08 07:04:40.595036 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:40.595006    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8lgmv"]
Sep 08 07:04:40.597595 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:40.597571    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jhq6t"]
Sep 08 07:04:40.609905 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:40.609882    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bf6vx"]
Sep 08 07:04:40.622922 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:40.622850    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8lgmv"
Sep 08 07:04:40.622922 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:40.622838    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gj5rb" event={"ID":"6fc4c1f5-eff0-4e2d-a5f8-0b21b412535b","Type":"ContainerStarted","Data":"26df6ec5becf81bbb89c115dc076f90b310c6e8c41989aac08931e8c9a90e207"}
Sep 08 07:04:40.623414 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:40.622950    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8lgmv" podUID="5ddb3084-72df-467e-9cb5-0cf05725de6f"
Sep 08 07:04:40.623414 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:40.622990    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bf6vx"
Sep 08 07:04:40.623414 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:40.622853    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jhq6t"
Sep 08 07:04:40.623414 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:40.623408    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bf6vx" podUID="ed95682c-c73e-47a2-9931-adc1417cf25c"
Sep 08 07:04:40.623612 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:40.623483    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jhq6t" podUID="fb65d52f-d619-46f8-b86a-fc6261a24eb3"
Sep 08 07:04:40.623917 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:40.623894    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kjppj"
Sep 08 07:04:40.640889 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:40.640866    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kjppj"
Sep 08 07:04:41.627356 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:41.627325    2564 generic.go:356] "Generic (PLEG): container finished" podID="6fc4c1f5-eff0-4e2d-a5f8-0b21b412535b" containerID="26df6ec5becf81bbb89c115dc076f90b310c6e8c41989aac08931e8c9a90e207" exitCode=0
Sep 08 07:04:41.627814 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:41.627417    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gj5rb" event={"ID":"6fc4c1f5-eff0-4e2d-a5f8-0b21b412535b","Type":"ContainerDied","Data":"26df6ec5becf81bbb89c115dc076f90b310c6e8c41989aac08931e8c9a90e207"}
Sep 08 07:04:42.506948 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:42.506778    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bf6vx"
Sep 08 07:04:42.506948 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:42.506809    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8lgmv"
Sep 08 07:04:42.506948 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:42.506913    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bf6vx" podUID="ed95682c-c73e-47a2-9931-adc1417cf25c"
Sep 08 07:04:42.507212 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:42.506986    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8lgmv" podUID="5ddb3084-72df-467e-9cb5-0cf05725de6f"
Sep 08 07:04:42.507212 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:42.507053    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jhq6t"
Sep 08 07:04:42.507212 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:42.507142    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jhq6t" podUID="fb65d52f-d619-46f8-b86a-fc6261a24eb3"
Sep 08 07:04:43.634944 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:43.634757    2564 generic.go:356] "Generic (PLEG): container finished" podID="6fc4c1f5-eff0-4e2d-a5f8-0b21b412535b" containerID="2b56a3be95e641a672b5cf3a59eb11d31ed1f3fd96fd901d1f76d45751d4b6ab" exitCode=0
Sep 08 07:04:43.634944 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:43.634830    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gj5rb" event={"ID":"6fc4c1f5-eff0-4e2d-a5f8-0b21b412535b","Type":"ContainerDied","Data":"2b56a3be95e641a672b5cf3a59eb11d31ed1f3fd96fd901d1f76d45751d4b6ab"}
Sep 08 07:04:44.503288 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:44.503214    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jhq6t"
Sep 08 07:04:44.503444 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:44.503214    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bf6vx"
Sep 08 07:04:44.503444 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:44.503331    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jhq6t" podUID="fb65d52f-d619-46f8-b86a-fc6261a24eb3"
Sep 08 07:04:44.503444 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:44.503214    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8lgmv"
Sep 08 07:04:44.503615 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:44.503389    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bf6vx" podUID="ed95682c-c73e-47a2-9931-adc1417cf25c"
Sep 08 07:04:44.503615 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:44.503494    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8lgmv" podUID="5ddb3084-72df-467e-9cb5-0cf05725de6f"
Sep 08 07:04:45.825874 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:45.825841    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-164.ec2.internal" event="NodeReady"
Sep 08 07:04:45.826277 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:45.826021    2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 08 07:04:45.858021 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:45.857981    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7bcc6fbcd6-66qdn"]
Sep 08 07:04:45.905148 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:45.905119    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-glxch"]
Sep 08 07:04:45.905290 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:45.905243    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7bcc6fbcd6-66qdn"
Sep 08 07:04:45.907261 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:45.907231    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 08 07:04:45.907261 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:45.907239    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 08 07:04:45.907462 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:45.907316    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-cpwg8\""
Sep 08 07:04:45.907761 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:45.907744    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 08 07:04:45.915103 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:45.915050    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 08 07:04:45.919046 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:45.919028    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7cbf7f84b-54255"]
Sep 08 07:04:45.919161 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:45.919147    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-glxch"
Sep 08 07:04:45.921295 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:45.921279    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 08 07:04:45.922187 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:45.922166    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 08 07:04:45.922267 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:45.922171    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 08 07:04:45.922267 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:45.922170    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-z4h6c\""
Sep 08 07:04:45.927437 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:45.927419    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 08 07:04:45.935679 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:45.935658    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-6glxt"]
Sep 08 07:04:45.935807 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:45.935790    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7cbf7f84b-54255"
Sep 08 07:04:45.938327 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:45.938309    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 08 07:04:45.938550 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:45.938520    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-v8sxx\""
Sep 08 07:04:45.938550 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:45.938337    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 08 07:04:45.938697 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:45.938399    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 08 07:04:45.938936 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:45.938909    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 08 07:04:45.939062 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:45.938928    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 08 07:04:45.939253 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:45.939233    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 08 07:04:45.945498 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:45.945478    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-kh2bx"]
Sep 08 07:04:45.945617 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:45.945602    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-6glxt"
Sep 08 07:04:45.947590 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:45.947571    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 08 07:04:45.947672 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:45.947592    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 08 07:04:45.947740 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:45.947723    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-xm5fc\""
Sep 08 07:04:45.957818 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:45.957799    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-lwtc7"]
Sep 08 07:04:45.957953 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:45.957932    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-kh2bx"
Sep 08 07:04:45.960095 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:45.960075    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-8x2pf\""
Sep 08 07:04:45.960297 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:45.960279    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 08 07:04:45.960366 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:45.960347    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 08 07:04:45.960409 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:45.960347    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 08 07:04:45.960468 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:45.960449    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 08 07:04:45.964766 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:45.964726    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-st5mf"]
Sep 08 07:04:45.965710 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:45.964962    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-lwtc7"
Sep 08 07:04:45.965710 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:45.965517    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 08 07:04:45.967366 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:45.967348    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-4mgtj\""
Sep 08 07:04:45.967477 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:45.967413    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 08 07:04:45.967818 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:45.967676    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 08 07:04:45.968037 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:45.968020    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 08 07:04:45.970984 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:45.970941    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-85b454874b-8d4lx"]
Sep 08 07:04:45.971091 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:45.971073    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-st5mf"
Sep 08 07:04:45.972945 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:45.972890    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 08 07:04:45.973114 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:45.973093    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 08 07:04:45.973745 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:45.973726    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-5zq8g\""
Sep 08 07:04:45.973745 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:45.973740    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 08 07:04:45.973881 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:45.973763    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 08 07:04:45.980404 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:45.980350    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fd323369-8471-4515-b250-2bcdf068b64c-registry-tls\") pod \"image-registry-7bcc6fbcd6-66qdn\" (UID: \"fd323369-8471-4515-b250-2bcdf068b64c\") " pod="openshift-image-registry/image-registry-7bcc6fbcd6-66qdn"
Sep 08 07:04:45.980404 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:45.980382    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fd323369-8471-4515-b250-2bcdf068b64c-registry-certificates\") pod \"image-registry-7bcc6fbcd6-66qdn\" (UID: \"fd323369-8471-4515-b250-2bcdf068b64c\") " pod="openshift-image-registry/image-registry-7bcc6fbcd6-66qdn"
Sep 08 07:04:45.980599 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:45.980420    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/291459fa-c8c6-49c7-ace3-4c0f500d94b5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-glxch\" (UID: \"291459fa-c8c6-49c7-ace3-4c0f500d94b5\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-glxch"
Sep 08 07:04:45.980599 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:45.980448    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqn2x\" (UniqueName: \"kubernetes.io/projected/fd323369-8471-4515-b250-2bcdf068b64c-kube-api-access-fqn2x\") pod \"image-registry-7bcc6fbcd6-66qdn\" (UID: \"fd323369-8471-4515-b250-2bcdf068b64c\") " pod="openshift-image-registry/image-registry-7bcc6fbcd6-66qdn"
Sep 08 07:04:45.980599 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:45.980475    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/291459fa-c8c6-49c7-ace3-4c0f500d94b5-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-glxch\" (UID: \"291459fa-c8c6-49c7-ace3-4c0f500d94b5\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-glxch"
Sep 08 07:04:45.980599 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:45.980535    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fd323369-8471-4515-b250-2bcdf068b64c-ca-trust-extracted\") pod \"image-registry-7bcc6fbcd6-66qdn\" (UID: \"fd323369-8471-4515-b250-2bcdf068b64c\") " pod="openshift-image-registry/image-registry-7bcc6fbcd6-66qdn"
Sep 08 07:04:45.980599 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:45.980586    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fd323369-8471-4515-b250-2bcdf068b64c-image-registry-private-configuration\") pod \"image-registry-7bcc6fbcd6-66qdn\" (UID: \"fd323369-8471-4515-b250-2bcdf068b64c\") " pod="openshift-image-registry/image-registry-7bcc6fbcd6-66qdn"
Sep 08 07:04:45.980842 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:45.980622    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cszrd\" (UniqueName: \"kubernetes.io/projected/291459fa-c8c6-49c7-ace3-4c0f500d94b5-kube-api-access-cszrd\") pod \"cluster-monitoring-operator-6cdcc96965-glxch\" (UID: \"291459fa-c8c6-49c7-ace3-4c0f500d94b5\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-glxch"
Sep 08 07:04:45.980842 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:45.980647    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fd323369-8471-4515-b250-2bcdf068b64c-bound-sa-token\") pod \"image-registry-7bcc6fbcd6-66qdn\" (UID: \"fd323369-8471-4515-b250-2bcdf068b64c\") " pod="openshift-image-registry/image-registry-7bcc6fbcd6-66qdn"
Sep 08 07:04:45.980842 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:45.980714    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fd323369-8471-4515-b250-2bcdf068b64c-installation-pull-secrets\") pod \"image-registry-7bcc6fbcd6-66qdn\" (UID: \"fd323369-8471-4515-b250-2bcdf068b64c\") " pod="openshift-image-registry/image-registry-7bcc6fbcd6-66qdn"
Sep 08 07:04:45.980842 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:45.980752    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fd323369-8471-4515-b250-2bcdf068b64c-trusted-ca\") pod \"image-registry-7bcc6fbcd6-66qdn\" (UID: \"fd323369-8471-4515-b250-2bcdf068b64c\") " pod="openshift-image-registry/image-registry-7bcc6fbcd6-66qdn"
Sep 08 07:04:45.981248 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:45.981171    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-nxclz"]
Sep 08 07:04:45.981310 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:45.981301    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-8d4lx"
Sep 08 07:04:45.981883 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:45.981844    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddrdv_2ddc39aa-5d19-45db-9990-5c0b33f0fa81/konnectivity-agent/0.log" limit=1024
Sep 08 07:04:45.983599 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:45.983574    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-9qqn4\""
Sep 08 07:04:45.983919 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:45.983898    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 08 07:04:45.984201 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:45.984182    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 08 07:04:45.984271 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:45.984228    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 08 07:04:45.984379 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:45.984191    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 08 07:04:45.990562 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:45.990418    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 08 07:04:45.993769 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:45.993747    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-mcddz"]
Sep 08 07:04:45.993889 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:45.993873    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-nxclz"
Sep 08 07:04:45.995810 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:45.995788    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-754nv\""
Sep 08 07:04:45.995922 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:45.995868    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 08 07:04:45.996005 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:45.995795    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 08 07:04:46.001925 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.001905    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-vg6m8"]
Sep 08 07:04:46.002070 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.002051    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-mcddz"
Sep 08 07:04:46.003782 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.003761    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 08 07:04:46.004068 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.004019    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 08 07:04:46.004153 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.004019    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 08 07:04:46.004153 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.004106    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 08 07:04:46.004267 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.004240    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-ctlgc\""
Sep 08 07:04:46.012754 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.012736    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-hrktk"]
Sep 08 07:04:46.012874 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.012859    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vg6m8"
Sep 08 07:04:46.015731 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.015712    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mmqzm\""
Sep 08 07:04:46.015918 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.015900    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 08 07:04:46.021024 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.021005    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7bcc6fbcd6-66qdn"]
Sep 08 07:04:46.021150 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.021034    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-mcddz"]
Sep 08 07:04:46.021150 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.021053    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-6glxt"]
Sep 08 07:04:46.021150 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.021072    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-st5mf"]
Sep 08 07:04:46.021150 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.021084    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-lwtc7"]
Sep 08 07:04:46.021150 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.021099    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-glxch"]
Sep 08 07:04:46.021150 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.021114    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-kh2bx"]
Sep 08 07:04:46.021150 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.021116    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hrktk"
Sep 08 07:04:46.021150 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.021131    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7cbf7f84b-54255"]
Sep 08 07:04:46.021150 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.021144    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vg6m8"]
Sep 08 07:04:46.021590 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.021159    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-nxclz"]
Sep 08 07:04:46.021590 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.021175    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hrktk"]
Sep 08 07:04:46.021590 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.021187    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-8d4lx"]
Sep 08 07:04:46.023616 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.023583    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 08 07:04:46.023616 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.023614    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 08 07:04:46.023769 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.023626    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 08 07:04:46.023916 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.023897    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-qkwpw\""
Sep 08 07:04:46.024030 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.023903    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 08 07:04:46.081758 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.081727    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9bd3d9fb-a0ba-40fe-bb47-060b9265e353-tmp\") pod \"insights-operator-76bcd6ccf5-kh2bx\" (UID: \"9bd3d9fb-a0ba-40fe-bb47-060b9265e353\") " pod="openshift-insights/insights-operator-76bcd6ccf5-kh2bx"
Sep 08 07:04:46.081950 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.081770    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7e5d6ef0-7b12-4602-a841-195b0c593f58-stats-auth\") pod \"router-default-7cbf7f84b-54255\" (UID: \"7e5d6ef0-7b12-4602-a841-195b0c593f58\") " pod="openshift-ingress/router-default-7cbf7f84b-54255"
Sep 08 07:04:46.081950 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.081803    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5cf68f79-8fda-42e2-92c1-05a5a601f505-trusted-ca\") pod \"console-operator-85b454874b-8d4lx\" (UID: \"5cf68f79-8fda-42e2-92c1-05a5a601f505\") " pod="openshift-console-operator/console-operator-85b454874b-8d4lx"
Sep 08 07:04:46.081950 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.081843    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pxn8\" (UniqueName: \"kubernetes.io/projected/664c9025-a46b-43de-a40a-bda5e922f99a-kube-api-access-6pxn8\") pod \"ingress-canary-hrktk\" (UID: \"664c9025-a46b-43de-a40a-bda5e922f99a\") " pod="openshift-ingress-canary/ingress-canary-hrktk"
Sep 08 07:04:46.081950 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.081873    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gr47h\" (UniqueName: \"kubernetes.io/projected/a2e1c24d-ae27-4bac-8446-0822f1e53adc-kube-api-access-gr47h\") pod \"service-ca-operator-859f94c4b-mcddz\" (UID: \"a2e1c24d-ae27-4bac-8446-0822f1e53adc\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-mcddz"
Sep 08 07:04:46.081950 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.081901    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bd3d9fb-a0ba-40fe-bb47-060b9265e353-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-kh2bx\" (UID: \"9bd3d9fb-a0ba-40fe-bb47-060b9265e353\") " pod="openshift-insights/insights-operator-76bcd6ccf5-kh2bx"
Sep 08 07:04:46.081950 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.081927    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5cf68f79-8fda-42e2-92c1-05a5a601f505-serving-cert\") pod \"console-operator-85b454874b-8d4lx\" (UID: \"5cf68f79-8fda-42e2-92c1-05a5a601f505\") " pod="openshift-console-operator/console-operator-85b454874b-8d4lx"
Sep 08 07:04:46.082262 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.081952    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vbg8\" (UniqueName: \"kubernetes.io/projected/5cf68f79-8fda-42e2-92c1-05a5a601f505-kube-api-access-9vbg8\") pod \"console-operator-85b454874b-8d4lx\" (UID: \"5cf68f79-8fda-42e2-92c1-05a5a601f505\") " pod="openshift-console-operator/console-operator-85b454874b-8d4lx"
Sep 08 07:04:46.082262 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.082009    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e5d6ef0-7b12-4602-a841-195b0c593f58-service-ca-bundle\") pod \"router-default-7cbf7f84b-54255\" (UID: \"7e5d6ef0-7b12-4602-a841-195b0c593f58\") " pod="openshift-ingress/router-default-7cbf7f84b-54255"
Sep 08 07:04:46.082262 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.082056    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlfbq\" (UniqueName: \"kubernetes.io/projected/9a60f971-69a4-45c0-9e7c-1cdf55b42770-kube-api-access-hlfbq\") pod \"volume-data-source-validator-695c895bd6-6glxt\" (UID: \"9a60f971-69a4-45c0-9e7c-1cdf55b42770\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-6glxt"
Sep 08 07:04:46.082262 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.082116    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/291459fa-c8c6-49c7-ace3-4c0f500d94b5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-glxch\" (UID: \"291459fa-c8c6-49c7-ace3-4c0f500d94b5\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-glxch"
Sep 08 07:04:46.082262 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.082147    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fd323369-8471-4515-b250-2bcdf068b64c-registry-certificates\") pod \"image-registry-7bcc6fbcd6-66qdn\" (UID: \"fd323369-8471-4515-b250-2bcdf068b64c\") " pod="openshift-image-registry/image-registry-7bcc6fbcd6-66qdn"
Sep 08 07:04:46.082262 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.082186    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9bd3d9fb-a0ba-40fe-bb47-060b9265e353-serving-cert\") pod \"insights-operator-76bcd6ccf5-kh2bx\" (UID: \"9bd3d9fb-a0ba-40fe-bb47-060b9265e353\") " pod="openshift-insights/insights-operator-76bcd6ccf5-kh2bx"
Sep 08 07:04:46.082262 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.082212    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/664c9025-a46b-43de-a40a-bda5e922f99a-cert\") pod \"ingress-canary-hrktk\" (UID: \"664c9025-a46b-43de-a40a-bda5e922f99a\") " pod="openshift-ingress-canary/ingress-canary-hrktk"
Sep 08 07:04:46.082262 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.082241    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/291459fa-c8c6-49c7-ace3-4c0f500d94b5-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-glxch\" (UID: \"291459fa-c8c6-49c7-ace3-4c0f500d94b5\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-glxch"
Sep 08 07:04:46.082262 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:46.082261    2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 08 07:04:46.082262 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.082265    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fd323369-8471-4515-b250-2bcdf068b64c-ca-trust-extracted\") pod \"image-registry-7bcc6fbcd6-66qdn\" (UID: \"fd323369-8471-4515-b250-2bcdf068b64c\") " pod="openshift-image-registry/image-registry-7bcc6fbcd6-66qdn"
Sep 08 07:04:46.082739 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.082293    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/90b86d86-d71b-4d36-874a-a2a03190d517-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-st5mf\" (UID: \"90b86d86-d71b-4d36-874a-a2a03190d517\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-st5mf"
Sep 08 07:04:46.082739 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:46.082320    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/291459fa-c8c6-49c7-ace3-4c0f500d94b5-cluster-monitoring-operator-tls podName:291459fa-c8c6-49c7-ace3-4c0f500d94b5 nodeName:}" failed. No retries permitted until 2026-09-08 07:04:46.582305386 +0000 UTC m=+34.563344670 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/291459fa-c8c6-49c7-ace3-4c0f500d94b5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-glxch" (UID: "291459fa-c8c6-49c7-ace3-4c0f500d94b5") : secret "cluster-monitoring-operator-tls" not found
Sep 08 07:04:46.082739 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.082334    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fd323369-8471-4515-b250-2bcdf068b64c-image-registry-private-configuration\") pod \"image-registry-7bcc6fbcd6-66qdn\" (UID: \"fd323369-8471-4515-b250-2bcdf068b64c\") " pod="openshift-image-registry/image-registry-7bcc6fbcd6-66qdn"
Sep 08 07:04:46.082739 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.082358    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b933ee39-2780-43cb-a34d-1fecfabcae2c-tmp-dir\") pod \"dns-default-vg6m8\" (UID: \"b933ee39-2780-43cb-a34d-1fecfabcae2c\") " pod="openshift-dns/dns-default-vg6m8"
Sep 08 07:04:46.082739 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.082383    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cszrd\" (UniqueName: \"kubernetes.io/projected/291459fa-c8c6-49c7-ace3-4c0f500d94b5-kube-api-access-cszrd\") pod \"cluster-monitoring-operator-6cdcc96965-glxch\" (UID: \"291459fa-c8c6-49c7-ace3-4c0f500d94b5\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-glxch"
Sep 08 07:04:46.082739 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.082407    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fd323369-8471-4515-b250-2bcdf068b64c-bound-sa-token\") pod \"image-registry-7bcc6fbcd6-66qdn\" (UID: \"fd323369-8471-4515-b250-2bcdf068b64c\") " pod="openshift-image-registry/image-registry-7bcc6fbcd6-66qdn"
Sep 08 07:04:46.082739 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.082444    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jj8kw\" (UniqueName: \"kubernetes.io/projected/90b86d86-d71b-4d36-874a-a2a03190d517-kube-api-access-jj8kw\") pod \"kube-storage-version-migrator-operator-8d7dd4675-st5mf\" (UID: \"90b86d86-d71b-4d36-874a-a2a03190d517\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-st5mf"
Sep 08 07:04:46.082739 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.082463    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8sm8\" (UniqueName: \"kubernetes.io/projected/9bd3d9fb-a0ba-40fe-bb47-060b9265e353-kube-api-access-q8sm8\") pod \"insights-operator-76bcd6ccf5-kh2bx\" (UID: \"9bd3d9fb-a0ba-40fe-bb47-060b9265e353\") " pod="openshift-insights/insights-operator-76bcd6ccf5-kh2bx"
Sep 08 07:04:46.082739 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.082488    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fd323369-8471-4515-b250-2bcdf068b64c-installation-pull-secrets\") pod \"image-registry-7bcc6fbcd6-66qdn\" (UID: \"fd323369-8471-4515-b250-2bcdf068b64c\") " pod="openshift-image-registry/image-registry-7bcc6fbcd6-66qdn"
Sep 08 07:04:46.082739 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.082504    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/9bd3d9fb-a0ba-40fe-bb47-060b9265e353-snapshots\") pod \"insights-operator-76bcd6ccf5-kh2bx\" (UID: \"9bd3d9fb-a0ba-40fe-bb47-060b9265e353\") " pod="openshift-insights/insights-operator-76bcd6ccf5-kh2bx"
Sep 08 07:04:46.082739 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.082530    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bd3d9fb-a0ba-40fe-bb47-060b9265e353-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-kh2bx\" (UID: \"9bd3d9fb-a0ba-40fe-bb47-060b9265e353\") " pod="openshift-insights/insights-operator-76bcd6ccf5-kh2bx"
Sep 08 07:04:46.082739 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.082545    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fd323369-8471-4515-b250-2bcdf068b64c-trusted-ca\") pod \"image-registry-7bcc6fbcd6-66qdn\" (UID: \"fd323369-8471-4515-b250-2bcdf068b64c\") " pod="openshift-image-registry/image-registry-7bcc6fbcd6-66qdn"
Sep 08 07:04:46.082739 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.082562    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/90b86d86-d71b-4d36-874a-a2a03190d517-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-st5mf\" (UID: \"90b86d86-d71b-4d36-874a-a2a03190d517\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-st5mf"
Sep 08 07:04:46.082739 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.082578    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a2e1c24d-ae27-4bac-8446-0822f1e53adc-serving-cert\") pod \"service-ca-operator-859f94c4b-mcddz\" (UID: \"a2e1c24d-ae27-4bac-8446-0822f1e53adc\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-mcddz"
Sep 08 07:04:46.083442 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.082593    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b933ee39-2780-43cb-a34d-1fecfabcae2c-metrics-tls\") pod \"dns-default-vg6m8\" (UID: \"b933ee39-2780-43cb-a34d-1fecfabcae2c\") " pod="openshift-dns/dns-default-vg6m8"
Sep 08 07:04:46.083442 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.082611    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2vtb\" (UniqueName: \"kubernetes.io/projected/003d3b4b-43d8-4cb7-add4-40846fb12ae7-kube-api-access-b2vtb\") pod \"network-check-source-685456655f-nxclz\" (UID: \"003d3b4b-43d8-4cb7-add4-40846fb12ae7\") " pod="openshift-network-diagnostics/network-check-source-685456655f-nxclz"
Sep 08 07:04:46.083442 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.082627    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfwcq\" (UniqueName: \"kubernetes.io/projected/8878f0f4-8057-42fc-9d02-1b336541b580-kube-api-access-nfwcq\") pod \"cluster-samples-operator-7cdcfcf76c-lwtc7\" (UID: \"8878f0f4-8057-42fc-9d02-1b336541b580\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-lwtc7"
Sep 08 07:04:46.083442 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.082642    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5cf68f79-8fda-42e2-92c1-05a5a601f505-config\") pod \"console-operator-85b454874b-8d4lx\" (UID: \"5cf68f79-8fda-42e2-92c1-05a5a601f505\") " pod="openshift-console-operator/console-operator-85b454874b-8d4lx"
Sep 08 07:04:46.083442 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.082658    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e5d6ef0-7b12-4602-a841-195b0c593f58-metrics-certs\") pod \"router-default-7cbf7f84b-54255\" (UID: \"7e5d6ef0-7b12-4602-a841-195b0c593f58\") " pod="openshift-ingress/router-default-7cbf7f84b-54255"
Sep 08 07:04:46.083442 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.082673    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8878f0f4-8057-42fc-9d02-1b336541b580-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-lwtc7\" (UID: \"8878f0f4-8057-42fc-9d02-1b336541b580\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-lwtc7"
Sep 08 07:04:46.083442 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.082688    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xshpv\" (UniqueName: \"kubernetes.io/projected/b933ee39-2780-43cb-a34d-1fecfabcae2c-kube-api-access-xshpv\") pod \"dns-default-vg6m8\" (UID: \"b933ee39-2780-43cb-a34d-1fecfabcae2c\") " pod="openshift-dns/dns-default-vg6m8"
Sep 08 07:04:46.083442 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.082707    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqn2x\" (UniqueName: \"kubernetes.io/projected/fd323369-8471-4515-b250-2bcdf068b64c-kube-api-access-fqn2x\") pod \"image-registry-7bcc6fbcd6-66qdn\" (UID: \"fd323369-8471-4515-b250-2bcdf068b64c\") " pod="openshift-image-registry/image-registry-7bcc6fbcd6-66qdn"
Sep 08 07:04:46.083442 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.082722    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7e5d6ef0-7b12-4602-a841-195b0c593f58-default-certificate\") pod \"router-default-7cbf7f84b-54255\" (UID: \"7e5d6ef0-7b12-4602-a841-195b0c593f58\") " pod="openshift-ingress/router-default-7cbf7f84b-54255"
Sep 08 07:04:46.083442 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.082736    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a2e1c24d-ae27-4bac-8446-0822f1e53adc-config\") pod \"service-ca-operator-859f94c4b-mcddz\" (UID: \"a2e1c24d-ae27-4bac-8446-0822f1e53adc\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-mcddz"
Sep 08 07:04:46.083442 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.082759    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fd323369-8471-4515-b250-2bcdf068b64c-registry-tls\") pod \"image-registry-7bcc6fbcd6-66qdn\" (UID: \"fd323369-8471-4515-b250-2bcdf068b64c\") " pod="openshift-image-registry/image-registry-7bcc6fbcd6-66qdn"
Sep 08 07:04:46.083442 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.082775    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6kks\" (UniqueName: \"kubernetes.io/projected/7e5d6ef0-7b12-4602-a841-195b0c593f58-kube-api-access-w6kks\") pod \"router-default-7cbf7f84b-54255\" (UID: \"7e5d6ef0-7b12-4602-a841-195b0c593f58\") " pod="openshift-ingress/router-default-7cbf7f84b-54255"
Sep 08 07:04:46.083442 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.082801    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b933ee39-2780-43cb-a34d-1fecfabcae2c-config-volume\") pod \"dns-default-vg6m8\" (UID: \"b933ee39-2780-43cb-a34d-1fecfabcae2c\") " pod="openshift-dns/dns-default-vg6m8"
Sep 08 07:04:46.083442 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.082903    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fd323369-8471-4515-b250-2bcdf068b64c-registry-certificates\") pod \"image-registry-7bcc6fbcd6-66qdn\" (UID: \"fd323369-8471-4515-b250-2bcdf068b64c\") " pod="openshift-image-registry/image-registry-7bcc6fbcd6-66qdn"
Sep 08 07:04:46.083442 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.083262    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fd323369-8471-4515-b250-2bcdf068b64c-ca-trust-extracted\") pod \"image-registry-7bcc6fbcd6-66qdn\" (UID: \"fd323369-8471-4515-b250-2bcdf068b64c\") " pod="openshift-image-registry/image-registry-7bcc6fbcd6-66qdn"
Sep 08 07:04:46.083442 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:46.083349    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 07:04:46.083442 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:46.083363    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bcc6fbcd6-66qdn: secret "image-registry-tls" not found
Sep 08 07:04:46.084281 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:46.083428    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd323369-8471-4515-b250-2bcdf068b64c-registry-tls podName:fd323369-8471-4515-b250-2bcdf068b64c nodeName:}" failed. No retries permitted until 2026-09-08 07:04:46.583411611 +0000 UTC m=+34.564450911 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fd323369-8471-4515-b250-2bcdf068b64c-registry-tls") pod "image-registry-7bcc6fbcd6-66qdn" (UID: "fd323369-8471-4515-b250-2bcdf068b64c") : secret "image-registry-tls" not found
Sep 08 07:04:46.084392 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.084337    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fd323369-8471-4515-b250-2bcdf068b64c-trusted-ca\") pod \"image-registry-7bcc6fbcd6-66qdn\" (UID: \"fd323369-8471-4515-b250-2bcdf068b64c\") " pod="openshift-image-registry/image-registry-7bcc6fbcd6-66qdn"
Sep 08 07:04:46.084936 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.084916    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/291459fa-c8c6-49c7-ace3-4c0f500d94b5-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-glxch\" (UID: \"291459fa-c8c6-49c7-ace3-4c0f500d94b5\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-glxch"
Sep 08 07:04:46.088099 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.088075    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fd323369-8471-4515-b250-2bcdf068b64c-installation-pull-secrets\") pod \"image-registry-7bcc6fbcd6-66qdn\" (UID: \"fd323369-8471-4515-b250-2bcdf068b64c\") " pod="openshift-image-registry/image-registry-7bcc6fbcd6-66qdn"
Sep 08 07:04:46.088099 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.088089    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fd323369-8471-4515-b250-2bcdf068b64c-image-registry-private-configuration\") pod \"image-registry-7bcc6fbcd6-66qdn\" (UID: \"fd323369-8471-4515-b250-2bcdf068b64c\") " pod="openshift-image-registry/image-registry-7bcc6fbcd6-66qdn"
Sep 08 07:04:46.093806 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.093783    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddrdv_2ddc39aa-5d19-45db-9990-5c0b33f0fa81/konnectivity-agent/0.log" limit=1024
Sep 08 07:04:46.096698 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.096681    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cszrd\" (UniqueName: \"kubernetes.io/projected/291459fa-c8c6-49c7-ace3-4c0f500d94b5-kube-api-access-cszrd\") pod \"cluster-monitoring-operator-6cdcc96965-glxch\" (UID: \"291459fa-c8c6-49c7-ace3-4c0f500d94b5\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-glxch"
Sep 08 07:04:46.097028 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.097005    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fd323369-8471-4515-b250-2bcdf068b64c-bound-sa-token\") pod \"image-registry-7bcc6fbcd6-66qdn\" (UID: \"fd323369-8471-4515-b250-2bcdf068b64c\") " pod="openshift-image-registry/image-registry-7bcc6fbcd6-66qdn"
Sep 08 07:04:46.097166 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.097152    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqn2x\" (UniqueName: \"kubernetes.io/projected/fd323369-8471-4515-b250-2bcdf068b64c-kube-api-access-fqn2x\") pod \"image-registry-7bcc6fbcd6-66qdn\" (UID: \"fd323369-8471-4515-b250-2bcdf068b64c\") " pod="openshift-image-registry/image-registry-7bcc6fbcd6-66qdn"
Sep 08 07:04:46.183817 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.183737    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7e5d6ef0-7b12-4602-a841-195b0c593f58-stats-auth\") pod \"router-default-7cbf7f84b-54255\" (UID: \"7e5d6ef0-7b12-4602-a841-195b0c593f58\") " pod="openshift-ingress/router-default-7cbf7f84b-54255"
Sep 08 07:04:46.183817 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.183780    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5cf68f79-8fda-42e2-92c1-05a5a601f505-trusted-ca\") pod \"console-operator-85b454874b-8d4lx\" (UID: \"5cf68f79-8fda-42e2-92c1-05a5a601f505\") " pod="openshift-console-operator/console-operator-85b454874b-8d4lx"
Sep 08 07:04:46.183817 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.183805    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pxn8\" (UniqueName: \"kubernetes.io/projected/664c9025-a46b-43de-a40a-bda5e922f99a-kube-api-access-6pxn8\") pod \"ingress-canary-hrktk\" (UID: \"664c9025-a46b-43de-a40a-bda5e922f99a\") " pod="openshift-ingress-canary/ingress-canary-hrktk"
Sep 08 07:04:46.184117 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.183834    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gr47h\" (UniqueName: \"kubernetes.io/projected/a2e1c24d-ae27-4bac-8446-0822f1e53adc-kube-api-access-gr47h\") pod \"service-ca-operator-859f94c4b-mcddz\" (UID: \"a2e1c24d-ae27-4bac-8446-0822f1e53adc\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-mcddz"
Sep 08 07:04:46.184117 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.183860    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bd3d9fb-a0ba-40fe-bb47-060b9265e353-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-kh2bx\" (UID: \"9bd3d9fb-a0ba-40fe-bb47-060b9265e353\") " pod="openshift-insights/insights-operator-76bcd6ccf5-kh2bx"
Sep 08 07:04:46.184117 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.183882    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5cf68f79-8fda-42e2-92c1-05a5a601f505-serving-cert\") pod \"console-operator-85b454874b-8d4lx\" (UID: \"5cf68f79-8fda-42e2-92c1-05a5a601f505\") " pod="openshift-console-operator/console-operator-85b454874b-8d4lx"
Sep 08 07:04:46.184117 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.183907    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vbg8\" (UniqueName: \"kubernetes.io/projected/5cf68f79-8fda-42e2-92c1-05a5a601f505-kube-api-access-9vbg8\") pod \"console-operator-85b454874b-8d4lx\" (UID: \"5cf68f79-8fda-42e2-92c1-05a5a601f505\") " pod="openshift-console-operator/console-operator-85b454874b-8d4lx"
Sep 08 07:04:46.184296 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.184115    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb65d52f-d619-46f8-b86a-fc6261a24eb3-metrics-certs\") pod \"network-metrics-daemon-jhq6t\" (UID: \"fb65d52f-d619-46f8-b86a-fc6261a24eb3\") " pod="openshift-multus/network-metrics-daemon-jhq6t"
Sep 08 07:04:46.184296 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.184178    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e5d6ef0-7b12-4602-a841-195b0c593f58-service-ca-bundle\") pod \"router-default-7cbf7f84b-54255\" (UID: \"7e5d6ef0-7b12-4602-a841-195b0c593f58\") " pod="openshift-ingress/router-default-7cbf7f84b-54255"
Sep 08 07:04:46.184296 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.184256    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlfbq\" (UniqueName: \"kubernetes.io/projected/9a60f971-69a4-45c0-9e7c-1cdf55b42770-kube-api-access-hlfbq\") pod \"volume-data-source-validator-695c895bd6-6glxt\" (UID: \"9a60f971-69a4-45c0-9e7c-1cdf55b42770\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-6glxt"
Sep 08 07:04:46.184296 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.184290    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ddb3084-72df-467e-9cb5-0cf05725de6f-original-pull-secret\") pod \"global-pull-secret-syncer-8lgmv\" (UID: \"5ddb3084-72df-467e-9cb5-0cf05725de6f\") " pod="kube-system/global-pull-secret-syncer-8lgmv"
Sep 08 07:04:46.184495 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:46.184320    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 07:04:46.184495 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:46.184387    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 07:04:46.184495 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:46.184406    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7e5d6ef0-7b12-4602-a841-195b0c593f58-service-ca-bundle podName:7e5d6ef0-7b12-4602-a841-195b0c593f58 nodeName:}" failed. No retries permitted until 2026-09-08 07:04:46.684382418 +0000 UTC m=+34.665421734 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7e5d6ef0-7b12-4602-a841-195b0c593f58-service-ca-bundle") pod "router-default-7cbf7f84b-54255" (UID: "7e5d6ef0-7b12-4602-a841-195b0c593f58") : configmap references non-existent config key: service-ca.crt
Sep 08 07:04:46.184495 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:46.184428    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb65d52f-d619-46f8-b86a-fc6261a24eb3-metrics-certs podName:fb65d52f-d619-46f8-b86a-fc6261a24eb3 nodeName:}" failed. No retries permitted until 2026-09-08 07:05:18.184418004 +0000 UTC m=+66.165457306 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fb65d52f-d619-46f8-b86a-fc6261a24eb3-metrics-certs") pod "network-metrics-daemon-jhq6t" (UID: "fb65d52f-d619-46f8-b86a-fc6261a24eb3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 07:04:46.184495 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.184465    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9bd3d9fb-a0ba-40fe-bb47-060b9265e353-serving-cert\") pod \"insights-operator-76bcd6ccf5-kh2bx\" (UID: \"9bd3d9fb-a0ba-40fe-bb47-060b9265e353\") " pod="openshift-insights/insights-operator-76bcd6ccf5-kh2bx"
Sep 08 07:04:46.184495 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:46.184483    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ddb3084-72df-467e-9cb5-0cf05725de6f-original-pull-secret podName:5ddb3084-72df-467e-9cb5-0cf05725de6f nodeName:}" failed. No retries permitted until 2026-09-08 07:05:18.184459887 +0000 UTC m=+66.165499196 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5ddb3084-72df-467e-9cb5-0cf05725de6f-original-pull-secret") pod "global-pull-secret-syncer-8lgmv" (UID: "5ddb3084-72df-467e-9cb5-0cf05725de6f") : object "kube-system"/"original-pull-secret" not registered
Sep 08 07:04:46.184799 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.184521    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/664c9025-a46b-43de-a40a-bda5e922f99a-cert\") pod \"ingress-canary-hrktk\" (UID: \"664c9025-a46b-43de-a40a-bda5e922f99a\") " pod="openshift-ingress-canary/ingress-canary-hrktk"
Sep 08 07:04:46.184799 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.184572    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/90b86d86-d71b-4d36-874a-a2a03190d517-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-st5mf\" (UID: \"90b86d86-d71b-4d36-874a-a2a03190d517\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-st5mf"
Sep 08 07:04:46.184799 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.184609    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b933ee39-2780-43cb-a34d-1fecfabcae2c-tmp-dir\") pod \"dns-default-vg6m8\" (UID: \"b933ee39-2780-43cb-a34d-1fecfabcae2c\") " pod="openshift-dns/dns-default-vg6m8"
Sep 08 07:04:46.184799 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.184643    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jj8kw\" (UniqueName: \"kubernetes.io/projected/90b86d86-d71b-4d36-874a-a2a03190d517-kube-api-access-jj8kw\") pod \"kube-storage-version-migrator-operator-8d7dd4675-st5mf\" (UID: \"90b86d86-d71b-4d36-874a-a2a03190d517\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-st5mf"
Sep 08 07:04:46.184799 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.184678    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8sm8\" (UniqueName: \"kubernetes.io/projected/9bd3d9fb-a0ba-40fe-bb47-060b9265e353-kube-api-access-q8sm8\") pod \"insights-operator-76bcd6ccf5-kh2bx\" (UID: \"9bd3d9fb-a0ba-40fe-bb47-060b9265e353\") " pod="openshift-insights/insights-operator-76bcd6ccf5-kh2bx"
Sep 08 07:04:46.184799 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.184708    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/9bd3d9fb-a0ba-40fe-bb47-060b9265e353-snapshots\") pod \"insights-operator-76bcd6ccf5-kh2bx\" (UID: \"9bd3d9fb-a0ba-40fe-bb47-060b9265e353\") " pod="openshift-insights/insights-operator-76bcd6ccf5-kh2bx"
Sep 08 07:04:46.184799 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.184747    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bd3d9fb-a0ba-40fe-bb47-060b9265e353-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-kh2bx\" (UID: \"9bd3d9fb-a0ba-40fe-bb47-060b9265e353\") " pod="openshift-insights/insights-operator-76bcd6ccf5-kh2bx"
Sep 08 07:04:46.184799 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.184776    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/90b86d86-d71b-4d36-874a-a2a03190d517-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-st5mf\" (UID: \"90b86d86-d71b-4d36-874a-a2a03190d517\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-st5mf"
Sep 08 07:04:46.185257 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.184804    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a2e1c24d-ae27-4bac-8446-0822f1e53adc-serving-cert\") pod \"service-ca-operator-859f94c4b-mcddz\" (UID: \"a2e1c24d-ae27-4bac-8446-0822f1e53adc\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-mcddz"
Sep 08 07:04:46.185257 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.184814    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5cf68f79-8fda-42e2-92c1-05a5a601f505-trusted-ca\") pod \"console-operator-85b454874b-8d4lx\" (UID: \"5cf68f79-8fda-42e2-92c1-05a5a601f505\") " pod="openshift-console-operator/console-operator-85b454874b-8d4lx"
Sep 08 07:04:46.185257 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.184830    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b933ee39-2780-43cb-a34d-1fecfabcae2c-metrics-tls\") pod \"dns-default-vg6m8\" (UID: \"b933ee39-2780-43cb-a34d-1fecfabcae2c\") " pod="openshift-dns/dns-default-vg6m8"
Sep 08 07:04:46.185257 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.184870    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2vtb\" (UniqueName: \"kubernetes.io/projected/003d3b4b-43d8-4cb7-add4-40846fb12ae7-kube-api-access-b2vtb\") pod \"network-check-source-685456655f-nxclz\" (UID: \"003d3b4b-43d8-4cb7-add4-40846fb12ae7\") " pod="openshift-network-diagnostics/network-check-source-685456655f-nxclz"
Sep 08 07:04:46.185257 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.184899    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfwcq\" (UniqueName: \"kubernetes.io/projected/8878f0f4-8057-42fc-9d02-1b336541b580-kube-api-access-nfwcq\") pod \"cluster-samples-operator-7cdcfcf76c-lwtc7\" (UID: \"8878f0f4-8057-42fc-9d02-1b336541b580\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-lwtc7"
Sep 08 07:04:46.185257 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.184922    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5cf68f79-8fda-42e2-92c1-05a5a601f505-config\") pod \"console-operator-85b454874b-8d4lx\" (UID: \"5cf68f79-8fda-42e2-92c1-05a5a601f505\") " pod="openshift-console-operator/console-operator-85b454874b-8d4lx"
Sep 08 07:04:46.185257 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.184949    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e5d6ef0-7b12-4602-a841-195b0c593f58-metrics-certs\") pod \"router-default-7cbf7f84b-54255\" (UID: \"7e5d6ef0-7b12-4602-a841-195b0c593f58\") " pod="openshift-ingress/router-default-7cbf7f84b-54255"
Sep 08 07:04:46.185257 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.184995    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8878f0f4-8057-42fc-9d02-1b336541b580-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-lwtc7\" (UID: \"8878f0f4-8057-42fc-9d02-1b336541b580\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-lwtc7"
Sep 08 07:04:46.185257 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.185020    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xshpv\" (UniqueName: \"kubernetes.io/projected/b933ee39-2780-43cb-a34d-1fecfabcae2c-kube-api-access-xshpv\") pod \"dns-default-vg6m8\" (UID: \"b933ee39-2780-43cb-a34d-1fecfabcae2c\") " pod="openshift-dns/dns-default-vg6m8"
Sep 08 07:04:46.185257 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.185063    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7e5d6ef0-7b12-4602-a841-195b0c593f58-default-certificate\") pod \"router-default-7cbf7f84b-54255\" (UID: \"7e5d6ef0-7b12-4602-a841-195b0c593f58\") " pod="openshift-ingress/router-default-7cbf7f84b-54255"
Sep 08 07:04:46.185257 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.185091    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a2e1c24d-ae27-4bac-8446-0822f1e53adc-config\") pod \"service-ca-operator-859f94c4b-mcddz\" (UID: \"a2e1c24d-ae27-4bac-8446-0822f1e53adc\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-mcddz"
Sep 08 07:04:46.185257 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:46.185132    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 07:04:46.185257 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.185144    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6kks\" (UniqueName: \"kubernetes.io/projected/7e5d6ef0-7b12-4602-a841-195b0c593f58-kube-api-access-w6kks\") pod \"router-default-7cbf7f84b-54255\" (UID: \"7e5d6ef0-7b12-4602-a841-195b0c593f58\") " pod="openshift-ingress/router-default-7cbf7f84b-54255"
Sep 08 07:04:46.185257 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.184775    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bd3d9fb-a0ba-40fe-bb47-060b9265e353-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-kh2bx\" (UID: \"9bd3d9fb-a0ba-40fe-bb47-060b9265e353\") " pod="openshift-insights/insights-operator-76bcd6ccf5-kh2bx"
Sep 08 07:04:46.185257 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.185170    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b933ee39-2780-43cb-a34d-1fecfabcae2c-config-volume\") pod \"dns-default-vg6m8\" (UID: \"b933ee39-2780-43cb-a34d-1fecfabcae2c\") " pod="openshift-dns/dns-default-vg6m8"
Sep 08 07:04:46.185257 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.185198    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9bd3d9fb-a0ba-40fe-bb47-060b9265e353-tmp\") pod \"insights-operator-76bcd6ccf5-kh2bx\" (UID: \"9bd3d9fb-a0ba-40fe-bb47-060b9265e353\") " pod="openshift-insights/insights-operator-76bcd6ccf5-kh2bx"
Sep 08 07:04:46.185257 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.185059    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b933ee39-2780-43cb-a34d-1fecfabcae2c-tmp-dir\") pod \"dns-default-vg6m8\" (UID: \"b933ee39-2780-43cb-a34d-1fecfabcae2c\") " pod="openshift-dns/dns-default-vg6m8"
Sep 08 07:04:46.186061 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:46.185276    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b933ee39-2780-43cb-a34d-1fecfabcae2c-metrics-tls podName:b933ee39-2780-43cb-a34d-1fecfabcae2c nodeName:}" failed. No retries permitted until 2026-09-08 07:04:46.685262626 +0000 UTC m=+34.666301910 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b933ee39-2780-43cb-a34d-1fecfabcae2c-metrics-tls") pod "dns-default-vg6m8" (UID: "b933ee39-2780-43cb-a34d-1fecfabcae2c") : secret "dns-default-metrics-tls" not found
Sep 08 07:04:46.186061 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:46.185509    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 08 07:04:46.186061 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:46.185557    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e5d6ef0-7b12-4602-a841-195b0c593f58-metrics-certs podName:7e5d6ef0-7b12-4602-a841-195b0c593f58 nodeName:}" failed. No retries permitted until 2026-09-08 07:04:46.685540153 +0000 UTC m=+34.666579453 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e5d6ef0-7b12-4602-a841-195b0c593f58-metrics-certs") pod "router-default-7cbf7f84b-54255" (UID: "7e5d6ef0-7b12-4602-a841-195b0c593f58") : secret "router-metrics-certs-default" not found
Sep 08 07:04:46.186061 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.185564    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/90b86d86-d71b-4d36-874a-a2a03190d517-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-st5mf\" (UID: \"90b86d86-d71b-4d36-874a-a2a03190d517\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-st5mf"
Sep 08 07:04:46.186061 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:46.185630    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 08 07:04:46.186061 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:46.185668    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8878f0f4-8057-42fc-9d02-1b336541b580-samples-operator-tls podName:8878f0f4-8057-42fc-9d02-1b336541b580 nodeName:}" failed. No retries permitted until 2026-09-08 07:04:46.685656146 +0000 UTC m=+34.666695643 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8878f0f4-8057-42fc-9d02-1b336541b580-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-lwtc7" (UID: "8878f0f4-8057-42fc-9d02-1b336541b580") : secret "samples-operator-tls" not found
Sep 08 07:04:46.186061 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.185845    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a2e1c24d-ae27-4bac-8446-0822f1e53adc-config\") pod \"service-ca-operator-859f94c4b-mcddz\" (UID: \"a2e1c24d-ae27-4bac-8446-0822f1e53adc\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-mcddz"
Sep 08 07:04:46.186061 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.186050    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b933ee39-2780-43cb-a34d-1fecfabcae2c-config-volume\") pod \"dns-default-vg6m8\" (UID: \"b933ee39-2780-43cb-a34d-1fecfabcae2c\") " pod="openshift-dns/dns-default-vg6m8"
Sep 08 07:04:46.186497 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.186128    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9bd3d9fb-a0ba-40fe-bb47-060b9265e353-tmp\") pod \"insights-operator-76bcd6ccf5-kh2bx\" (UID: \"9bd3d9fb-a0ba-40fe-bb47-060b9265e353\") " pod="openshift-insights/insights-operator-76bcd6ccf5-kh2bx"
Sep 08 07:04:46.187135 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.186962    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5cf68f79-8fda-42e2-92c1-05a5a601f505-config\") pod \"console-operator-85b454874b-8d4lx\" (UID: \"5cf68f79-8fda-42e2-92c1-05a5a601f505\") " pod="openshift-console-operator/console-operator-85b454874b-8d4lx"
Sep 08 07:04:46.187135 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.187016    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/9bd3d9fb-a0ba-40fe-bb47-060b9265e353-snapshots\") pod \"insights-operator-76bcd6ccf5-kh2bx\" (UID: \"9bd3d9fb-a0ba-40fe-bb47-060b9265e353\") " pod="openshift-insights/insights-operator-76bcd6ccf5-kh2bx"
Sep 08 07:04:46.187360 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.187338    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9bd3d9fb-a0ba-40fe-bb47-060b9265e353-serving-cert\") pod \"insights-operator-76bcd6ccf5-kh2bx\" (UID: \"9bd3d9fb-a0ba-40fe-bb47-060b9265e353\") " pod="openshift-insights/insights-operator-76bcd6ccf5-kh2bx"
Sep 08 07:04:46.187360 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.187350    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bd3d9fb-a0ba-40fe-bb47-060b9265e353-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-kh2bx\" (UID: \"9bd3d9fb-a0ba-40fe-bb47-060b9265e353\") " pod="openshift-insights/insights-operator-76bcd6ccf5-kh2bx"
Sep 08 07:04:46.187602 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.187581    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/664c9025-a46b-43de-a40a-bda5e922f99a-cert\") pod \"ingress-canary-hrktk\" (UID: \"664c9025-a46b-43de-a40a-bda5e922f99a\") " pod="openshift-ingress-canary/ingress-canary-hrktk"
Sep 08 07:04:46.188434 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.188141    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/90b86d86-d71b-4d36-874a-a2a03190d517-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-st5mf\" (UID: \"90b86d86-d71b-4d36-874a-a2a03190d517\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-st5mf"
Sep 08 07:04:46.188434 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.188273    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7e5d6ef0-7b12-4602-a841-195b0c593f58-stats-auth\") pod \"router-default-7cbf7f84b-54255\" (UID: \"7e5d6ef0-7b12-4602-a841-195b0c593f58\") " pod="openshift-ingress/router-default-7cbf7f84b-54255"
Sep 08 07:04:46.188434 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.188397    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a2e1c24d-ae27-4bac-8446-0822f1e53adc-serving-cert\") pod \"service-ca-operator-859f94c4b-mcddz\" (UID: \"a2e1c24d-ae27-4bac-8446-0822f1e53adc\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-mcddz"
Sep 08 07:04:46.189018 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.188994    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5cf68f79-8fda-42e2-92c1-05a5a601f505-serving-cert\") pod \"console-operator-85b454874b-8d4lx\" (UID: \"5cf68f79-8fda-42e2-92c1-05a5a601f505\") " pod="openshift-console-operator/console-operator-85b454874b-8d4lx"
Sep 08 07:04:46.189263 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.189248    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7e5d6ef0-7b12-4602-a841-195b0c593f58-default-certificate\") pod \"router-default-7cbf7f84b-54255\" (UID: \"7e5d6ef0-7b12-4602-a841-195b0c593f58\") " pod="openshift-ingress/router-default-7cbf7f84b-54255"
Sep 08 07:04:46.199451 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.199423    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gr47h\" (UniqueName: \"kubernetes.io/projected/a2e1c24d-ae27-4bac-8446-0822f1e53adc-kube-api-access-gr47h\") pod \"service-ca-operator-859f94c4b-mcddz\" (UID: \"a2e1c24d-ae27-4bac-8446-0822f1e53adc\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-mcddz"
Sep 08 07:04:46.199813 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.199769    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jj8kw\" (UniqueName: \"kubernetes.io/projected/90b86d86-d71b-4d36-874a-a2a03190d517-kube-api-access-jj8kw\") pod \"kube-storage-version-migrator-operator-8d7dd4675-st5mf\" (UID: \"90b86d86-d71b-4d36-874a-a2a03190d517\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-st5mf"
Sep 08 07:04:46.200326 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.200302    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6kks\" (UniqueName: \"kubernetes.io/projected/7e5d6ef0-7b12-4602-a841-195b0c593f58-kube-api-access-w6kks\") pod \"router-default-7cbf7f84b-54255\" (UID: \"7e5d6ef0-7b12-4602-a841-195b0c593f58\") " pod="openshift-ingress/router-default-7cbf7f84b-54255"
Sep 08 07:04:46.200430 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.200336    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pxn8\" (UniqueName: \"kubernetes.io/projected/664c9025-a46b-43de-a40a-bda5e922f99a-kube-api-access-6pxn8\") pod \"ingress-canary-hrktk\" (UID: \"664c9025-a46b-43de-a40a-bda5e922f99a\") " pod="openshift-ingress-canary/ingress-canary-hrktk"
Sep 08 07:04:46.200500 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.200446    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlfbq\" (UniqueName: \"kubernetes.io/projected/9a60f971-69a4-45c0-9e7c-1cdf55b42770-kube-api-access-hlfbq\") pod \"volume-data-source-validator-695c895bd6-6glxt\" (UID: \"9a60f971-69a4-45c0-9e7c-1cdf55b42770\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-6glxt"
Sep 08 07:04:46.201029 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.201009    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vbg8\" (UniqueName: \"kubernetes.io/projected/5cf68f79-8fda-42e2-92c1-05a5a601f505-kube-api-access-9vbg8\") pod \"console-operator-85b454874b-8d4lx\" (UID: \"5cf68f79-8fda-42e2-92c1-05a5a601f505\") " pod="openshift-console-operator/console-operator-85b454874b-8d4lx"
Sep 08 07:04:46.201939 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.201919    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xshpv\" (UniqueName: \"kubernetes.io/projected/b933ee39-2780-43cb-a34d-1fecfabcae2c-kube-api-access-xshpv\") pod \"dns-default-vg6m8\" (UID: \"b933ee39-2780-43cb-a34d-1fecfabcae2c\") " pod="openshift-dns/dns-default-vg6m8"
Sep 08 07:04:46.202048 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.202028    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2vtb\" (UniqueName: \"kubernetes.io/projected/003d3b4b-43d8-4cb7-add4-40846fb12ae7-kube-api-access-b2vtb\") pod \"network-check-source-685456655f-nxclz\" (UID: \"003d3b4b-43d8-4cb7-add4-40846fb12ae7\") " pod="openshift-network-diagnostics/network-check-source-685456655f-nxclz"
Sep 08 07:04:46.202170 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.202149    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfwcq\" (UniqueName: \"kubernetes.io/projected/8878f0f4-8057-42fc-9d02-1b336541b580-kube-api-access-nfwcq\") pod \"cluster-samples-operator-7cdcfcf76c-lwtc7\" (UID: \"8878f0f4-8057-42fc-9d02-1b336541b580\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-lwtc7"
Sep 08 07:04:46.202789 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.202763    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8sm8\" (UniqueName: \"kubernetes.io/projected/9bd3d9fb-a0ba-40fe-bb47-060b9265e353-kube-api-access-q8sm8\") pod \"insights-operator-76bcd6ccf5-kh2bx\" (UID: \"9bd3d9fb-a0ba-40fe-bb47-060b9265e353\") " pod="openshift-insights/insights-operator-76bcd6ccf5-kh2bx"
Sep 08 07:04:46.256562 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.256528    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-6glxt"
Sep 08 07:04:46.269747 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.269717    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-kh2bx"
Sep 08 07:04:46.285786 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.285758    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-st5mf"
Sep 08 07:04:46.288424 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.288269    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rvmt\" (UniqueName: \"kubernetes.io/projected/ed95682c-c73e-47a2-9931-adc1417cf25c-kube-api-access-8rvmt\") pod \"network-check-target-bf6vx\" (UID: \"ed95682c-c73e-47a2-9931-adc1417cf25c\") " pod="openshift-network-diagnostics/network-check-target-bf6vx"
Sep 08 07:04:46.291283 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.291262    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rvmt\" (UniqueName: \"kubernetes.io/projected/ed95682c-c73e-47a2-9931-adc1417cf25c-kube-api-access-8rvmt\") pod \"network-check-target-bf6vx\" (UID: \"ed95682c-c73e-47a2-9931-adc1417cf25c\") " pod="openshift-network-diagnostics/network-check-target-bf6vx"
Sep 08 07:04:46.295603 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.294994    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-8d4lx"
Sep 08 07:04:46.303844 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.303807    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-nxclz"
Sep 08 07:04:46.312553 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.312498    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-mcddz"
Sep 08 07:04:46.330610 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.330539    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hrktk"
Sep 08 07:04:46.366362 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.356501    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddrdv_2ddc39aa-5d19-45db-9990-5c0b33f0fa81/konnectivity-agent/0.log" limit=1024
Sep 08 07:04:46.457711 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.457517    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddrdv_2ddc39aa-5d19-45db-9990-5c0b33f0fa81/konnectivity-agent/0.log" limit=1024
Sep 08 07:04:46.503770 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.503736    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jhq6t"
Sep 08 07:04:46.504467 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.504035    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bf6vx"
Sep 08 07:04:46.504467 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.503736    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8lgmv"
Sep 08 07:04:46.506068 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.506049    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 08 07:04:46.506217 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.506106    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ldq7w\""
Sep 08 07:04:46.506217 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.506057    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7mcm7\""
Sep 08 07:04:46.506376 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.506058    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 08 07:04:46.523066 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.523044    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bf6vx"
Sep 08 07:04:46.581783 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.581686    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-kh2bx"]
Sep 08 07:04:46.583998 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.583924    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-6glxt"]
Sep 08 07:04:46.587957 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:46.587928    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bd3d9fb_a0ba_40fe_bb47_060b9265e353.slice/crio-b6c0c6f7e480c43b103a1b581ef156bb7fea465676731e186f6e18a393837252 WatchSource:0}: Error finding container b6c0c6f7e480c43b103a1b581ef156bb7fea465676731e186f6e18a393837252: Status 404 returned error can't find the container with id b6c0c6f7e480c43b103a1b581ef156bb7fea465676731e186f6e18a393837252
Sep 08 07:04:46.588406 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:46.588385    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a60f971_69a4_45c0_9e7c_1cdf55b42770.slice/crio-376b9feccd9dece7e56c6f37f19f4c46bddba3f584ca7a0bc94b56fa96c4a19e WatchSource:0}: Error finding container 376b9feccd9dece7e56c6f37f19f4c46bddba3f584ca7a0bc94b56fa96c4a19e: Status 404 returned error can't find the container with id 376b9feccd9dece7e56c6f37f19f4c46bddba3f584ca7a0bc94b56fa96c4a19e
Sep 08 07:04:46.595868 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.594644    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fd323369-8471-4515-b250-2bcdf068b64c-registry-tls\") pod \"image-registry-7bcc6fbcd6-66qdn\" (UID: \"fd323369-8471-4515-b250-2bcdf068b64c\") " pod="openshift-image-registry/image-registry-7bcc6fbcd6-66qdn"
Sep 08 07:04:46.595868 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.594711    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/291459fa-c8c6-49c7-ace3-4c0f500d94b5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-glxch\" (UID: \"291459fa-c8c6-49c7-ace3-4c0f500d94b5\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-glxch"
Sep 08 07:04:46.595868 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:46.595699    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 07:04:46.595868 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:46.595717    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bcc6fbcd6-66qdn: secret "image-registry-tls" not found
Sep 08 07:04:46.595868 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:46.595750    2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 08 07:04:46.595868 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:46.595810    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/291459fa-c8c6-49c7-ace3-4c0f500d94b5-cluster-monitoring-operator-tls podName:291459fa-c8c6-49c7-ace3-4c0f500d94b5 nodeName:}" failed. No retries permitted until 2026-09-08 07:04:47.595787418 +0000 UTC m=+35.576826721 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/291459fa-c8c6-49c7-ace3-4c0f500d94b5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-glxch" (UID: "291459fa-c8c6-49c7-ace3-4c0f500d94b5") : secret "cluster-monitoring-operator-tls" not found
Sep 08 07:04:46.596315 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:46.596136    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd323369-8471-4515-b250-2bcdf068b64c-registry-tls podName:fd323369-8471-4515-b250-2bcdf068b64c nodeName:}" failed. No retries permitted until 2026-09-08 07:04:47.596114956 +0000 UTC m=+35.577154257 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fd323369-8471-4515-b250-2bcdf068b64c-registry-tls") pod "image-registry-7bcc6fbcd6-66qdn" (UID: "fd323369-8471-4515-b250-2bcdf068b64c") : secret "image-registry-tls" not found
Sep 08 07:04:46.619524 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.619494    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-st5mf"]
Sep 08 07:04:46.622103 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:46.622080    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90b86d86_d71b_4d36_874a_a2a03190d517.slice/crio-9859ab5992710b768ce14f3724c09aaa579a7ed2e4baf55490f8fc08ee7a8f53 WatchSource:0}: Error finding container 9859ab5992710b768ce14f3724c09aaa579a7ed2e4baf55490f8fc08ee7a8f53: Status 404 returned error can't find the container with id 9859ab5992710b768ce14f3724c09aaa579a7ed2e4baf55490f8fc08ee7a8f53
Sep 08 07:04:46.632539 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.632513    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-8d4lx"]
Sep 08 07:04:46.635147 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:46.635127    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cf68f79_8fda_42e2_92c1_05a5a601f505.slice/crio-878282ec3958bd82bce6ee3ea173da4593fea55a7babf1fa889c94af2c4a8d65 WatchSource:0}: Error finding container 878282ec3958bd82bce6ee3ea173da4593fea55a7babf1fa889c94af2c4a8d65: Status 404 returned error can't find the container with id 878282ec3958bd82bce6ee3ea173da4593fea55a7babf1fa889c94af2c4a8d65
Sep 08 07:04:46.643903 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.643872    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-st5mf" event={"ID":"90b86d86-d71b-4d36-874a-a2a03190d517","Type":"ContainerStarted","Data":"9859ab5992710b768ce14f3724c09aaa579a7ed2e4baf55490f8fc08ee7a8f53"}
Sep 08 07:04:46.644560 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.644526    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-mcddz"]
Sep 08 07:04:46.645172 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.645124    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-kh2bx" event={"ID":"9bd3d9fb-a0ba-40fe-bb47-060b9265e353","Type":"ContainerStarted","Data":"b6c0c6f7e480c43b103a1b581ef156bb7fea465676731e186f6e18a393837252"}
Sep 08 07:04:46.646480 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.646449    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-6glxt" event={"ID":"9a60f971-69a4-45c0-9e7c-1cdf55b42770","Type":"ContainerStarted","Data":"376b9feccd9dece7e56c6f37f19f4c46bddba3f584ca7a0bc94b56fa96c4a19e"}
Sep 08 07:04:46.647732 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.647703    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-8d4lx" event={"ID":"5cf68f79-8fda-42e2-92c1-05a5a601f505","Type":"ContainerStarted","Data":"878282ec3958bd82bce6ee3ea173da4593fea55a7babf1fa889c94af2c4a8d65"}
Sep 08 07:04:46.648414 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:46.648380    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2e1c24d_ae27_4bac_8446_0822f1e53adc.slice/crio-5eaba904dbb21fbcac4299a56532c806840dae198f050f7e602ad835c0cd8fc7 WatchSource:0}: Error finding container 5eaba904dbb21fbcac4299a56532c806840dae198f050f7e602ad835c0cd8fc7: Status 404 returned error can't find the container with id 5eaba904dbb21fbcac4299a56532c806840dae198f050f7e602ad835c0cd8fc7
Sep 08 07:04:46.663102 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.663065    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddrdv_2ddc39aa-5d19-45db-9990-5c0b33f0fa81/konnectivity-agent/0.log" limit=1024
Sep 08 07:04:46.684237 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.684206    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hrktk"]
Sep 08 07:04:46.686958 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:46.686932    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod664c9025_a46b_43de_a40a_bda5e922f99a.slice/crio-ed3313192f68964ef9984b4f7ed47f1b625e9a78eb3e8e7bfa2cae7eee0e6816 WatchSource:0}: Error finding container ed3313192f68964ef9984b4f7ed47f1b625e9a78eb3e8e7bfa2cae7eee0e6816: Status 404 returned error can't find the container with id ed3313192f68964ef9984b4f7ed47f1b625e9a78eb3e8e7bfa2cae7eee0e6816
Sep 08 07:04:46.696063 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.696037    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b933ee39-2780-43cb-a34d-1fecfabcae2c-metrics-tls\") pod \"dns-default-vg6m8\" (UID: \"b933ee39-2780-43cb-a34d-1fecfabcae2c\") " pod="openshift-dns/dns-default-vg6m8"
Sep 08 07:04:46.696164 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.696084    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e5d6ef0-7b12-4602-a841-195b0c593f58-metrics-certs\") pod \"router-default-7cbf7f84b-54255\" (UID: \"7e5d6ef0-7b12-4602-a841-195b0c593f58\") " pod="openshift-ingress/router-default-7cbf7f84b-54255"
Sep 08 07:04:46.696164 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.696114    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8878f0f4-8057-42fc-9d02-1b336541b580-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-lwtc7\" (UID: \"8878f0f4-8057-42fc-9d02-1b336541b580\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-lwtc7"
Sep 08 07:04:46.696430 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:46.696184    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 07:04:46.696430 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.696201    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e5d6ef0-7b12-4602-a841-195b0c593f58-service-ca-bundle\") pod \"router-default-7cbf7f84b-54255\" (UID: \"7e5d6ef0-7b12-4602-a841-195b0c593f58\") " pod="openshift-ingress/router-default-7cbf7f84b-54255"
Sep 08 07:04:46.696430 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:46.696285    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b933ee39-2780-43cb-a34d-1fecfabcae2c-metrics-tls podName:b933ee39-2780-43cb-a34d-1fecfabcae2c nodeName:}" failed. No retries permitted until 2026-09-08 07:04:47.696261387 +0000 UTC m=+35.677300671 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b933ee39-2780-43cb-a34d-1fecfabcae2c-metrics-tls") pod "dns-default-vg6m8" (UID: "b933ee39-2780-43cb-a34d-1fecfabcae2c") : secret "dns-default-metrics-tls" not found
Sep 08 07:04:46.696430 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:46.696406    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 08 07:04:46.696430 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:46.696428    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 08 07:04:46.696683 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:46.696454    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e5d6ef0-7b12-4602-a841-195b0c593f58-metrics-certs podName:7e5d6ef0-7b12-4602-a841-195b0c593f58 nodeName:}" failed. No retries permitted until 2026-09-08 07:04:47.696439597 +0000 UTC m=+35.677478888 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e5d6ef0-7b12-4602-a841-195b0c593f58-metrics-certs") pod "router-default-7cbf7f84b-54255" (UID: "7e5d6ef0-7b12-4602-a841-195b0c593f58") : secret "router-metrics-certs-default" not found
Sep 08 07:04:46.696683 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:46.696476    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8878f0f4-8057-42fc-9d02-1b336541b580-samples-operator-tls podName:8878f0f4-8057-42fc-9d02-1b336541b580 nodeName:}" failed. No retries permitted until 2026-09-08 07:04:47.696461503 +0000 UTC m=+35.677500790 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8878f0f4-8057-42fc-9d02-1b336541b580-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-lwtc7" (UID: "8878f0f4-8057-42fc-9d02-1b336541b580") : secret "samples-operator-tls" not found
Sep 08 07:04:46.696683 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:46.696553    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7e5d6ef0-7b12-4602-a841-195b0c593f58-service-ca-bundle podName:7e5d6ef0-7b12-4602-a841-195b0c593f58 nodeName:}" failed. No retries permitted until 2026-09-08 07:04:47.696534971 +0000 UTC m=+35.677574268 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7e5d6ef0-7b12-4602-a841-195b0c593f58-service-ca-bundle") pod "router-default-7cbf7f84b-54255" (UID: "7e5d6ef0-7b12-4602-a841-195b0c593f58") : configmap references non-existent config key: service-ca.crt
Sep 08 07:04:46.696832 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.696766    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-nxclz"]
Sep 08 07:04:46.700408 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:46.700382    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod003d3b4b_43d8_4cb7_add4_40846fb12ae7.slice/crio-31cd124dfca79c2f702e7bf8f8ef74cb53afe05b35e9d903a2e6e01f94a11147 WatchSource:0}: Error finding container 31cd124dfca79c2f702e7bf8f8ef74cb53afe05b35e9d903a2e6e01f94a11147: Status 404 returned error can't find the container with id 31cd124dfca79c2f702e7bf8f8ef74cb53afe05b35e9d903a2e6e01f94a11147
Sep 08 07:04:46.757881 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.757783    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddrdv_2ddc39aa-5d19-45db-9990-5c0b33f0fa81/konnectivity-agent/0.log" limit=1024
Sep 08 07:04:46.812736 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.812706    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bf6vx"]
Sep 08 07:04:46.815947 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:46.815916    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded95682c_c73e_47a2_9931_adc1417cf25c.slice/crio-c2e17579b99890371002b6d565efd209723b508be719c5bb788e9fe3b25c39d2 WatchSource:0}: Error finding container c2e17579b99890371002b6d565efd209723b508be719c5bb788e9fe3b25c39d2: Status 404 returned error can't find the container with id c2e17579b99890371002b6d565efd209723b508be719c5bb788e9fe3b25c39d2
Sep 08 07:04:46.820398 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:46.820368    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddrdv_2ddc39aa-5d19-45db-9990-5c0b33f0fa81/konnectivity-agent/0.log" limit=1024
Sep 08 07:04:47.166759 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:47.166716    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddrdv_2ddc39aa-5d19-45db-9990-5c0b33f0fa81/konnectivity-agent/0.log" limit=1024
Sep 08 07:04:47.219010 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:47.218963    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddrdv_2ddc39aa-5d19-45db-9990-5c0b33f0fa81/konnectivity-agent/0.log" limit=1024
Sep 08 07:04:47.555464 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:47.555430    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddrdv_2ddc39aa-5d19-45db-9990-5c0b33f0fa81/konnectivity-agent/0.log" limit=1024
Sep 08 07:04:47.605412 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:47.605381    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/291459fa-c8c6-49c7-ace3-4c0f500d94b5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-glxch\" (UID: \"291459fa-c8c6-49c7-ace3-4c0f500d94b5\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-glxch"
Sep 08 07:04:47.605584 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:47.605469    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fd323369-8471-4515-b250-2bcdf068b64c-registry-tls\") pod \"image-registry-7bcc6fbcd6-66qdn\" (UID: \"fd323369-8471-4515-b250-2bcdf068b64c\") " pod="openshift-image-registry/image-registry-7bcc6fbcd6-66qdn"
Sep 08 07:04:47.605584 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:47.605556    2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 08 07:04:47.605692 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:47.605636    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/291459fa-c8c6-49c7-ace3-4c0f500d94b5-cluster-monitoring-operator-tls podName:291459fa-c8c6-49c7-ace3-4c0f500d94b5 nodeName:}" failed. No retries permitted until 2026-09-08 07:04:49.60561416 +0000 UTC m=+37.586653460 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/291459fa-c8c6-49c7-ace3-4c0f500d94b5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-glxch" (UID: "291459fa-c8c6-49c7-ace3-4c0f500d94b5") : secret "cluster-monitoring-operator-tls" not found
Sep 08 07:04:47.605692 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:47.605562    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 07:04:47.605692 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:47.605677    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bcc6fbcd6-66qdn: secret "image-registry-tls" not found
Sep 08 07:04:47.605842 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:47.605749    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd323369-8471-4515-b250-2bcdf068b64c-registry-tls podName:fd323369-8471-4515-b250-2bcdf068b64c nodeName:}" failed. No retries permitted until 2026-09-08 07:04:49.605731491 +0000 UTC m=+37.586770798 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fd323369-8471-4515-b250-2bcdf068b64c-registry-tls") pod "image-registry-7bcc6fbcd6-66qdn" (UID: "fd323369-8471-4515-b250-2bcdf068b64c") : secret "image-registry-tls" not found
Sep 08 07:04:47.651731 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:47.651685    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bf6vx" event={"ID":"ed95682c-c73e-47a2-9931-adc1417cf25c","Type":"ContainerStarted","Data":"c2e17579b99890371002b6d565efd209723b508be719c5bb788e9fe3b25c39d2"}
Sep 08 07:04:47.653012 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:47.652981    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hrktk" event={"ID":"664c9025-a46b-43de-a40a-bda5e922f99a","Type":"ContainerStarted","Data":"ed3313192f68964ef9984b4f7ed47f1b625e9a78eb3e8e7bfa2cae7eee0e6816"}
Sep 08 07:04:47.654354 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:47.654322    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-nxclz" event={"ID":"003d3b4b-43d8-4cb7-add4-40846fb12ae7","Type":"ContainerStarted","Data":"31cd124dfca79c2f702e7bf8f8ef74cb53afe05b35e9d903a2e6e01f94a11147"}
Sep 08 07:04:47.654466 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:47.654436    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddrdv_2ddc39aa-5d19-45db-9990-5c0b33f0fa81/konnectivity-agent/0.log" limit=1024
Sep 08 07:04:47.655751 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:47.655733    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-mcddz" event={"ID":"a2e1c24d-ae27-4bac-8446-0822f1e53adc","Type":"ContainerStarted","Data":"5eaba904dbb21fbcac4299a56532c806840dae198f050f7e602ad835c0cd8fc7"}
Sep 08 07:04:47.706308 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:47.706273    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e5d6ef0-7b12-4602-a841-195b0c593f58-service-ca-bundle\") pod \"router-default-7cbf7f84b-54255\" (UID: \"7e5d6ef0-7b12-4602-a841-195b0c593f58\") " pod="openshift-ingress/router-default-7cbf7f84b-54255"
Sep 08 07:04:47.706476 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:47.706456    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b933ee39-2780-43cb-a34d-1fecfabcae2c-metrics-tls\") pod \"dns-default-vg6m8\" (UID: \"b933ee39-2780-43cb-a34d-1fecfabcae2c\") " pod="openshift-dns/dns-default-vg6m8"
Sep 08 07:04:47.706536 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:47.706512    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e5d6ef0-7b12-4602-a841-195b0c593f58-metrics-certs\") pod \"router-default-7cbf7f84b-54255\" (UID: \"7e5d6ef0-7b12-4602-a841-195b0c593f58\") " pod="openshift-ingress/router-default-7cbf7f84b-54255"
Sep 08 07:04:47.706590 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:47.706544    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8878f0f4-8057-42fc-9d02-1b336541b580-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-lwtc7\" (UID: \"8878f0f4-8057-42fc-9d02-1b336541b580\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-lwtc7"
Sep 08 07:04:47.706643 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:47.706600    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 07:04:47.706695 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:47.706658    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b933ee39-2780-43cb-a34d-1fecfabcae2c-metrics-tls podName:b933ee39-2780-43cb-a34d-1fecfabcae2c nodeName:}" failed. No retries permitted until 2026-09-08 07:04:49.706641406 +0000 UTC m=+37.687680693 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b933ee39-2780-43cb-a34d-1fecfabcae2c-metrics-tls") pod "dns-default-vg6m8" (UID: "b933ee39-2780-43cb-a34d-1fecfabcae2c") : secret "dns-default-metrics-tls" not found
Sep 08 07:04:47.706695 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:47.706662    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 08 07:04:47.706695 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:47.706679    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7e5d6ef0-7b12-4602-a841-195b0c593f58-service-ca-bundle podName:7e5d6ef0-7b12-4602-a841-195b0c593f58 nodeName:}" failed. No retries permitted until 2026-09-08 07:04:49.70667282 +0000 UTC m=+37.687712105 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7e5d6ef0-7b12-4602-a841-195b0c593f58-service-ca-bundle") pod "router-default-7cbf7f84b-54255" (UID: "7e5d6ef0-7b12-4602-a841-195b0c593f58") : configmap references non-existent config key: service-ca.crt
Sep 08 07:04:47.706839 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:47.706709    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8878f0f4-8057-42fc-9d02-1b336541b580-samples-operator-tls podName:8878f0f4-8057-42fc-9d02-1b336541b580 nodeName:}" failed. No retries permitted until 2026-09-08 07:04:49.70669326 +0000 UTC m=+37.687732562 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8878f0f4-8057-42fc-9d02-1b336541b580-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-lwtc7" (UID: "8878f0f4-8057-42fc-9d02-1b336541b580") : secret "samples-operator-tls" not found
Sep 08 07:04:47.706839 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:47.706720    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 08 07:04:47.706839 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:47.706770    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e5d6ef0-7b12-4602-a841-195b0c593f58-metrics-certs podName:7e5d6ef0-7b12-4602-a841-195b0c593f58 nodeName:}" failed. No retries permitted until 2026-09-08 07:04:49.706759907 +0000 UTC m=+37.687799191 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e5d6ef0-7b12-4602-a841-195b0c593f58-metrics-certs") pod "router-default-7cbf7f84b-54255" (UID: "7e5d6ef0-7b12-4602-a841-195b0c593f58") : secret "router-metrics-certs-default" not found
Sep 08 07:04:48.360750 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:48.360709    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddrdv_2ddc39aa-5d19-45db-9990-5c0b33f0fa81/konnectivity-agent/0.log" limit=1024
Sep 08 07:04:48.422217 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:48.422182    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddrdv_2ddc39aa-5d19-45db-9990-5c0b33f0fa81/konnectivity-agent/0.log" limit=1024
Sep 08 07:04:48.756380 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:48.756349    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddrdv_2ddc39aa-5d19-45db-9990-5c0b33f0fa81/konnectivity-agent/0.log" limit=1024
Sep 08 07:04:48.857552 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:48.857514    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddrdv_2ddc39aa-5d19-45db-9990-5c0b33f0fa81/konnectivity-agent/0.log" limit=1024
Sep 08 07:04:49.625747 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:49.625102    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fd323369-8471-4515-b250-2bcdf068b64c-registry-tls\") pod \"image-registry-7bcc6fbcd6-66qdn\" (UID: \"fd323369-8471-4515-b250-2bcdf068b64c\") " pod="openshift-image-registry/image-registry-7bcc6fbcd6-66qdn"
Sep 08 07:04:49.625747 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:49.625206    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/291459fa-c8c6-49c7-ace3-4c0f500d94b5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-glxch\" (UID: \"291459fa-c8c6-49c7-ace3-4c0f500d94b5\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-glxch"
Sep 08 07:04:49.625747 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:49.625337    2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 08 07:04:49.625747 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:49.625362    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 07:04:49.625747 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:49.625381    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bcc6fbcd6-66qdn: secret "image-registry-tls" not found
Sep 08 07:04:49.625747 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:49.625403    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/291459fa-c8c6-49c7-ace3-4c0f500d94b5-cluster-monitoring-operator-tls podName:291459fa-c8c6-49c7-ace3-4c0f500d94b5 nodeName:}" failed. No retries permitted until 2026-09-08 07:04:53.62538524 +0000 UTC m=+41.606424529 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/291459fa-c8c6-49c7-ace3-4c0f500d94b5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-glxch" (UID: "291459fa-c8c6-49c7-ace3-4c0f500d94b5") : secret "cluster-monitoring-operator-tls" not found
Sep 08 07:04:49.625747 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:49.625433    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd323369-8471-4515-b250-2bcdf068b64c-registry-tls podName:fd323369-8471-4515-b250-2bcdf068b64c nodeName:}" failed. No retries permitted until 2026-09-08 07:04:53.625415357 +0000 UTC m=+41.606454656 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fd323369-8471-4515-b250-2bcdf068b64c-registry-tls") pod "image-registry-7bcc6fbcd6-66qdn" (UID: "fd323369-8471-4515-b250-2bcdf068b64c") : secret "image-registry-tls" not found
Sep 08 07:04:49.626524 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:49.625921    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddrdv_2ddc39aa-5d19-45db-9990-5c0b33f0fa81/konnectivity-agent/0.log" limit=1024
Sep 08 07:04:49.673154 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:49.673119    2564 generic.go:356] "Generic (PLEG): container finished" podID="6fc4c1f5-eff0-4e2d-a5f8-0b21b412535b" containerID="5af318dedad747c125254174815fc2a28a9365bb646ecbdfb1a236b68a928b88" exitCode=0
Sep 08 07:04:49.673327 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:49.673200    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gj5rb" event={"ID":"6fc4c1f5-eff0-4e2d-a5f8-0b21b412535b","Type":"ContainerDied","Data":"5af318dedad747c125254174815fc2a28a9365bb646ecbdfb1a236b68a928b88"}
Sep 08 07:04:49.701742 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:49.701712    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddrdv_2ddc39aa-5d19-45db-9990-5c0b33f0fa81/konnectivity-agent/0.log" limit=1024
Sep 08 07:04:49.726499 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:49.726464    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b933ee39-2780-43cb-a34d-1fecfabcae2c-metrics-tls\") pod \"dns-default-vg6m8\" (UID: \"b933ee39-2780-43cb-a34d-1fecfabcae2c\") " pod="openshift-dns/dns-default-vg6m8"
Sep 08 07:04:49.726627 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:49.726524    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e5d6ef0-7b12-4602-a841-195b0c593f58-metrics-certs\") pod \"router-default-7cbf7f84b-54255\" (UID: \"7e5d6ef0-7b12-4602-a841-195b0c593f58\") " pod="openshift-ingress/router-default-7cbf7f84b-54255"
Sep 08 07:04:49.726627 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:49.726554    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8878f0f4-8057-42fc-9d02-1b336541b580-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-lwtc7\" (UID: \"8878f0f4-8057-42fc-9d02-1b336541b580\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-lwtc7"
Sep 08 07:04:49.726734 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:49.726643    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e5d6ef0-7b12-4602-a841-195b0c593f58-service-ca-bundle\") pod \"router-default-7cbf7f84b-54255\" (UID: \"7e5d6ef0-7b12-4602-a841-195b0c593f58\") " pod="openshift-ingress/router-default-7cbf7f84b-54255"
Sep 08 07:04:49.727585 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:49.726825    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7e5d6ef0-7b12-4602-a841-195b0c593f58-service-ca-bundle podName:7e5d6ef0-7b12-4602-a841-195b0c593f58 nodeName:}" failed. No retries permitted until 2026-09-08 07:04:53.726806337 +0000 UTC m=+41.707845623 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7e5d6ef0-7b12-4602-a841-195b0c593f58-service-ca-bundle") pod "router-default-7cbf7f84b-54255" (UID: "7e5d6ef0-7b12-4602-a841-195b0c593f58") : configmap references non-existent config key: service-ca.crt
Sep 08 07:04:49.727585 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:49.727249    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 07:04:49.727585 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:49.727301    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b933ee39-2780-43cb-a34d-1fecfabcae2c-metrics-tls podName:b933ee39-2780-43cb-a34d-1fecfabcae2c nodeName:}" failed. No retries permitted until 2026-09-08 07:04:53.727286243 +0000 UTC m=+41.708325534 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b933ee39-2780-43cb-a34d-1fecfabcae2c-metrics-tls") pod "dns-default-vg6m8" (UID: "b933ee39-2780-43cb-a34d-1fecfabcae2c") : secret "dns-default-metrics-tls" not found
Sep 08 07:04:49.727585 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:49.727354    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 08 07:04:49.727585 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:49.727408    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e5d6ef0-7b12-4602-a841-195b0c593f58-metrics-certs podName:7e5d6ef0-7b12-4602-a841-195b0c593f58 nodeName:}" failed. No retries permitted until 2026-09-08 07:04:53.727395361 +0000 UTC m=+41.708434661 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e5d6ef0-7b12-4602-a841-195b0c593f58-metrics-certs") pod "router-default-7cbf7f84b-54255" (UID: "7e5d6ef0-7b12-4602-a841-195b0c593f58") : secret "router-metrics-certs-default" not found
Sep 08 07:04:49.727585 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:49.727467    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 08 07:04:49.727585 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:49.727499    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8878f0f4-8057-42fc-9d02-1b336541b580-samples-operator-tls podName:8878f0f4-8057-42fc-9d02-1b336541b580 nodeName:}" failed. No retries permitted until 2026-09-08 07:04:53.727490215 +0000 UTC m=+41.708529514 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8878f0f4-8057-42fc-9d02-1b336541b580-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-lwtc7" (UID: "8878f0f4-8057-42fc-9d02-1b336541b580") : secret "samples-operator-tls" not found
Sep 08 07:04:50.688163 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:50.688123    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gj5rb" event={"ID":"6fc4c1f5-eff0-4e2d-a5f8-0b21b412535b","Type":"ContainerStarted","Data":"b658113c4f764c75fca39ee23285ae9faa0750b709fd7d7a456b75be5e82d39b"}
Sep 08 07:04:51.660895 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:51.660858    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddrdv_2ddc39aa-5d19-45db-9990-5c0b33f0fa81/konnectivity-agent/0.log" limit=1024
Sep 08 07:04:51.698048 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:51.698010    2564 generic.go:356] "Generic (PLEG): container finished" podID="6fc4c1f5-eff0-4e2d-a5f8-0b21b412535b" containerID="b658113c4f764c75fca39ee23285ae9faa0750b709fd7d7a456b75be5e82d39b" exitCode=0
Sep 08 07:04:51.698497 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:51.698074    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gj5rb" event={"ID":"6fc4c1f5-eff0-4e2d-a5f8-0b21b412535b","Type":"ContainerDied","Data":"b658113c4f764c75fca39ee23285ae9faa0750b709fd7d7a456b75be5e82d39b"}
Sep 08 07:04:51.723841 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:51.723788    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddrdv_2ddc39aa-5d19-45db-9990-5c0b33f0fa81/konnectivity-agent/0.log" limit=1024
Sep 08 07:04:53.666705 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:53.666614    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fd323369-8471-4515-b250-2bcdf068b64c-registry-tls\") pod \"image-registry-7bcc6fbcd6-66qdn\" (UID: \"fd323369-8471-4515-b250-2bcdf068b64c\") " pod="openshift-image-registry/image-registry-7bcc6fbcd6-66qdn"
Sep 08 07:04:53.666705 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:53.666699    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/291459fa-c8c6-49c7-ace3-4c0f500d94b5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-glxch\" (UID: \"291459fa-c8c6-49c7-ace3-4c0f500d94b5\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-glxch"
Sep 08 07:04:53.667214 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:53.666785    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 07:04:53.667214 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:53.666804    2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 08 07:04:53.667214 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:53.666809    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bcc6fbcd6-66qdn: secret "image-registry-tls" not found
Sep 08 07:04:53.667214 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:53.666866    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/291459fa-c8c6-49c7-ace3-4c0f500d94b5-cluster-monitoring-operator-tls podName:291459fa-c8c6-49c7-ace3-4c0f500d94b5 nodeName:}" failed. No retries permitted until 2026-09-08 07:05:01.666847516 +0000 UTC m=+49.647886800 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/291459fa-c8c6-49c7-ace3-4c0f500d94b5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-glxch" (UID: "291459fa-c8c6-49c7-ace3-4c0f500d94b5") : secret "cluster-monitoring-operator-tls" not found
Sep 08 07:04:53.667214 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:53.666885    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd323369-8471-4515-b250-2bcdf068b64c-registry-tls podName:fd323369-8471-4515-b250-2bcdf068b64c nodeName:}" failed. No retries permitted until 2026-09-08 07:05:01.666875307 +0000 UTC m=+49.647914591 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fd323369-8471-4515-b250-2bcdf068b64c-registry-tls") pod "image-registry-7bcc6fbcd6-66qdn" (UID: "fd323369-8471-4515-b250-2bcdf068b64c") : secret "image-registry-tls" not found
Sep 08 07:04:53.768038 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:53.768000    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e5d6ef0-7b12-4602-a841-195b0c593f58-service-ca-bundle\") pod \"router-default-7cbf7f84b-54255\" (UID: \"7e5d6ef0-7b12-4602-a841-195b0c593f58\") " pod="openshift-ingress/router-default-7cbf7f84b-54255"
Sep 08 07:04:53.768195 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:53.768100    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b933ee39-2780-43cb-a34d-1fecfabcae2c-metrics-tls\") pod \"dns-default-vg6m8\" (UID: \"b933ee39-2780-43cb-a34d-1fecfabcae2c\") " pod="openshift-dns/dns-default-vg6m8"
Sep 08 07:04:53.768195 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:53.768137    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e5d6ef0-7b12-4602-a841-195b0c593f58-metrics-certs\") pod \"router-default-7cbf7f84b-54255\" (UID: \"7e5d6ef0-7b12-4602-a841-195b0c593f58\") " pod="openshift-ingress/router-default-7cbf7f84b-54255"
Sep 08 07:04:53.768195 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:53.768165    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8878f0f4-8057-42fc-9d02-1b336541b580-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-lwtc7\" (UID: \"8878f0f4-8057-42fc-9d02-1b336541b580\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-lwtc7"
Sep 08 07:04:53.768353 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:53.768190    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7e5d6ef0-7b12-4602-a841-195b0c593f58-service-ca-bundle podName:7e5d6ef0-7b12-4602-a841-195b0c593f58 nodeName:}" failed. No retries permitted until 2026-09-08 07:05:01.768163442 +0000 UTC m=+49.749202731 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7e5d6ef0-7b12-4602-a841-195b0c593f58-service-ca-bundle") pod "router-default-7cbf7f84b-54255" (UID: "7e5d6ef0-7b12-4602-a841-195b0c593f58") : configmap references non-existent config key: service-ca.crt
Sep 08 07:04:53.768353 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:53.768258    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 08 07:04:53.768353 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:53.768259    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 07:04:53.768353 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:53.768281    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 08 07:04:53.768353 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:53.768308    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8878f0f4-8057-42fc-9d02-1b336541b580-samples-operator-tls podName:8878f0f4-8057-42fc-9d02-1b336541b580 nodeName:}" failed. No retries permitted until 2026-09-08 07:05:01.768292207 +0000 UTC m=+49.749331509 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8878f0f4-8057-42fc-9d02-1b336541b580-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-lwtc7" (UID: "8878f0f4-8057-42fc-9d02-1b336541b580") : secret "samples-operator-tls" not found
Sep 08 07:04:53.768353 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:53.768325    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b933ee39-2780-43cb-a34d-1fecfabcae2c-metrics-tls podName:b933ee39-2780-43cb-a34d-1fecfabcae2c nodeName:}" failed. No retries permitted until 2026-09-08 07:05:01.768315607 +0000 UTC m=+49.749354896 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b933ee39-2780-43cb-a34d-1fecfabcae2c-metrics-tls") pod "dns-default-vg6m8" (UID: "b933ee39-2780-43cb-a34d-1fecfabcae2c") : secret "dns-default-metrics-tls" not found
Sep 08 07:04:53.768353 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:53.768339    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e5d6ef0-7b12-4602-a841-195b0c593f58-metrics-certs podName:7e5d6ef0-7b12-4602-a841-195b0c593f58 nodeName:}" failed. No retries permitted until 2026-09-08 07:05:01.768331209 +0000 UTC m=+49.749370528 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e5d6ef0-7b12-4602-a841-195b0c593f58-metrics-certs") pod "router-default-7cbf7f84b-54255" (UID: "7e5d6ef0-7b12-4602-a841-195b0c593f58") : secret "router-metrics-certs-default" not found
Sep 08 07:04:57.722758 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:57.722649    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gj5rb" event={"ID":"6fc4c1f5-eff0-4e2d-a5f8-0b21b412535b","Type":"ContainerStarted","Data":"d9e487aba7bed258fef8f263ef4d4f38204af78bd8fc8029cf83e933379e6021"}
Sep 08 07:04:57.724479 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:57.724446    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-st5mf" event={"ID":"90b86d86-d71b-4d36-874a-a2a03190d517","Type":"ContainerStarted","Data":"66aa29668ea7077a8f376e6dd6aa89701f8e9f7f3d0e248a276c397fbe81f1a4"}
Sep 08 07:04:57.726188 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:57.726138    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-kh2bx" event={"ID":"9bd3d9fb-a0ba-40fe-bb47-060b9265e353","Type":"ContainerStarted","Data":"5a30ddb45029abe1d86ca3d14daba07afe62842235e3f11a53baa238e92c78b0"}
Sep 08 07:04:57.728380 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:57.728361    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-6glxt" event={"ID":"9a60f971-69a4-45c0-9e7c-1cdf55b42770","Type":"ContainerStarted","Data":"630a8603a584a683fbd993b15e53e6301ea80ec72fc099af7df8d39d654aba9d"}
Sep 08 07:04:57.730071 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:57.730051    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bf6vx" event={"ID":"ed95682c-c73e-47a2-9931-adc1417cf25c","Type":"ContainerStarted","Data":"b966c96498601b3d9378a426f1994af909a82f5ea716844a9d93a3fb1ff97daa"}
Sep 08 07:04:57.730163 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:57.730103    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-bf6vx"
Sep 08 07:04:57.731809 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:57.731789    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-8d4lx_5cf68f79-8fda-42e2-92c1-05a5a601f505/console-operator/0.log"
Sep 08 07:04:57.731898 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:57.731827    2564 generic.go:356] "Generic (PLEG): container finished" podID="5cf68f79-8fda-42e2-92c1-05a5a601f505" containerID="54848202f1d8957c6a95c37199adfb4b5664cbd07533e0fefaef88805a094c05" exitCode=255
Sep 08 07:04:57.731961 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:57.731897    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-8d4lx" event={"ID":"5cf68f79-8fda-42e2-92c1-05a5a601f505","Type":"ContainerDied","Data":"54848202f1d8957c6a95c37199adfb4b5664cbd07533e0fefaef88805a094c05"}
Sep 08 07:04:57.732074 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:57.732059    2564 scope.go:117] "RemoveContainer" containerID="54848202f1d8957c6a95c37199adfb4b5664cbd07533e0fefaef88805a094c05"
Sep 08 07:04:57.733559 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:57.733529    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hrktk" event={"ID":"664c9025-a46b-43de-a40a-bda5e922f99a","Type":"ContainerStarted","Data":"5364176b7d9d9f6aaef7fd25a933abe39ed51a1b40cf9aa52af66957cb23e30d"}
Sep 08 07:04:57.735458 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:57.735437    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-nxclz" event={"ID":"003d3b4b-43d8-4cb7-add4-40846fb12ae7","Type":"ContainerStarted","Data":"823a8c57efc70769ed455af5555a9d070984db9665e529016570a75798e5218e"}
Sep 08 07:04:57.737028 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:57.737008    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-mcddz" event={"ID":"a2e1c24d-ae27-4bac-8446-0822f1e53adc","Type":"ContainerStarted","Data":"b1623dad3446154050675623001d460ba37dc224d8c2f21a0e7b0a08cf865e31"}
Sep 08 07:04:57.743874 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:57.743536    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-gj5rb" podStartSLOduration=15.557100972 podStartE2EDuration="45.743515773s" totalImagesPullingTime="30.186414801s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 07:04:12 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:04:57.742387105 +0000 UTC m=+45.723426427" watchObservedRunningTime="2026-09-08 07:04:57.743515773 +0000 UTC m=+45.724555080"
Sep 08 07:04:57.756639 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:57.756596    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-bf6vx" podStartSLOduration=35.505212296 podStartE2EDuration="45.756580607s" totalImagesPullingTime="10.251368311s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:04:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:04:57.756382736 +0000 UTC m=+45.737422043" watchObservedRunningTime="2026-09-08 07:04:57.756580607 +0000 UTC m=+45.737619914"
Sep 08 07:04:57.770357 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:57.770316    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-6glxt" podStartSLOduration=24.745023115 podStartE2EDuration="34.770301021s" totalImagesPullingTime="10.025277906s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:04:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:04:57.769788958 +0000 UTC m=+45.750828259" watchObservedRunningTime="2026-09-08 07:04:57.770301021 +0000 UTC m=+45.751340328"
Sep 08 07:04:57.787269 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:57.787226    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-76bcd6ccf5-kh2bx" podStartSLOduration=29.758930062 podStartE2EDuration="39.787209576s" totalImagesPullingTime="10.028279514s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:04:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:04:57.785954204 +0000 UTC m=+45.766993511" watchObservedRunningTime="2026-09-08 07:04:57.787209576 +0000 UTC m=+45.768248884"
Sep 08 07:04:57.801472 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:57.801422    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-st5mf" podStartSLOduration=19.805517342999998 podStartE2EDuration="29.801408738s" totalImagesPullingTime="9.995891395s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:04:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:04:57.800331061 +0000 UTC m=+45.781370369" watchObservedRunningTime="2026-09-08 07:04:57.801408738 +0000 UTC m=+45.782448058"
Sep 08 07:04:57.840452 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:57.840404    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-685456655f-nxclz" podStartSLOduration=16.461598209 podStartE2EDuration="26.840368688s" totalImagesPullingTime="10.378770479s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:04:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:04:57.839363916 +0000 UTC m=+45.820403241" watchObservedRunningTime="2026-09-08 07:04:57.840368688 +0000 UTC m=+45.821407995"
Sep 08 07:04:57.856844 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:57.856784    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-mcddz" podStartSLOduration=19.887281444 podStartE2EDuration="29.856764272s" totalImagesPullingTime="9.969482828s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:04:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:04:57.856128583 +0000 UTC m=+45.837167890" watchObservedRunningTime="2026-09-08 07:04:57.856764272 +0000 UTC m=+45.837803579"
Sep 08 07:04:57.864740 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:57.864715    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddrdv_2ddc39aa-5d19-45db-9990-5c0b33f0fa81/konnectivity-agent/0.log" limit=1024
Sep 08 07:04:57.870665 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:57.870597    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-hrktk" podStartSLOduration=2.933150629 podStartE2EDuration="12.870577027s" totalImagesPullingTime="9.937426398s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:04:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:04:57.869892327 +0000 UTC m=+45.850931648" watchObservedRunningTime="2026-09-08 07:04:57.870577027 +0000 UTC m=+45.851616334"
Sep 08 07:04:57.970782 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:57.970752    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddrdv_2ddc39aa-5d19-45db-9990-5c0b33f0fa81/konnectivity-agent/0.log" limit=1024
Sep 08 07:04:58.327146 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:58.327098    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddrdv_2ddc39aa-5d19-45db-9990-5c0b33f0fa81/konnectivity-agent/0.log" limit=1024
Sep 08 07:04:58.415807 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:58.415776    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-m9vqp"]
Sep 08 07:04:58.416176 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:58.416149    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddrdv_2ddc39aa-5d19-45db-9990-5c0b33f0fa81/konnectivity-agent/0.log" limit=1024
Sep 08 07:04:58.435871 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:58.435849    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-m9vqp"]
Sep 08 07:04:58.436022 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:58.435942    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-m9vqp"
Sep 08 07:04:58.438043 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:58.438017    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 08 07:04:58.438043 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:58.438037    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lv5z5\""
Sep 08 07:04:58.438227 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:58.438017    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 08 07:04:58.510779 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:58.510740    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddrdv_2ddc39aa-5d19-45db-9990-5c0b33f0fa81/konnectivity-agent/0.log" limit=1024
Sep 08 07:04:58.513528 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:58.513504    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-v4ts8"]
Sep 08 07:04:58.526982 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:58.526942    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-v4ts8"]
Sep 08 07:04:58.527094 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:58.527065    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-v4ts8"
Sep 08 07:04:58.529156 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:58.529094    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 08 07:04:58.529156 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:58.529127    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 08 07:04:58.529343 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:58.529127    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-kbpt7\""
Sep 08 07:04:58.569146 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:58.569119    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddrdv_2ddc39aa-5d19-45db-9990-5c0b33f0fa81/konnectivity-agent/0.log" limit=1024
Sep 08 07:04:58.611066 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:58.611033    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2f7de5be-1aea-40af-ae8e-bcbeb6db29f2-crio-socket\") pod \"insights-runtime-extractor-m9vqp\" (UID: \"2f7de5be-1aea-40af-ae8e-bcbeb6db29f2\") " pod="openshift-insights/insights-runtime-extractor-m9vqp"
Sep 08 07:04:58.611201 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:58.611088    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2f7de5be-1aea-40af-ae8e-bcbeb6db29f2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m9vqp\" (UID: \"2f7de5be-1aea-40af-ae8e-bcbeb6db29f2\") " pod="openshift-insights/insights-runtime-extractor-m9vqp"
Sep 08 07:04:58.611201 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:58.611134    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6k9hm\" (UniqueName: \"kubernetes.io/projected/2f7de5be-1aea-40af-ae8e-bcbeb6db29f2-kube-api-access-6k9hm\") pod \"insights-runtime-extractor-m9vqp\" (UID: \"2f7de5be-1aea-40af-ae8e-bcbeb6db29f2\") " pod="openshift-insights/insights-runtime-extractor-m9vqp"
Sep 08 07:04:58.611284 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:58.611270    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2f7de5be-1aea-40af-ae8e-bcbeb6db29f2-data-volume\") pod \"insights-runtime-extractor-m9vqp\" (UID: \"2f7de5be-1aea-40af-ae8e-bcbeb6db29f2\") " pod="openshift-insights/insights-runtime-extractor-m9vqp"
Sep 08 07:04:58.611334 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:58.611318    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2f7de5be-1aea-40af-ae8e-bcbeb6db29f2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m9vqp\" (UID: \"2f7de5be-1aea-40af-ae8e-bcbeb6db29f2\") " pod="openshift-insights/insights-runtime-extractor-m9vqp"
Sep 08 07:04:58.711949 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:58.711879    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2f7de5be-1aea-40af-ae8e-bcbeb6db29f2-data-volume\") pod \"insights-runtime-extractor-m9vqp\" (UID: \"2f7de5be-1aea-40af-ae8e-bcbeb6db29f2\") " pod="openshift-insights/insights-runtime-extractor-m9vqp"
Sep 08 07:04:58.711949 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:58.711930    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2f7de5be-1aea-40af-ae8e-bcbeb6db29f2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m9vqp\" (UID: \"2f7de5be-1aea-40af-ae8e-bcbeb6db29f2\") " pod="openshift-insights/insights-runtime-extractor-m9vqp"
Sep 08 07:04:58.712155 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:58.712024    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 07:04:58.712155 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:58.712091    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2f7de5be-1aea-40af-ae8e-bcbeb6db29f2-kube-rbac-proxy-cm podName:2f7de5be-1aea-40af-ae8e-bcbeb6db29f2 nodeName:}" failed. No retries permitted until 2026-09-08 07:04:59.212075957 +0000 UTC m=+47.193115241 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2f7de5be-1aea-40af-ae8e-bcbeb6db29f2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-m9vqp" (UID: "2f7de5be-1aea-40af-ae8e-bcbeb6db29f2") : configmap "kube-rbac-proxy" not found
Sep 08 07:04:58.712155 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:58.712083    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2f7de5be-1aea-40af-ae8e-bcbeb6db29f2-crio-socket\") pod \"insights-runtime-extractor-m9vqp\" (UID: \"2f7de5be-1aea-40af-ae8e-bcbeb6db29f2\") " pod="openshift-insights/insights-runtime-extractor-m9vqp"
Sep 08 07:04:58.712155 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:58.712117    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vx78q\" (UniqueName: \"kubernetes.io/projected/1d7a1fa0-5368-4e01-a8e7-6be0b6308090-kube-api-access-vx78q\") pod \"migrator-fdbb8fdff-v4ts8\" (UID: \"1d7a1fa0-5368-4e01-a8e7-6be0b6308090\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-v4ts8"
Sep 08 07:04:58.712155 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:58.712140    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2f7de5be-1aea-40af-ae8e-bcbeb6db29f2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m9vqp\" (UID: \"2f7de5be-1aea-40af-ae8e-bcbeb6db29f2\") " pod="openshift-insights/insights-runtime-extractor-m9vqp"
Sep 08 07:04:58.712397 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:58.712177    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6k9hm\" (UniqueName: \"kubernetes.io/projected/2f7de5be-1aea-40af-ae8e-bcbeb6db29f2-kube-api-access-6k9hm\") pod \"insights-runtime-extractor-m9vqp\" (UID: \"2f7de5be-1aea-40af-ae8e-bcbeb6db29f2\") " pod="openshift-insights/insights-runtime-extractor-m9vqp"
Sep 08 07:04:58.712397 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:58.712249    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2f7de5be-1aea-40af-ae8e-bcbeb6db29f2-data-volume\") pod \"insights-runtime-extractor-m9vqp\" (UID: \"2f7de5be-1aea-40af-ae8e-bcbeb6db29f2\") " pod="openshift-insights/insights-runtime-extractor-m9vqp"
Sep 08 07:04:58.712397 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:58.712263    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2f7de5be-1aea-40af-ae8e-bcbeb6db29f2-crio-socket\") pod \"insights-runtime-extractor-m9vqp\" (UID: \"2f7de5be-1aea-40af-ae8e-bcbeb6db29f2\") " pod="openshift-insights/insights-runtime-extractor-m9vqp"
Sep 08 07:04:58.712397 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:58.712308    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 07:04:58.712397 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:58.712384    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f7de5be-1aea-40af-ae8e-bcbeb6db29f2-insights-runtime-extractor-tls podName:2f7de5be-1aea-40af-ae8e-bcbeb6db29f2 nodeName:}" failed. No retries permitted until 2026-09-08 07:04:59.212364929 +0000 UTC m=+47.193404234 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2f7de5be-1aea-40af-ae8e-bcbeb6db29f2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m9vqp" (UID: "2f7de5be-1aea-40af-ae8e-bcbeb6db29f2") : secret "insights-runtime-extractor-tls" not found
Sep 08 07:04:58.721952 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:58.721927    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6k9hm\" (UniqueName: \"kubernetes.io/projected/2f7de5be-1aea-40af-ae8e-bcbeb6db29f2-kube-api-access-6k9hm\") pod \"insights-runtime-extractor-m9vqp\" (UID: \"2f7de5be-1aea-40af-ae8e-bcbeb6db29f2\") " pod="openshift-insights/insights-runtime-extractor-m9vqp"
Sep 08 07:04:58.741653 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:58.741633    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-8d4lx_5cf68f79-8fda-42e2-92c1-05a5a601f505/console-operator/1.log"
Sep 08 07:04:58.742124 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:58.742109    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-8d4lx_5cf68f79-8fda-42e2-92c1-05a5a601f505/console-operator/0.log"
Sep 08 07:04:58.742187 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:58.742141    2564 generic.go:356] "Generic (PLEG): container finished" podID="5cf68f79-8fda-42e2-92c1-05a5a601f505" containerID="caa916f37c7a6ec8c632deda5926c6ea9780cb2fda4b038897198565db159ea9" exitCode=255
Sep 08 07:04:58.742187 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:58.742169    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-8d4lx" event={"ID":"5cf68f79-8fda-42e2-92c1-05a5a601f505","Type":"ContainerDied","Data":"caa916f37c7a6ec8c632deda5926c6ea9780cb2fda4b038897198565db159ea9"}
Sep 08 07:04:58.742269 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:58.742229    2564 scope.go:117] "RemoveContainer" containerID="54848202f1d8957c6a95c37199adfb4b5664cbd07533e0fefaef88805a094c05"
Sep 08 07:04:58.742489 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:58.742461    2564 scope.go:117] "RemoveContainer" containerID="caa916f37c7a6ec8c632deda5926c6ea9780cb2fda4b038897198565db159ea9"
Sep 08 07:04:58.742657 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:58.742636    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-8d4lx_openshift-console-operator(5cf68f79-8fda-42e2-92c1-05a5a601f505)\"" pod="openshift-console-operator/console-operator-85b454874b-8d4lx" podUID="5cf68f79-8fda-42e2-92c1-05a5a601f505"
Sep 08 07:04:58.771107 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:58.771085    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-7l54g"]
Sep 08 07:04:58.774568 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:58.774542    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddrdv_2ddc39aa-5d19-45db-9990-5c0b33f0fa81/konnectivity-agent/0.log" limit=1024
Sep 08 07:04:58.804575 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:58.804553    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-7l54g"]
Sep 08 07:04:58.804656 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:58.804632    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-7l54g"
Sep 08 07:04:58.806571 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:58.806546    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 08 07:04:58.806843 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:58.806827    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 08 07:04:58.806924 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:58.806844    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-mfbtb\""
Sep 08 07:04:58.812825 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:58.812805    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vx78q\" (UniqueName: \"kubernetes.io/projected/1d7a1fa0-5368-4e01-a8e7-6be0b6308090-kube-api-access-vx78q\") pod \"migrator-fdbb8fdff-v4ts8\" (UID: \"1d7a1fa0-5368-4e01-a8e7-6be0b6308090\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-v4ts8"
Sep 08 07:04:58.822544 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:58.822522    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vx78q\" (UniqueName: \"kubernetes.io/projected/1d7a1fa0-5368-4e01-a8e7-6be0b6308090-kube-api-access-vx78q\") pod \"migrator-fdbb8fdff-v4ts8\" (UID: \"1d7a1fa0-5368-4e01-a8e7-6be0b6308090\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-v4ts8"
Sep 08 07:04:58.836574 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:58.836556    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-v4ts8"
Sep 08 07:04:58.840276 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:58.840249    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddrdv_2ddc39aa-5d19-45db-9990-5c0b33f0fa81/konnectivity-agent/0.log" limit=1024
Sep 08 07:04:58.915776 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:58.914683    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7416321a-6800-4360-9b3d-0434aff598ea-nginx-conf\") pod \"networking-console-plugin-79977f9844-7l54g\" (UID: \"7416321a-6800-4360-9b3d-0434aff598ea\") " pod="openshift-network-console/networking-console-plugin-79977f9844-7l54g"
Sep 08 07:04:58.915776 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:58.914746    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7416321a-6800-4360-9b3d-0434aff598ea-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-7l54g\" (UID: \"7416321a-6800-4360-9b3d-0434aff598ea\") " pod="openshift-network-console/networking-console-plugin-79977f9844-7l54g"
Sep 08 07:04:58.936937 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:58.936908    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddrdv_2ddc39aa-5d19-45db-9990-5c0b33f0fa81/konnectivity-agent/0.log" limit=1024
Sep 08 07:04:59.018994 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:59.018952    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7416321a-6800-4360-9b3d-0434aff598ea-nginx-conf\") pod \"networking-console-plugin-79977f9844-7l54g\" (UID: \"7416321a-6800-4360-9b3d-0434aff598ea\") " pod="openshift-network-console/networking-console-plugin-79977f9844-7l54g"
Sep 08 07:04:59.018994 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:59.019004    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7416321a-6800-4360-9b3d-0434aff598ea-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-7l54g\" (UID: \"7416321a-6800-4360-9b3d-0434aff598ea\") " pod="openshift-network-console/networking-console-plugin-79977f9844-7l54g"
Sep 08 07:04:59.019187 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:59.019167    2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 08 07:04:59.019263 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:59.019251    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7416321a-6800-4360-9b3d-0434aff598ea-networking-console-plugin-cert podName:7416321a-6800-4360-9b3d-0434aff598ea nodeName:}" failed. No retries permitted until 2026-09-08 07:04:59.519227577 +0000 UTC m=+47.500266883 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7416321a-6800-4360-9b3d-0434aff598ea-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-7l54g" (UID: "7416321a-6800-4360-9b3d-0434aff598ea") : secret "networking-console-plugin-cert" not found
Sep 08 07:04:59.019711 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:59.019691    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7416321a-6800-4360-9b3d-0434aff598ea-nginx-conf\") pod \"networking-console-plugin-79977f9844-7l54g\" (UID: \"7416321a-6800-4360-9b3d-0434aff598ea\") " pod="openshift-network-console/networking-console-plugin-79977f9844-7l54g"
Sep 08 07:04:59.036844 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:59.036816    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddrdv_2ddc39aa-5d19-45db-9990-5c0b33f0fa81/konnectivity-agent/0.log" limit=1024
Sep 08 07:04:59.123025 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:59.122994    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-v4ts8"]
Sep 08 07:04:59.125983 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:59.125942    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddrdv_2ddc39aa-5d19-45db-9990-5c0b33f0fa81/konnectivity-agent/0.log" limit=1024
Sep 08 07:04:59.126941 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:04:59.126914    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d7a1fa0_5368_4e01_a8e7_6be0b6308090.slice/crio-4054bbc3723d18eb0d90f815db5505fd8a5da6cfed93349453bad66918bafe08 WatchSource:0}: Error finding container 4054bbc3723d18eb0d90f815db5505fd8a5da6cfed93349453bad66918bafe08: Status 404 returned error can't find the container with id 4054bbc3723d18eb0d90f815db5505fd8a5da6cfed93349453bad66918bafe08
Sep 08 07:04:59.221215 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:59.221179    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2f7de5be-1aea-40af-ae8e-bcbeb6db29f2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m9vqp\" (UID: \"2f7de5be-1aea-40af-ae8e-bcbeb6db29f2\") " pod="openshift-insights/insights-runtime-extractor-m9vqp"
Sep 08 07:04:59.221386 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:59.221242    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2f7de5be-1aea-40af-ae8e-bcbeb6db29f2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m9vqp\" (UID: \"2f7de5be-1aea-40af-ae8e-bcbeb6db29f2\") " pod="openshift-insights/insights-runtime-extractor-m9vqp"
Sep 08 07:04:59.221386 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:59.221343    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 07:04:59.221386 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:59.221344    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 07:04:59.221483 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:59.221395    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f7de5be-1aea-40af-ae8e-bcbeb6db29f2-insights-runtime-extractor-tls podName:2f7de5be-1aea-40af-ae8e-bcbeb6db29f2 nodeName:}" failed. No retries permitted until 2026-09-08 07:05:00.221382472 +0000 UTC m=+48.202421769 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2f7de5be-1aea-40af-ae8e-bcbeb6db29f2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m9vqp" (UID: "2f7de5be-1aea-40af-ae8e-bcbeb6db29f2") : secret "insights-runtime-extractor-tls" not found
Sep 08 07:04:59.221483 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:59.221439    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2f7de5be-1aea-40af-ae8e-bcbeb6db29f2-kube-rbac-proxy-cm podName:2f7de5be-1aea-40af-ae8e-bcbeb6db29f2 nodeName:}" failed. No retries permitted until 2026-09-08 07:05:00.221403036 +0000 UTC m=+48.202442333 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2f7de5be-1aea-40af-ae8e-bcbeb6db29f2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-m9vqp" (UID: "2f7de5be-1aea-40af-ae8e-bcbeb6db29f2") : configmap "kube-rbac-proxy" not found
Sep 08 07:04:59.365621 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:59.365536    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4cwpb_890fab40-3e97-456c-88ed-01de5ff6c541/dns-node-resolver/0.log"
Sep 08 07:04:59.524638 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:59.524594    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7416321a-6800-4360-9b3d-0434aff598ea-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-7l54g\" (UID: \"7416321a-6800-4360-9b3d-0434aff598ea\") " pod="openshift-network-console/networking-console-plugin-79977f9844-7l54g"
Sep 08 07:04:59.524807 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:59.524735    2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 08 07:04:59.524807 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:59.524800    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7416321a-6800-4360-9b3d-0434aff598ea-networking-console-plugin-cert podName:7416321a-6800-4360-9b3d-0434aff598ea nodeName:}" failed. No retries permitted until 2026-09-08 07:05:00.524784885 +0000 UTC m=+48.505824169 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7416321a-6800-4360-9b3d-0434aff598ea-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-7l54g" (UID: "7416321a-6800-4360-9b3d-0434aff598ea") : secret "networking-console-plugin-cert" not found
Sep 08 07:04:59.748876 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:59.748783    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-v4ts8" event={"ID":"1d7a1fa0-5368-4e01-a8e7-6be0b6308090","Type":"ContainerStarted","Data":"4054bbc3723d18eb0d90f815db5505fd8a5da6cfed93349453bad66918bafe08"}
Sep 08 07:04:59.750381 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:59.750360    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-8d4lx_5cf68f79-8fda-42e2-92c1-05a5a601f505/console-operator/1.log"
Sep 08 07:04:59.750685 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:04:59.750668    2564 scope.go:117] "RemoveContainer" containerID="caa916f37c7a6ec8c632deda5926c6ea9780cb2fda4b038897198565db159ea9"
Sep 08 07:04:59.750833 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:04:59.750815    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-8d4lx_openshift-console-operator(5cf68f79-8fda-42e2-92c1-05a5a601f505)\"" pod="openshift-console-operator/console-operator-85b454874b-8d4lx" podUID="5cf68f79-8fda-42e2-92c1-05a5a601f505"
Sep 08 07:05:00.231861 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:00.231828    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2f7de5be-1aea-40af-ae8e-bcbeb6db29f2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m9vqp\" (UID: \"2f7de5be-1aea-40af-ae8e-bcbeb6db29f2\") " pod="openshift-insights/insights-runtime-extractor-m9vqp"
Sep 08 07:05:00.232054 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:00.231904    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2f7de5be-1aea-40af-ae8e-bcbeb6db29f2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m9vqp\" (UID: \"2f7de5be-1aea-40af-ae8e-bcbeb6db29f2\") " pod="openshift-insights/insights-runtime-extractor-m9vqp"
Sep 08 07:05:00.232054 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:05:00.231951    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 07:05:00.232054 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:05:00.232032    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2f7de5be-1aea-40af-ae8e-bcbeb6db29f2-kube-rbac-proxy-cm podName:2f7de5be-1aea-40af-ae8e-bcbeb6db29f2 nodeName:}" failed. No retries permitted until 2026-09-08 07:05:02.232016516 +0000 UTC m=+50.213055800 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2f7de5be-1aea-40af-ae8e-bcbeb6db29f2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-m9vqp" (UID: "2f7de5be-1aea-40af-ae8e-bcbeb6db29f2") : configmap "kube-rbac-proxy" not found
Sep 08 07:05:00.232181 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:05:00.232066    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 07:05:00.232181 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:05:00.232129    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f7de5be-1aea-40af-ae8e-bcbeb6db29f2-insights-runtime-extractor-tls podName:2f7de5be-1aea-40af-ae8e-bcbeb6db29f2 nodeName:}" failed. No retries permitted until 2026-09-08 07:05:02.232112386 +0000 UTC m=+50.213151680 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2f7de5be-1aea-40af-ae8e-bcbeb6db29f2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m9vqp" (UID: "2f7de5be-1aea-40af-ae8e-bcbeb6db29f2") : secret "insights-runtime-extractor-tls" not found
Sep 08 07:05:00.478137 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:00.478095    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddrdv_2ddc39aa-5d19-45db-9990-5c0b33f0fa81/konnectivity-agent/0.log" limit=1024
Sep 08 07:05:00.534680 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:00.534642    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7416321a-6800-4360-9b3d-0434aff598ea-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-7l54g\" (UID: \"7416321a-6800-4360-9b3d-0434aff598ea\") " pod="openshift-network-console/networking-console-plugin-79977f9844-7l54g"
Sep 08 07:05:00.534875 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:05:00.534738    2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 08 07:05:00.534875 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:05:00.534812    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7416321a-6800-4360-9b3d-0434aff598ea-networking-console-plugin-cert podName:7416321a-6800-4360-9b3d-0434aff598ea nodeName:}" failed. No retries permitted until 2026-09-08 07:05:02.534791188 +0000 UTC m=+50.515830486 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7416321a-6800-4360-9b3d-0434aff598ea-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-7l54g" (UID: "7416321a-6800-4360-9b3d-0434aff598ea") : secret "networking-console-plugin-cert" not found
Sep 08 07:05:00.536508 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:00.536472    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddrdv_2ddc39aa-5d19-45db-9990-5c0b33f0fa81/konnectivity-agent/0.log" limit=1024
Sep 08 07:05:00.632677 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:00.632647    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-75d99c484-48r9c"]
Sep 08 07:05:00.655731 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:00.655704    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-48r9c"]
Sep 08 07:05:00.655867 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:00.655795    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-48r9c"
Sep 08 07:05:00.658047 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:00.658023    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 08 07:05:00.658628 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:00.658607    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 08 07:05:00.658628 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:00.658611    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 08 07:05:00.658800 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:00.658657    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-nvxf9\""
Sep 08 07:05:00.658800 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:00.658659    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 08 07:05:00.671483 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:00.671455    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddrdv_2ddc39aa-5d19-45db-9990-5c0b33f0fa81/konnectivity-agent/0.log" limit=1024
Sep 08 07:05:00.737006 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:00.736952    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1e6c0551-55b1-4153-9ae2-ba48c9174d62-signing-cabundle\") pod \"service-ca-75d99c484-48r9c\" (UID: \"1e6c0551-55b1-4153-9ae2-ba48c9174d62\") " pod="openshift-service-ca/service-ca-75d99c484-48r9c"
Sep 08 07:05:00.737158 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:00.737019    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1e6c0551-55b1-4153-9ae2-ba48c9174d62-signing-key\") pod \"service-ca-75d99c484-48r9c\" (UID: \"1e6c0551-55b1-4153-9ae2-ba48c9174d62\") " pod="openshift-service-ca/service-ca-75d99c484-48r9c"
Sep 08 07:05:00.737158 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:00.737115    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmdqc\" (UniqueName: \"kubernetes.io/projected/1e6c0551-55b1-4153-9ae2-ba48c9174d62-kube-api-access-vmdqc\") pod \"service-ca-75d99c484-48r9c\" (UID: \"1e6c0551-55b1-4153-9ae2-ba48c9174d62\") " pod="openshift-service-ca/service-ca-75d99c484-48r9c"
Sep 08 07:05:00.770461 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:00.770436    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qllkn_5b60264a-f3fc-4640-a51a-d556e505482a/node-ca/0.log"
Sep 08 07:05:00.773259 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:00.773236    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddrdv_2ddc39aa-5d19-45db-9990-5c0b33f0fa81/konnectivity-agent/0.log" limit=1024
Sep 08 07:05:00.838607 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:00.838515    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1e6c0551-55b1-4153-9ae2-ba48c9174d62-signing-cabundle\") pod \"service-ca-75d99c484-48r9c\" (UID: \"1e6c0551-55b1-4153-9ae2-ba48c9174d62\") " pod="openshift-service-ca/service-ca-75d99c484-48r9c"
Sep 08 07:05:00.838607 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:00.838579    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1e6c0551-55b1-4153-9ae2-ba48c9174d62-signing-key\") pod \"service-ca-75d99c484-48r9c\" (UID: \"1e6c0551-55b1-4153-9ae2-ba48c9174d62\") " pod="openshift-service-ca/service-ca-75d99c484-48r9c"
Sep 08 07:05:00.838834 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:00.838637    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmdqc\" (UniqueName: \"kubernetes.io/projected/1e6c0551-55b1-4153-9ae2-ba48c9174d62-kube-api-access-vmdqc\") pod \"service-ca-75d99c484-48r9c\" (UID: \"1e6c0551-55b1-4153-9ae2-ba48c9174d62\") " pod="openshift-service-ca/service-ca-75d99c484-48r9c"
Sep 08 07:05:00.839163 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:00.839143    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1e6c0551-55b1-4153-9ae2-ba48c9174d62-signing-cabundle\") pod \"service-ca-75d99c484-48r9c\" (UID: \"1e6c0551-55b1-4153-9ae2-ba48c9174d62\") " pod="openshift-service-ca/service-ca-75d99c484-48r9c"
Sep 08 07:05:00.840946 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:00.840928    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1e6c0551-55b1-4153-9ae2-ba48c9174d62-signing-key\") pod \"service-ca-75d99c484-48r9c\" (UID: \"1e6c0551-55b1-4153-9ae2-ba48c9174d62\") " pod="openshift-service-ca/service-ca-75d99c484-48r9c"
Sep 08 07:05:00.847752 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:00.847728    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmdqc\" (UniqueName: \"kubernetes.io/projected/1e6c0551-55b1-4153-9ae2-ba48c9174d62-kube-api-access-vmdqc\") pod \"service-ca-75d99c484-48r9c\" (UID: \"1e6c0551-55b1-4153-9ae2-ba48c9174d62\") " pod="openshift-service-ca/service-ca-75d99c484-48r9c"
Sep 08 07:05:00.964621 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:00.964585    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-48r9c"
Sep 08 07:05:01.167273 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:01.167243    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hrktk_664c9025-a46b-43de-a40a-bda5e922f99a/serve-healthcheck-canary/0.log"
Sep 08 07:05:01.319127 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:01.319102    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-48r9c"]
Sep 08 07:05:01.321746 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:05:01.321714    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e6c0551_55b1_4153_9ae2_ba48c9174d62.slice/crio-e64658acbeae702c06178b044e25b48b5578ef55b5e9c7b65d37aa4825f7cfc8 WatchSource:0}: Error finding container e64658acbeae702c06178b044e25b48b5578ef55b5e9c7b65d37aa4825f7cfc8: Status 404 returned error can't find the container with id e64658acbeae702c06178b044e25b48b5578ef55b5e9c7b65d37aa4825f7cfc8
Sep 08 07:05:01.558736 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:01.558701    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddrdv_2ddc39aa-5d19-45db-9990-5c0b33f0fa81/konnectivity-agent/0.log" limit=1024
Sep 08 07:05:01.746582 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:01.746484    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fd323369-8471-4515-b250-2bcdf068b64c-registry-tls\") pod \"image-registry-7bcc6fbcd6-66qdn\" (UID: \"fd323369-8471-4515-b250-2bcdf068b64c\") " pod="openshift-image-registry/image-registry-7bcc6fbcd6-66qdn"
Sep 08 07:05:01.746749 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:01.746614    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/291459fa-c8c6-49c7-ace3-4c0f500d94b5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-glxch\" (UID: \"291459fa-c8c6-49c7-ace3-4c0f500d94b5\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-glxch"
Sep 08 07:05:01.746749 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:05:01.746633    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 07:05:01.746749 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:05:01.746652    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bcc6fbcd6-66qdn: secret "image-registry-tls" not found
Sep 08 07:05:01.746749 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:05:01.746709    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd323369-8471-4515-b250-2bcdf068b64c-registry-tls podName:fd323369-8471-4515-b250-2bcdf068b64c nodeName:}" failed. No retries permitted until 2026-09-08 07:05:17.746689532 +0000 UTC m=+65.727728838 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fd323369-8471-4515-b250-2bcdf068b64c-registry-tls") pod "image-registry-7bcc6fbcd6-66qdn" (UID: "fd323369-8471-4515-b250-2bcdf068b64c") : secret "image-registry-tls" not found
Sep 08 07:05:01.746916 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:05:01.746749    2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 08 07:05:01.746916 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:05:01.746804    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/291459fa-c8c6-49c7-ace3-4c0f500d94b5-cluster-monitoring-operator-tls podName:291459fa-c8c6-49c7-ace3-4c0f500d94b5 nodeName:}" failed. No retries permitted until 2026-09-08 07:05:17.74679076 +0000 UTC m=+65.727830044 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/291459fa-c8c6-49c7-ace3-4c0f500d94b5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-glxch" (UID: "291459fa-c8c6-49c7-ace3-4c0f500d94b5") : secret "cluster-monitoring-operator-tls" not found
Sep 08 07:05:01.759044 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:01.759011    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-v4ts8" event={"ID":"1d7a1fa0-5368-4e01-a8e7-6be0b6308090","Type":"ContainerStarted","Data":"35dea4b7f90d59166cb11efac1d0f3d0f60a7b13e1cd7f2bb0ab5413c8fef97e"}
Sep 08 07:05:01.759216 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:01.759079    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-v4ts8" event={"ID":"1d7a1fa0-5368-4e01-a8e7-6be0b6308090","Type":"ContainerStarted","Data":"4228c8966be4a99370fa58484f7e141b25ef3a3e1276b352676d2e36b2da969f"}
Sep 08 07:05:01.760642 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:01.760613    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-48r9c" event={"ID":"1e6c0551-55b1-4153-9ae2-ba48c9174d62","Type":"ContainerStarted","Data":"85ae65deef1274251c9db8dc695de556141aeff036e5dfd343f7127e30eec25d"}
Sep 08 07:05:01.760736 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:01.760661    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-48r9c" event={"ID":"1e6c0551-55b1-4153-9ae2-ba48c9174d62","Type":"ContainerStarted","Data":"e64658acbeae702c06178b044e25b48b5578ef55b5e9c7b65d37aa4825f7cfc8"}
Sep 08 07:05:01.775003 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:01.774937    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-v4ts8" podStartSLOduration=1.848722502 podStartE2EDuration="3.774923932s" totalImagesPullingTime="1.92620143s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:04:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:05:01.774130853 +0000 UTC m=+49.755170178" watchObservedRunningTime="2026-09-08 07:05:01.774923932 +0000 UTC m=+49.755963237"
Sep 08 07:05:01.789751 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:01.789692    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-75d99c484-48r9c" podStartSLOduration=1.789672787 podStartE2EDuration="1.789672787s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:05:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:05:01.78806441 +0000 UTC m=+49.769103752" watchObservedRunningTime="2026-09-08 07:05:01.789672787 +0000 UTC m=+49.770712094"
Sep 08 07:05:01.848025 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:01.847991    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e5d6ef0-7b12-4602-a841-195b0c593f58-service-ca-bundle\") pod \"router-default-7cbf7f84b-54255\" (UID: \"7e5d6ef0-7b12-4602-a841-195b0c593f58\") " pod="openshift-ingress/router-default-7cbf7f84b-54255"
Sep 08 07:05:01.848174 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:01.848147    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b933ee39-2780-43cb-a34d-1fecfabcae2c-metrics-tls\") pod \"dns-default-vg6m8\" (UID: \"b933ee39-2780-43cb-a34d-1fecfabcae2c\") " pod="openshift-dns/dns-default-vg6m8"
Sep 08 07:05:01.848174 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:05:01.848164    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7e5d6ef0-7b12-4602-a841-195b0c593f58-service-ca-bundle podName:7e5d6ef0-7b12-4602-a841-195b0c593f58 nodeName:}" failed. No retries permitted until 2026-09-08 07:05:17.848143048 +0000 UTC m=+65.829182346 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7e5d6ef0-7b12-4602-a841-195b0c593f58-service-ca-bundle") pod "router-default-7cbf7f84b-54255" (UID: "7e5d6ef0-7b12-4602-a841-195b0c593f58") : configmap references non-existent config key: service-ca.crt
Sep 08 07:05:01.848282 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:01.848210    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e5d6ef0-7b12-4602-a841-195b0c593f58-metrics-certs\") pod \"router-default-7cbf7f84b-54255\" (UID: \"7e5d6ef0-7b12-4602-a841-195b0c593f58\") " pod="openshift-ingress/router-default-7cbf7f84b-54255"
Sep 08 07:05:01.848282 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:05:01.848223    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 07:05:01.848282 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:01.848242    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8878f0f4-8057-42fc-9d02-1b336541b580-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-lwtc7\" (UID: \"8878f0f4-8057-42fc-9d02-1b336541b580\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-lwtc7"
Sep 08 07:05:01.848282 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:05:01.848261    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b933ee39-2780-43cb-a34d-1fecfabcae2c-metrics-tls podName:b933ee39-2780-43cb-a34d-1fecfabcae2c nodeName:}" failed. No retries permitted until 2026-09-08 07:05:17.848249155 +0000 UTC m=+65.829288460 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b933ee39-2780-43cb-a34d-1fecfabcae2c-metrics-tls") pod "dns-default-vg6m8" (UID: "b933ee39-2780-43cb-a34d-1fecfabcae2c") : secret "dns-default-metrics-tls" not found
Sep 08 07:05:01.848456 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:05:01.848305    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 08 07:05:01.848456 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:05:01.848337    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8878f0f4-8057-42fc-9d02-1b336541b580-samples-operator-tls podName:8878f0f4-8057-42fc-9d02-1b336541b580 nodeName:}" failed. No retries permitted until 2026-09-08 07:05:17.848326707 +0000 UTC m=+65.829366005 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8878f0f4-8057-42fc-9d02-1b336541b580-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-lwtc7" (UID: "8878f0f4-8057-42fc-9d02-1b336541b580") : secret "samples-operator-tls" not found
Sep 08 07:05:01.848852 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:05:01.848749    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 08 07:05:01.848852 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:05:01.848816    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e5d6ef0-7b12-4602-a841-195b0c593f58-metrics-certs podName:7e5d6ef0-7b12-4602-a841-195b0c593f58 nodeName:}" failed. No retries permitted until 2026-09-08 07:05:17.848798434 +0000 UTC m=+65.829837737 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e5d6ef0-7b12-4602-a841-195b0c593f58-metrics-certs") pod "router-default-7cbf7f84b-54255" (UID: "7e5d6ef0-7b12-4602-a841-195b0c593f58") : secret "router-metrics-certs-default" not found
Sep 08 07:05:02.245146 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:02.245109    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddrdv_2ddc39aa-5d19-45db-9990-5c0b33f0fa81/konnectivity-agent/0.log" limit=1024
Sep 08 07:05:02.253286 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:02.253247    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2f7de5be-1aea-40af-ae8e-bcbeb6db29f2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m9vqp\" (UID: \"2f7de5be-1aea-40af-ae8e-bcbeb6db29f2\") " pod="openshift-insights/insights-runtime-extractor-m9vqp"
Sep 08 07:05:02.253428 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:02.253336    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2f7de5be-1aea-40af-ae8e-bcbeb6db29f2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m9vqp\" (UID: \"2f7de5be-1aea-40af-ae8e-bcbeb6db29f2\") " pod="openshift-insights/insights-runtime-extractor-m9vqp"
Sep 08 07:05:02.253488 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:05:02.253461    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 07:05:02.253530 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:05:02.253523    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f7de5be-1aea-40af-ae8e-bcbeb6db29f2-insights-runtime-extractor-tls podName:2f7de5be-1aea-40af-ae8e-bcbeb6db29f2 nodeName:}" failed. No retries permitted until 2026-09-08 07:05:06.253507803 +0000 UTC m=+54.234547087 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2f7de5be-1aea-40af-ae8e-bcbeb6db29f2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m9vqp" (UID: "2f7de5be-1aea-40af-ae8e-bcbeb6db29f2") : secret "insights-runtime-extractor-tls" not found
Sep 08 07:05:02.253798 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:02.253781    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2f7de5be-1aea-40af-ae8e-bcbeb6db29f2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m9vqp\" (UID: \"2f7de5be-1aea-40af-ae8e-bcbeb6db29f2\") " pod="openshift-insights/insights-runtime-extractor-m9vqp"
Sep 08 07:05:02.556010 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:02.555953    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7416321a-6800-4360-9b3d-0434aff598ea-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-7l54g\" (UID: \"7416321a-6800-4360-9b3d-0434aff598ea\") " pod="openshift-network-console/networking-console-plugin-79977f9844-7l54g"
Sep 08 07:05:02.556192 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:05:02.556110    2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 08 07:05:02.556192 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:05:02.556171    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7416321a-6800-4360-9b3d-0434aff598ea-networking-console-plugin-cert podName:7416321a-6800-4360-9b3d-0434aff598ea nodeName:}" failed. No retries permitted until 2026-09-08 07:05:06.556154961 +0000 UTC m=+54.537194252 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7416321a-6800-4360-9b3d-0434aff598ea-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-7l54g" (UID: "7416321a-6800-4360-9b3d-0434aff598ea") : secret "networking-console-plugin-cert" not found
Sep 08 07:05:02.988409 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:02.988316    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddrdv_2ddc39aa-5d19-45db-9990-5c0b33f0fa81/konnectivity-agent/0.log" limit=1024
Sep 08 07:05:03.165069 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:03.165033    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddrdv_2ddc39aa-5d19-45db-9990-5c0b33f0fa81/konnectivity-agent/0.log" limit=1024
Sep 08 07:05:03.266870 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:03.266832    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddrdv_2ddc39aa-5d19-45db-9990-5c0b33f0fa81/konnectivity-agent/0.log" limit=1024
Sep 08 07:05:03.367198 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:03.367119    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddrdv_2ddc39aa-5d19-45db-9990-5c0b33f0fa81/konnectivity-agent/0.log" limit=1024
Sep 08 07:05:03.472788 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:03.472751    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddrdv_2ddc39aa-5d19-45db-9990-5c0b33f0fa81/konnectivity-agent/0.log" limit=1024
Sep 08 07:05:03.567856 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:03.567756    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddrdv_2ddc39aa-5d19-45db-9990-5c0b33f0fa81/konnectivity-agent/0.log" limit=1024
Sep 08 07:05:03.686744 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:03.686710    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddrdv_2ddc39aa-5d19-45db-9990-5c0b33f0fa81/konnectivity-agent/0.log" limit=1024
Sep 08 07:05:04.625118 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:04.625082    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddrdv_2ddc39aa-5d19-45db-9990-5c0b33f0fa81/konnectivity-agent/0.log" limit=1024
Sep 08 07:05:04.725758 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:04.725723    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddrdv_2ddc39aa-5d19-45db-9990-5c0b33f0fa81/konnectivity-agent/0.log" limit=1024
Sep 08 07:05:04.825480 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:04.825447    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddrdv_2ddc39aa-5d19-45db-9990-5c0b33f0fa81/konnectivity-agent/0.log" limit=1024
Sep 08 07:05:05.091525 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:05.091491    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddrdv_2ddc39aa-5d19-45db-9990-5c0b33f0fa81/konnectivity-agent/0.log" limit=1024
Sep 08 07:05:05.290618 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:05.290580    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddrdv_2ddc39aa-5d19-45db-9990-5c0b33f0fa81/konnectivity-agent/0.log" limit=1024
Sep 08 07:05:05.490829 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:05.490743    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddrdv_2ddc39aa-5d19-45db-9990-5c0b33f0fa81/konnectivity-agent/0.log" limit=1024
Sep 08 07:05:05.696621 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:05.696586    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddrdv_2ddc39aa-5d19-45db-9990-5c0b33f0fa81/konnectivity-agent/0.log" limit=1024
Sep 08 07:05:05.751980 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:05.751880    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddrdv_2ddc39aa-5d19-45db-9990-5c0b33f0fa81/konnectivity-agent/0.log" limit=1024
Sep 08 07:05:06.289627 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:06.289580    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2f7de5be-1aea-40af-ae8e-bcbeb6db29f2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m9vqp\" (UID: \"2f7de5be-1aea-40af-ae8e-bcbeb6db29f2\") " pod="openshift-insights/insights-runtime-extractor-m9vqp"
Sep 08 07:05:06.289881 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:05:06.289705    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 07:05:06.289881 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:05:06.289766    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f7de5be-1aea-40af-ae8e-bcbeb6db29f2-insights-runtime-extractor-tls podName:2f7de5be-1aea-40af-ae8e-bcbeb6db29f2 nodeName:}" failed. No retries permitted until 2026-09-08 07:05:14.289749701 +0000 UTC m=+62.270788989 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2f7de5be-1aea-40af-ae8e-bcbeb6db29f2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m9vqp" (UID: "2f7de5be-1aea-40af-ae8e-bcbeb6db29f2") : secret "insights-runtime-extractor-tls" not found
Sep 08 07:05:06.296047 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:06.296029    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-8d4lx"
Sep 08 07:05:06.296112 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:06.296102    2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85b454874b-8d4lx"
Sep 08 07:05:06.296422 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:06.296411    2564 scope.go:117] "RemoveContainer" containerID="caa916f37c7a6ec8c632deda5926c6ea9780cb2fda4b038897198565db159ea9"
Sep 08 07:05:06.296563 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:05:06.296547    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-8d4lx_openshift-console-operator(5cf68f79-8fda-42e2-92c1-05a5a601f505)\"" pod="openshift-console-operator/console-operator-85b454874b-8d4lx" podUID="5cf68f79-8fda-42e2-92c1-05a5a601f505"
Sep 08 07:05:06.592300 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:06.592218    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7416321a-6800-4360-9b3d-0434aff598ea-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-7l54g\" (UID: \"7416321a-6800-4360-9b3d-0434aff598ea\") " pod="openshift-network-console/networking-console-plugin-79977f9844-7l54g"
Sep 08 07:05:06.592448 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:05:06.592325    2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 08 07:05:06.592448 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:05:06.592376    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7416321a-6800-4360-9b3d-0434aff598ea-networking-console-plugin-cert podName:7416321a-6800-4360-9b3d-0434aff598ea nodeName:}" failed. No retries permitted until 2026-09-08 07:05:14.592362707 +0000 UTC m=+62.573401992 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7416321a-6800-4360-9b3d-0434aff598ea-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-7l54g" (UID: "7416321a-6800-4360-9b3d-0434aff598ea") : secret "networking-console-plugin-cert" not found
Sep 08 07:05:12.639941 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:12.639915    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kjppj"
Sep 08 07:05:14.363596 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:14.363559    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2f7de5be-1aea-40af-ae8e-bcbeb6db29f2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m9vqp\" (UID: \"2f7de5be-1aea-40af-ae8e-bcbeb6db29f2\") " pod="openshift-insights/insights-runtime-extractor-m9vqp"
Sep 08 07:05:14.365788 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:14.365768    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2f7de5be-1aea-40af-ae8e-bcbeb6db29f2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m9vqp\" (UID: \"2f7de5be-1aea-40af-ae8e-bcbeb6db29f2\") " pod="openshift-insights/insights-runtime-extractor-m9vqp"
Sep 08 07:05:14.647929 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:14.647851    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lv5z5\""
Sep 08 07:05:14.656525 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:14.656492    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-m9vqp"
Sep 08 07:05:14.666907 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:14.666882    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7416321a-6800-4360-9b3d-0434aff598ea-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-7l54g\" (UID: \"7416321a-6800-4360-9b3d-0434aff598ea\") " pod="openshift-network-console/networking-console-plugin-79977f9844-7l54g"
Sep 08 07:05:14.669384 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:14.669364    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7416321a-6800-4360-9b3d-0434aff598ea-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-7l54g\" (UID: \"7416321a-6800-4360-9b3d-0434aff598ea\") " pod="openshift-network-console/networking-console-plugin-79977f9844-7l54g"
Sep 08 07:05:14.715521 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:14.715485    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-mfbtb\""
Sep 08 07:05:14.723327 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:14.723303    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-7l54g"
Sep 08 07:05:14.927594 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:14.927572    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-m9vqp"]
Sep 08 07:05:14.929856 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:05:14.929832    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f7de5be_1aea_40af_ae8e_bcbeb6db29f2.slice/crio-ca447ffdbd47c869e1de138b3252398e3c66d32a363a62c10794c268f652305c WatchSource:0}: Error finding container ca447ffdbd47c869e1de138b3252398e3c66d32a363a62c10794c268f652305c: Status 404 returned error can't find the container with id ca447ffdbd47c869e1de138b3252398e3c66d32a363a62c10794c268f652305c
Sep 08 07:05:14.989690 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:14.989665    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-7l54g"]
Sep 08 07:05:14.993834 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:05:14.993805    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7416321a_6800_4360_9b3d_0434aff598ea.slice/crio-e3647394637ea6d8ee0a1d3249617875260635ddfdf2ce013f109e5323854d23 WatchSource:0}: Error finding container e3647394637ea6d8ee0a1d3249617875260635ddfdf2ce013f109e5323854d23: Status 404 returned error can't find the container with id e3647394637ea6d8ee0a1d3249617875260635ddfdf2ce013f109e5323854d23
Sep 08 07:05:15.809839 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:15.809809    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m9vqp" event={"ID":"2f7de5be-1aea-40af-ae8e-bcbeb6db29f2","Type":"ContainerStarted","Data":"d5ee5131c4e3ac2dae358323219008d8a8e64dd19e76f99b58da8b43d0e540f7"}
Sep 08 07:05:15.810233 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:15.809880    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m9vqp" event={"ID":"2f7de5be-1aea-40af-ae8e-bcbeb6db29f2","Type":"ContainerStarted","Data":"ca447ffdbd47c869e1de138b3252398e3c66d32a363a62c10794c268f652305c"}
Sep 08 07:05:15.810961 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:15.810938    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-7l54g" event={"ID":"7416321a-6800-4360-9b3d-0434aff598ea","Type":"ContainerStarted","Data":"e3647394637ea6d8ee0a1d3249617875260635ddfdf2ce013f109e5323854d23"}
Sep 08 07:05:16.815755 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:16.815714    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m9vqp" event={"ID":"2f7de5be-1aea-40af-ae8e-bcbeb6db29f2","Type":"ContainerStarted","Data":"257d5e8f0c6261bbe9b24916abeccd39a95e5ea980e2c8493e38005b06107825"}
Sep 08 07:05:16.817533 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:16.817499    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-7l54g" event={"ID":"7416321a-6800-4360-9b3d-0434aff598ea","Type":"ContainerStarted","Data":"f2a886f486cf1721e1f8c749d3505765b80ab5e80dfd5e42532475658247e1af"}
Sep 08 07:05:16.832322 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:16.832270    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-79977f9844-7l54g" podStartSLOduration=17.684056916 podStartE2EDuration="18.83225306s" totalImagesPullingTime="1.148196144s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:04:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:05:16.831482415 +0000 UTC m=+64.812521745" watchObservedRunningTime="2026-09-08 07:05:16.83225306 +0000 UTC m=+64.813292368"
Sep 08 07:05:17.503634 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:17.503602    2564 scope.go:117] "RemoveContainer" containerID="caa916f37c7a6ec8c632deda5926c6ea9780cb2fda4b038897198565db159ea9"
Sep 08 07:05:17.796703 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:17.796669    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/291459fa-c8c6-49c7-ace3-4c0f500d94b5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-glxch\" (UID: \"291459fa-c8c6-49c7-ace3-4c0f500d94b5\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-glxch"
Sep 08 07:05:17.796840 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:17.796797    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fd323369-8471-4515-b250-2bcdf068b64c-registry-tls\") pod \"image-registry-7bcc6fbcd6-66qdn\" (UID: \"fd323369-8471-4515-b250-2bcdf068b64c\") " pod="openshift-image-registry/image-registry-7bcc6fbcd6-66qdn"
Sep 08 07:05:17.799134 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:17.799108    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/291459fa-c8c6-49c7-ace3-4c0f500d94b5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-glxch\" (UID: \"291459fa-c8c6-49c7-ace3-4c0f500d94b5\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-glxch"
Sep 08 07:05:17.799233 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:17.799193    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fd323369-8471-4515-b250-2bcdf068b64c-registry-tls\") pod \"image-registry-7bcc6fbcd6-66qdn\" (UID: \"fd323369-8471-4515-b250-2bcdf068b64c\") " pod="openshift-image-registry/image-registry-7bcc6fbcd6-66qdn"
Sep 08 07:05:17.823181 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:17.823161    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-8d4lx_5cf68f79-8fda-42e2-92c1-05a5a601f505/console-operator/1.log"
Sep 08 07:05:17.823539 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:17.823241    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-8d4lx" event={"ID":"5cf68f79-8fda-42e2-92c1-05a5a601f505","Type":"ContainerStarted","Data":"3c851259262e5590818e2ceb1f769b75cc3696983ffedd7a7c86541adaf84809"}
Sep 08 07:05:17.823539 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:17.823470    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-8d4lx"
Sep 08 07:05:17.825528 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:17.825506    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m9vqp" event={"ID":"2f7de5be-1aea-40af-ae8e-bcbeb6db29f2","Type":"ContainerStarted","Data":"38547e829429301472869f3b59c6f031b15d7f3fb811dd4bf8803c19c3deda50"}
Sep 08 07:05:17.840076 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:17.840035    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-85b454874b-8d4lx" podStartSLOduration=43.857153863 podStartE2EDuration="53.840021022s" totalImagesPullingTime="9.982867159s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:04:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:05:17.839538674 +0000 UTC m=+65.820578002" watchObservedRunningTime="2026-09-08 07:05:17.840021022 +0000 UTC m=+65.821060328"
Sep 08 07:05:17.857025 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:17.856984    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-m9vqp" podStartSLOduration=17.598395206 podStartE2EDuration="19.856952838s" totalImagesPullingTime="2.258557632s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 07:04:58 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:05:17.855511463 +0000 UTC m=+65.836550792" watchObservedRunningTime="2026-09-08 07:05:17.856952838 +0000 UTC m=+65.837992144"
Sep 08 07:05:17.898536 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:17.898504    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b933ee39-2780-43cb-a34d-1fecfabcae2c-metrics-tls\") pod \"dns-default-vg6m8\" (UID: \"b933ee39-2780-43cb-a34d-1fecfabcae2c\") " pod="openshift-dns/dns-default-vg6m8"
Sep 08 07:05:17.898637 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:17.898596    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e5d6ef0-7b12-4602-a841-195b0c593f58-metrics-certs\") pod \"router-default-7cbf7f84b-54255\" (UID: \"7e5d6ef0-7b12-4602-a841-195b0c593f58\") " pod="openshift-ingress/router-default-7cbf7f84b-54255"
Sep 08 07:05:17.904295 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:17.899574    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8878f0f4-8057-42fc-9d02-1b336541b580-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-lwtc7\" (UID: \"8878f0f4-8057-42fc-9d02-1b336541b580\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-lwtc7"
Sep 08 07:05:17.904295 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:17.899797    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e5d6ef0-7b12-4602-a841-195b0c593f58-service-ca-bundle\") pod \"router-default-7cbf7f84b-54255\" (UID: \"7e5d6ef0-7b12-4602-a841-195b0c593f58\") " pod="openshift-ingress/router-default-7cbf7f84b-54255"
Sep 08 07:05:17.904295 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:17.901545    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e5d6ef0-7b12-4602-a841-195b0c593f58-metrics-certs\") pod \"router-default-7cbf7f84b-54255\" (UID: \"7e5d6ef0-7b12-4602-a841-195b0c593f58\") " pod="openshift-ingress/router-default-7cbf7f84b-54255"
Sep 08 07:05:17.905032 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:17.905006    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e5d6ef0-7b12-4602-a841-195b0c593f58-service-ca-bundle\") pod \"router-default-7cbf7f84b-54255\" (UID: \"7e5d6ef0-7b12-4602-a841-195b0c593f58\") " pod="openshift-ingress/router-default-7cbf7f84b-54255"
Sep 08 07:05:17.905489 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:17.905472    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8878f0f4-8057-42fc-9d02-1b336541b580-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-lwtc7\" (UID: \"8878f0f4-8057-42fc-9d02-1b336541b580\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-lwtc7"
Sep 08 07:05:17.905691 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:17.905674    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b933ee39-2780-43cb-a34d-1fecfabcae2c-metrics-tls\") pod \"dns-default-vg6m8\" (UID: \"b933ee39-2780-43cb-a34d-1fecfabcae2c\") " pod="openshift-dns/dns-default-vg6m8"
Sep 08 07:05:17.992410 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:17.992386    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-85b454874b-8d4lx"
Sep 08 07:05:18.018646 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:18.018446    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-cpwg8\""
Sep 08 07:05:18.027277 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:18.027244    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7bcc6fbcd6-66qdn"
Sep 08 07:05:18.029029 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:18.029009    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-z4h6c\""
Sep 08 07:05:18.038280 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:18.038265    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-glxch"
Sep 08 07:05:18.049951 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:18.049929    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-v8sxx\""
Sep 08 07:05:18.058201 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:18.058178    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7cbf7f84b-54255"
Sep 08 07:05:18.083446 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:18.082340    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-4mgtj\""
Sep 08 07:05:18.088803 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:18.088707    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-lwtc7"
Sep 08 07:05:18.128830 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:18.128719    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mmqzm\""
Sep 08 07:05:18.137251 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:18.137049    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vg6m8"
Sep 08 07:05:18.203172 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:18.202628    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb65d52f-d619-46f8-b86a-fc6261a24eb3-metrics-certs\") pod \"network-metrics-daemon-jhq6t\" (UID: \"fb65d52f-d619-46f8-b86a-fc6261a24eb3\") " pod="openshift-multus/network-metrics-daemon-jhq6t"
Sep 08 07:05:18.203172 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:18.202683    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ddb3084-72df-467e-9cb5-0cf05725de6f-original-pull-secret\") pod \"global-pull-secret-syncer-8lgmv\" (UID: \"5ddb3084-72df-467e-9cb5-0cf05725de6f\") " pod="kube-system/global-pull-secret-syncer-8lgmv"
Sep 08 07:05:18.205232 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:18.205052    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 08 07:05:18.205232 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:18.205055    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 08 07:05:18.215824 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:18.215799    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb65d52f-d619-46f8-b86a-fc6261a24eb3-metrics-certs\") pod \"network-metrics-daemon-jhq6t\" (UID: \"fb65d52f-d619-46f8-b86a-fc6261a24eb3\") " pod="openshift-multus/network-metrics-daemon-jhq6t"
Sep 08 07:05:18.216051 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:18.216033    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ddb3084-72df-467e-9cb5-0cf05725de6f-original-pull-secret\") pod \"global-pull-secret-syncer-8lgmv\" (UID: \"5ddb3084-72df-467e-9cb5-0cf05725de6f\") " pod="kube-system/global-pull-secret-syncer-8lgmv"
Sep 08 07:05:18.310144 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:18.310057    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7bcc6fbcd6-66qdn"]
Sep 08 07:05:18.313658 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:05:18.313629    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd323369_8471_4515_b250_2bcdf068b64c.slice/crio-4f0d04bbf42bdd5d91bc4c42c5f5b40f8a5b7f1a4786653d892e36dc85fa7297 WatchSource:0}: Error finding container 4f0d04bbf42bdd5d91bc4c42c5f5b40f8a5b7f1a4786653d892e36dc85fa7297: Status 404 returned error can't find the container with id 4f0d04bbf42bdd5d91bc4c42c5f5b40f8a5b7f1a4786653d892e36dc85fa7297
Sep 08 07:05:18.317872 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:18.317854    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ldq7w\""
Sep 08 07:05:18.327308 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:18.327291    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jhq6t"
Sep 08 07:05:18.329203 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:18.329166    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8lgmv"
Sep 08 07:05:18.329796 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:18.329777    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-glxch"]
Sep 08 07:05:18.333208 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:05:18.333187    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod291459fa_c8c6_49c7_ace3_4c0f500d94b5.slice/crio-5bb49e70abca4ceecb65beb83e2a092a158a1eee09673bdef9864b453d17f38a WatchSource:0}: Error finding container 5bb49e70abca4ceecb65beb83e2a092a158a1eee09673bdef9864b453d17f38a: Status 404 returned error can't find the container with id 5bb49e70abca4ceecb65beb83e2a092a158a1eee09673bdef9864b453d17f38a
Sep 08 07:05:18.352339 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:18.352316    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7cbf7f84b-54255"]
Sep 08 07:05:18.355606 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:05:18.355579    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e5d6ef0_7b12_4602_a841_195b0c593f58.slice/crio-ce46b1554c5a2ed418b8f54f94da5e9082584d8f4092baa7324363b7cb6469ba WatchSource:0}: Error finding container ce46b1554c5a2ed418b8f54f94da5e9082584d8f4092baa7324363b7cb6469ba: Status 404 returned error can't find the container with id ce46b1554c5a2ed418b8f54f94da5e9082584d8f4092baa7324363b7cb6469ba
Sep 08 07:05:18.400039 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:18.399945    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-lwtc7"]
Sep 08 07:05:18.428447 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:18.428419    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vg6m8"]
Sep 08 07:05:18.430802 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:05:18.430769    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb933ee39_2780_43cb_a34d_1fecfabcae2c.slice/crio-9806a70bd18759ecef90045a4e4ab30c172d394ee45d9354e1783f76574570c8 WatchSource:0}: Error finding container 9806a70bd18759ecef90045a4e4ab30c172d394ee45d9354e1783f76574570c8: Status 404 returned error can't find the container with id 9806a70bd18759ecef90045a4e4ab30c172d394ee45d9354e1783f76574570c8
Sep 08 07:05:18.612694 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:18.612619    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8lgmv"]
Sep 08 07:05:18.615188 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:18.615167    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jhq6t"]
Sep 08 07:05:18.616103 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:05:18.616077    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ddb3084_72df_467e_9cb5_0cf05725de6f.slice/crio-a2010994c84dee6007e2d0074e11bdb3b3753e6056ba007b28882b8b64eb26bc WatchSource:0}: Error finding container a2010994c84dee6007e2d0074e11bdb3b3753e6056ba007b28882b8b64eb26bc: Status 404 returned error can't find the container with id a2010994c84dee6007e2d0074e11bdb3b3753e6056ba007b28882b8b64eb26bc
Sep 08 07:05:18.618457 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:05:18.618432    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb65d52f_d619_46f8_b86a_fc6261a24eb3.slice/crio-d27b3bd4f6fb481621975f234206723e173356e4639c50b26f0767459db5f12f WatchSource:0}: Error finding container d27b3bd4f6fb481621975f234206723e173356e4639c50b26f0767459db5f12f: Status 404 returned error can't find the container with id d27b3bd4f6fb481621975f234206723e173356e4639c50b26f0767459db5f12f
Sep 08 07:05:18.831053 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:18.831013    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jhq6t" event={"ID":"fb65d52f-d619-46f8-b86a-fc6261a24eb3","Type":"ContainerStarted","Data":"d27b3bd4f6fb481621975f234206723e173356e4639c50b26f0767459db5f12f"}
Sep 08 07:05:18.832648 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:18.832618    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8lgmv" event={"ID":"5ddb3084-72df-467e-9cb5-0cf05725de6f","Type":"ContainerStarted","Data":"a2010994c84dee6007e2d0074e11bdb3b3753e6056ba007b28882b8b64eb26bc"}
Sep 08 07:05:18.834021 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:18.833992    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-lwtc7" event={"ID":"8878f0f4-8057-42fc-9d02-1b336541b580","Type":"ContainerStarted","Data":"f31c5dca83b426654135fbfbd9a67da933a0faa17d5b4c785699aa03a0830c18"}
Sep 08 07:05:18.835269 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:18.835240    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vg6m8" event={"ID":"b933ee39-2780-43cb-a34d-1fecfabcae2c","Type":"ContainerStarted","Data":"9806a70bd18759ecef90045a4e4ab30c172d394ee45d9354e1783f76574570c8"}
Sep 08 07:05:18.836579 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:18.836553    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-glxch" event={"ID":"291459fa-c8c6-49c7-ace3-4c0f500d94b5","Type":"ContainerStarted","Data":"5bb49e70abca4ceecb65beb83e2a092a158a1eee09673bdef9864b453d17f38a"}
Sep 08 07:05:18.838326 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:18.838297    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7cbf7f84b-54255" event={"ID":"7e5d6ef0-7b12-4602-a841-195b0c593f58","Type":"ContainerStarted","Data":"beeb815b2f0027b72f83e70b95d223b511adbd0989e3ce599e07a47e2da3338d"}
Sep 08 07:05:18.838428 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:18.838339    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7cbf7f84b-54255" event={"ID":"7e5d6ef0-7b12-4602-a841-195b0c593f58","Type":"ContainerStarted","Data":"ce46b1554c5a2ed418b8f54f94da5e9082584d8f4092baa7324363b7cb6469ba"}
Sep 08 07:05:18.840196 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:18.840171    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7bcc6fbcd6-66qdn" event={"ID":"fd323369-8471-4515-b250-2bcdf068b64c","Type":"ContainerStarted","Data":"b51d9e1465f6d326f200f0defb867680b1da59518698296f024de9873ff2966b"}
Sep 08 07:05:18.840298 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:18.840212    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7bcc6fbcd6-66qdn" event={"ID":"fd323369-8471-4515-b250-2bcdf068b64c","Type":"ContainerStarted","Data":"4f0d04bbf42bdd5d91bc4c42c5f5b40f8a5b7f1a4786653d892e36dc85fa7297"}
Sep 08 07:05:18.856467 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:18.856418    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7cbf7f84b-54255" podStartSLOduration=60.856404983 podStartE2EDuration="1m0.856404983s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:04:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:05:18.855596146 +0000 UTC m=+66.836635472" watchObservedRunningTime="2026-09-08 07:05:18.856404983 +0000 UTC m=+66.837444289"
Sep 08 07:05:18.877757 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:18.877672    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7bcc6fbcd6-66qdn" podStartSLOduration=65.877656547 podStartE2EDuration="1m5.877656547s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:04:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:05:18.875799284 +0000 UTC m=+66.856838615" watchObservedRunningTime="2026-09-08 07:05:18.877656547 +0000 UTC m=+66.858695844"
Sep 08 07:05:19.058783 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:19.058701    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7cbf7f84b-54255"
Sep 08 07:05:19.061919 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:19.061705    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7cbf7f84b-54255"
Sep 08 07:05:19.845923 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:19.845775    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7bcc6fbcd6-66qdn"
Sep 08 07:05:19.846486 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:19.846437    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7cbf7f84b-54255"
Sep 08 07:05:19.847933 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:19.847737    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7cbf7f84b-54255"
Sep 08 07:05:20.172077 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:20.170668    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-fd649d778-jz5nh"]
Sep 08 07:05:20.175412 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:20.175383    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-766c778757-zwqss"]
Sep 08 07:05:20.176910 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:20.176032    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-fd649d778-jz5nh"
Sep 08 07:05:20.179055 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:20.178425    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 08 07:05:20.179055 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:20.178599    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Sep 08 07:05:20.179055 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:20.178743    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-nbjmz\""
Sep 08 07:05:20.179055 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:20.178853    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 08 07:05:20.179055 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:20.178936    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 08 07:05:20.179352 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:20.179144    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5466bd85b6-xgdwv"]
Sep 08 07:05:20.180260 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:20.180018    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-766c778757-zwqss"
Sep 08 07:05:20.183682 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:20.183617    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Sep 08 07:05:20.183852 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:20.183831    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5466bd85b6-xgdwv"
Sep 08 07:05:20.195482 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:20.193925    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 08 07:05:20.195482 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:20.194001    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 08 07:05:20.195482 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:20.194640    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 08 07:05:20.195482 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:20.194909    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 08 07:05:20.201624 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:20.200934    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-fd649d778-jz5nh"]
Sep 08 07:05:20.202940 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:20.202915    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-766c778757-zwqss"]
Sep 08 07:05:20.204570 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:20.204071    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5466bd85b6-xgdwv"]
Sep 08 07:05:20.270700 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:20.270657    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-85d98c998f-drsvw"]
Sep 08 07:05:20.274182 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:20.274157    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-drsvw"
Sep 08 07:05:20.276816 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:20.276791    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-9t45v\""
Sep 08 07:05:20.276816 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:20.276808    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 08 07:05:20.277037 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:20.277000    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 08 07:05:20.283620 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:20.283599    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-drsvw"]
Sep 08 07:05:20.321698 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:20.321659    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f44fea9a-c035-47e6-a0f4-e8cdba1f911a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5466bd85b6-xgdwv\" (UID: \"f44fea9a-c035-47e6-a0f4-e8cdba1f911a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5466bd85b6-xgdwv"
Sep 08 07:05:20.321866 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:20.321731    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/0e58ecbb-f2dc-4938-b034-2f70cb119dc9-klusterlet-config\") pod \"klusterlet-addon-workmgr-766c778757-zwqss\" (UID: \"0e58ecbb-f2dc-4938-b034-2f70cb119dc9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-766c778757-zwqss"
Sep 08 07:05:20.321866 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:20.321781    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f44fea9a-c035-47e6-a0f4-e8cdba1f911a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5466bd85b6-xgdwv\" (UID: \"f44fea9a-c035-47e6-a0f4-e8cdba1f911a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5466bd85b6-xgdwv"
Sep 08 07:05:20.321866 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:20.321815    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f44fea9a-c035-47e6-a0f4-e8cdba1f911a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5466bd85b6-xgdwv\" (UID: \"f44fea9a-c035-47e6-a0f4-e8cdba1f911a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5466bd85b6-xgdwv"
Sep 08 07:05:20.322068 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:20.321864    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0e58ecbb-f2dc-4938-b034-2f70cb119dc9-tmp\") pod \"klusterlet-addon-workmgr-766c778757-zwqss\" (UID: \"0e58ecbb-f2dc-4938-b034-2f70cb119dc9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-766c778757-zwqss"
Sep 08 07:05:20.322068 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:20.321894    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vqbt\" (UniqueName: \"kubernetes.io/projected/f44fea9a-c035-47e6-a0f4-e8cdba1f911a-kube-api-access-9vqbt\") pod \"cluster-proxy-proxy-agent-5466bd85b6-xgdwv\" (UID: \"f44fea9a-c035-47e6-a0f4-e8cdba1f911a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5466bd85b6-xgdwv"
Sep 08 07:05:20.322068 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:20.321917    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tk4zs\" (UniqueName: \"kubernetes.io/projected/0e58ecbb-f2dc-4938-b034-2f70cb119dc9-kube-api-access-tk4zs\") pod \"klusterlet-addon-workmgr-766c778757-zwqss\" (UID: \"0e58ecbb-f2dc-4938-b034-2f70cb119dc9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-766c778757-zwqss"
Sep 08 07:05:20.322068 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:20.322040    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f44fea9a-c035-47e6-a0f4-e8cdba1f911a-hub\") pod \"cluster-proxy-proxy-agent-5466bd85b6-xgdwv\" (UID: \"f44fea9a-c035-47e6-a0f4-e8cdba1f911a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5466bd85b6-xgdwv"
Sep 08 07:05:20.322262 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:20.322104    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ff0cbc5d-dbda-4480-99c0-c34bbd58d3ca-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-fd649d778-jz5nh\" (UID: \"ff0cbc5d-dbda-4480-99c0-c34bbd58d3ca\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-fd649d778-jz5nh"
Sep 08 07:05:20.322262 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:20.322139    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f44fea9a-c035-47e6-a0f4-e8cdba1f911a-ca\") pod \"cluster-proxy-proxy-agent-5466bd85b6-xgdwv\" (UID: \"f44fea9a-c035-47e6-a0f4-e8cdba1f911a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5466bd85b6-xgdwv"
Sep 08 07:05:20.322262 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:20.322193    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-td97x\" (UniqueName: \"kubernetes.io/projected/ff0cbc5d-dbda-4480-99c0-c34bbd58d3ca-kube-api-access-td97x\") pod \"managed-serviceaccount-addon-agent-fd649d778-jz5nh\" (UID: \"ff0cbc5d-dbda-4480-99c0-c34bbd58d3ca\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-fd649d778-jz5nh"
Sep 08 07:05:20.423427 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:20.423345    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzxqq\" (UniqueName: \"kubernetes.io/projected/cfe945ce-eef8-4eb9-8d5e-601b45b39514-kube-api-access-qzxqq\") pod \"downloads-85d98c998f-drsvw\" (UID: \"cfe945ce-eef8-4eb9-8d5e-601b45b39514\") " pod="openshift-console/downloads-85d98c998f-drsvw"
Sep 08 07:05:20.423427 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:20.423405    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f44fea9a-c035-47e6-a0f4-e8cdba1f911a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5466bd85b6-xgdwv\" (UID: \"f44fea9a-c035-47e6-a0f4-e8cdba1f911a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5466bd85b6-xgdwv"
Sep 08 07:05:20.424617 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:20.423434    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/0e58ecbb-f2dc-4938-b034-2f70cb119dc9-klusterlet-config\") pod \"klusterlet-addon-workmgr-766c778757-zwqss\" (UID: \"0e58ecbb-f2dc-4938-b034-2f70cb119dc9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-766c778757-zwqss"
Sep 08 07:05:20.424617 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:20.423452    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f44fea9a-c035-47e6-a0f4-e8cdba1f911a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5466bd85b6-xgdwv\" (UID: \"f44fea9a-c035-47e6-a0f4-e8cdba1f911a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5466bd85b6-xgdwv"
Sep 08 07:05:20.424617 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:20.423477    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f44fea9a-c035-47e6-a0f4-e8cdba1f911a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5466bd85b6-xgdwv\" (UID: \"f44fea9a-c035-47e6-a0f4-e8cdba1f911a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5466bd85b6-xgdwv"
Sep 08 07:05:20.424617 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:20.423512    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0e58ecbb-f2dc-4938-b034-2f70cb119dc9-tmp\") pod \"klusterlet-addon-workmgr-766c778757-zwqss\" (UID: \"0e58ecbb-f2dc-4938-b034-2f70cb119dc9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-766c778757-zwqss"
Sep 08 07:05:20.424617 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:20.423546    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vqbt\" (UniqueName: \"kubernetes.io/projected/f44fea9a-c035-47e6-a0f4-e8cdba1f911a-kube-api-access-9vqbt\") pod \"cluster-proxy-proxy-agent-5466bd85b6-xgdwv\" (UID: \"f44fea9a-c035-47e6-a0f4-e8cdba1f911a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5466bd85b6-xgdwv"
Sep 08 07:05:20.424617 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:20.423573    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tk4zs\" (UniqueName: \"kubernetes.io/projected/0e58ecbb-f2dc-4938-b034-2f70cb119dc9-kube-api-access-tk4zs\") pod \"klusterlet-addon-workmgr-766c778757-zwqss\" (UID: \"0e58ecbb-f2dc-4938-b034-2f70cb119dc9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-766c778757-zwqss"
Sep 08 07:05:20.424617 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:20.423602    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f44fea9a-c035-47e6-a0f4-e8cdba1f911a-hub\") pod \"cluster-proxy-proxy-agent-5466bd85b6-xgdwv\" (UID: \"f44fea9a-c035-47e6-a0f4-e8cdba1f911a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5466bd85b6-xgdwv"
Sep 08 07:05:20.424617 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:20.423991    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0e58ecbb-f2dc-4938-b034-2f70cb119dc9-tmp\") pod \"klusterlet-addon-workmgr-766c778757-zwqss\" (UID: \"0e58ecbb-f2dc-4938-b034-2f70cb119dc9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-766c778757-zwqss"
Sep 08 07:05:20.424617 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:20.424007    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ff0cbc5d-dbda-4480-99c0-c34bbd58d3ca-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-fd649d778-jz5nh\" (UID: \"ff0cbc5d-dbda-4480-99c0-c34bbd58d3ca\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-fd649d778-jz5nh"
Sep 08 07:05:20.424617 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:20.424217    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f44fea9a-c035-47e6-a0f4-e8cdba1f911a-ca\") pod \"cluster-proxy-proxy-agent-5466bd85b6-xgdwv\" (UID: \"f44fea9a-c035-47e6-a0f4-e8cdba1f911a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5466bd85b6-xgdwv"
Sep 08 07:05:20.424617 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:20.424298    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-td97x\" (UniqueName: \"kubernetes.io/projected/ff0cbc5d-dbda-4480-99c0-c34bbd58d3ca-kube-api-access-td97x\") pod \"managed-serviceaccount-addon-agent-fd649d778-jz5nh\" (UID: \"ff0cbc5d-dbda-4480-99c0-c34bbd58d3ca\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-fd649d778-jz5nh"
Sep 08 07:05:20.424617 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:20.424312    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f44fea9a-c035-47e6-a0f4-e8cdba1f911a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5466bd85b6-xgdwv\" (UID: \"f44fea9a-c035-47e6-a0f4-e8cdba1f911a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5466bd85b6-xgdwv"
Sep 08 07:05:20.427102 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:20.427059    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/0e58ecbb-f2dc-4938-b034-2f70cb119dc9-klusterlet-config\") pod \"klusterlet-addon-workmgr-766c778757-zwqss\" (UID: \"0e58ecbb-f2dc-4938-b034-2f70cb119dc9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-766c778757-zwqss"
Sep 08 07:05:20.427102 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:20.427081    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ff0cbc5d-dbda-4480-99c0-c34bbd58d3ca-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-fd649d778-jz5nh\" (UID: \"ff0cbc5d-dbda-4480-99c0-c34bbd58d3ca\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-fd649d778-jz5nh"
Sep 08 07:05:20.427651 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:20.427609    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f44fea9a-c035-47e6-a0f4-e8cdba1f911a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5466bd85b6-xgdwv\" (UID: \"f44fea9a-c035-47e6-a0f4-e8cdba1f911a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5466bd85b6-xgdwv"
Sep 08 07:05:20.428005 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:20.427957    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f44fea9a-c035-47e6-a0f4-e8cdba1f911a-ca\") pod \"cluster-proxy-proxy-agent-5466bd85b6-xgdwv\" (UID: \"f44fea9a-c035-47e6-a0f4-e8cdba1f911a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5466bd85b6-xgdwv"
Sep 08 07:05:20.428005 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:20.427960    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f44fea9a-c035-47e6-a0f4-e8cdba1f911a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5466bd85b6-xgdwv\" (UID: \"f44fea9a-c035-47e6-a0f4-e8cdba1f911a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5466bd85b6-xgdwv"
Sep 08 07:05:20.428497 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:20.428465    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f44fea9a-c035-47e6-a0f4-e8cdba1f911a-hub\") pod \"cluster-proxy-proxy-agent-5466bd85b6-xgdwv\" (UID: \"f44fea9a-c035-47e6-a0f4-e8cdba1f911a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5466bd85b6-xgdwv"
Sep 08 07:05:20.439934 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:20.439891    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-td97x\" (UniqueName: \"kubernetes.io/projected/ff0cbc5d-dbda-4480-99c0-c34bbd58d3ca-kube-api-access-td97x\") pod \"managed-serviceaccount-addon-agent-fd649d778-jz5nh\" (UID: \"ff0cbc5d-dbda-4480-99c0-c34bbd58d3ca\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-fd649d778-jz5nh"
Sep 08 07:05:20.440742 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:20.440719    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vqbt\" (UniqueName: \"kubernetes.io/projected/f44fea9a-c035-47e6-a0f4-e8cdba1f911a-kube-api-access-9vqbt\") pod \"cluster-proxy-proxy-agent-5466bd85b6-xgdwv\" (UID: \"f44fea9a-c035-47e6-a0f4-e8cdba1f911a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5466bd85b6-xgdwv"
Sep 08 07:05:20.441326 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:20.441283    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tk4zs\" (UniqueName: \"kubernetes.io/projected/0e58ecbb-f2dc-4938-b034-2f70cb119dc9-kube-api-access-tk4zs\") pod \"klusterlet-addon-workmgr-766c778757-zwqss\" (UID: \"0e58ecbb-f2dc-4938-b034-2f70cb119dc9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-766c778757-zwqss"
Sep 08 07:05:20.507782 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:20.507691    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-fd649d778-jz5nh"
Sep 08 07:05:20.518414 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:20.518348    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-766c778757-zwqss"
Sep 08 07:05:20.524888 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:20.524687    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzxqq\" (UniqueName: \"kubernetes.io/projected/cfe945ce-eef8-4eb9-8d5e-601b45b39514-kube-api-access-qzxqq\") pod \"downloads-85d98c998f-drsvw\" (UID: \"cfe945ce-eef8-4eb9-8d5e-601b45b39514\") " pod="openshift-console/downloads-85d98c998f-drsvw"
Sep 08 07:05:20.527996 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:20.527910    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5466bd85b6-xgdwv"
Sep 08 07:05:20.533020 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:20.532963    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzxqq\" (UniqueName: \"kubernetes.io/projected/cfe945ce-eef8-4eb9-8d5e-601b45b39514-kube-api-access-qzxqq\") pod \"downloads-85d98c998f-drsvw\" (UID: \"cfe945ce-eef8-4eb9-8d5e-601b45b39514\") " pod="openshift-console/downloads-85d98c998f-drsvw"
Sep 08 07:05:20.593460 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:20.593425    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-drsvw"
Sep 08 07:05:24.376717 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:24.376648    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-fd649d778-jz5nh"]
Sep 08 07:05:24.378674 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:24.378646    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-766c778757-zwqss"]
Sep 08 07:05:24.383609 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:05:24.383576    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e58ecbb_f2dc_4938_b034_2f70cb119dc9.slice/crio-3e29847124c523a4da9684e096f90492908d9bed3b65bb5d2c4314e838e989eb WatchSource:0}: Error finding container 3e29847124c523a4da9684e096f90492908d9bed3b65bb5d2c4314e838e989eb: Status 404 returned error can't find the container with id 3e29847124c523a4da9684e096f90492908d9bed3b65bb5d2c4314e838e989eb
Sep 08 07:05:24.386046 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:24.386018    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5466bd85b6-xgdwv"]
Sep 08 07:05:24.387623 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:24.387545    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-drsvw"]
Sep 08 07:05:24.767556 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:24.767524    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-v46z6"]
Sep 08 07:05:24.785247 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:24.785223    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-v46z6"]
Sep 08 07:05:24.785388 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:24.785326    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-v46z6"
Sep 08 07:05:24.787289 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:24.787270    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 08 07:05:24.787408 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:24.787313    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-gjrwx\""
Sep 08 07:05:24.863013 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:24.862956    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a941ceab-0941-4da6-9674-43f74522535f-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-v46z6\" (UID: \"a941ceab-0941-4da6-9674-43f74522535f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-v46z6"
Sep 08 07:05:24.865934 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:24.865875    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5466bd85b6-xgdwv" event={"ID":"f44fea9a-c035-47e6-a0f4-e8cdba1f911a","Type":"ContainerStarted","Data":"6d9bc76d381039ca440534289dc2fe6614d6343037357a82db510d726dfc66a1"}
Sep 08 07:05:24.868210 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:24.868186    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vg6m8" event={"ID":"b933ee39-2780-43cb-a34d-1fecfabcae2c","Type":"ContainerStarted","Data":"42d821c59fd65f94d784a5c3a48f53cb31d7050733ac455e898607a03bec7f8a"}
Sep 08 07:05:24.868345 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:24.868249    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vg6m8" event={"ID":"b933ee39-2780-43cb-a34d-1fecfabcae2c","Type":"ContainerStarted","Data":"ec9055bae4947ffe4252b60481a231013161b1c957bd3e128d63cf23ca06c90e"}
Sep 08 07:05:24.868345 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:24.868318    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-vg6m8"
Sep 08 07:05:24.869658 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:24.869631    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-766c778757-zwqss" event={"ID":"0e58ecbb-f2dc-4938-b034-2f70cb119dc9","Type":"ContainerStarted","Data":"3e29847124c523a4da9684e096f90492908d9bed3b65bb5d2c4314e838e989eb"}
Sep 08 07:05:24.871640 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:24.871597    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-glxch" event={"ID":"291459fa-c8c6-49c7-ace3-4c0f500d94b5","Type":"ContainerStarted","Data":"33759fcef72a06251f31d418601a09b47338aa14910b8f03e1e8717d71afb738"}
Sep 08 07:05:24.874031 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:24.874008    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jhq6t" event={"ID":"fb65d52f-d619-46f8-b86a-fc6261a24eb3","Type":"ContainerStarted","Data":"67b9b664952dc5d22de52eb023c5a693fed1b3e29d4ea19269d9016501173bb2"}
Sep 08 07:05:24.874122 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:24.874061    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jhq6t" event={"ID":"fb65d52f-d619-46f8-b86a-fc6261a24eb3","Type":"ContainerStarted","Data":"b7916d5a63be171a9688b6612bab987d054631fc1840274772c08987dd66ccfe"}
Sep 08 07:05:24.876543 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:24.876511    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8lgmv" event={"ID":"5ddb3084-72df-467e-9cb5-0cf05725de6f","Type":"ContainerStarted","Data":"55aa017d34fac0884760e231c13dace2296305ea6ba4ea69b9df13b3dc73bbc2"}
Sep 08 07:05:24.879085 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:24.878712    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-lwtc7" event={"ID":"8878f0f4-8057-42fc-9d02-1b336541b580","Type":"ContainerStarted","Data":"3d9ec69e4e9cacef0b60f3764dfde86fc8c869e45525227aa66c1c969c1bdf49"}
Sep 08 07:05:24.879085 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:24.878761    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-lwtc7" event={"ID":"8878f0f4-8057-42fc-9d02-1b336541b580","Type":"ContainerStarted","Data":"3509000c682c3b1c02c4defdfab1fa029b937f1e646006ebc7628346f36798db"}
Sep 08 07:05:24.880531 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:24.880509    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-drsvw" event={"ID":"cfe945ce-eef8-4eb9-8d5e-601b45b39514","Type":"ContainerStarted","Data":"689564c307b1d2bb11e0e1366cc520fa82d85115095fd536751e7da51fad9fbe"}
Sep 08 07:05:24.881820 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:24.881798    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-fd649d778-jz5nh" event={"ID":"ff0cbc5d-dbda-4480-99c0-c34bbd58d3ca","Type":"ContainerStarted","Data":"2bb0e642b299ea89fb40a84df2f4f2059b3f367d3e494cdc02d1b78f7e2c46b6"}
Sep 08 07:05:24.885534 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:24.885489    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-vg6m8" podStartSLOduration=34.229966191 podStartE2EDuration="39.885472709s" totalImagesPullingTime="5.655506518s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:04:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:05:24.883535098 +0000 UTC m=+72.864574405" watchObservedRunningTime="2026-09-08 07:05:24.885472709 +0000 UTC m=+72.866512014"
Sep 08 07:05:24.897698 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:24.897645    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-8lgmv" podStartSLOduration=67.411753851 podStartE2EDuration="1m12.897628533s" totalImagesPullingTime="5.485874682s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 07:04:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:05:24.89686392 +0000 UTC m=+72.877903229" watchObservedRunningTime="2026-09-08 07:05:24.897628533 +0000 UTC m=+72.878667841"
Sep 08 07:05:24.912130 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:24.912083    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-lwtc7" podStartSLOduration=56.320307044 podStartE2EDuration="1m1.912065952s" totalImagesPullingTime="5.591758908s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:04:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:05:24.910498025 +0000 UTC m=+72.891537370" watchObservedRunningTime="2026-09-08 07:05:24.912065952 +0000 UTC m=+72.893105261"
Sep 08 07:05:24.924851 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:24.924809    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-glxch" podStartSLOduration=61.177502597 podStartE2EDuration="1m6.924792212s" totalImagesPullingTime="5.747289615s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:04:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:05:24.924137296 +0000 UTC m=+72.905176624" watchObservedRunningTime="2026-09-08 07:05:24.924792212 +0000 UTC m=+72.905831510"
Sep 08 07:05:24.938035 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:24.937958    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-jhq6t" podStartSLOduration=67.474951235 podStartE2EDuration="1m12.937942448s" totalImagesPullingTime="5.462991213s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:04:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:05:24.937652227 +0000 UTC m=+72.918691568" watchObservedRunningTime="2026-09-08 07:05:24.937942448 +0000 UTC m=+72.918981754"
Sep 08 07:05:24.964283 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:24.964101    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a941ceab-0941-4da6-9674-43f74522535f-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-v46z6\" (UID: \"a941ceab-0941-4da6-9674-43f74522535f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-v46z6"
Sep 08 07:05:24.964283 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:05:24.964238    2564 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Sep 08 07:05:24.965231 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:05:24.965213    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a941ceab-0941-4da6-9674-43f74522535f-tls-certificates podName:a941ceab-0941-4da6-9674-43f74522535f nodeName:}" failed. No retries permitted until 2026-09-08 07:05:25.465192283 +0000 UTC m=+73.446231583 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/a941ceab-0941-4da6-9674-43f74522535f-tls-certificates") pod "prometheus-operator-admission-webhook-78f599db79-v46z6" (UID: "a941ceab-0941-4da6-9674-43f74522535f") : secret "prometheus-operator-admission-webhook-tls" not found
Sep 08 07:05:25.471062 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:25.471020    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a941ceab-0941-4da6-9674-43f74522535f-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-v46z6\" (UID: \"a941ceab-0941-4da6-9674-43f74522535f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-v46z6"
Sep 08 07:05:25.489157 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:25.489088    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a941ceab-0941-4da6-9674-43f74522535f-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-v46z6\" (UID: \"a941ceab-0941-4da6-9674-43f74522535f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-v46z6"
Sep 08 07:05:25.695665 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:25.695599    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-v46z6"
Sep 08 07:05:26.037817 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:26.036485    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-v46z6"]
Sep 08 07:05:26.050188 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:05:26.050147    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda941ceab_0941_4da6_9674_43f74522535f.slice/crio-86623f6ae5c55ef43160c347929643074aee683a0f6943dd688711e0adb457d5 WatchSource:0}: Error finding container 86623f6ae5c55ef43160c347929643074aee683a0f6943dd688711e0adb457d5: Status 404 returned error can't find the container with id 86623f6ae5c55ef43160c347929643074aee683a0f6943dd688711e0adb457d5
Sep 08 07:05:26.910307 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:26.910225    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-v46z6" event={"ID":"a941ceab-0941-4da6-9674-43f74522535f","Type":"ContainerStarted","Data":"86623f6ae5c55ef43160c347929643074aee683a0f6943dd688711e0adb457d5"}
Sep 08 07:05:28.746340 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:28.746306    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-bf6vx"
Sep 08 07:05:32.952286 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:32.952186    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-v46z6" event={"ID":"a941ceab-0941-4da6-9674-43f74522535f","Type":"ContainerStarted","Data":"edf0f51fef94cb5c117c3bc82c6a94ba9d25eab513d8a2ae023ad91ab906abe0"}
Sep 08 07:05:32.952697 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:32.952418    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-v46z6"
Sep 08 07:05:32.953627 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:32.953594    2564 patch_prober.go:28] interesting pod/prometheus-operator-admission-webhook-78f599db79-v46z6 container/prometheus-operator-admission-webhook namespace/openshift-monitoring: Readiness probe status=failure output="Get \"https://10.132.0.26:8443/healthz\": dial tcp 10.132.0.26:8443: connect: connection refused" start-of-body=
Sep 08 07:05:32.953724 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:32.953654    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-v46z6" podUID="a941ceab-0941-4da6-9674-43f74522535f" containerName="prometheus-operator-admission-webhook" probeResult="failure" output="Get \"https://10.132.0.26:8443/healthz\": dial tcp 10.132.0.26:8443: connect: connection refused"
Sep 08 07:05:32.958509 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:32.958083    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-fd649d778-jz5nh" event={"ID":"ff0cbc5d-dbda-4480-99c0-c34bbd58d3ca","Type":"ContainerStarted","Data":"0c91c9f2116a5a4961ad139a51df7c4cbb86691834e64423b9e38a4e0924c619"}
Sep 08 07:05:32.960837 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:32.960811    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5466bd85b6-xgdwv" event={"ID":"f44fea9a-c035-47e6-a0f4-e8cdba1f911a","Type":"ContainerStarted","Data":"77c5378efc00780f038efcaf1a9534d05bc52aa2aa9a880529f3324c4e5e37fe"}
Sep 08 07:05:32.963392 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:32.963367    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-766c778757-zwqss" event={"ID":"0e58ecbb-f2dc-4938-b034-2f70cb119dc9","Type":"ContainerStarted","Data":"ee122d1437f091f3bdd36e77325ed03f4bb33b6b29b09720ebb52fd1ccd3444f"}
Sep 08 07:05:32.963603 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:32.963579    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-766c778757-zwqss"
Sep 08 07:05:32.964576 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:32.964545    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-766c778757-zwqss" podUID="0e58ecbb-f2dc-4938-b034-2f70cb119dc9" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.23:8000/readyz\": dial tcp 10.132.0.23:8000: connect: connection refused"
Sep 08 07:05:32.969636 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:32.969166    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-v46z6" podStartSLOduration=2.230090903 podStartE2EDuration="8.969152856s" totalImagesPullingTime="6.739061953s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:05:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:05:32.967396257 +0000 UTC m=+80.948435590" watchObservedRunningTime="2026-09-08 07:05:32.969152856 +0000 UTC m=+80.950192162"
Sep 08 07:05:32.983791 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:32.983748    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-766c778757-zwqss" podStartSLOduration=4.582542753 podStartE2EDuration="12.983733331s" totalImagesPullingTime="8.401190578s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:05:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:05:32.982287215 +0000 UTC m=+80.963326550" watchObservedRunningTime="2026-09-08 07:05:32.983733331 +0000 UTC m=+80.964772627"
Sep 08 07:05:33.000938 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:33.000858    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-fd649d778-jz5nh" podStartSLOduration=4.6092645260000005 podStartE2EDuration="13.000844138s" totalImagesPullingTime="8.391579612s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:05:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:05:32.998749581 +0000 UTC m=+80.979788888" watchObservedRunningTime="2026-09-08 07:05:33.000844138 +0000 UTC m=+80.981883444"
Sep 08 07:05:33.970528 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:33.970477    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5466bd85b6-xgdwv" event={"ID":"f44fea9a-c035-47e6-a0f4-e8cdba1f911a","Type":"ContainerStarted","Data":"204dcdc12a347affa6957caf3b6adce3259981f2e6c551541ff22ff13f8e4d1b"}
Sep 08 07:05:33.970927 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:33.970545    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5466bd85b6-xgdwv" event={"ID":"f44fea9a-c035-47e6-a0f4-e8cdba1f911a","Type":"ContainerStarted","Data":"7f5dc0a8689fe2e6ca7f45832200b027d9d4f645b2ef4219470192f3fa3d7adc"}
Sep 08 07:05:33.971816 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:33.971788    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-766c778757-zwqss"
Sep 08 07:05:33.975079 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:33.975056    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-v46z6"
Sep 08 07:05:33.989060 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:33.989011    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5466bd85b6-xgdwv" podStartSLOduration=5.590622661 podStartE2EDuration="13.988998113s" totalImagesPullingTime="8.398375452s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:05:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:05:33.987877776 +0000 UTC m=+81.968917095" watchObservedRunningTime="2026-09-08 07:05:33.988998113 +0000 UTC m=+81.970037464"
Sep 08 07:05:34.892198 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:34.892062    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-vg6m8"
Sep 08 07:05:38.033345 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:38.033311    2564 patch_prober.go:28] interesting pod/image-registry-7bcc6fbcd6-66qdn container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 08 07:05:38.033787 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:38.033369    2564 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7bcc6fbcd6-66qdn" podUID="fd323369-8471-4515-b250-2bcdf068b64c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 07:05:40.245151 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:40.245112    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-b2dlx"]
Sep 08 07:05:40.304460 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:40.304426    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-b2dlx"
Sep 08 07:05:40.306927 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:40.306876    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-vfkd4\""
Sep 08 07:05:40.308182 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:40.307703    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 08 07:05:40.308182 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:40.307709    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 08 07:05:40.308182 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:40.307940    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 08 07:05:40.308182 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:40.308088    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 08 07:05:40.402270 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:40.402235    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/55969acc-4171-499e-8864-4b910a5d43c8-sys\") pod \"node-exporter-b2dlx\" (UID: \"55969acc-4171-499e-8864-4b910a5d43c8\") " pod="openshift-monitoring/node-exporter-b2dlx"
Sep 08 07:05:40.402270 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:40.402274    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/55969acc-4171-499e-8864-4b910a5d43c8-root\") pod \"node-exporter-b2dlx\" (UID: \"55969acc-4171-499e-8864-4b910a5d43c8\") " pod="openshift-monitoring/node-exporter-b2dlx"
Sep 08 07:05:40.402505 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:40.402355    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/55969acc-4171-499e-8864-4b910a5d43c8-node-exporter-textfile\") pod \"node-exporter-b2dlx\" (UID: \"55969acc-4171-499e-8864-4b910a5d43c8\") " pod="openshift-monitoring/node-exporter-b2dlx"
Sep 08 07:05:40.402505 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:40.402394    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/55969acc-4171-499e-8864-4b910a5d43c8-node-exporter-tls\") pod \"node-exporter-b2dlx\" (UID: \"55969acc-4171-499e-8864-4b910a5d43c8\") " pod="openshift-monitoring/node-exporter-b2dlx"
Sep 08 07:05:40.402505 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:40.402415    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/55969acc-4171-499e-8864-4b910a5d43c8-node-exporter-wtmp\") pod \"node-exporter-b2dlx\" (UID: \"55969acc-4171-499e-8864-4b910a5d43c8\") " pod="openshift-monitoring/node-exporter-b2dlx"
Sep 08 07:05:40.402505 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:40.402439    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55969acc-4171-499e-8864-4b910a5d43c8-metrics-client-ca\") pod \"node-exporter-b2dlx\" (UID: \"55969acc-4171-499e-8864-4b910a5d43c8\") " pod="openshift-monitoring/node-exporter-b2dlx"
Sep 08 07:05:40.402505 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:40.402462    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/55969acc-4171-499e-8864-4b910a5d43c8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-b2dlx\" (UID: \"55969acc-4171-499e-8864-4b910a5d43c8\") " pod="openshift-monitoring/node-exporter-b2dlx"
Sep 08 07:05:40.402732 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:40.402552    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/55969acc-4171-499e-8864-4b910a5d43c8-node-exporter-accelerators-collector-config\") pod \"node-exporter-b2dlx\" (UID: \"55969acc-4171-499e-8864-4b910a5d43c8\") " pod="openshift-monitoring/node-exporter-b2dlx"
Sep 08 07:05:40.402732 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:40.402596    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzn26\" (UniqueName: \"kubernetes.io/projected/55969acc-4171-499e-8864-4b910a5d43c8-kube-api-access-kzn26\") pod \"node-exporter-b2dlx\" (UID: \"55969acc-4171-499e-8864-4b910a5d43c8\") " pod="openshift-monitoring/node-exporter-b2dlx"
Sep 08 07:05:40.503511 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:40.503419    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/55969acc-4171-499e-8864-4b910a5d43c8-node-exporter-accelerators-collector-config\") pod \"node-exporter-b2dlx\" (UID: \"55969acc-4171-499e-8864-4b910a5d43c8\") " pod="openshift-monitoring/node-exporter-b2dlx"
Sep 08 07:05:40.503511 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:40.503480    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzn26\" (UniqueName: \"kubernetes.io/projected/55969acc-4171-499e-8864-4b910a5d43c8-kube-api-access-kzn26\") pod \"node-exporter-b2dlx\" (UID: \"55969acc-4171-499e-8864-4b910a5d43c8\") " pod="openshift-monitoring/node-exporter-b2dlx"
Sep 08 07:05:40.503729 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:40.503560    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/55969acc-4171-499e-8864-4b910a5d43c8-sys\") pod \"node-exporter-b2dlx\" (UID: \"55969acc-4171-499e-8864-4b910a5d43c8\") " pod="openshift-monitoring/node-exporter-b2dlx"
Sep 08 07:05:40.503729 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:40.503583    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/55969acc-4171-499e-8864-4b910a5d43c8-root\") pod \"node-exporter-b2dlx\" (UID: \"55969acc-4171-499e-8864-4b910a5d43c8\") " pod="openshift-monitoring/node-exporter-b2dlx"
Sep 08 07:05:40.503729 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:40.503618    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/55969acc-4171-499e-8864-4b910a5d43c8-node-exporter-textfile\") pod \"node-exporter-b2dlx\" (UID: \"55969acc-4171-499e-8864-4b910a5d43c8\") " pod="openshift-monitoring/node-exporter-b2dlx"
Sep 08 07:05:40.503729 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:40.503641    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/55969acc-4171-499e-8864-4b910a5d43c8-node-exporter-tls\") pod \"node-exporter-b2dlx\" (UID: \"55969acc-4171-499e-8864-4b910a5d43c8\") " pod="openshift-monitoring/node-exporter-b2dlx"
Sep 08 07:05:40.503729 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:40.503662    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/55969acc-4171-499e-8864-4b910a5d43c8-node-exporter-wtmp\") pod \"node-exporter-b2dlx\" (UID: \"55969acc-4171-499e-8864-4b910a5d43c8\") " pod="openshift-monitoring/node-exporter-b2dlx"
Sep 08 07:05:40.503729 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:40.503666    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/55969acc-4171-499e-8864-4b910a5d43c8-sys\") pod \"node-exporter-b2dlx\" (UID: \"55969acc-4171-499e-8864-4b910a5d43c8\") " pod="openshift-monitoring/node-exporter-b2dlx"
Sep 08 07:05:40.503729 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:40.503685    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55969acc-4171-499e-8864-4b910a5d43c8-metrics-client-ca\") pod \"node-exporter-b2dlx\" (UID: \"55969acc-4171-499e-8864-4b910a5d43c8\") " pod="openshift-monitoring/node-exporter-b2dlx"
Sep 08 07:05:40.503729 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:40.503667    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/55969acc-4171-499e-8864-4b910a5d43c8-root\") pod \"node-exporter-b2dlx\" (UID: \"55969acc-4171-499e-8864-4b910a5d43c8\") " pod="openshift-monitoring/node-exporter-b2dlx"
Sep 08 07:05:40.503729 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:40.503709    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/55969acc-4171-499e-8864-4b910a5d43c8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-b2dlx\" (UID: \"55969acc-4171-499e-8864-4b910a5d43c8\") " pod="openshift-monitoring/node-exporter-b2dlx"
Sep 08 07:05:40.504283 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:40.503822    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/55969acc-4171-499e-8864-4b910a5d43c8-node-exporter-wtmp\") pod \"node-exporter-b2dlx\" (UID: \"55969acc-4171-499e-8864-4b910a5d43c8\") " pod="openshift-monitoring/node-exporter-b2dlx"
Sep 08 07:05:40.504283 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:40.503989    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/55969acc-4171-499e-8864-4b910a5d43c8-node-exporter-textfile\") pod \"node-exporter-b2dlx\" (UID: \"55969acc-4171-499e-8864-4b910a5d43c8\") " pod="openshift-monitoring/node-exporter-b2dlx"
Sep 08 07:05:40.504283 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:40.504109    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/55969acc-4171-499e-8864-4b910a5d43c8-node-exporter-accelerators-collector-config\") pod \"node-exporter-b2dlx\" (UID: \"55969acc-4171-499e-8864-4b910a5d43c8\") " pod="openshift-monitoring/node-exporter-b2dlx"
Sep 08 07:05:40.504412 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:40.504400    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55969acc-4171-499e-8864-4b910a5d43c8-metrics-client-ca\") pod \"node-exporter-b2dlx\" (UID: \"55969acc-4171-499e-8864-4b910a5d43c8\") " pod="openshift-monitoring/node-exporter-b2dlx"
Sep 08 07:05:40.506796 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:40.506530    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/55969acc-4171-499e-8864-4b910a5d43c8-node-exporter-tls\") pod \"node-exporter-b2dlx\" (UID: \"55969acc-4171-499e-8864-4b910a5d43c8\") " pod="openshift-monitoring/node-exporter-b2dlx"
Sep 08 07:05:40.506796 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:40.506553    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/55969acc-4171-499e-8864-4b910a5d43c8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-b2dlx\" (UID: \"55969acc-4171-499e-8864-4b910a5d43c8\") " pod="openshift-monitoring/node-exporter-b2dlx"
Sep 08 07:05:40.513865 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:40.513839    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzn26\" (UniqueName: \"kubernetes.io/projected/55969acc-4171-499e-8864-4b910a5d43c8-kube-api-access-kzn26\") pod \"node-exporter-b2dlx\" (UID: \"55969acc-4171-499e-8864-4b910a5d43c8\") " pod="openshift-monitoring/node-exporter-b2dlx"
Sep 08 07:05:40.618042 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:40.617785    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-b2dlx"
Sep 08 07:05:40.854139 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:40.854107    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7bcc6fbcd6-66qdn"
Sep 08 07:05:42.472898 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:05:42.472860    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55969acc_4171_499e_8864_4b910a5d43c8.slice/crio-7fbab078758a7c1a2fab1db60e7b9dc6b308fc3995a09ff054fb17f4ba737f0d WatchSource:0}: Error finding container 7fbab078758a7c1a2fab1db60e7b9dc6b308fc3995a09ff054fb17f4ba737f0d: Status 404 returned error can't find the container with id 7fbab078758a7c1a2fab1db60e7b9dc6b308fc3995a09ff054fb17f4ba737f0d
Sep 08 07:05:43.011935 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:43.011880    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b2dlx" event={"ID":"55969acc-4171-499e-8864-4b910a5d43c8","Type":"ContainerStarted","Data":"7fbab078758a7c1a2fab1db60e7b9dc6b308fc3995a09ff054fb17f4ba737f0d"}
Sep 08 07:05:43.013639 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:43.013614    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-drsvw" event={"ID":"cfe945ce-eef8-4eb9-8d5e-601b45b39514","Type":"ContainerStarted","Data":"d01db0d6816a1dc6adae11bf79e9a97ae40f7714847d24cd9bf3d1f6fa54f586"}
Sep 08 07:05:43.014346 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:43.014020    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-85d98c998f-drsvw"
Sep 08 07:05:43.015357 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:43.015323    2564 patch_prober.go:28] interesting pod/downloads-85d98c998f-drsvw container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.132.0.25:8080/\": dial tcp 10.132.0.25:8080: connect: connection refused" start-of-body=
Sep 08 07:05:43.015459 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:43.015380    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-85d98c998f-drsvw" podUID="cfe945ce-eef8-4eb9-8d5e-601b45b39514" containerName="download-server" probeResult="failure" output="Get \"http://10.132.0.25:8080/\": dial tcp 10.132.0.25:8080: connect: connection refused"
Sep 08 07:05:43.030726 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:43.030666    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-85d98c998f-drsvw" podStartSLOduration=4.584589323 podStartE2EDuration="23.030646959s" totalImagesPullingTime="18.446057636s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:05:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:05:43.028614236 +0000 UTC m=+91.009653579" watchObservedRunningTime="2026-09-08 07:05:43.030646959 +0000 UTC m=+91.011686265"
Sep 08 07:05:44.033052 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:44.033014    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-85d98c998f-drsvw"
Sep 08 07:05:45.027868 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:45.027458    2564 generic.go:356] "Generic (PLEG): container finished" podID="55969acc-4171-499e-8864-4b910a5d43c8" containerID="08960f68229ea512011be298279d7f724e5920ecc34e9caf575b76e0271ee29e" exitCode=0
Sep 08 07:05:45.027868 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:45.027601    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b2dlx" event={"ID":"55969acc-4171-499e-8864-4b910a5d43c8","Type":"ContainerDied","Data":"08960f68229ea512011be298279d7f724e5920ecc34e9caf575b76e0271ee29e"}
Sep 08 07:05:46.036498 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:46.036458    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b2dlx" event={"ID":"55969acc-4171-499e-8864-4b910a5d43c8","Type":"ContainerStarted","Data":"7e2c79ba9a9a9e8b0780acc9e9b37ce1525172a1b6b3f714b0b7f356c079a874"}
Sep 08 07:05:46.036958 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:46.036554    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b2dlx" event={"ID":"55969acc-4171-499e-8864-4b910a5d43c8","Type":"ContainerStarted","Data":"94a551fa51d7938dcbe1bf4da649f7cae3e3a21280c26a64b2292e27262919ba"}
Sep 08 07:05:46.057009 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:46.056947    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-b2dlx" podStartSLOduration=4.367376489 podStartE2EDuration="6.05693068s" totalImagesPullingTime="1.605916197s" totalInitContainerRuntime="83.637994ms" isStatefulPod=true podCreationTimestamp="2026-09-08 07:05:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:05:46.055644439 +0000 UTC m=+94.036683764" watchObservedRunningTime="2026-09-08 07:05:46.05693068 +0000 UTC m=+94.037969986"
Sep 08 07:05:47.168857 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:05:47.168822    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7bcc6fbcd6-66qdn"]
Sep 08 07:06:03.114719 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:06:03.114680    2564 generic.go:356] "Generic (PLEG): container finished" podID="90b86d86-d71b-4d36-874a-a2a03190d517" containerID="66aa29668ea7077a8f376e6dd6aa89701f8e9f7f3d0e248a276c397fbe81f1a4" exitCode=0
Sep 08 07:06:03.115256 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:06:03.114759    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-st5mf" event={"ID":"90b86d86-d71b-4d36-874a-a2a03190d517","Type":"ContainerDied","Data":"66aa29668ea7077a8f376e6dd6aa89701f8e9f7f3d0e248a276c397fbe81f1a4"}
Sep 08 07:06:03.115256 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:06:03.115194    2564 scope.go:117] "RemoveContainer" containerID="66aa29668ea7077a8f376e6dd6aa89701f8e9f7f3d0e248a276c397fbe81f1a4"
Sep 08 07:06:04.120760 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:06:04.120718    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-st5mf" event={"ID":"90b86d86-d71b-4d36-874a-a2a03190d517","Type":"ContainerStarted","Data":"14bdbdd449f4693d3a6a61c51996eba1686da50e7a7b9efc1b98e457ea94f304"}
Sep 08 07:06:12.192823 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:06:12.192776    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7bcc6fbcd6-66qdn" podUID="fd323369-8471-4515-b250-2bcdf068b64c" containerName="registry" containerID="cri-o://b51d9e1465f6d326f200f0defb867680b1da59518698296f024de9873ff2966b" gracePeriod=30
Sep 08 07:06:12.460021 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:06:12.459939    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7bcc6fbcd6-66qdn"
Sep 08 07:06:12.586412 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:06:12.586382    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fd323369-8471-4515-b250-2bcdf068b64c-bound-sa-token\") pod \"fd323369-8471-4515-b250-2bcdf068b64c\" (UID: \"fd323369-8471-4515-b250-2bcdf068b64c\") "
Sep 08 07:06:12.586596 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:06:12.586422    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fd323369-8471-4515-b250-2bcdf068b64c-image-registry-private-configuration\") pod \"fd323369-8471-4515-b250-2bcdf068b64c\" (UID: \"fd323369-8471-4515-b250-2bcdf068b64c\") "
Sep 08 07:06:12.586596 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:06:12.586446    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fd323369-8471-4515-b250-2bcdf068b64c-trusted-ca\") pod \"fd323369-8471-4515-b250-2bcdf068b64c\" (UID: \"fd323369-8471-4515-b250-2bcdf068b64c\") "
Sep 08 07:06:12.586596 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:06:12.586472    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fqn2x\" (UniqueName: \"kubernetes.io/projected/fd323369-8471-4515-b250-2bcdf068b64c-kube-api-access-fqn2x\") pod \"fd323369-8471-4515-b250-2bcdf068b64c\" (UID: \"fd323369-8471-4515-b250-2bcdf068b64c\") "
Sep 08 07:06:12.586596 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:06:12.586506    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fd323369-8471-4515-b250-2bcdf068b64c-ca-trust-extracted\") pod \"fd323369-8471-4515-b250-2bcdf068b64c\" (UID: \"fd323369-8471-4515-b250-2bcdf068b64c\") "
Sep 08 07:06:12.586596 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:06:12.586522    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fd323369-8471-4515-b250-2bcdf068b64c-installation-pull-secrets\") pod \"fd323369-8471-4515-b250-2bcdf068b64c\" (UID: \"fd323369-8471-4515-b250-2bcdf068b64c\") "
Sep 08 07:06:12.586596 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:06:12.586545    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fd323369-8471-4515-b250-2bcdf068b64c-registry-tls\") pod \"fd323369-8471-4515-b250-2bcdf068b64c\" (UID: \"fd323369-8471-4515-b250-2bcdf068b64c\") "
Sep 08 07:06:12.586596 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:06:12.586590    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fd323369-8471-4515-b250-2bcdf068b64c-registry-certificates\") pod \"fd323369-8471-4515-b250-2bcdf068b64c\" (UID: \"fd323369-8471-4515-b250-2bcdf068b64c\") "
Sep 08 07:06:12.587232 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:06:12.587199    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd323369-8471-4515-b250-2bcdf068b64c-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "fd323369-8471-4515-b250-2bcdf068b64c" (UID: "fd323369-8471-4515-b250-2bcdf068b64c"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 07:06:12.587713 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:06:12.587669    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd323369-8471-4515-b250-2bcdf068b64c-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "fd323369-8471-4515-b250-2bcdf068b64c" (UID: "fd323369-8471-4515-b250-2bcdf068b64c"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 07:06:12.589451 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:06:12.589409    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd323369-8471-4515-b250-2bcdf068b64c-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "fd323369-8471-4515-b250-2bcdf068b64c" (UID: "fd323369-8471-4515-b250-2bcdf068b64c"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 07:06:12.589547 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:06:12.589451    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd323369-8471-4515-b250-2bcdf068b64c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "fd323369-8471-4515-b250-2bcdf068b64c" (UID: "fd323369-8471-4515-b250-2bcdf068b64c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 07:06:12.589547 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:06:12.589519    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd323369-8471-4515-b250-2bcdf068b64c-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "fd323369-8471-4515-b250-2bcdf068b64c" (UID: "fd323369-8471-4515-b250-2bcdf068b64c"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 07:06:12.589661 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:06:12.589640    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd323369-8471-4515-b250-2bcdf068b64c-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "fd323369-8471-4515-b250-2bcdf068b64c" (UID: "fd323369-8471-4515-b250-2bcdf068b64c"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 07:06:12.589709 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:06:12.589691    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd323369-8471-4515-b250-2bcdf068b64c-kube-api-access-fqn2x" (OuterVolumeSpecName: "kube-api-access-fqn2x") pod "fd323369-8471-4515-b250-2bcdf068b64c" (UID: "fd323369-8471-4515-b250-2bcdf068b64c"). InnerVolumeSpecName "kube-api-access-fqn2x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 07:06:12.596195 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:06:12.596171    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd323369-8471-4515-b250-2bcdf068b64c-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "fd323369-8471-4515-b250-2bcdf068b64c" (UID: "fd323369-8471-4515-b250-2bcdf068b64c"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 07:06:12.687663 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:06:12.687634    2564 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fd323369-8471-4515-b250-2bcdf068b64c-bound-sa-token\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:06:12.687663 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:06:12.687658    2564 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fd323369-8471-4515-b250-2bcdf068b64c-image-registry-private-configuration\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:06:12.687663 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:06:12.687668    2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fd323369-8471-4515-b250-2bcdf068b64c-trusted-ca\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:06:12.687872 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:06:12.687676    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fqn2x\" (UniqueName: \"kubernetes.io/projected/fd323369-8471-4515-b250-2bcdf068b64c-kube-api-access-fqn2x\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:06:12.687872 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:06:12.687686    2564 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fd323369-8471-4515-b250-2bcdf068b64c-ca-trust-extracted\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:06:12.687872 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:06:12.687695    2564 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fd323369-8471-4515-b250-2bcdf068b64c-installation-pull-secrets\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:06:12.687872 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:06:12.687703    2564 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fd323369-8471-4515-b250-2bcdf068b64c-registry-tls\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:06:12.687872 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:06:12.687711    2564 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fd323369-8471-4515-b250-2bcdf068b64c-registry-certificates\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:06:13.163098 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:06:13.163017    2564 generic.go:356] "Generic (PLEG): container finished" podID="fd323369-8471-4515-b250-2bcdf068b64c" containerID="b51d9e1465f6d326f200f0defb867680b1da59518698296f024de9873ff2966b" exitCode=0
Sep 08 07:06:13.163098 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:06:13.163064    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7bcc6fbcd6-66qdn"
Sep 08 07:06:13.163321 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:06:13.163102    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7bcc6fbcd6-66qdn" event={"ID":"fd323369-8471-4515-b250-2bcdf068b64c","Type":"ContainerDied","Data":"b51d9e1465f6d326f200f0defb867680b1da59518698296f024de9873ff2966b"}
Sep 08 07:06:13.163321 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:06:13.163147    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7bcc6fbcd6-66qdn" event={"ID":"fd323369-8471-4515-b250-2bcdf068b64c","Type":"ContainerDied","Data":"4f0d04bbf42bdd5d91bc4c42c5f5b40f8a5b7f1a4786653d892e36dc85fa7297"}
Sep 08 07:06:13.163321 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:06:13.163161    2564 scope.go:117] "RemoveContainer" containerID="b51d9e1465f6d326f200f0defb867680b1da59518698296f024de9873ff2966b"
Sep 08 07:06:13.165023 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:06:13.165002    2564 generic.go:356] "Generic (PLEG): container finished" podID="a2e1c24d-ae27-4bac-8446-0822f1e53adc" containerID="b1623dad3446154050675623001d460ba37dc224d8c2f21a0e7b0a08cf865e31" exitCode=0
Sep 08 07:06:13.165136 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:06:13.165046    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-mcddz" event={"ID":"a2e1c24d-ae27-4bac-8446-0822f1e53adc","Type":"ContainerDied","Data":"b1623dad3446154050675623001d460ba37dc224d8c2f21a0e7b0a08cf865e31"}
Sep 08 07:06:13.165308 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:06:13.165296    2564 scope.go:117] "RemoveContainer" containerID="b1623dad3446154050675623001d460ba37dc224d8c2f21a0e7b0a08cf865e31"
Sep 08 07:06:13.172963 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:06:13.172946    2564 scope.go:117] "RemoveContainer" containerID="b51d9e1465f6d326f200f0defb867680b1da59518698296f024de9873ff2966b"
Sep 08 07:06:13.173259 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:06:13.173236    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b51d9e1465f6d326f200f0defb867680b1da59518698296f024de9873ff2966b\": container with ID starting with b51d9e1465f6d326f200f0defb867680b1da59518698296f024de9873ff2966b not found: ID does not exist" containerID="b51d9e1465f6d326f200f0defb867680b1da59518698296f024de9873ff2966b"
Sep 08 07:06:13.173302 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:06:13.173269    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b51d9e1465f6d326f200f0defb867680b1da59518698296f024de9873ff2966b"} err="failed to get container status \"b51d9e1465f6d326f200f0defb867680b1da59518698296f024de9873ff2966b\": rpc error: code = NotFound desc = could not find container \"b51d9e1465f6d326f200f0defb867680b1da59518698296f024de9873ff2966b\": container with ID starting with b51d9e1465f6d326f200f0defb867680b1da59518698296f024de9873ff2966b not found: ID does not exist"
Sep 08 07:06:13.200073 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:06:13.200050    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7bcc6fbcd6-66qdn"]
Sep 08 07:06:13.202927 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:06:13.202906    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7bcc6fbcd6-66qdn"]
Sep 08 07:06:14.170989 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:06:14.170934    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-mcddz" event={"ID":"a2e1c24d-ae27-4bac-8446-0822f1e53adc","Type":"ContainerStarted","Data":"5bb6946c5b0c9b234bff09b416bb4cbb57d3bd34991a33148404974654bc4717"}
Sep 08 07:06:14.508372 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:06:14.508301    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd323369-8471-4515-b250-2bcdf068b64c" path="/var/lib/kubelet/pods/fd323369-8471-4515-b250-2bcdf068b64c/volumes"
Sep 08 07:06:28.233076 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:06:28.232999    2564 generic.go:356] "Generic (PLEG): container finished" podID="9bd3d9fb-a0ba-40fe-bb47-060b9265e353" containerID="5a30ddb45029abe1d86ca3d14daba07afe62842235e3f11a53baa238e92c78b0" exitCode=0
Sep 08 07:06:28.233076 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:06:28.233057    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-kh2bx" event={"ID":"9bd3d9fb-a0ba-40fe-bb47-060b9265e353","Type":"ContainerDied","Data":"5a30ddb45029abe1d86ca3d14daba07afe62842235e3f11a53baa238e92c78b0"}
Sep 08 07:06:28.233491 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:06:28.233362    2564 scope.go:117] "RemoveContainer" containerID="5a30ddb45029abe1d86ca3d14daba07afe62842235e3f11a53baa238e92c78b0"
Sep 08 07:06:29.242129 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:06:29.241685    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-kh2bx" event={"ID":"9bd3d9fb-a0ba-40fe-bb47-060b9265e353","Type":"ContainerStarted","Data":"4bf73ecf1cbfe5279bffbaf0bb2921e74ad694b11a8ef480278b701bb77ffd7e"}
Sep 08 07:09:12.444677 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:09:12.444641    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-8d4lx_5cf68f79-8fda-42e2-92c1-05a5a601f505/console-operator/1.log"
Sep 08 07:09:12.446718 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:09:12.446697    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-8d4lx_5cf68f79-8fda-42e2-92c1-05a5a601f505/console-operator/1.log"
Sep 08 07:09:12.455724 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:09:12.455701    2564 kubelet.go:1648] "Image garbage collection succeeded"
Sep 08 07:10:44.770923 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:10:44.770880    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79c9ffb96f-pkcfs"]
Sep 08 07:10:44.771548 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:10:44.771358    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd323369-8471-4515-b250-2bcdf068b64c" containerName="registry"
Sep 08 07:10:44.771548 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:10:44.771379    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd323369-8471-4515-b250-2bcdf068b64c" containerName="registry"
Sep 08 07:10:44.771548 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:10:44.771474    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd323369-8471-4515-b250-2bcdf068b64c" containerName="registry"
Sep 08 07:10:44.774555 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:10:44.774534    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79c9ffb96f-pkcfs"
Sep 08 07:10:44.776792 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:10:44.776767    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 08 07:10:44.776912 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:10:44.776767    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-nw77s\""
Sep 08 07:10:44.776912 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:10:44.776771    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 08 07:10:44.776912 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:10:44.776771    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 08 07:10:44.777116 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:10:44.777100    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 08 07:10:44.795578 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:10:44.795542    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79c9ffb96f-pkcfs"]
Sep 08 07:10:44.872954 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:10:44.872914    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbl67\" (UniqueName: \"kubernetes.io/projected/dafa53fa-9e34-4a32-8c19-4a2521033ee1-kube-api-access-pbl67\") pod \"opendatahub-operator-controller-manager-79c9ffb96f-pkcfs\" (UID: \"dafa53fa-9e34-4a32-8c19-4a2521033ee1\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9ffb96f-pkcfs"
Sep 08 07:10:44.872954 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:10:44.872958    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dafa53fa-9e34-4a32-8c19-4a2521033ee1-tmp\") pod \"opendatahub-operator-controller-manager-79c9ffb96f-pkcfs\" (UID: \"dafa53fa-9e34-4a32-8c19-4a2521033ee1\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9ffb96f-pkcfs"
Sep 08 07:10:44.873217 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:10:44.873072    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/dafa53fa-9e34-4a32-8c19-4a2521033ee1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79c9ffb96f-pkcfs\" (UID: \"dafa53fa-9e34-4a32-8c19-4a2521033ee1\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9ffb96f-pkcfs"
Sep 08 07:10:44.873217 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:10:44.873127    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/dafa53fa-9e34-4a32-8c19-4a2521033ee1-manifests\") pod \"opendatahub-operator-controller-manager-79c9ffb96f-pkcfs\" (UID: \"dafa53fa-9e34-4a32-8c19-4a2521033ee1\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9ffb96f-pkcfs"
Sep 08 07:10:44.873217 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:10:44.873189    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dafa53fa-9e34-4a32-8c19-4a2521033ee1-webhook-cert\") pod \"opendatahub-operator-controller-manager-79c9ffb96f-pkcfs\" (UID: \"dafa53fa-9e34-4a32-8c19-4a2521033ee1\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9ffb96f-pkcfs"
Sep 08 07:10:44.973867 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:10:44.973827    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/dafa53fa-9e34-4a32-8c19-4a2521033ee1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79c9ffb96f-pkcfs\" (UID: \"dafa53fa-9e34-4a32-8c19-4a2521033ee1\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9ffb96f-pkcfs"
Sep 08 07:10:44.973867 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:10:44.973873    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/dafa53fa-9e34-4a32-8c19-4a2521033ee1-manifests\") pod \"opendatahub-operator-controller-manager-79c9ffb96f-pkcfs\" (UID: \"dafa53fa-9e34-4a32-8c19-4a2521033ee1\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9ffb96f-pkcfs"
Sep 08 07:10:44.974146 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:10:44.973922    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dafa53fa-9e34-4a32-8c19-4a2521033ee1-webhook-cert\") pod \"opendatahub-operator-controller-manager-79c9ffb96f-pkcfs\" (UID: \"dafa53fa-9e34-4a32-8c19-4a2521033ee1\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9ffb96f-pkcfs"
Sep 08 07:10:44.974146 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:10:44.974004    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbl67\" (UniqueName: \"kubernetes.io/projected/dafa53fa-9e34-4a32-8c19-4a2521033ee1-kube-api-access-pbl67\") pod \"opendatahub-operator-controller-manager-79c9ffb96f-pkcfs\" (UID: \"dafa53fa-9e34-4a32-8c19-4a2521033ee1\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9ffb96f-pkcfs"
Sep 08 07:10:44.974146 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:10:44.974031    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dafa53fa-9e34-4a32-8c19-4a2521033ee1-tmp\") pod \"opendatahub-operator-controller-manager-79c9ffb96f-pkcfs\" (UID: \"dafa53fa-9e34-4a32-8c19-4a2521033ee1\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9ffb96f-pkcfs"
Sep 08 07:10:44.974426 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:10:44.974393    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/dafa53fa-9e34-4a32-8c19-4a2521033ee1-manifests\") pod \"opendatahub-operator-controller-manager-79c9ffb96f-pkcfs\" (UID: \"dafa53fa-9e34-4a32-8c19-4a2521033ee1\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9ffb96f-pkcfs"
Sep 08 07:10:44.976297 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:10:44.976276    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dafa53fa-9e34-4a32-8c19-4a2521033ee1-tmp\") pod \"opendatahub-operator-controller-manager-79c9ffb96f-pkcfs\" (UID: \"dafa53fa-9e34-4a32-8c19-4a2521033ee1\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9ffb96f-pkcfs"
Sep 08 07:10:44.976384 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:10:44.976328    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/dafa53fa-9e34-4a32-8c19-4a2521033ee1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79c9ffb96f-pkcfs\" (UID: \"dafa53fa-9e34-4a32-8c19-4a2521033ee1\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9ffb96f-pkcfs"
Sep 08 07:10:44.976424 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:10:44.976380    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dafa53fa-9e34-4a32-8c19-4a2521033ee1-webhook-cert\") pod \"opendatahub-operator-controller-manager-79c9ffb96f-pkcfs\" (UID: \"dafa53fa-9e34-4a32-8c19-4a2521033ee1\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9ffb96f-pkcfs"
Sep 08 07:10:44.982393 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:10:44.982370    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbl67\" (UniqueName: \"kubernetes.io/projected/dafa53fa-9e34-4a32-8c19-4a2521033ee1-kube-api-access-pbl67\") pod \"opendatahub-operator-controller-manager-79c9ffb96f-pkcfs\" (UID: \"dafa53fa-9e34-4a32-8c19-4a2521033ee1\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9ffb96f-pkcfs"
Sep 08 07:10:45.084383 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:10:45.084290    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79c9ffb96f-pkcfs"
Sep 08 07:10:45.362081 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:10:45.362052    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79c9ffb96f-pkcfs"]
Sep 08 07:10:45.365062 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:10:45.365031    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddafa53fa_9e34_4a32_8c19_4a2521033ee1.slice/crio-e7b2fb8e0e8ce0685b8b710713804c6b8486eb9a7088e8272dfbd9d24e725cb5 WatchSource:0}: Error finding container e7b2fb8e0e8ce0685b8b710713804c6b8486eb9a7088e8272dfbd9d24e725cb5: Status 404 returned error can't find the container with id e7b2fb8e0e8ce0685b8b710713804c6b8486eb9a7088e8272dfbd9d24e725cb5
Sep 08 07:10:45.366821 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:10:45.366803    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 07:10:46.267112 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:10:46.267065    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79c9ffb96f-pkcfs" event={"ID":"dafa53fa-9e34-4a32-8c19-4a2521033ee1","Type":"ContainerStarted","Data":"e7b2fb8e0e8ce0685b8b710713804c6b8486eb9a7088e8272dfbd9d24e725cb5"}
Sep 08 07:10:49.284681 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:10:49.284641    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79c9ffb96f-pkcfs" event={"ID":"dafa53fa-9e34-4a32-8c19-4a2521033ee1","Type":"ContainerStarted","Data":"560a02e3d4f55753ff845f2159fcf354a1f4a51b1147fccab46e711bbe42cf83"}
Sep 08 07:10:50.290811 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:10:50.290774    2564 generic.go:356] "Generic (PLEG): container finished" podID="dafa53fa-9e34-4a32-8c19-4a2521033ee1" containerID="560a02e3d4f55753ff845f2159fcf354a1f4a51b1147fccab46e711bbe42cf83" exitCode=0
Sep 08 07:10:50.291253 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:10:50.290847    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79c9ffb96f-pkcfs" event={"ID":"dafa53fa-9e34-4a32-8c19-4a2521033ee1","Type":"ContainerDied","Data":"560a02e3d4f55753ff845f2159fcf354a1f4a51b1147fccab46e711bbe42cf83"}
Sep 08 07:10:51.299101 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:10:51.299065    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79c9ffb96f-pkcfs" event={"ID":"dafa53fa-9e34-4a32-8c19-4a2521033ee1","Type":"ContainerStarted","Data":"c9c78aa2e620fd547c27e53585cc059b7c414c680f82596d220fb0eb4769e440"}
Sep 08 07:10:51.299542 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:10:51.299203    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-79c9ffb96f-pkcfs"
Sep 08 07:10:51.329765 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:10:51.329707    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-79c9ffb96f-pkcfs" podStartSLOduration=2.580740122 podStartE2EDuration="7.329684288s" totalImagesPullingTime="3.706269526s" totalInitContainerRuntime="1.04267464s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:10:44 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:10:51.328582028 +0000 UTC m=+399.309621563" watchObservedRunningTime="2026-09-08 07:10:51.329684288 +0000 UTC m=+399.310723594"
Sep 08 07:11:02.306458 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:02.306416    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-79c9ffb96f-pkcfs"
Sep 08 07:11:09.639896 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:09.639858    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-cd6874cf-892rs"]
Sep 08 07:11:09.643040 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:09.643011    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-cd6874cf-892rs"
Sep 08 07:11:09.644915 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:09.644891    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-dtt8k\""
Sep 08 07:11:09.645027 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:09.644890    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 08 07:11:09.645086 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:09.645028    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 08 07:11:09.652542 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:09.652516    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-cd6874cf-892rs"]
Sep 08 07:11:09.769392 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:09.769360    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fb8d2989-9fe9-4852-869d-0befcdebecf2-tmp\") pod \"kube-auth-proxy-cd6874cf-892rs\" (UID: \"fb8d2989-9fe9-4852-869d-0befcdebecf2\") " pod="openshift-ingress/kube-auth-proxy-cd6874cf-892rs"
Sep 08 07:11:09.769571 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:09.769400    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkswd\" (UniqueName: \"kubernetes.io/projected/fb8d2989-9fe9-4852-869d-0befcdebecf2-kube-api-access-xkswd\") pod \"kube-auth-proxy-cd6874cf-892rs\" (UID: \"fb8d2989-9fe9-4852-869d-0befcdebecf2\") " pod="openshift-ingress/kube-auth-proxy-cd6874cf-892rs"
Sep 08 07:11:09.769571 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:09.769447    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb8d2989-9fe9-4852-869d-0befcdebecf2-tls-certs\") pod \"kube-auth-proxy-cd6874cf-892rs\" (UID: \"fb8d2989-9fe9-4852-869d-0befcdebecf2\") " pod="openshift-ingress/kube-auth-proxy-cd6874cf-892rs"
Sep 08 07:11:09.869954 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:09.869919    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb8d2989-9fe9-4852-869d-0befcdebecf2-tls-certs\") pod \"kube-auth-proxy-cd6874cf-892rs\" (UID: \"fb8d2989-9fe9-4852-869d-0befcdebecf2\") " pod="openshift-ingress/kube-auth-proxy-cd6874cf-892rs"
Sep 08 07:11:09.870132 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:09.869996    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fb8d2989-9fe9-4852-869d-0befcdebecf2-tmp\") pod \"kube-auth-proxy-cd6874cf-892rs\" (UID: \"fb8d2989-9fe9-4852-869d-0befcdebecf2\") " pod="openshift-ingress/kube-auth-proxy-cd6874cf-892rs"
Sep 08 07:11:09.870132 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:09.870020    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkswd\" (UniqueName: \"kubernetes.io/projected/fb8d2989-9fe9-4852-869d-0befcdebecf2-kube-api-access-xkswd\") pod \"kube-auth-proxy-cd6874cf-892rs\" (UID: \"fb8d2989-9fe9-4852-869d-0befcdebecf2\") " pod="openshift-ingress/kube-auth-proxy-cd6874cf-892rs"
Sep 08 07:11:09.872218 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:09.872188    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fb8d2989-9fe9-4852-869d-0befcdebecf2-tmp\") pod \"kube-auth-proxy-cd6874cf-892rs\" (UID: \"fb8d2989-9fe9-4852-869d-0befcdebecf2\") " pod="openshift-ingress/kube-auth-proxy-cd6874cf-892rs"
Sep 08 07:11:09.872431 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:09.872411    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb8d2989-9fe9-4852-869d-0befcdebecf2-tls-certs\") pod \"kube-auth-proxy-cd6874cf-892rs\" (UID: \"fb8d2989-9fe9-4852-869d-0befcdebecf2\") " pod="openshift-ingress/kube-auth-proxy-cd6874cf-892rs"
Sep 08 07:11:09.878098 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:09.878076    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkswd\" (UniqueName: \"kubernetes.io/projected/fb8d2989-9fe9-4852-869d-0befcdebecf2-kube-api-access-xkswd\") pod \"kube-auth-proxy-cd6874cf-892rs\" (UID: \"fb8d2989-9fe9-4852-869d-0befcdebecf2\") " pod="openshift-ingress/kube-auth-proxy-cd6874cf-892rs"
Sep 08 07:11:09.953007 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:09.952897    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-cd6874cf-892rs"
Sep 08 07:11:10.243102 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:10.243046    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-cd6874cf-892rs"]
Sep 08 07:11:10.245628 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:11:10.245603    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb8d2989_9fe9_4852_869d_0befcdebecf2.slice/crio-6ce6ee647d0461e3a7b4eafa2a9b6415878c428f7d10773c421d17f05d45a0a6 WatchSource:0}: Error finding container 6ce6ee647d0461e3a7b4eafa2a9b6415878c428f7d10773c421d17f05d45a0a6: Status 404 returned error can't find the container with id 6ce6ee647d0461e3a7b4eafa2a9b6415878c428f7d10773c421d17f05d45a0a6
Sep 08 07:11:10.378269 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:10.378233    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-cd6874cf-892rs" event={"ID":"fb8d2989-9fe9-4852-869d-0befcdebecf2","Type":"ContainerStarted","Data":"6ce6ee647d0461e3a7b4eafa2a9b6415878c428f7d10773c421d17f05d45a0a6"}
Sep 08 07:11:10.820756 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:10.820720    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2jxq"]
Sep 08 07:11:10.825152 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:10.825135    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2jxq"
Sep 08 07:11:10.827391 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:10.827363    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 08 07:11:10.827391 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:10.827362    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 08 07:11:10.827615 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:10.827601    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 08 07:11:10.827677 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:10.827629    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 08 07:11:10.828187 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:10.828161    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-7gfcm\""
Sep 08 07:11:10.837634 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:10.837610    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2jxq"]
Sep 08 07:11:10.878424 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:10.878393    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7066ffce-6b0e-4f95-8fec-b74dc79685ec-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-f2jxq\" (UID: \"7066ffce-6b0e-4f95-8fec-b74dc79685ec\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2jxq"
Sep 08 07:11:10.878424 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:10.878430    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7066ffce-6b0e-4f95-8fec-b74dc79685ec-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-f2jxq\" (UID: \"7066ffce-6b0e-4f95-8fec-b74dc79685ec\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2jxq"
Sep 08 07:11:10.878610 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:10.878470    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7066ffce-6b0e-4f95-8fec-b74dc79685ec-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-f2jxq\" (UID: \"7066ffce-6b0e-4f95-8fec-b74dc79685ec\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2jxq"
Sep 08 07:11:10.878610 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:10.878509    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7066ffce-6b0e-4f95-8fec-b74dc79685ec-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-f2jxq\" (UID: \"7066ffce-6b0e-4f95-8fec-b74dc79685ec\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2jxq"
Sep 08 07:11:10.878610 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:10.878552    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkjx4\" (UniqueName: \"kubernetes.io/projected/7066ffce-6b0e-4f95-8fec-b74dc79685ec-kube-api-access-pkjx4\") pod \"istiod-openshift-gateway-7b7995d5cd-f2jxq\" (UID: \"7066ffce-6b0e-4f95-8fec-b74dc79685ec\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2jxq"
Sep 08 07:11:10.878610 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:10.878571    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7066ffce-6b0e-4f95-8fec-b74dc79685ec-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-f2jxq\" (UID: \"7066ffce-6b0e-4f95-8fec-b74dc79685ec\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2jxq"
Sep 08 07:11:10.878610 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:10.878586    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7066ffce-6b0e-4f95-8fec-b74dc79685ec-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-f2jxq\" (UID: \"7066ffce-6b0e-4f95-8fec-b74dc79685ec\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2jxq"
Sep 08 07:11:10.979166 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:10.979127    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7066ffce-6b0e-4f95-8fec-b74dc79685ec-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-f2jxq\" (UID: \"7066ffce-6b0e-4f95-8fec-b74dc79685ec\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2jxq"
Sep 08 07:11:10.979349 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:10.979176    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7066ffce-6b0e-4f95-8fec-b74dc79685ec-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-f2jxq\" (UID: \"7066ffce-6b0e-4f95-8fec-b74dc79685ec\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2jxq"
Sep 08 07:11:10.979349 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:10.979218    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkjx4\" (UniqueName: \"kubernetes.io/projected/7066ffce-6b0e-4f95-8fec-b74dc79685ec-kube-api-access-pkjx4\") pod \"istiod-openshift-gateway-7b7995d5cd-f2jxq\" (UID: \"7066ffce-6b0e-4f95-8fec-b74dc79685ec\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2jxq"
Sep 08 07:11:10.979349 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:10.979246    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7066ffce-6b0e-4f95-8fec-b74dc79685ec-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-f2jxq\" (UID: \"7066ffce-6b0e-4f95-8fec-b74dc79685ec\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2jxq"
Sep 08 07:11:10.979349 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:10.979267    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7066ffce-6b0e-4f95-8fec-b74dc79685ec-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-f2jxq\" (UID: \"7066ffce-6b0e-4f95-8fec-b74dc79685ec\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2jxq"
Sep 08 07:11:10.979349 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:10.979302    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7066ffce-6b0e-4f95-8fec-b74dc79685ec-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-f2jxq\" (UID: \"7066ffce-6b0e-4f95-8fec-b74dc79685ec\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2jxq"
Sep 08 07:11:10.979349 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:10.979327    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7066ffce-6b0e-4f95-8fec-b74dc79685ec-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-f2jxq\" (UID: \"7066ffce-6b0e-4f95-8fec-b74dc79685ec\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2jxq"
Sep 08 07:11:10.980152 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:10.980127    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7066ffce-6b0e-4f95-8fec-b74dc79685ec-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-f2jxq\" (UID: \"7066ffce-6b0e-4f95-8fec-b74dc79685ec\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2jxq"
Sep 08 07:11:10.982260 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:10.982233    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7066ffce-6b0e-4f95-8fec-b74dc79685ec-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-f2jxq\" (UID: \"7066ffce-6b0e-4f95-8fec-b74dc79685ec\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2jxq"
Sep 08 07:11:10.982470 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:10.982452    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7066ffce-6b0e-4f95-8fec-b74dc79685ec-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-f2jxq\" (UID: \"7066ffce-6b0e-4f95-8fec-b74dc79685ec\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2jxq"
Sep 08 07:11:10.982675 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:10.982653    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7066ffce-6b0e-4f95-8fec-b74dc79685ec-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-f2jxq\" (UID: \"7066ffce-6b0e-4f95-8fec-b74dc79685ec\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2jxq"
Sep 08 07:11:10.982731 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:10.982653    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7066ffce-6b0e-4f95-8fec-b74dc79685ec-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-f2jxq\" (UID: \"7066ffce-6b0e-4f95-8fec-b74dc79685ec\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2jxq"
Sep 08 07:11:10.987713 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:10.987689    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkjx4\" (UniqueName: \"kubernetes.io/projected/7066ffce-6b0e-4f95-8fec-b74dc79685ec-kube-api-access-pkjx4\") pod \"istiod-openshift-gateway-7b7995d5cd-f2jxq\" (UID: \"7066ffce-6b0e-4f95-8fec-b74dc79685ec\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2jxq"
Sep 08 07:11:10.988240 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:10.988201    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7066ffce-6b0e-4f95-8fec-b74dc79685ec-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-f2jxq\" (UID: \"7066ffce-6b0e-4f95-8fec-b74dc79685ec\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2jxq"
Sep 08 07:11:11.137818 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:11.137725    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2jxq"
Sep 08 07:11:11.431134 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:11.431107    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2jxq"]
Sep 08 07:11:11.434348 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:11:11.434317    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7066ffce_6b0e_4f95_8fec_b74dc79685ec.slice/crio-50d531be294b40187d4c589781f4acc018182f4535937ac5adbdb44f10e58ed6 WatchSource:0}: Error finding container 50d531be294b40187d4c589781f4acc018182f4535937ac5adbdb44f10e58ed6: Status 404 returned error can't find the container with id 50d531be294b40187d4c589781f4acc018182f4535937ac5adbdb44f10e58ed6
Sep 08 07:11:12.390559 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:12.390517    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2jxq" event={"ID":"7066ffce-6b0e-4f95-8fec-b74dc79685ec","Type":"ContainerStarted","Data":"50d531be294b40187d4c589781f4acc018182f4535937ac5adbdb44f10e58ed6"}
Sep 08 07:11:13.276215 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:13.276194    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 08 07:11:13.399466 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:13.399427    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-cd6874cf-892rs" event={"ID":"fb8d2989-9fe9-4852-869d-0befcdebecf2","Type":"ContainerStarted","Data":"5b0a2861c0b6101312a53ff9c1918600ba8705b4014bbffb1f974923641aa81e"}
Sep 08 07:11:13.417626 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:13.417569    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-cd6874cf-892rs" podStartSLOduration=1.390839657 podStartE2EDuration="4.417546554s" totalImagesPullingTime="3.026706897s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:11:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:11:13.415363074 +0000 UTC m=+421.396402404" watchObservedRunningTime="2026-09-08 07:11:13.417546554 +0000 UTC m=+421.398585861"
Sep 08 07:11:14.597319 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:14.597276    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 07:11:14.597617 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:14.597348    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 07:11:15.414097 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:15.414047    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2jxq" event={"ID":"7066ffce-6b0e-4f95-8fec-b74dc79685ec","Type":"ContainerStarted","Data":"6f807b5e03a166384c6e00788f34319749d9d5cd82a4d57a7e97dddf8542eb7c"}
Sep 08 07:11:15.414410 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:15.414272    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2jxq"
Sep 08 07:11:15.416785 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:15.416510    2564 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-f2jxq container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 07:11:15.416785 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:15.416562    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2jxq" podUID="7066ffce-6b0e-4f95-8fec-b74dc79685ec" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 07:11:15.438422 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:15.438367    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2jxq" podStartSLOduration=2.278256194 podStartE2EDuration="5.438349202s" totalImagesPullingTime="3.160093008s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:11:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:11:15.436634218 +0000 UTC m=+423.417673544" watchObservedRunningTime="2026-09-08 07:11:15.438349202 +0000 UTC m=+423.419388507"
Sep 08 07:11:16.421246 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:16.421206    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2jxq"
Sep 08 07:11:24.483862 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:24.483828    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-hwtbd"]
Sep 08 07:11:24.488684 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:24.488660    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-hwtbd"
Sep 08 07:11:24.490690 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:24.490666    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 08 07:11:24.490810 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:24.490720    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-pdkjr\""
Sep 08 07:11:24.496289 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:24.495598    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-scw75"]
Sep 08 07:11:24.499941 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:24.499888    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-hwtbd"]
Sep 08 07:11:24.500097 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:24.500002    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-scw75"
Sep 08 07:11:24.502399 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:24.502184    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 08 07:11:24.502399 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:24.502213    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-pbtks\""
Sep 08 07:11:24.514587 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:24.514562    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-scw75"]
Sep 08 07:11:24.599084 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:24.599050    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1be6fd86-3254-484e-9461-1f55869da9d0-cert\") pod \"kserve-controller-manager-d6f4b65b8-hwtbd\" (UID: \"1be6fd86-3254-484e-9461-1f55869da9d0\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-hwtbd"
Sep 08 07:11:24.599259 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:24.599110    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpg5d\" (UniqueName: \"kubernetes.io/projected/8b87b2ce-394b-4faf-9625-d773aa787a23-kube-api-access-hpg5d\") pod \"llmisvc-controller-manager-777c6bd7d5-scw75\" (UID: \"8b87b2ce-394b-4faf-9625-d773aa787a23\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-scw75"
Sep 08 07:11:24.599259 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:24.599222    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9rkx\" (UniqueName: \"kubernetes.io/projected/1be6fd86-3254-484e-9461-1f55869da9d0-kube-api-access-p9rkx\") pod \"kserve-controller-manager-d6f4b65b8-hwtbd\" (UID: \"1be6fd86-3254-484e-9461-1f55869da9d0\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-hwtbd"
Sep 08 07:11:24.599366 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:24.599286    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8b87b2ce-394b-4faf-9625-d773aa787a23-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-scw75\" (UID: \"8b87b2ce-394b-4faf-9625-d773aa787a23\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-scw75"
Sep 08 07:11:24.700353 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:24.700323    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9rkx\" (UniqueName: \"kubernetes.io/projected/1be6fd86-3254-484e-9461-1f55869da9d0-kube-api-access-p9rkx\") pod \"kserve-controller-manager-d6f4b65b8-hwtbd\" (UID: \"1be6fd86-3254-484e-9461-1f55869da9d0\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-hwtbd"
Sep 08 07:11:24.700570 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:24.700372    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8b87b2ce-394b-4faf-9625-d773aa787a23-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-scw75\" (UID: \"8b87b2ce-394b-4faf-9625-d773aa787a23\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-scw75"
Sep 08 07:11:24.700570 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:24.700408    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1be6fd86-3254-484e-9461-1f55869da9d0-cert\") pod \"kserve-controller-manager-d6f4b65b8-hwtbd\" (UID: \"1be6fd86-3254-484e-9461-1f55869da9d0\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-hwtbd"
Sep 08 07:11:24.700570 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:24.700450    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpg5d\" (UniqueName: \"kubernetes.io/projected/8b87b2ce-394b-4faf-9625-d773aa787a23-kube-api-access-hpg5d\") pod \"llmisvc-controller-manager-777c6bd7d5-scw75\" (UID: \"8b87b2ce-394b-4faf-9625-d773aa787a23\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-scw75"
Sep 08 07:11:24.700570 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:11:24.700566    2564 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Sep 08 07:11:24.700821 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:11:24.700674    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1be6fd86-3254-484e-9461-1f55869da9d0-cert podName:1be6fd86-3254-484e-9461-1f55869da9d0 nodeName:}" failed. No retries permitted until 2026-09-08 07:11:25.20065106 +0000 UTC m=+433.181690344 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1be6fd86-3254-484e-9461-1f55869da9d0-cert") pod "kserve-controller-manager-d6f4b65b8-hwtbd" (UID: "1be6fd86-3254-484e-9461-1f55869da9d0") : secret "kserve-webhook-server-cert" not found
Sep 08 07:11:24.703056 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:24.703033    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8b87b2ce-394b-4faf-9625-d773aa787a23-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-scw75\" (UID: \"8b87b2ce-394b-4faf-9625-d773aa787a23\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-scw75"
Sep 08 07:11:24.709910 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:24.709889    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpg5d\" (UniqueName: \"kubernetes.io/projected/8b87b2ce-394b-4faf-9625-d773aa787a23-kube-api-access-hpg5d\") pod \"llmisvc-controller-manager-777c6bd7d5-scw75\" (UID: \"8b87b2ce-394b-4faf-9625-d773aa787a23\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-scw75"
Sep 08 07:11:24.712726 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:24.712699    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9rkx\" (UniqueName: \"kubernetes.io/projected/1be6fd86-3254-484e-9461-1f55869da9d0-kube-api-access-p9rkx\") pod \"kserve-controller-manager-d6f4b65b8-hwtbd\" (UID: \"1be6fd86-3254-484e-9461-1f55869da9d0\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-hwtbd"
Sep 08 07:11:24.815123 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:24.815085    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-scw75"
Sep 08 07:11:25.088759 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:25.088625    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-scw75"]
Sep 08 07:11:25.091318 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:11:25.091286    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8b87b2ce_394b_4faf_9625_d773aa787a23.slice/crio-bb01bd4e73f5c8d03e56695d624cf9b7f7e99872acd21f39f76b4cf0879ef900 WatchSource:0}: Error finding container bb01bd4e73f5c8d03e56695d624cf9b7f7e99872acd21f39f76b4cf0879ef900: Status 404 returned error can't find the container with id bb01bd4e73f5c8d03e56695d624cf9b7f7e99872acd21f39f76b4cf0879ef900
Sep 08 07:11:25.205469 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:25.205437    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1be6fd86-3254-484e-9461-1f55869da9d0-cert\") pod \"kserve-controller-manager-d6f4b65b8-hwtbd\" (UID: \"1be6fd86-3254-484e-9461-1f55869da9d0\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-hwtbd"
Sep 08 07:11:25.207813 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:25.207791    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1be6fd86-3254-484e-9461-1f55869da9d0-cert\") pod \"kserve-controller-manager-d6f4b65b8-hwtbd\" (UID: \"1be6fd86-3254-484e-9461-1f55869da9d0\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-hwtbd"
Sep 08 07:11:25.403031 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:25.402937    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-hwtbd"
Sep 08 07:11:25.466893 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:25.466860    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-scw75" event={"ID":"8b87b2ce-394b-4faf-9625-d773aa787a23","Type":"ContainerStarted","Data":"bb01bd4e73f5c8d03e56695d624cf9b7f7e99872acd21f39f76b4cf0879ef900"}
Sep 08 07:11:25.682845 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:25.682820    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-hwtbd"]
Sep 08 07:11:25.684541 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:11:25.684513    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1be6fd86_3254_484e_9461_1f55869da9d0.slice/crio-5cdf00ef9f404f14fa170153fc5faf895af301ef77d3887d559a2e71a8499ec5 WatchSource:0}: Error finding container 5cdf00ef9f404f14fa170153fc5faf895af301ef77d3887d559a2e71a8499ec5: Status 404 returned error can't find the container with id 5cdf00ef9f404f14fa170153fc5faf895af301ef77d3887d559a2e71a8499ec5
Sep 08 07:11:26.474429 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:26.474384    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-hwtbd" event={"ID":"1be6fd86-3254-484e-9461-1f55869da9d0","Type":"ContainerStarted","Data":"5cdf00ef9f404f14fa170153fc5faf895af301ef77d3887d559a2e71a8499ec5"}
Sep 08 07:11:29.491307 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:29.491269    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-hwtbd" event={"ID":"1be6fd86-3254-484e-9461-1f55869da9d0","Type":"ContainerStarted","Data":"9d25ba73787e1d97ec38c586ba550ecae2ba0254a4ef320b99c4044d5ff01928"}
Sep 08 07:11:29.491780 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:29.491431    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-hwtbd"
Sep 08 07:11:29.492854 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:29.492831    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-scw75" event={"ID":"8b87b2ce-394b-4faf-9625-d773aa787a23","Type":"ContainerStarted","Data":"ab6e6e672f4189c695243216164bde834cbd62b059aed2fdf54ce015ed489e6e"}
Sep 08 07:11:29.492982 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:29.492918    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-scw75"
Sep 08 07:11:29.512309 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:29.512271    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-hwtbd" podStartSLOduration=2.5829045710000003 podStartE2EDuration="5.512260128s" totalImagesPullingTime="2.929355557s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:11:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:11:29.511203455 +0000 UTC m=+437.492242778" watchObservedRunningTime="2026-09-08 07:11:29.512260128 +0000 UTC m=+437.493299434"
Sep 08 07:11:29.529898 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:29.529847    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-scw75" podStartSLOduration=2.003429225 podStartE2EDuration="5.529834269s" totalImagesPullingTime="3.526405044s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:11:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:11:29.528041766 +0000 UTC m=+437.509081102" watchObservedRunningTime="2026-09-08 07:11:29.529834269 +0000 UTC m=+437.510873575"
Sep 08 07:11:29.751829 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:29.751744    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2jxq"]
Sep 08 07:11:29.752002 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:29.751924    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2jxq" podUID="7066ffce-6b0e-4f95-8fec-b74dc79685ec" containerName="discovery" containerID="cri-o://6f807b5e03a166384c6e00788f34319749d9d5cd82a4d57a7e97dddf8542eb7c" gracePeriod=30
Sep 08 07:11:29.996518 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:29.996496    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2jxq"
Sep 08 07:11:30.147404 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:30.147356    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7066ffce-6b0e-4f95-8fec-b74dc79685ec-istio-csr-ca-configmap\") pod \"7066ffce-6b0e-4f95-8fec-b74dc79685ec\" (UID: \"7066ffce-6b0e-4f95-8fec-b74dc79685ec\") "
Sep 08 07:11:30.147404 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:30.147416    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7066ffce-6b0e-4f95-8fec-b74dc79685ec-local-certs\") pod \"7066ffce-6b0e-4f95-8fec-b74dc79685ec\" (UID: \"7066ffce-6b0e-4f95-8fec-b74dc79685ec\") "
Sep 08 07:11:30.147620 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:30.147472    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7066ffce-6b0e-4f95-8fec-b74dc79685ec-istio-token\") pod \"7066ffce-6b0e-4f95-8fec-b74dc79685ec\" (UID: \"7066ffce-6b0e-4f95-8fec-b74dc79685ec\") "
Sep 08 07:11:30.147620 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:30.147492    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7066ffce-6b0e-4f95-8fec-b74dc79685ec-istio-csr-dns-cert\") pod \"7066ffce-6b0e-4f95-8fec-b74dc79685ec\" (UID: \"7066ffce-6b0e-4f95-8fec-b74dc79685ec\") "
Sep 08 07:11:30.147620 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:30.147532    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7066ffce-6b0e-4f95-8fec-b74dc79685ec-istio-kubeconfig\") pod \"7066ffce-6b0e-4f95-8fec-b74dc79685ec\" (UID: \"7066ffce-6b0e-4f95-8fec-b74dc79685ec\") "
Sep 08 07:11:30.147620 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:30.147567    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pkjx4\" (UniqueName: \"kubernetes.io/projected/7066ffce-6b0e-4f95-8fec-b74dc79685ec-kube-api-access-pkjx4\") pod \"7066ffce-6b0e-4f95-8fec-b74dc79685ec\" (UID: \"7066ffce-6b0e-4f95-8fec-b74dc79685ec\") "
Sep 08 07:11:30.147620 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:30.147600    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7066ffce-6b0e-4f95-8fec-b74dc79685ec-cacerts\") pod \"7066ffce-6b0e-4f95-8fec-b74dc79685ec\" (UID: \"7066ffce-6b0e-4f95-8fec-b74dc79685ec\") "
Sep 08 07:11:30.147867 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:30.147842    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7066ffce-6b0e-4f95-8fec-b74dc79685ec-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "7066ffce-6b0e-4f95-8fec-b74dc79685ec" (UID: "7066ffce-6b0e-4f95-8fec-b74dc79685ec"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 07:11:30.149903 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:30.149864    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7066ffce-6b0e-4f95-8fec-b74dc79685ec-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "7066ffce-6b0e-4f95-8fec-b74dc79685ec" (UID: "7066ffce-6b0e-4f95-8fec-b74dc79685ec"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 07:11:30.150085 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:30.149937    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7066ffce-6b0e-4f95-8fec-b74dc79685ec-cacerts" (OuterVolumeSpecName: "cacerts") pod "7066ffce-6b0e-4f95-8fec-b74dc79685ec" (UID: "7066ffce-6b0e-4f95-8fec-b74dc79685ec"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 07:11:30.150187 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:30.150164    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7066ffce-6b0e-4f95-8fec-b74dc79685ec-kube-api-access-pkjx4" (OuterVolumeSpecName: "kube-api-access-pkjx4") pod "7066ffce-6b0e-4f95-8fec-b74dc79685ec" (UID: "7066ffce-6b0e-4f95-8fec-b74dc79685ec"). InnerVolumeSpecName "kube-api-access-pkjx4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 07:11:30.150285 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:30.150269    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7066ffce-6b0e-4f95-8fec-b74dc79685ec-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "7066ffce-6b0e-4f95-8fec-b74dc79685ec" (UID: "7066ffce-6b0e-4f95-8fec-b74dc79685ec"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 07:11:30.150347 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:30.150283    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7066ffce-6b0e-4f95-8fec-b74dc79685ec-istio-token" (OuterVolumeSpecName: "istio-token") pod "7066ffce-6b0e-4f95-8fec-b74dc79685ec" (UID: "7066ffce-6b0e-4f95-8fec-b74dc79685ec"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 07:11:30.150566 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:30.150546    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7066ffce-6b0e-4f95-8fec-b74dc79685ec-local-certs" (OuterVolumeSpecName: "local-certs") pod "7066ffce-6b0e-4f95-8fec-b74dc79685ec" (UID: "7066ffce-6b0e-4f95-8fec-b74dc79685ec"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 07:11:30.249219 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:30.249177    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7066ffce-6b0e-4f95-8fec-b74dc79685ec-istio-token\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:11:30.249219 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:30.249213    2564 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7066ffce-6b0e-4f95-8fec-b74dc79685ec-istio-csr-dns-cert\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:11:30.249219 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:30.249223    2564 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7066ffce-6b0e-4f95-8fec-b74dc79685ec-istio-kubeconfig\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:11:30.249440 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:30.249232    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pkjx4\" (UniqueName: \"kubernetes.io/projected/7066ffce-6b0e-4f95-8fec-b74dc79685ec-kube-api-access-pkjx4\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:11:30.249440 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:30.249241    2564 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7066ffce-6b0e-4f95-8fec-b74dc79685ec-cacerts\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:11:30.249440 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:30.249250    2564 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7066ffce-6b0e-4f95-8fec-b74dc79685ec-istio-csr-ca-configmap\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:11:30.249440 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:30.249259    2564 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7066ffce-6b0e-4f95-8fec-b74dc79685ec-local-certs\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:11:30.498652 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:30.498560    2564 generic.go:356] "Generic (PLEG): container finished" podID="7066ffce-6b0e-4f95-8fec-b74dc79685ec" containerID="6f807b5e03a166384c6e00788f34319749d9d5cd82a4d57a7e97dddf8542eb7c" exitCode=0
Sep 08 07:11:30.498652 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:30.498606    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2jxq"
Sep 08 07:11:30.498652 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:30.498640    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2jxq" event={"ID":"7066ffce-6b0e-4f95-8fec-b74dc79685ec","Type":"ContainerDied","Data":"6f807b5e03a166384c6e00788f34319749d9d5cd82a4d57a7e97dddf8542eb7c"}
Sep 08 07:11:30.499303 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:30.498692    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2jxq" event={"ID":"7066ffce-6b0e-4f95-8fec-b74dc79685ec","Type":"ContainerDied","Data":"50d531be294b40187d4c589781f4acc018182f4535937ac5adbdb44f10e58ed6"}
Sep 08 07:11:30.499303 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:30.498715    2564 scope.go:117] "RemoveContainer" containerID="6f807b5e03a166384c6e00788f34319749d9d5cd82a4d57a7e97dddf8542eb7c"
Sep 08 07:11:30.512497 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:30.512437    2564 scope.go:117] "RemoveContainer" containerID="6f807b5e03a166384c6e00788f34319749d9d5cd82a4d57a7e97dddf8542eb7c"
Sep 08 07:11:30.512719 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:11:30.512697    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f807b5e03a166384c6e00788f34319749d9d5cd82a4d57a7e97dddf8542eb7c\": container with ID starting with 6f807b5e03a166384c6e00788f34319749d9d5cd82a4d57a7e97dddf8542eb7c not found: ID does not exist" containerID="6f807b5e03a166384c6e00788f34319749d9d5cd82a4d57a7e97dddf8542eb7c"
Sep 08 07:11:30.512802 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:30.512726    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f807b5e03a166384c6e00788f34319749d9d5cd82a4d57a7e97dddf8542eb7c"} err="failed to get container status \"6f807b5e03a166384c6e00788f34319749d9d5cd82a4d57a7e97dddf8542eb7c\": rpc error: code = NotFound desc = could not find container \"6f807b5e03a166384c6e00788f34319749d9d5cd82a4d57a7e97dddf8542eb7c\": container with ID starting with 6f807b5e03a166384c6e00788f34319749d9d5cd82a4d57a7e97dddf8542eb7c not found: ID does not exist"
Sep 08 07:11:30.521479 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:30.521455    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2jxq"]
Sep 08 07:11:30.536175 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:30.535985    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2jxq"]
Sep 08 07:11:32.508842 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:11:32.508808    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7066ffce-6b0e-4f95-8fec-b74dc79685ec" path="/var/lib/kubelet/pods/7066ffce-6b0e-4f95-8fec-b74dc79685ec/volumes"
Sep 08 07:12:00.501104 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:12:00.501071    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-scw75"
Sep 08 07:12:00.509752 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:12:00.509728    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-hwtbd"
Sep 08 07:12:42.364452 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:12:42.364415    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-7xlrd"]
Sep 08 07:12:42.364866 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:12:42.364729    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7066ffce-6b0e-4f95-8fec-b74dc79685ec" containerName="discovery"
Sep 08 07:12:42.364866 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:12:42.364740    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7066ffce-6b0e-4f95-8fec-b74dc79685ec" containerName="discovery"
Sep 08 07:12:42.364866 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:12:42.364813    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7066ffce-6b0e-4f95-8fec-b74dc79685ec" containerName="discovery"
Sep 08 07:12:42.367678 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:12:42.367662    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-5985564776-7xlrd"
Sep 08 07:12:42.369479 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:12:42.369456    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 08 07:12:42.369852 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:12:42.369835    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 08 07:12:42.369941 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:12:42.369864    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-h9rrf\""
Sep 08 07:12:42.370166 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:12:42.370150    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 08 07:12:42.377115 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:12:42.377094    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-7xlrd"]
Sep 08 07:12:42.536583 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:12:42.536552    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jj247\" (UniqueName: \"kubernetes.io/projected/6091876c-9d34-4096-9409-419438e95c61-kube-api-access-jj247\") pod \"dns-operator-controller-manager-5985564776-7xlrd\" (UID: \"6091876c-9d34-4096-9409-419438e95c61\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-7xlrd"
Sep 08 07:12:42.637305 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:12:42.637229    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jj247\" (UniqueName: \"kubernetes.io/projected/6091876c-9d34-4096-9409-419438e95c61-kube-api-access-jj247\") pod \"dns-operator-controller-manager-5985564776-7xlrd\" (UID: \"6091876c-9d34-4096-9409-419438e95c61\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-7xlrd"
Sep 08 07:12:42.649156 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:12:42.649081    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jj247\" (UniqueName: \"kubernetes.io/projected/6091876c-9d34-4096-9409-419438e95c61-kube-api-access-jj247\") pod \"dns-operator-controller-manager-5985564776-7xlrd\" (UID: \"6091876c-9d34-4096-9409-419438e95c61\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-7xlrd"
Sep 08 07:12:42.677792 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:12:42.677762    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-5985564776-7xlrd"
Sep 08 07:12:42.951957 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:12:42.951930    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-7xlrd"]
Sep 08 07:12:42.954812 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:12:42.954763    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6091876c_9d34_4096_9409_419438e95c61.slice/crio-f69e3d6967418c132156f3b7594e9358533ba57f13f2fbf7705ac2f57691a4e6 WatchSource:0}: Error finding container f69e3d6967418c132156f3b7594e9358533ba57f13f2fbf7705ac2f57691a4e6: Status 404 returned error can't find the container with id f69e3d6967418c132156f3b7594e9358533ba57f13f2fbf7705ac2f57691a4e6
Sep 08 07:12:43.819885 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:12:43.819849    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-5985564776-7xlrd" event={"ID":"6091876c-9d34-4096-9409-419438e95c61","Type":"ContainerStarted","Data":"f69e3d6967418c132156f3b7594e9358533ba57f13f2fbf7705ac2f57691a4e6"}
Sep 08 07:12:44.859483 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:12:44.859449    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-c5mq8"]
Sep 08 07:12:44.869530 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:12:44.869496    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-c5mq8"
Sep 08 07:12:44.872227 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:12:44.872029    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-lfs6q\""
Sep 08 07:12:44.874315 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:12:44.874279    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-c5mq8"]
Sep 08 07:12:44.957858 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:12:44.957812    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhjrc\" (UniqueName: \"kubernetes.io/projected/1c13adf1-1366-4264-b7de-734e313d317b-kube-api-access-rhjrc\") pod \"authorino-operator-68d88948d8-c5mq8\" (UID: \"1c13adf1-1366-4264-b7de-734e313d317b\") " pod="kuadrant-system/authorino-operator-68d88948d8-c5mq8"
Sep 08 07:12:45.058749 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:12:45.058710    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhjrc\" (UniqueName: \"kubernetes.io/projected/1c13adf1-1366-4264-b7de-734e313d317b-kube-api-access-rhjrc\") pod \"authorino-operator-68d88948d8-c5mq8\" (UID: \"1c13adf1-1366-4264-b7de-734e313d317b\") " pod="kuadrant-system/authorino-operator-68d88948d8-c5mq8"
Sep 08 07:12:45.070403 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:12:45.070374    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhjrc\" (UniqueName: \"kubernetes.io/projected/1c13adf1-1366-4264-b7de-734e313d317b-kube-api-access-rhjrc\") pod \"authorino-operator-68d88948d8-c5mq8\" (UID: \"1c13adf1-1366-4264-b7de-734e313d317b\") " pod="kuadrant-system/authorino-operator-68d88948d8-c5mq8"
Sep 08 07:12:45.183813 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:12:45.183721    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-c5mq8"
Sep 08 07:12:45.676504 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:12:45.676473    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-c5mq8"]
Sep 08 07:12:45.677340 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:12:45.677301    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c13adf1_1366_4264_b7de_734e313d317b.slice/crio-1b697d0c4115656c10e571b68d2d3513f55cb9417e400057357aa37a182eede6 WatchSource:0}: Error finding container 1b697d0c4115656c10e571b68d2d3513f55cb9417e400057357aa37a182eede6: Status 404 returned error can't find the container with id 1b697d0c4115656c10e571b68d2d3513f55cb9417e400057357aa37a182eede6
Sep 08 07:12:45.832455 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:12:45.832419    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-c5mq8" event={"ID":"1c13adf1-1366-4264-b7de-734e313d317b","Type":"ContainerStarted","Data":"1b697d0c4115656c10e571b68d2d3513f55cb9417e400057357aa37a182eede6"}
Sep 08 07:12:45.834175 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:12:45.834139    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-5985564776-7xlrd" event={"ID":"6091876c-9d34-4096-9409-419438e95c61","Type":"ContainerStarted","Data":"a88b7ff8c3891d5b42cbc33867f869ecf5ef589f4080123b71503418dd55c816"}
Sep 08 07:12:45.834341 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:12:45.834325    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-5985564776-7xlrd"
Sep 08 07:12:45.856304 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:12:45.856255    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-5985564776-7xlrd" podStartSLOduration=1.344161177 podStartE2EDuration="3.856240923s" totalImagesPullingTime="2.512079746s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:12:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:12:45.855565745 +0000 UTC m=+513.836605052" watchObservedRunningTime="2026-09-08 07:12:45.856240923 +0000 UTC m=+513.837280229"
Sep 08 07:12:47.360644 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:12:47.360611    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-xdbcp"]
Sep 08 07:12:47.363826 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:12:47.363808    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-xdbcp"
Sep 08 07:12:47.366396 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:12:47.366366    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-d7lnn\""
Sep 08 07:12:47.377701 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:12:47.377673    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-xdbcp"]
Sep 08 07:12:47.479861 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:12:47.479823    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqszz\" (UniqueName: \"kubernetes.io/projected/b8566a01-ba43-4530-b742-3534972192b7-kube-api-access-vqszz\") pod \"limitador-operator-controller-manager-6c549b6d85-xdbcp\" (UID: \"b8566a01-ba43-4530-b742-3534972192b7\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-xdbcp"
Sep 08 07:12:47.580424 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:12:47.580333    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqszz\" (UniqueName: \"kubernetes.io/projected/b8566a01-ba43-4530-b742-3534972192b7-kube-api-access-vqszz\") pod \"limitador-operator-controller-manager-6c549b6d85-xdbcp\" (UID: \"b8566a01-ba43-4530-b742-3534972192b7\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-xdbcp"
Sep 08 07:12:47.588382 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:12:47.588350    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqszz\" (UniqueName: \"kubernetes.io/projected/b8566a01-ba43-4530-b742-3534972192b7-kube-api-access-vqszz\") pod \"limitador-operator-controller-manager-6c549b6d85-xdbcp\" (UID: \"b8566a01-ba43-4530-b742-3534972192b7\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-xdbcp"
Sep 08 07:12:47.679432 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:12:47.679390    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-xdbcp"
Sep 08 07:12:47.847845 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:12:47.847764    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-c5mq8" event={"ID":"1c13adf1-1366-4264-b7de-734e313d317b","Type":"ContainerStarted","Data":"daa53a3c1eea7b1431f5d9f802bbb9f31c111fa05d95610c9cd6d2e8288df316"}
Sep 08 07:12:47.848033 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:12:47.847883    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-68d88948d8-c5mq8"
Sep 08 07:12:47.865708 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:12:47.865662    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-68d88948d8-c5mq8" podStartSLOduration=2.248989706 podStartE2EDuration="3.865645707s" totalImagesPullingTime="1.616656001s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:12:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:12:47.864082441 +0000 UTC m=+515.845121788" watchObservedRunningTime="2026-09-08 07:12:47.865645707 +0000 UTC m=+515.846685012"
Sep 08 07:12:47.952209 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:12:47.952166    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-xdbcp"]
Sep 08 07:12:47.954471 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:12:47.954442    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8566a01_ba43_4530_b742_3534972192b7.slice/crio-958a96e08872041e122345cbbcb3c585d5a4e724cde319b98727ca87e24a9847 WatchSource:0}: Error finding container 958a96e08872041e122345cbbcb3c585d5a4e724cde319b98727ca87e24a9847: Status 404 returned error can't find the container with id 958a96e08872041e122345cbbcb3c585d5a4e724cde319b98727ca87e24a9847
Sep 08 07:12:48.854940 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:12:48.854890    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-xdbcp" event={"ID":"b8566a01-ba43-4530-b742-3534972192b7","Type":"ContainerStarted","Data":"958a96e08872041e122345cbbcb3c585d5a4e724cde319b98727ca87e24a9847"}
Sep 08 07:12:49.861297 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:12:49.861259    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-xdbcp" event={"ID":"b8566a01-ba43-4530-b742-3534972192b7","Type":"ContainerStarted","Data":"6a7b7e5f683f4f54a98fe595c096140456d1f8953779409a202f1ccc2fbe87c7"}
Sep 08 07:12:49.861705 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:12:49.861378    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-xdbcp"
Sep 08 07:12:49.882610 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:12:49.882563    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-xdbcp" podStartSLOduration=1.412540806 podStartE2EDuration="2.882549449s" totalImagesPullingTime="1.470008643s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:12:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:12:49.881587038 +0000 UTC m=+517.862626354" watchObservedRunningTime="2026-09-08 07:12:49.882549449 +0000 UTC m=+517.863588755"
Sep 08 07:12:51.818093 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:12:51.818031    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-sdht5"]
Sep 08 07:12:51.821779 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:12:51.821755    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-sdht5"
Sep 08 07:12:51.823558 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:12:51.823536    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-bnvtt\""
Sep 08 07:12:51.833220 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:12:51.833198    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-sdht5"]
Sep 08 07:12:52.013955 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:12:52.013915    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f3b62d3e-c8fb-4f83-b561-cc98f70ddfb7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-sdht5\" (UID: \"f3b62d3e-c8fb-4f83-b561-cc98f70ddfb7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-sdht5"
Sep 08 07:12:52.013955 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:12:52.013957    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4whv\" (UniqueName: \"kubernetes.io/projected/f3b62d3e-c8fb-4f83-b561-cc98f70ddfb7-kube-api-access-j4whv\") pod \"kuadrant-operator-controller-manager-58fc56757c-sdht5\" (UID: \"f3b62d3e-c8fb-4f83-b561-cc98f70ddfb7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-sdht5"
Sep 08 07:12:52.115163 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:12:52.115059    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f3b62d3e-c8fb-4f83-b561-cc98f70ddfb7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-sdht5\" (UID: \"f3b62d3e-c8fb-4f83-b561-cc98f70ddfb7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-sdht5"
Sep 08 07:12:52.115163 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:12:52.115105    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4whv\" (UniqueName: \"kubernetes.io/projected/f3b62d3e-c8fb-4f83-b561-cc98f70ddfb7-kube-api-access-j4whv\") pod \"kuadrant-operator-controller-manager-58fc56757c-sdht5\" (UID: \"f3b62d3e-c8fb-4f83-b561-cc98f70ddfb7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-sdht5"
Sep 08 07:12:52.115475 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:12:52.115450    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f3b62d3e-c8fb-4f83-b561-cc98f70ddfb7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-sdht5\" (UID: \"f3b62d3e-c8fb-4f83-b561-cc98f70ddfb7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-sdht5"
Sep 08 07:12:52.127096 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:12:52.127068    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4whv\" (UniqueName: \"kubernetes.io/projected/f3b62d3e-c8fb-4f83-b561-cc98f70ddfb7-kube-api-access-j4whv\") pod \"kuadrant-operator-controller-manager-58fc56757c-sdht5\" (UID: \"f3b62d3e-c8fb-4f83-b561-cc98f70ddfb7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-sdht5"
Sep 08 07:12:52.132856 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:12:52.132818    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-sdht5"
Sep 08 07:12:52.407750 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:12:52.407720    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-sdht5"]
Sep 08 07:12:52.409698 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:12:52.409673    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3b62d3e_c8fb_4f83_b561_cc98f70ddfb7.slice/crio-275173ffa460173d67366b38f163b04a762266b64dbee4b3f19502da99b76a67 WatchSource:0}: Error finding container 275173ffa460173d67366b38f163b04a762266b64dbee4b3f19502da99b76a67: Status 404 returned error can't find the container with id 275173ffa460173d67366b38f163b04a762266b64dbee4b3f19502da99b76a67
Sep 08 07:12:52.876139 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:12:52.876102    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-sdht5" event={"ID":"f3b62d3e-c8fb-4f83-b561-cc98f70ddfb7","Type":"ContainerStarted","Data":"275173ffa460173d67366b38f163b04a762266b64dbee4b3f19502da99b76a67"}
Sep 08 07:12:56.842645 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:12:56.842608    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-5985564776-7xlrd"
Sep 08 07:12:56.900589 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:12:56.900552    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-sdht5" event={"ID":"f3b62d3e-c8fb-4f83-b561-cc98f70ddfb7","Type":"ContainerStarted","Data":"f43c067d2e60e27cfa2284560489abad902332ae3d0a336afdc31e564f0332bc"}
Sep 08 07:12:56.900736 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:12:56.900697    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-sdht5"
Sep 08 07:12:56.920516 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:12:56.920463    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-sdht5" podStartSLOduration=2.273074783 podStartE2EDuration="5.920443918s" totalImagesPullingTime="3.647369135s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:12:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:12:56.919448826 +0000 UTC m=+524.900488114" watchObservedRunningTime="2026-09-08 07:12:56.920443918 +0000 UTC m=+524.901483224"
Sep 08 07:12:58.857415 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:12:58.857384    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-68d88948d8-c5mq8"
Sep 08 07:13:00.869214 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:00.869185    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-xdbcp"
Sep 08 07:13:07.908993 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:07.908896    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-sdht5"
Sep 08 07:13:09.883903 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:09.883868    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-sdht5"]
Sep 08 07:13:09.884343 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:09.884066    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-sdht5" podUID="f3b62d3e-c8fb-4f83-b561-cc98f70ddfb7" containerName="manager" containerID="cri-o://f43c067d2e60e27cfa2284560489abad902332ae3d0a336afdc31e564f0332bc" gracePeriod=2
Sep 08 07:13:09.900593 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:09.900562    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-sdht5"]
Sep 08 07:13:09.905781 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:13:09.905751    2564 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"f3b62d3e-c8fb-4f83-b561-cc98f70ddfb7\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-58fc56757c-sdht5\": pods \"kuadrant-operator-controller-manager-58fc56757c-sdht5\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-sdht5"
Sep 08 07:13:09.919780 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:09.919744    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vjp4z"]
Sep 08 07:13:09.920216 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:09.920199    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3b62d3e-c8fb-4f83-b561-cc98f70ddfb7" containerName="manager"
Sep 08 07:13:09.920216 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:09.920216    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3b62d3e-c8fb-4f83-b561-cc98f70ddfb7" containerName="manager"
Sep 08 07:13:09.920366 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:09.920279    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3b62d3e-c8fb-4f83-b561-cc98f70ddfb7" containerName="manager"
Sep 08 07:13:09.923255 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:09.923237    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vjp4z"
Sep 08 07:13:09.925473 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:13:09.925443    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-sdht5\" is forbidden: User \"system:node:ip-10-0-133-164.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-164.ec2.internal' and this object" podUID="f3b62d3e-c8fb-4f83-b561-cc98f70ddfb7" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-sdht5"
Sep 08 07:13:09.933453 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:09.933432    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-xdbcp"]
Sep 08 07:13:09.933617 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:09.933599    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-xdbcp" podUID="b8566a01-ba43-4530-b742-3534972192b7" containerName="manager" containerID="cri-o://6a7b7e5f683f4f54a98fe595c096140456d1f8953779409a202f1ccc2fbe87c7" gracePeriod=2
Sep 08 07:13:09.942517 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:09.942492    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-xdbcp"]
Sep 08 07:13:09.948633 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:09.948613    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vjp4z"]
Sep 08 07:13:09.961618 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:09.961594    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-nt8lr"]
Sep 08 07:13:09.962139 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:09.962121    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8566a01-ba43-4530-b742-3534972192b7" containerName="manager"
Sep 08 07:13:09.962217 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:09.962143    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8566a01-ba43-4530-b742-3534972192b7" containerName="manager"
Sep 08 07:13:09.962282 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:09.962270    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8566a01-ba43-4530-b742-3534972192b7" containerName="manager"
Sep 08 07:13:09.965446 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:09.965424    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-nt8lr"
Sep 08 07:13:09.966572 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:09.966555    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3527bfc8-44e7-4e23-9a37-d4b8670dd1a9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-vjp4z\" (UID: \"3527bfc8-44e7-4e23-9a37-d4b8670dd1a9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vjp4z"
Sep 08 07:13:09.966643 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:09.966579    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxxgc\" (UniqueName: \"kubernetes.io/projected/3527bfc8-44e7-4e23-9a37-d4b8670dd1a9-kube-api-access-kxxgc\") pod \"kuadrant-operator-controller-manager-58fc56757c-vjp4z\" (UID: \"3527bfc8-44e7-4e23-9a37-d4b8670dd1a9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vjp4z"
Sep 08 07:13:09.985227 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:09.985201    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-nt8lr"]
Sep 08 07:13:10.010086 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:13:10.010050    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-sdht5\" is forbidden: User \"system:node:ip-10-0-133-164.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-164.ec2.internal' and this object" podUID="f3b62d3e-c8fb-4f83-b561-cc98f70ddfb7" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-sdht5"
Sep 08 07:13:10.012225 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:13:10.012114    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-xdbcp\" is forbidden: User \"system:node:ip-10-0-133-164.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-164.ec2.internal' and this object" podUID="b8566a01-ba43-4530-b742-3534972192b7" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-xdbcp"
Sep 08 07:13:10.067711 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:10.067642    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7953ece0-8a97-4344-bf2d-baba5ab6a6f9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-96db98c47-nt8lr\" (UID: \"7953ece0-8a97-4344-bf2d-baba5ab6a6f9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-nt8lr"
Sep 08 07:13:10.067711 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:10.067692    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kv2j\" (UniqueName: \"kubernetes.io/projected/7953ece0-8a97-4344-bf2d-baba5ab6a6f9-kube-api-access-8kv2j\") pod \"kuadrant-operator-controller-manager-96db98c47-nt8lr\" (UID: \"7953ece0-8a97-4344-bf2d-baba5ab6a6f9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-nt8lr"
Sep 08 07:13:10.067925 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:10.067734    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3527bfc8-44e7-4e23-9a37-d4b8670dd1a9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-vjp4z\" (UID: \"3527bfc8-44e7-4e23-9a37-d4b8670dd1a9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vjp4z"
Sep 08 07:13:10.067925 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:10.067760    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxxgc\" (UniqueName: \"kubernetes.io/projected/3527bfc8-44e7-4e23-9a37-d4b8670dd1a9-kube-api-access-kxxgc\") pod \"kuadrant-operator-controller-manager-58fc56757c-vjp4z\" (UID: \"3527bfc8-44e7-4e23-9a37-d4b8670dd1a9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vjp4z"
Sep 08 07:13:10.068233 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:10.068194    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3527bfc8-44e7-4e23-9a37-d4b8670dd1a9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-vjp4z\" (UID: \"3527bfc8-44e7-4e23-9a37-d4b8670dd1a9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vjp4z"
Sep 08 07:13:10.077134 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:10.077079    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxxgc\" (UniqueName: \"kubernetes.io/projected/3527bfc8-44e7-4e23-9a37-d4b8670dd1a9-kube-api-access-kxxgc\") pod \"kuadrant-operator-controller-manager-58fc56757c-vjp4z\" (UID: \"3527bfc8-44e7-4e23-9a37-d4b8670dd1a9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vjp4z"
Sep 08 07:13:10.166808 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:10.166783    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-sdht5"
Sep 08 07:13:10.168694 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:13:10.168663    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-sdht5\" is forbidden: User \"system:node:ip-10-0-133-164.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-164.ec2.internal' and this object" podUID="f3b62d3e-c8fb-4f83-b561-cc98f70ddfb7" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-sdht5"
Sep 08 07:13:10.168820 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:10.168772    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7953ece0-8a97-4344-bf2d-baba5ab6a6f9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-96db98c47-nt8lr\" (UID: \"7953ece0-8a97-4344-bf2d-baba5ab6a6f9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-nt8lr"
Sep 08 07:13:10.168820 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:10.168805    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kv2j\" (UniqueName: \"kubernetes.io/projected/7953ece0-8a97-4344-bf2d-baba5ab6a6f9-kube-api-access-8kv2j\") pod \"kuadrant-operator-controller-manager-96db98c47-nt8lr\" (UID: \"7953ece0-8a97-4344-bf2d-baba5ab6a6f9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-nt8lr"
Sep 08 07:13:10.169113 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:10.169091    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7953ece0-8a97-4344-bf2d-baba5ab6a6f9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-96db98c47-nt8lr\" (UID: \"7953ece0-8a97-4344-bf2d-baba5ab6a6f9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-nt8lr"
Sep 08 07:13:10.169383 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:10.169368    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-xdbcp"
Sep 08 07:13:10.170391 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:13:10.170368    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-xdbcp\" is forbidden: User \"system:node:ip-10-0-133-164.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-164.ec2.internal' and this object" podUID="b8566a01-ba43-4530-b742-3534972192b7" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-xdbcp"
Sep 08 07:13:10.175482 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:13:10.175462    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-xdbcp\" is forbidden: User \"system:node:ip-10-0-133-164.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-164.ec2.internal' and this object" podUID="b8566a01-ba43-4530-b742-3534972192b7" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-xdbcp"
Sep 08 07:13:10.177202 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:13:10.177183    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-sdht5\" is forbidden: User \"system:node:ip-10-0-133-164.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-164.ec2.internal' and this object" podUID="f3b62d3e-c8fb-4f83-b561-cc98f70ddfb7" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-sdht5"
Sep 08 07:13:10.180431 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:10.180410    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kv2j\" (UniqueName: \"kubernetes.io/projected/7953ece0-8a97-4344-bf2d-baba5ab6a6f9-kube-api-access-8kv2j\") pod \"kuadrant-operator-controller-manager-96db98c47-nt8lr\" (UID: \"7953ece0-8a97-4344-bf2d-baba5ab6a6f9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-nt8lr"
Sep 08 07:13:10.270062 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:10.270033    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vqszz\" (UniqueName: \"kubernetes.io/projected/b8566a01-ba43-4530-b742-3534972192b7-kube-api-access-vqszz\") pod \"b8566a01-ba43-4530-b742-3534972192b7\" (UID: \"b8566a01-ba43-4530-b742-3534972192b7\") "
Sep 08 07:13:10.270209 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:10.270085    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f3b62d3e-c8fb-4f83-b561-cc98f70ddfb7-extensions-socket-volume\") pod \"f3b62d3e-c8fb-4f83-b561-cc98f70ddfb7\" (UID: \"f3b62d3e-c8fb-4f83-b561-cc98f70ddfb7\") "
Sep 08 07:13:10.270291 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:10.270269    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j4whv\" (UniqueName: \"kubernetes.io/projected/f3b62d3e-c8fb-4f83-b561-cc98f70ddfb7-kube-api-access-j4whv\") pod \"f3b62d3e-c8fb-4f83-b561-cc98f70ddfb7\" (UID: \"f3b62d3e-c8fb-4f83-b561-cc98f70ddfb7\") "
Sep 08 07:13:10.270528 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:10.270509    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3b62d3e-c8fb-4f83-b561-cc98f70ddfb7-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f3b62d3e-c8fb-4f83-b561-cc98f70ddfb7" (UID: "f3b62d3e-c8fb-4f83-b561-cc98f70ddfb7"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 07:13:10.272241 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:10.272220    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3b62d3e-c8fb-4f83-b561-cc98f70ddfb7-kube-api-access-j4whv" (OuterVolumeSpecName: "kube-api-access-j4whv") pod "f3b62d3e-c8fb-4f83-b561-cc98f70ddfb7" (UID: "f3b62d3e-c8fb-4f83-b561-cc98f70ddfb7"). InnerVolumeSpecName "kube-api-access-j4whv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 07:13:10.272319 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:10.272303    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8566a01-ba43-4530-b742-3534972192b7-kube-api-access-vqszz" (OuterVolumeSpecName: "kube-api-access-vqszz") pod "b8566a01-ba43-4530-b742-3534972192b7" (UID: "b8566a01-ba43-4530-b742-3534972192b7"). InnerVolumeSpecName "kube-api-access-vqszz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 07:13:10.304038 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:10.304018    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vjp4z"
Sep 08 07:13:10.311067 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:10.311045    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-nt8lr"
Sep 08 07:13:10.371679 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:10.371649    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j4whv\" (UniqueName: \"kubernetes.io/projected/f3b62d3e-c8fb-4f83-b561-cc98f70ddfb7-kube-api-access-j4whv\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:13:10.371802 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:10.371688    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vqszz\" (UniqueName: \"kubernetes.io/projected/b8566a01-ba43-4530-b742-3534972192b7-kube-api-access-vqszz\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:13:10.371802 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:10.371708    2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f3b62d3e-c8fb-4f83-b561-cc98f70ddfb7-extensions-socket-volume\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:13:10.509090 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:10.509017    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8566a01-ba43-4530-b742-3534972192b7" path="/var/lib/kubelet/pods/b8566a01-ba43-4530-b742-3534972192b7/volumes"
Sep 08 07:13:10.509390 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:10.509377    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3b62d3e-c8fb-4f83-b561-cc98f70ddfb7" path="/var/lib/kubelet/pods/f3b62d3e-c8fb-4f83-b561-cc98f70ddfb7/volumes"
Sep 08 07:13:10.583679 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:10.583649    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vjp4z"]
Sep 08 07:13:10.586464 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:13:10.586437    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3527bfc8_44e7_4e23_9a37_d4b8670dd1a9.slice/crio-3a678ea80183c56d95b100bbce56fabac760d759664c7b2df832b500d4608d66 WatchSource:0}: Error finding container 3a678ea80183c56d95b100bbce56fabac760d759664c7b2df832b500d4608d66: Status 404 returned error can't find the container with id 3a678ea80183c56d95b100bbce56fabac760d759664c7b2df832b500d4608d66
Sep 08 07:13:10.592852 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:10.592833    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-nt8lr"]
Sep 08 07:13:10.595391 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:13:10.595365    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7953ece0_8a97_4344_bf2d_baba5ab6a6f9.slice/crio-f2bea0473d589d1b68efab711df36b2a7ce16c6ce35168372b57ea947f0f3189 WatchSource:0}: Error finding container f2bea0473d589d1b68efab711df36b2a7ce16c6ce35168372b57ea947f0f3189: Status 404 returned error can't find the container with id f2bea0473d589d1b68efab711df36b2a7ce16c6ce35168372b57ea947f0f3189
Sep 08 07:13:10.972700 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:10.972665    2564 generic.go:356] "Generic (PLEG): container finished" podID="b8566a01-ba43-4530-b742-3534972192b7" containerID="6a7b7e5f683f4f54a98fe595c096140456d1f8953779409a202f1ccc2fbe87c7" exitCode=0
Sep 08 07:13:10.973142 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:10.972707    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-xdbcp"
Sep 08 07:13:10.973142 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:10.972750    2564 scope.go:117] "RemoveContainer" containerID="6a7b7e5f683f4f54a98fe595c096140456d1f8953779409a202f1ccc2fbe87c7"
Sep 08 07:13:10.974549 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:10.974455    2564 generic.go:356] "Generic (PLEG): container finished" podID="f3b62d3e-c8fb-4f83-b561-cc98f70ddfb7" containerID="f43c067d2e60e27cfa2284560489abad902332ae3d0a336afdc31e564f0332bc" exitCode=0
Sep 08 07:13:10.974549 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:10.974508    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-sdht5"
Sep 08 07:13:10.976576 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:10.976552    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vjp4z" event={"ID":"3527bfc8-44e7-4e23-9a37-d4b8670dd1a9","Type":"ContainerStarted","Data":"f0592802bc78c606e7b835f7d63f8b3769e7f78c92ba2250d2976567afa909b6"}
Sep 08 07:13:10.976692 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:10.976603    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vjp4z" event={"ID":"3527bfc8-44e7-4e23-9a37-d4b8670dd1a9","Type":"ContainerStarted","Data":"3a678ea80183c56d95b100bbce56fabac760d759664c7b2df832b500d4608d66"}
Sep 08 07:13:10.976692 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:10.976633    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vjp4z"
Sep 08 07:13:10.978354 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:10.978325    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-nt8lr" event={"ID":"7953ece0-8a97-4344-bf2d-baba5ab6a6f9","Type":"ContainerStarted","Data":"2b82704d29ed4ec5b0cafb7b3b0b810488877514050d777d43be07a1c24a5997"}
Sep 08 07:13:10.978429 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:10.978366    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-nt8lr"
Sep 08 07:13:10.978429 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:10.978382    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-nt8lr" event={"ID":"7953ece0-8a97-4344-bf2d-baba5ab6a6f9","Type":"ContainerStarted","Data":"f2bea0473d589d1b68efab711df36b2a7ce16c6ce35168372b57ea947f0f3189"}
Sep 08 07:13:10.981861 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:10.981833    2564 scope.go:117] "RemoveContainer" containerID="6a7b7e5f683f4f54a98fe595c096140456d1f8953779409a202f1ccc2fbe87c7"
Sep 08 07:13:10.982136 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:13:10.982118    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a7b7e5f683f4f54a98fe595c096140456d1f8953779409a202f1ccc2fbe87c7\": container with ID starting with 6a7b7e5f683f4f54a98fe595c096140456d1f8953779409a202f1ccc2fbe87c7 not found: ID does not exist" containerID="6a7b7e5f683f4f54a98fe595c096140456d1f8953779409a202f1ccc2fbe87c7"
Sep 08 07:13:10.982190 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:10.982144    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a7b7e5f683f4f54a98fe595c096140456d1f8953779409a202f1ccc2fbe87c7"} err="failed to get container status \"6a7b7e5f683f4f54a98fe595c096140456d1f8953779409a202f1ccc2fbe87c7\": rpc error: code = NotFound desc = could not find container \"6a7b7e5f683f4f54a98fe595c096140456d1f8953779409a202f1ccc2fbe87c7\": container with ID starting with 6a7b7e5f683f4f54a98fe595c096140456d1f8953779409a202f1ccc2fbe87c7 not found: ID does not exist"
Sep 08 07:13:10.982190 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:10.982159    2564 scope.go:117] "RemoveContainer" containerID="f43c067d2e60e27cfa2284560489abad902332ae3d0a336afdc31e564f0332bc"
Sep 08 07:13:10.992576 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:10.992554    2564 scope.go:117] "RemoveContainer" containerID="f43c067d2e60e27cfa2284560489abad902332ae3d0a336afdc31e564f0332bc"
Sep 08 07:13:10.992886 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:13:10.992866    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f43c067d2e60e27cfa2284560489abad902332ae3d0a336afdc31e564f0332bc\": container with ID starting with f43c067d2e60e27cfa2284560489abad902332ae3d0a336afdc31e564f0332bc not found: ID does not exist" containerID="f43c067d2e60e27cfa2284560489abad902332ae3d0a336afdc31e564f0332bc"
Sep 08 07:13:10.992934 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:10.992893    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f43c067d2e60e27cfa2284560489abad902332ae3d0a336afdc31e564f0332bc"} err="failed to get container status \"f43c067d2e60e27cfa2284560489abad902332ae3d0a336afdc31e564f0332bc\": rpc error: code = NotFound desc = could not find container \"f43c067d2e60e27cfa2284560489abad902332ae3d0a336afdc31e564f0332bc\": container with ID starting with f43c067d2e60e27cfa2284560489abad902332ae3d0a336afdc31e564f0332bc not found: ID does not exist"
Sep 08 07:13:10.997778 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:10.997735    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vjp4z" podStartSLOduration=1.9977220180000002 podStartE2EDuration="1.997722018s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:13:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:13:10.99631957 +0000 UTC m=+538.977358897" watchObservedRunningTime="2026-09-08 07:13:10.997722018 +0000 UTC m=+538.978761323"
Sep 08 07:13:11.018865 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:11.018817    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-nt8lr" podStartSLOduration=2.018804889 podStartE2EDuration="2.018804889s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:13:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:13:11.017094114 +0000 UTC m=+538.998133464" watchObservedRunningTime="2026-09-08 07:13:11.018804889 +0000 UTC m=+538.999844196"
Sep 08 07:13:21.987907 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:21.987874    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vjp4z"
Sep 08 07:13:21.988434 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:21.988016    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-nt8lr"
Sep 08 07:13:22.052034 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:22.052000    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vjp4z"]
Sep 08 07:13:22.052198 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:22.052182    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vjp4z" podUID="3527bfc8-44e7-4e23-9a37-d4b8670dd1a9" containerName="manager" containerID="cri-o://f0592802bc78c606e7b835f7d63f8b3769e7f78c92ba2250d2976567afa909b6" gracePeriod=10
Sep 08 07:13:22.246696 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:22.246623    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-xc7pp"]
Sep 08 07:13:22.250151 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:22.250135    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-xc7pp"
Sep 08 07:13:22.260681 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:22.260650    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-xc7pp"]
Sep 08 07:13:22.314378 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:22.314355    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vjp4z"
Sep 08 07:13:22.377050 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:22.376976    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3527bfc8-44e7-4e23-9a37-d4b8670dd1a9-extensions-socket-volume\") pod \"3527bfc8-44e7-4e23-9a37-d4b8670dd1a9\" (UID: \"3527bfc8-44e7-4e23-9a37-d4b8670dd1a9\") "
Sep 08 07:13:22.377229 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:22.377076    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kxxgc\" (UniqueName: \"kubernetes.io/projected/3527bfc8-44e7-4e23-9a37-d4b8670dd1a9-kube-api-access-kxxgc\") pod \"3527bfc8-44e7-4e23-9a37-d4b8670dd1a9\" (UID: \"3527bfc8-44e7-4e23-9a37-d4b8670dd1a9\") "
Sep 08 07:13:22.377229 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:22.377208    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cf76376b-e05d-4bd8-b33d-a5dc294102bc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-xc7pp\" (UID: \"cf76376b-e05d-4bd8-b33d-a5dc294102bc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-xc7pp"
Sep 08 07:13:22.377326 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:22.377304    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3527bfc8-44e7-4e23-9a37-d4b8670dd1a9-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3527bfc8-44e7-4e23-9a37-d4b8670dd1a9" (UID: "3527bfc8-44e7-4e23-9a37-d4b8670dd1a9"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 07:13:22.377370 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:22.377341    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqqkh\" (UniqueName: \"kubernetes.io/projected/cf76376b-e05d-4bd8-b33d-a5dc294102bc-kube-api-access-rqqkh\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-xc7pp\" (UID: \"cf76376b-e05d-4bd8-b33d-a5dc294102bc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-xc7pp"
Sep 08 07:13:22.377446 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:22.377433    2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3527bfc8-44e7-4e23-9a37-d4b8670dd1a9-extensions-socket-volume\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:13:22.379177 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:22.379152    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3527bfc8-44e7-4e23-9a37-d4b8670dd1a9-kube-api-access-kxxgc" (OuterVolumeSpecName: "kube-api-access-kxxgc") pod "3527bfc8-44e7-4e23-9a37-d4b8670dd1a9" (UID: "3527bfc8-44e7-4e23-9a37-d4b8670dd1a9"). InnerVolumeSpecName "kube-api-access-kxxgc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 07:13:22.478146 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:22.478110    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqqkh\" (UniqueName: \"kubernetes.io/projected/cf76376b-e05d-4bd8-b33d-a5dc294102bc-kube-api-access-rqqkh\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-xc7pp\" (UID: \"cf76376b-e05d-4bd8-b33d-a5dc294102bc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-xc7pp"
Sep 08 07:13:22.478328 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:22.478179    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cf76376b-e05d-4bd8-b33d-a5dc294102bc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-xc7pp\" (UID: \"cf76376b-e05d-4bd8-b33d-a5dc294102bc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-xc7pp"
Sep 08 07:13:22.478328 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:22.478232    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kxxgc\" (UniqueName: \"kubernetes.io/projected/3527bfc8-44e7-4e23-9a37-d4b8670dd1a9-kube-api-access-kxxgc\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:13:22.478524 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:22.478508    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cf76376b-e05d-4bd8-b33d-a5dc294102bc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-xc7pp\" (UID: \"cf76376b-e05d-4bd8-b33d-a5dc294102bc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-xc7pp"
Sep 08 07:13:22.486018 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:22.485991    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqqkh\" (UniqueName: \"kubernetes.io/projected/cf76376b-e05d-4bd8-b33d-a5dc294102bc-kube-api-access-rqqkh\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-xc7pp\" (UID: \"cf76376b-e05d-4bd8-b33d-a5dc294102bc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-xc7pp"
Sep 08 07:13:22.561629 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:22.561604    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-xc7pp"
Sep 08 07:13:22.834413 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:22.834341    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-xc7pp"]
Sep 08 07:13:22.837734 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:13:22.837706    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf76376b_e05d_4bd8_b33d_a5dc294102bc.slice/crio-5ebfd7ffe1834dc697227075d03265bc292973d5cb20a411256366fd79e7b63e WatchSource:0}: Error finding container 5ebfd7ffe1834dc697227075d03265bc292973d5cb20a411256366fd79e7b63e: Status 404 returned error can't find the container with id 5ebfd7ffe1834dc697227075d03265bc292973d5cb20a411256366fd79e7b63e
Sep 08 07:13:23.038449 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:23.038415    2564 generic.go:356] "Generic (PLEG): container finished" podID="3527bfc8-44e7-4e23-9a37-d4b8670dd1a9" containerID="f0592802bc78c606e7b835f7d63f8b3769e7f78c92ba2250d2976567afa909b6" exitCode=0
Sep 08 07:13:23.038875 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:23.038464    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vjp4z"
Sep 08 07:13:23.038875 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:23.038487    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vjp4z" event={"ID":"3527bfc8-44e7-4e23-9a37-d4b8670dd1a9","Type":"ContainerDied","Data":"f0592802bc78c606e7b835f7d63f8b3769e7f78c92ba2250d2976567afa909b6"}
Sep 08 07:13:23.038875 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:23.038533    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vjp4z" event={"ID":"3527bfc8-44e7-4e23-9a37-d4b8670dd1a9","Type":"ContainerDied","Data":"3a678ea80183c56d95b100bbce56fabac760d759664c7b2df832b500d4608d66"}
Sep 08 07:13:23.038875 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:23.038557    2564 scope.go:117] "RemoveContainer" containerID="f0592802bc78c606e7b835f7d63f8b3769e7f78c92ba2250d2976567afa909b6"
Sep 08 07:13:23.040679 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:23.040649    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-xc7pp" event={"ID":"cf76376b-e05d-4bd8-b33d-a5dc294102bc","Type":"ContainerStarted","Data":"da482a8efaf5208e33762985b6ed286a9312803147b366a061e3a8653aa26699"}
Sep 08 07:13:23.040862 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:23.040734    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-xc7pp" event={"ID":"cf76376b-e05d-4bd8-b33d-a5dc294102bc","Type":"ContainerStarted","Data":"5ebfd7ffe1834dc697227075d03265bc292973d5cb20a411256366fd79e7b63e"}
Sep 08 07:13:23.040862 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:23.040786    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-xc7pp"
Sep 08 07:13:23.047656 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:23.047641    2564 scope.go:117] "RemoveContainer" containerID="f0592802bc78c606e7b835f7d63f8b3769e7f78c92ba2250d2976567afa909b6"
Sep 08 07:13:23.047944 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:13:23.047924    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0592802bc78c606e7b835f7d63f8b3769e7f78c92ba2250d2976567afa909b6\": container with ID starting with f0592802bc78c606e7b835f7d63f8b3769e7f78c92ba2250d2976567afa909b6 not found: ID does not exist" containerID="f0592802bc78c606e7b835f7d63f8b3769e7f78c92ba2250d2976567afa909b6"
Sep 08 07:13:23.048023 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:23.047953    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0592802bc78c606e7b835f7d63f8b3769e7f78c92ba2250d2976567afa909b6"} err="failed to get container status \"f0592802bc78c606e7b835f7d63f8b3769e7f78c92ba2250d2976567afa909b6\": rpc error: code = NotFound desc = could not find container \"f0592802bc78c606e7b835f7d63f8b3769e7f78c92ba2250d2976567afa909b6\": container with ID starting with f0592802bc78c606e7b835f7d63f8b3769e7f78c92ba2250d2976567afa909b6 not found: ID does not exist"
Sep 08 07:13:23.056693 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:23.056671    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vjp4z"]
Sep 08 07:13:23.060424 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:23.060407    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vjp4z"]
Sep 08 07:13:23.081083 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:23.081041    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-xc7pp" podStartSLOduration=1.081026549 podStartE2EDuration="1.081026549s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:13:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:13:23.079446878 +0000 UTC m=+551.060486211" watchObservedRunningTime="2026-09-08 07:13:23.081026549 +0000 UTC m=+551.062065855"
Sep 08 07:13:24.510357 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:24.510315    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3527bfc8-44e7-4e23-9a37-d4b8670dd1a9" path="/var/lib/kubelet/pods/3527bfc8-44e7-4e23-9a37-d4b8670dd1a9/volumes"
Sep 08 07:13:34.048651 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:34.048623    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-xc7pp"
Sep 08 07:13:34.103601 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:34.103563    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-nt8lr"]
Sep 08 07:13:34.103820 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:34.103778    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-nt8lr" podUID="7953ece0-8a97-4344-bf2d-baba5ab6a6f9" containerName="manager" containerID="cri-o://2b82704d29ed4ec5b0cafb7b3b0b810488877514050d777d43be07a1c24a5997" gracePeriod=10
Sep 08 07:13:34.349646 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:34.349622    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-nt8lr"
Sep 08 07:13:34.481380 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:34.481344    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8kv2j\" (UniqueName: \"kubernetes.io/projected/7953ece0-8a97-4344-bf2d-baba5ab6a6f9-kube-api-access-8kv2j\") pod \"7953ece0-8a97-4344-bf2d-baba5ab6a6f9\" (UID: \"7953ece0-8a97-4344-bf2d-baba5ab6a6f9\") "
Sep 08 07:13:34.481548 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:34.481400    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7953ece0-8a97-4344-bf2d-baba5ab6a6f9-extensions-socket-volume\") pod \"7953ece0-8a97-4344-bf2d-baba5ab6a6f9\" (UID: \"7953ece0-8a97-4344-bf2d-baba5ab6a6f9\") "
Sep 08 07:13:34.481794 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:34.481764    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7953ece0-8a97-4344-bf2d-baba5ab6a6f9-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "7953ece0-8a97-4344-bf2d-baba5ab6a6f9" (UID: "7953ece0-8a97-4344-bf2d-baba5ab6a6f9"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 07:13:34.483493 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:34.483464    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7953ece0-8a97-4344-bf2d-baba5ab6a6f9-kube-api-access-8kv2j" (OuterVolumeSpecName: "kube-api-access-8kv2j") pod "7953ece0-8a97-4344-bf2d-baba5ab6a6f9" (UID: "7953ece0-8a97-4344-bf2d-baba5ab6a6f9"). InnerVolumeSpecName "kube-api-access-8kv2j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 07:13:34.582533 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:34.582455    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8kv2j\" (UniqueName: \"kubernetes.io/projected/7953ece0-8a97-4344-bf2d-baba5ab6a6f9-kube-api-access-8kv2j\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:13:34.582533 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:34.582485    2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7953ece0-8a97-4344-bf2d-baba5ab6a6f9-extensions-socket-volume\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:13:35.098310 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:35.098276    2564 generic.go:356] "Generic (PLEG): container finished" podID="7953ece0-8a97-4344-bf2d-baba5ab6a6f9" containerID="2b82704d29ed4ec5b0cafb7b3b0b810488877514050d777d43be07a1c24a5997" exitCode=0
Sep 08 07:13:35.098751 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:35.098318    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-nt8lr"
Sep 08 07:13:35.098751 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:35.098366    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-nt8lr" event={"ID":"7953ece0-8a97-4344-bf2d-baba5ab6a6f9","Type":"ContainerDied","Data":"2b82704d29ed4ec5b0cafb7b3b0b810488877514050d777d43be07a1c24a5997"}
Sep 08 07:13:35.098751 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:35.098426    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-nt8lr" event={"ID":"7953ece0-8a97-4344-bf2d-baba5ab6a6f9","Type":"ContainerDied","Data":"f2bea0473d589d1b68efab711df36b2a7ce16c6ce35168372b57ea947f0f3189"}
Sep 08 07:13:35.098751 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:35.098460    2564 scope.go:117] "RemoveContainer" containerID="2b82704d29ed4ec5b0cafb7b3b0b810488877514050d777d43be07a1c24a5997"
Sep 08 07:13:35.107423 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:35.107217    2564 scope.go:117] "RemoveContainer" containerID="2b82704d29ed4ec5b0cafb7b3b0b810488877514050d777d43be07a1c24a5997"
Sep 08 07:13:35.107514 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:13:35.107494    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b82704d29ed4ec5b0cafb7b3b0b810488877514050d777d43be07a1c24a5997\": container with ID starting with 2b82704d29ed4ec5b0cafb7b3b0b810488877514050d777d43be07a1c24a5997 not found: ID does not exist" containerID="2b82704d29ed4ec5b0cafb7b3b0b810488877514050d777d43be07a1c24a5997"
Sep 08 07:13:35.107556 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:35.107522    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b82704d29ed4ec5b0cafb7b3b0b810488877514050d777d43be07a1c24a5997"} err="failed to get container status \"2b82704d29ed4ec5b0cafb7b3b0b810488877514050d777d43be07a1c24a5997\": rpc error: code = NotFound desc = could not find container \"2b82704d29ed4ec5b0cafb7b3b0b810488877514050d777d43be07a1c24a5997\": container with ID starting with 2b82704d29ed4ec5b0cafb7b3b0b810488877514050d777d43be07a1c24a5997 not found: ID does not exist"
Sep 08 07:13:35.118498 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:35.118475    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-nt8lr"]
Sep 08 07:13:35.122598 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:35.122576    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-nt8lr"]
Sep 08 07:13:36.509937 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:36.509901    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7953ece0-8a97-4344-bf2d-baba5ab6a6f9" path="/var/lib/kubelet/pods/7953ece0-8a97-4344-bf2d-baba5ab6a6f9/volumes"
Sep 08 07:13:49.146815 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:49.146780    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-hpfkw"]
Sep 08 07:13:49.147220 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:49.147142    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3527bfc8-44e7-4e23-9a37-d4b8670dd1a9" containerName="manager"
Sep 08 07:13:49.147220 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:49.147155    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3527bfc8-44e7-4e23-9a37-d4b8670dd1a9" containerName="manager"
Sep 08 07:13:49.147220 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:49.147173    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7953ece0-8a97-4344-bf2d-baba5ab6a6f9" containerName="manager"
Sep 08 07:13:49.147220 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:49.147180    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7953ece0-8a97-4344-bf2d-baba5ab6a6f9" containerName="manager"
Sep 08 07:13:49.147343 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:49.147241    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="3527bfc8-44e7-4e23-9a37-d4b8670dd1a9" containerName="manager"
Sep 08 07:13:49.147343 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:49.147252    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7953ece0-8a97-4344-bf2d-baba5ab6a6f9" containerName="manager"
Sep 08 07:13:49.150675 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:49.150655    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-hpfkw"
Sep 08 07:13:49.152944 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:49.152922    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 08 07:13:49.153091 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:49.152963    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-rgb29\""
Sep 08 07:13:49.158336 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:49.158313    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-hpfkw"]
Sep 08 07:13:49.201651 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:49.201614    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9a7f16fa-2658-41dc-b21d-95451b47b466-config-file\") pod \"limitador-limitador-859c4d96d6-hpfkw\" (UID: \"9a7f16fa-2658-41dc-b21d-95451b47b466\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-hpfkw"
Sep 08 07:13:49.201788 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:49.201668    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7h5bs\" (UniqueName: \"kubernetes.io/projected/9a7f16fa-2658-41dc-b21d-95451b47b466-kube-api-access-7h5bs\") pod \"limitador-limitador-859c4d96d6-hpfkw\" (UID: \"9a7f16fa-2658-41dc-b21d-95451b47b466\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-hpfkw"
Sep 08 07:13:49.246185 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:49.246138    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-hpfkw"]
Sep 08 07:13:49.302300 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:49.302258    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9a7f16fa-2658-41dc-b21d-95451b47b466-config-file\") pod \"limitador-limitador-859c4d96d6-hpfkw\" (UID: \"9a7f16fa-2658-41dc-b21d-95451b47b466\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-hpfkw"
Sep 08 07:13:49.302474 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:49.302323    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7h5bs\" (UniqueName: \"kubernetes.io/projected/9a7f16fa-2658-41dc-b21d-95451b47b466-kube-api-access-7h5bs\") pod \"limitador-limitador-859c4d96d6-hpfkw\" (UID: \"9a7f16fa-2658-41dc-b21d-95451b47b466\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-hpfkw"
Sep 08 07:13:49.303093 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:49.303068    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9a7f16fa-2658-41dc-b21d-95451b47b466-config-file\") pod \"limitador-limitador-859c4d96d6-hpfkw\" (UID: \"9a7f16fa-2658-41dc-b21d-95451b47b466\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-hpfkw"
Sep 08 07:13:49.312375 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:49.312349    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7h5bs\" (UniqueName: \"kubernetes.io/projected/9a7f16fa-2658-41dc-b21d-95451b47b466-kube-api-access-7h5bs\") pod \"limitador-limitador-859c4d96d6-hpfkw\" (UID: \"9a7f16fa-2658-41dc-b21d-95451b47b466\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-hpfkw"
Sep 08 07:13:49.461598 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:49.461514    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-hpfkw"
Sep 08 07:13:49.571520 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:49.571482    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:13:49.575822 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:49.575807    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"
Sep 08 07:13:49.581948 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:49.581923    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:13:49.605289 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:49.605198    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdl9j\" (UniqueName: \"kubernetes.io/projected/075d4063-10b1-42f4-a676-edec8c6753eb-kube-api-access-xdl9j\") pod \"limitador-limitador-85d9db4d5d-ksmvr\" (UID: \"075d4063-10b1-42f4-a676-edec8c6753eb\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"
Sep 08 07:13:49.605453 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:49.605431    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/075d4063-10b1-42f4-a676-edec8c6753eb-config-file\") pod \"limitador-limitador-85d9db4d5d-ksmvr\" (UID: \"075d4063-10b1-42f4-a676-edec8c6753eb\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"
Sep 08 07:13:49.607657 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:49.607630    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:13:49.707184 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:49.707150    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdl9j\" (UniqueName: \"kubernetes.io/projected/075d4063-10b1-42f4-a676-edec8c6753eb-kube-api-access-xdl9j\") pod \"limitador-limitador-85d9db4d5d-ksmvr\" (UID: \"075d4063-10b1-42f4-a676-edec8c6753eb\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"
Sep 08 07:13:49.707343 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:49.707196    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/075d4063-10b1-42f4-a676-edec8c6753eb-config-file\") pod \"limitador-limitador-85d9db4d5d-ksmvr\" (UID: \"075d4063-10b1-42f4-a676-edec8c6753eb\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"
Sep 08 07:13:49.707829 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:49.707809    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/075d4063-10b1-42f4-a676-edec8c6753eb-config-file\") pod \"limitador-limitador-85d9db4d5d-ksmvr\" (UID: \"075d4063-10b1-42f4-a676-edec8c6753eb\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"
Sep 08 07:13:49.714929 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:49.714873    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdl9j\" (UniqueName: \"kubernetes.io/projected/075d4063-10b1-42f4-a676-edec8c6753eb-kube-api-access-xdl9j\") pod \"limitador-limitador-85d9db4d5d-ksmvr\" (UID: \"075d4063-10b1-42f4-a676-edec8c6753eb\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"
Sep 08 07:13:49.733113 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:49.733084    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-hpfkw"]
Sep 08 07:13:49.736607 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:13:49.736580    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a7f16fa_2658_41dc_b21d_95451b47b466.slice/crio-6b155867c288e8f634dd6c66553f5a95215cfd8de2211f8bb47b99535a3ecec3 WatchSource:0}: Error finding container 6b155867c288e8f634dd6c66553f5a95215cfd8de2211f8bb47b99535a3ecec3: Status 404 returned error can't find the container with id 6b155867c288e8f634dd6c66553f5a95215cfd8de2211f8bb47b99535a3ecec3
Sep 08 07:13:49.887367 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:49.887337    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"
Sep 08 07:13:50.157290 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:50.157208    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:13:50.161867 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:13:50.161834    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod075d4063_10b1_42f4_a676_edec8c6753eb.slice/crio-0655e6907805ce3b3623bb5fa281674afc3229b1cb0c971d65eecf341a936f1a WatchSource:0}: Error finding container 0655e6907805ce3b3623bb5fa281674afc3229b1cb0c971d65eecf341a936f1a: Status 404 returned error can't find the container with id 0655e6907805ce3b3623bb5fa281674afc3229b1cb0c971d65eecf341a936f1a
Sep 08 07:13:50.173372 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:50.173341    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-hpfkw" event={"ID":"9a7f16fa-2658-41dc-b21d-95451b47b466","Type":"ContainerStarted","Data":"6b155867c288e8f634dd6c66553f5a95215cfd8de2211f8bb47b99535a3ecec3"}
Sep 08 07:13:50.174627 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:50.174606    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr" event={"ID":"075d4063-10b1-42f4-a676-edec8c6753eb","Type":"ContainerStarted","Data":"0655e6907805ce3b3623bb5fa281674afc3229b1cb0c971d65eecf341a936f1a"}
Sep 08 07:13:51.182131 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:51.182098    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-hpfkw" event={"ID":"9a7f16fa-2658-41dc-b21d-95451b47b466","Type":"ContainerStarted","Data":"55c0d6120354e6123d1f9ab468caeca4d8473053a8676dd292d88566ce43159c"}
Sep 08 07:13:51.182537 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:51.182173    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-859c4d96d6-hpfkw"
Sep 08 07:13:51.183704 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:51.183679    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr" event={"ID":"075d4063-10b1-42f4-a676-edec8c6753eb","Type":"ContainerStarted","Data":"c0b5fdbfe771bc889285f17902bcd1a79e760e548f130ef9b4cd17a706d56027"}
Sep 08 07:13:51.183812 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:51.183752    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"
Sep 08 07:13:51.198931 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:51.198880    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-859c4d96d6-hpfkw" podStartSLOduration=0.961670077 podStartE2EDuration="2.198864068s" totalImagesPullingTime="1.237193991s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:13:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:13:51.197007359 +0000 UTC m=+579.178046678" watchObservedRunningTime="2026-09-08 07:13:51.198864068 +0000 UTC m=+579.179903373"
Sep 08 07:13:51.210766 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:13:51.210724    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr" podStartSLOduration=1.397916318 podStartE2EDuration="2.210709666s" totalImagesPullingTime="812.793348ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:13:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:13:51.210688355 +0000 UTC m=+579.191727662" watchObservedRunningTime="2026-09-08 07:13:51.210709666 +0000 UTC m=+579.191748973"
Sep 08 07:14:02.189807 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:14:02.189772    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"
Sep 08 07:14:02.190312 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:14:02.189842    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-859c4d96d6-hpfkw"
Sep 08 07:14:02.250319 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:14:02.250282    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-hpfkw"]
Sep 08 07:14:02.250494 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:14:02.250473    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-859c4d96d6-hpfkw" podUID="9a7f16fa-2658-41dc-b21d-95451b47b466" containerName="limitador" containerID="cri-o://55c0d6120354e6123d1f9ab468caeca4d8473053a8676dd292d88566ce43159c" gracePeriod=30
Sep 08 07:14:02.792810 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:14:02.792786    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-hpfkw"
Sep 08 07:14:02.910834 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:14:02.910725    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7h5bs\" (UniqueName: \"kubernetes.io/projected/9a7f16fa-2658-41dc-b21d-95451b47b466-kube-api-access-7h5bs\") pod \"9a7f16fa-2658-41dc-b21d-95451b47b466\" (UID: \"9a7f16fa-2658-41dc-b21d-95451b47b466\") "
Sep 08 07:14:02.910834 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:14:02.910821    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9a7f16fa-2658-41dc-b21d-95451b47b466-config-file\") pod \"9a7f16fa-2658-41dc-b21d-95451b47b466\" (UID: \"9a7f16fa-2658-41dc-b21d-95451b47b466\") "
Sep 08 07:14:02.911230 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:14:02.911206    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a7f16fa-2658-41dc-b21d-95451b47b466-config-file" (OuterVolumeSpecName: "config-file") pod "9a7f16fa-2658-41dc-b21d-95451b47b466" (UID: "9a7f16fa-2658-41dc-b21d-95451b47b466"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 07:14:02.912866 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:14:02.912840    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a7f16fa-2658-41dc-b21d-95451b47b466-kube-api-access-7h5bs" (OuterVolumeSpecName: "kube-api-access-7h5bs") pod "9a7f16fa-2658-41dc-b21d-95451b47b466" (UID: "9a7f16fa-2658-41dc-b21d-95451b47b466"). InnerVolumeSpecName "kube-api-access-7h5bs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 07:14:03.012109 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:14:03.012074    2564 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9a7f16fa-2658-41dc-b21d-95451b47b466-config-file\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:14:03.012109 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:14:03.012107    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7h5bs\" (UniqueName: \"kubernetes.io/projected/9a7f16fa-2658-41dc-b21d-95451b47b466-kube-api-access-7h5bs\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:14:03.241430 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:14:03.241343    2564 generic.go:356] "Generic (PLEG): container finished" podID="9a7f16fa-2658-41dc-b21d-95451b47b466" containerID="55c0d6120354e6123d1f9ab468caeca4d8473053a8676dd292d88566ce43159c" exitCode=0
Sep 08 07:14:03.241430 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:14:03.241394    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-hpfkw"
Sep 08 07:14:03.241836 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:14:03.241430    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-hpfkw" event={"ID":"9a7f16fa-2658-41dc-b21d-95451b47b466","Type":"ContainerDied","Data":"55c0d6120354e6123d1f9ab468caeca4d8473053a8676dd292d88566ce43159c"}
Sep 08 07:14:03.241836 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:14:03.241483    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-hpfkw" event={"ID":"9a7f16fa-2658-41dc-b21d-95451b47b466","Type":"ContainerDied","Data":"6b155867c288e8f634dd6c66553f5a95215cfd8de2211f8bb47b99535a3ecec3"}
Sep 08 07:14:03.241836 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:14:03.241506    2564 scope.go:117] "RemoveContainer" containerID="55c0d6120354e6123d1f9ab468caeca4d8473053a8676dd292d88566ce43159c"
Sep 08 07:14:03.250723 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:14:03.250699    2564 scope.go:117] "RemoveContainer" containerID="55c0d6120354e6123d1f9ab468caeca4d8473053a8676dd292d88566ce43159c"
Sep 08 07:14:03.251038 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:14:03.251016    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55c0d6120354e6123d1f9ab468caeca4d8473053a8676dd292d88566ce43159c\": container with ID starting with 55c0d6120354e6123d1f9ab468caeca4d8473053a8676dd292d88566ce43159c not found: ID does not exist" containerID="55c0d6120354e6123d1f9ab468caeca4d8473053a8676dd292d88566ce43159c"
Sep 08 07:14:03.251115 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:14:03.251047    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55c0d6120354e6123d1f9ab468caeca4d8473053a8676dd292d88566ce43159c"} err="failed to get container status \"55c0d6120354e6123d1f9ab468caeca4d8473053a8676dd292d88566ce43159c\": rpc error: code = NotFound desc = could not find container \"55c0d6120354e6123d1f9ab468caeca4d8473053a8676dd292d88566ce43159c\": container with ID starting with 55c0d6120354e6123d1f9ab468caeca4d8473053a8676dd292d88566ce43159c not found: ID does not exist"
Sep 08 07:14:03.262398 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:14:03.262369    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-hpfkw"]
Sep 08 07:14:03.266121 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:14:03.266095    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-hpfkw"]
Sep 08 07:14:04.509815 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:14:04.509784    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a7f16fa-2658-41dc-b21d-95451b47b466" path="/var/lib/kubelet/pods/9a7f16fa-2658-41dc-b21d-95451b47b466/volumes"
Sep 08 07:14:06.982854 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:14:06.982821    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-jgn8s"]
Sep 08 07:14:06.983342 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:14:06.983194    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a7f16fa-2658-41dc-b21d-95451b47b466" containerName="limitador"
Sep 08 07:14:06.983342 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:14:06.983207    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a7f16fa-2658-41dc-b21d-95451b47b466" containerName="limitador"
Sep 08 07:14:06.983342 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:14:06.983282    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a7f16fa-2658-41dc-b21d-95451b47b466" containerName="limitador"
Sep 08 07:14:06.986511 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:14:06.986491    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jgn8s"
Sep 08 07:14:06.988493 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:14:06.988471    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-p54bp\""
Sep 08 07:14:06.988621 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:14:06.988478    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 08 07:14:06.989105 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:14:06.989086    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 07:14:06.989208 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:14:06.989145    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 08 07:14:06.995454 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:14:06.995429    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-jgn8s"]
Sep 08 07:14:07.048670 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:14:07.048632    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/64aa2a3a-a4d1-44e3-a7a4-6f7b8ce75432-data\") pod \"postgres-69fb4594cf-jgn8s\" (UID: \"64aa2a3a-a4d1-44e3-a7a4-6f7b8ce75432\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jgn8s"
Sep 08 07:14:07.048670 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:14:07.048673    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkhr6\" (UniqueName: \"kubernetes.io/projected/64aa2a3a-a4d1-44e3-a7a4-6f7b8ce75432-kube-api-access-hkhr6\") pod \"postgres-69fb4594cf-jgn8s\" (UID: \"64aa2a3a-a4d1-44e3-a7a4-6f7b8ce75432\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jgn8s"
Sep 08 07:14:07.149841 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:14:07.149806    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/64aa2a3a-a4d1-44e3-a7a4-6f7b8ce75432-data\") pod \"postgres-69fb4594cf-jgn8s\" (UID: \"64aa2a3a-a4d1-44e3-a7a4-6f7b8ce75432\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jgn8s"
Sep 08 07:14:07.149841 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:14:07.149850    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkhr6\" (UniqueName: \"kubernetes.io/projected/64aa2a3a-a4d1-44e3-a7a4-6f7b8ce75432-kube-api-access-hkhr6\") pod \"postgres-69fb4594cf-jgn8s\" (UID: \"64aa2a3a-a4d1-44e3-a7a4-6f7b8ce75432\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jgn8s"
Sep 08 07:14:07.150335 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:14:07.150313    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/64aa2a3a-a4d1-44e3-a7a4-6f7b8ce75432-data\") pod \"postgres-69fb4594cf-jgn8s\" (UID: \"64aa2a3a-a4d1-44e3-a7a4-6f7b8ce75432\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jgn8s"
Sep 08 07:14:07.158853 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:14:07.158826    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkhr6\" (UniqueName: \"kubernetes.io/projected/64aa2a3a-a4d1-44e3-a7a4-6f7b8ce75432-kube-api-access-hkhr6\") pod \"postgres-69fb4594cf-jgn8s\" (UID: \"64aa2a3a-a4d1-44e3-a7a4-6f7b8ce75432\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jgn8s"
Sep 08 07:14:07.297644 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:14:07.297611    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jgn8s"
Sep 08 07:14:07.568151 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:14:07.568125    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-jgn8s"]
Sep 08 07:14:07.570658 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:14:07.570632    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64aa2a3a_a4d1_44e3_a7a4_6f7b8ce75432.slice/crio-d10c38907eb594c78465d46d725e0761697b8e54b72e685f473bce446eecc819 WatchSource:0}: Error finding container d10c38907eb594c78465d46d725e0761697b8e54b72e685f473bce446eecc819: Status 404 returned error can't find the container with id d10c38907eb594c78465d46d725e0761697b8e54b72e685f473bce446eecc819
Sep 08 07:14:08.270028 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:14:08.269991    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jgn8s" event={"ID":"64aa2a3a-a4d1-44e3-a7a4-6f7b8ce75432","Type":"ContainerStarted","Data":"d10c38907eb594c78465d46d725e0761697b8e54b72e685f473bce446eecc819"}
Sep 08 07:14:12.479469 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:14:12.479438    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-8d4lx_5cf68f79-8fda-42e2-92c1-05a5a601f505/console-operator/1.log"
Sep 08 07:14:12.482074 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:14:12.482049    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-8d4lx_5cf68f79-8fda-42e2-92c1-05a5a601f505/console-operator/1.log"
Sep 08 07:14:13.305607 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:14:13.305574    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jgn8s" event={"ID":"64aa2a3a-a4d1-44e3-a7a4-6f7b8ce75432","Type":"ContainerStarted","Data":"d92847a7f3a6343b177a25b566837e72a81b35abaed0ca927c5175935694a11e"}
Sep 08 07:14:13.305849 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:14:13.305684    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jgn8s"
Sep 08 07:14:13.321827 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:14:13.321772    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jgn8s" podStartSLOduration=2.543760217 podStartE2EDuration="7.321752761s" totalImagesPullingTime="4.777992544s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:14:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:14:13.319379947 +0000 UTC m=+601.300419264" watchObservedRunningTime="2026-09-08 07:14:13.321752761 +0000 UTC m=+601.302792070"
Sep 08 07:14:19.339176 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:14:19.339144    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jgn8s"
Sep 08 07:14:26.036026 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:14:26.035988    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-67fbccb46f-4hxv2"]
Sep 08 07:14:26.069041 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:14:26.069009    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-67fbccb46f-4hxv2"]
Sep 08 07:14:26.069201 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:14:26.069068    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-67fbccb46f-4hxv2"
Sep 08 07:14:26.071167 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:14:26.071144    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 08 07:14:26.071664 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:14:26.071646    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-w2vnv\""
Sep 08 07:14:26.071761 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:14:26.071668    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 08 07:14:26.071761 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:14:26.071648    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 08 07:14:26.211236 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:14:26.211196    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfw4b\" (UniqueName: \"kubernetes.io/projected/e41f2ba9-6035-4a6a-9ac1-e730f29a246f-kube-api-access-vfw4b\") pod \"maas-controller-67fbccb46f-4hxv2\" (UID: \"e41f2ba9-6035-4a6a-9ac1-e730f29a246f\") " pod="opendatahub/maas-controller-67fbccb46f-4hxv2"
Sep 08 07:14:26.211443 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:14:26.211315    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e41f2ba9-6035-4a6a-9ac1-e730f29a246f-webhook-cert\") pod \"maas-controller-67fbccb46f-4hxv2\" (UID: \"e41f2ba9-6035-4a6a-9ac1-e730f29a246f\") " pod="opendatahub/maas-controller-67fbccb46f-4hxv2"
Sep 08 07:14:26.211443 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:14:26.211351    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e41f2ba9-6035-4a6a-9ac1-e730f29a246f-metrics-certs\") pod \"maas-controller-67fbccb46f-4hxv2\" (UID: \"e41f2ba9-6035-4a6a-9ac1-e730f29a246f\") " pod="opendatahub/maas-controller-67fbccb46f-4hxv2"
Sep 08 07:14:26.312812 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:14:26.312721    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e41f2ba9-6035-4a6a-9ac1-e730f29a246f-webhook-cert\") pod \"maas-controller-67fbccb46f-4hxv2\" (UID: \"e41f2ba9-6035-4a6a-9ac1-e730f29a246f\") " pod="opendatahub/maas-controller-67fbccb46f-4hxv2"
Sep 08 07:14:26.312812 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:14:26.312766    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e41f2ba9-6035-4a6a-9ac1-e730f29a246f-metrics-certs\") pod \"maas-controller-67fbccb46f-4hxv2\" (UID: \"e41f2ba9-6035-4a6a-9ac1-e730f29a246f\") " pod="opendatahub/maas-controller-67fbccb46f-4hxv2"
Sep 08 07:14:26.312812 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:14:26.312791    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfw4b\" (UniqueName: \"kubernetes.io/projected/e41f2ba9-6035-4a6a-9ac1-e730f29a246f-kube-api-access-vfw4b\") pod \"maas-controller-67fbccb46f-4hxv2\" (UID: \"e41f2ba9-6035-4a6a-9ac1-e730f29a246f\") " pod="opendatahub/maas-controller-67fbccb46f-4hxv2"
Sep 08 07:14:26.315325 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:14:26.315298    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e41f2ba9-6035-4a6a-9ac1-e730f29a246f-metrics-certs\") pod \"maas-controller-67fbccb46f-4hxv2\" (UID: \"e41f2ba9-6035-4a6a-9ac1-e730f29a246f\") " pod="opendatahub/maas-controller-67fbccb46f-4hxv2"
Sep 08 07:14:26.315462 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:14:26.315298    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e41f2ba9-6035-4a6a-9ac1-e730f29a246f-webhook-cert\") pod \"maas-controller-67fbccb46f-4hxv2\" (UID: \"e41f2ba9-6035-4a6a-9ac1-e730f29a246f\") " pod="opendatahub/maas-controller-67fbccb46f-4hxv2"
Sep 08 07:14:26.320963 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:14:26.320934    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfw4b\" (UniqueName: \"kubernetes.io/projected/e41f2ba9-6035-4a6a-9ac1-e730f29a246f-kube-api-access-vfw4b\") pod \"maas-controller-67fbccb46f-4hxv2\" (UID: \"e41f2ba9-6035-4a6a-9ac1-e730f29a246f\") " pod="opendatahub/maas-controller-67fbccb46f-4hxv2"
Sep 08 07:14:26.379810 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:14:26.379784    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-67fbccb46f-4hxv2"
Sep 08 07:14:26.649248 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:14:26.649173    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-67fbccb46f-4hxv2"]
Sep 08 07:14:26.652101 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:14:26.652073    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode41f2ba9_6035_4a6a_9ac1_e730f29a246f.slice/crio-30d080401e1ec095ccfc16da40c0ceaadd13eb9dd3f2637b78704f676ac23bde WatchSource:0}: Error finding container 30d080401e1ec095ccfc16da40c0ceaadd13eb9dd3f2637b78704f676ac23bde: Status 404 returned error can't find the container with id 30d080401e1ec095ccfc16da40c0ceaadd13eb9dd3f2637b78704f676ac23bde
Sep 08 07:14:27.374857 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:14:27.374813    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-67fbccb46f-4hxv2" event={"ID":"e41f2ba9-6035-4a6a-9ac1-e730f29a246f","Type":"ContainerStarted","Data":"30d080401e1ec095ccfc16da40c0ceaadd13eb9dd3f2637b78704f676ac23bde"}
Sep 08 07:14:29.385074 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:14:29.384947    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-67fbccb46f-4hxv2" event={"ID":"e41f2ba9-6035-4a6a-9ac1-e730f29a246f","Type":"ContainerStarted","Data":"4aa8f2b33a9a0224cbaeaf58b4170b387193762694f7cb0f253fb70c29038204"}
Sep 08 07:14:29.385074 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:14:29.385045    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-67fbccb46f-4hxv2"
Sep 08 07:14:29.403963 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:14:29.403912    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-67fbccb46f-4hxv2" podStartSLOduration=1.024168169 podStartE2EDuration="3.403896328s" totalImagesPullingTime="2.379728159s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:14:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:14:29.401991019 +0000 UTC m=+617.383030342" watchObservedRunningTime="2026-09-08 07:14:29.403896328 +0000 UTC m=+617.384935633"
Sep 08 07:14:40.392754 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:14:40.392676    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-67fbccb46f-4hxv2"
Sep 08 07:15:02.330033 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:15:02.329998    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-55f944c447-7dgdn"]
Sep 08 07:15:02.335249 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:15:02.335223    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-55f944c447-7dgdn"
Sep 08 07:15:02.337223 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:15:02.337198    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 08 07:15:02.337345 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:15:02.337289    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-qfrsm\""
Sep 08 07:15:02.337642 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:15:02.337623    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 08 07:15:02.346367 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:15:02.346271    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-55f944c447-7dgdn"]
Sep 08 07:15:02.424531 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:15:02.424483    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab37a706-3074-4de9-9c82-4f003c5ab495-metrics-certs\") pod \"maas-api-55f944c447-7dgdn\" (UID: \"ab37a706-3074-4de9-9c82-4f003c5ab495\") " pod="odh-ai-gateway-infra/maas-api-55f944c447-7dgdn"
Sep 08 07:15:02.424531 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:15:02.424532    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab37a706-3074-4de9-9c82-4f003c5ab495-maas-api-tls\") pod \"maas-api-55f944c447-7dgdn\" (UID: \"ab37a706-3074-4de9-9c82-4f003c5ab495\") " pod="odh-ai-gateway-infra/maas-api-55f944c447-7dgdn"
Sep 08 07:15:02.424788 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:15:02.424667    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9pjl\" (UniqueName: \"kubernetes.io/projected/ab37a706-3074-4de9-9c82-4f003c5ab495-kube-api-access-t9pjl\") pod \"maas-api-55f944c447-7dgdn\" (UID: \"ab37a706-3074-4de9-9c82-4f003c5ab495\") " pod="odh-ai-gateway-infra/maas-api-55f944c447-7dgdn"
Sep 08 07:15:02.424788 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:15:02.424714    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab37a706-3074-4de9-9c82-4f003c5ab495-openshift-service-ca\") pod \"maas-api-55f944c447-7dgdn\" (UID: \"ab37a706-3074-4de9-9c82-4f003c5ab495\") " pod="odh-ai-gateway-infra/maas-api-55f944c447-7dgdn"
Sep 08 07:15:02.525229 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:15:02.525197    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9pjl\" (UniqueName: \"kubernetes.io/projected/ab37a706-3074-4de9-9c82-4f003c5ab495-kube-api-access-t9pjl\") pod \"maas-api-55f944c447-7dgdn\" (UID: \"ab37a706-3074-4de9-9c82-4f003c5ab495\") " pod="odh-ai-gateway-infra/maas-api-55f944c447-7dgdn"
Sep 08 07:15:02.525229 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:15:02.525234    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab37a706-3074-4de9-9c82-4f003c5ab495-openshift-service-ca\") pod \"maas-api-55f944c447-7dgdn\" (UID: \"ab37a706-3074-4de9-9c82-4f003c5ab495\") " pod="odh-ai-gateway-infra/maas-api-55f944c447-7dgdn"
Sep 08 07:15:02.525490 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:15:02.525257    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab37a706-3074-4de9-9c82-4f003c5ab495-metrics-certs\") pod \"maas-api-55f944c447-7dgdn\" (UID: \"ab37a706-3074-4de9-9c82-4f003c5ab495\") " pod="odh-ai-gateway-infra/maas-api-55f944c447-7dgdn"
Sep 08 07:15:02.525490 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:15:02.525285    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab37a706-3074-4de9-9c82-4f003c5ab495-maas-api-tls\") pod \"maas-api-55f944c447-7dgdn\" (UID: \"ab37a706-3074-4de9-9c82-4f003c5ab495\") " pod="odh-ai-gateway-infra/maas-api-55f944c447-7dgdn"
Sep 08 07:15:02.525490 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:15:02.525418    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-metrics-tls: secret "maas-api-metrics-tls" not found
Sep 08 07:15:02.525638 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:15:02.525494    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab37a706-3074-4de9-9c82-4f003c5ab495-metrics-certs podName:ab37a706-3074-4de9-9c82-4f003c5ab495 nodeName:}" failed. No retries permitted until 2026-09-08 07:15:03.025471285 +0000 UTC m=+651.006510586 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab37a706-3074-4de9-9c82-4f003c5ab495-metrics-certs") pod "maas-api-55f944c447-7dgdn" (UID: "ab37a706-3074-4de9-9c82-4f003c5ab495") : secret "maas-api-metrics-tls" not found
Sep 08 07:15:02.526064 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:15:02.526042    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab37a706-3074-4de9-9c82-4f003c5ab495-openshift-service-ca\") pod \"maas-api-55f944c447-7dgdn\" (UID: \"ab37a706-3074-4de9-9c82-4f003c5ab495\") " pod="odh-ai-gateway-infra/maas-api-55f944c447-7dgdn"
Sep 08 07:15:02.528179 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:15:02.528157    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab37a706-3074-4de9-9c82-4f003c5ab495-maas-api-tls\") pod \"maas-api-55f944c447-7dgdn\" (UID: \"ab37a706-3074-4de9-9c82-4f003c5ab495\") " pod="odh-ai-gateway-infra/maas-api-55f944c447-7dgdn"
Sep 08 07:15:02.532961 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:15:02.532937    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9pjl\" (UniqueName: \"kubernetes.io/projected/ab37a706-3074-4de9-9c82-4f003c5ab495-kube-api-access-t9pjl\") pod \"maas-api-55f944c447-7dgdn\" (UID: \"ab37a706-3074-4de9-9c82-4f003c5ab495\") " pod="odh-ai-gateway-infra/maas-api-55f944c447-7dgdn"
Sep 08 07:15:03.028590 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:15:03.028540    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab37a706-3074-4de9-9c82-4f003c5ab495-metrics-certs\") pod \"maas-api-55f944c447-7dgdn\" (UID: \"ab37a706-3074-4de9-9c82-4f003c5ab495\") " pod="odh-ai-gateway-infra/maas-api-55f944c447-7dgdn"
Sep 08 07:15:03.031040 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:15:03.031014    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab37a706-3074-4de9-9c82-4f003c5ab495-metrics-certs\") pod \"maas-api-55f944c447-7dgdn\" (UID: \"ab37a706-3074-4de9-9c82-4f003c5ab495\") " pod="odh-ai-gateway-infra/maas-api-55f944c447-7dgdn"
Sep 08 07:15:03.141271 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:15:03.141237    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:15:03.248857 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:15:03.248815    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-55f944c447-7dgdn"
Sep 08 07:15:03.538758 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:15:03.538720    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-55f944c447-7dgdn"]
Sep 08 07:15:03.541914 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:15:03.541884    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab37a706_3074_4de9_9c82_4f003c5ab495.slice/crio-883c28d433d7f60db5add515dc31226cfff9405025f07e0327fe8e3d8176a743 WatchSource:0}: Error finding container 883c28d433d7f60db5add515dc31226cfff9405025f07e0327fe8e3d8176a743: Status 404 returned error can't find the container with id 883c28d433d7f60db5add515dc31226cfff9405025f07e0327fe8e3d8176a743
Sep 08 07:15:04.551116 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:15:04.551080    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-55f944c447-7dgdn" event={"ID":"ab37a706-3074-4de9-9c82-4f003c5ab495","Type":"ContainerStarted","Data":"883c28d433d7f60db5add515dc31226cfff9405025f07e0327fe8e3d8176a743"}
Sep 08 07:15:05.557730 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:15:05.557697    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-55f944c447-7dgdn" event={"ID":"ab37a706-3074-4de9-9c82-4f003c5ab495","Type":"ContainerStarted","Data":"e79d870f672db5375248de931383e41b146528f19ec7ee8784f78b614ba304cb"}
Sep 08 07:15:05.558187 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:15:05.557806    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-55f944c447-7dgdn"
Sep 08 07:15:05.573711 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:15:05.573659    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-55f944c447-7dgdn" podStartSLOduration=1.9630457319999999 podStartE2EDuration="3.573640467s" totalImagesPullingTime="1.610594735s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:15:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:15:05.572184642 +0000 UTC m=+653.553223949" watchObservedRunningTime="2026-09-08 07:15:05.573640467 +0000 UTC m=+653.554679773"
Sep 08 07:15:11.568653 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:15:11.568622    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-55f944c447-7dgdn"
Sep 08 07:15:26.322619 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:15:26.322584    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:15:35.336911 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:15:35.336877    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-hcz2v"]
Sep 08 07:15:35.342011 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:15:35.341986    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hcz2v"
Sep 08 07:15:35.344369 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:15:35.344345    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 08 07:15:35.344565 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:15:35.344548    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 08 07:15:35.345008 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:15:35.344991    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-zg7w8\""
Sep 08 07:15:35.345298 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:15:35.345282    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Sep 08 07:15:35.348688 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:15:35.348665    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-hcz2v"]
Sep 08 07:15:35.517241 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:15:35.517207    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/02fa3eb4-e4dd-4a72-bb16-2c1fef583226-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hcz2v\" (UID: \"02fa3eb4-e4dd-4a72-bb16-2c1fef583226\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hcz2v"
Sep 08 07:15:35.517431 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:15:35.517247    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02fa3eb4-e4dd-4a72-bb16-2c1fef583226-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hcz2v\" (UID: \"02fa3eb4-e4dd-4a72-bb16-2c1fef583226\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hcz2v"
Sep 08 07:15:35.517431 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:15:35.517288    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/02fa3eb4-e4dd-4a72-bb16-2c1fef583226-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hcz2v\" (UID: \"02fa3eb4-e4dd-4a72-bb16-2c1fef583226\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hcz2v"
Sep 08 07:15:35.517431 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:15:35.517313    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/02fa3eb4-e4dd-4a72-bb16-2c1fef583226-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hcz2v\" (UID: \"02fa3eb4-e4dd-4a72-bb16-2c1fef583226\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hcz2v"
Sep 08 07:15:35.517431 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:15:35.517337    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhvdw\" (UniqueName: \"kubernetes.io/projected/02fa3eb4-e4dd-4a72-bb16-2c1fef583226-kube-api-access-xhvdw\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hcz2v\" (UID: \"02fa3eb4-e4dd-4a72-bb16-2c1fef583226\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hcz2v"
Sep 08 07:15:35.517431 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:15:35.517404    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/02fa3eb4-e4dd-4a72-bb16-2c1fef583226-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hcz2v\" (UID: \"02fa3eb4-e4dd-4a72-bb16-2c1fef583226\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hcz2v"
Sep 08 07:15:35.618130 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:15:35.618046    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/02fa3eb4-e4dd-4a72-bb16-2c1fef583226-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hcz2v\" (UID: \"02fa3eb4-e4dd-4a72-bb16-2c1fef583226\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hcz2v"
Sep 08 07:15:35.618130 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:15:35.618084    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02fa3eb4-e4dd-4a72-bb16-2c1fef583226-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hcz2v\" (UID: \"02fa3eb4-e4dd-4a72-bb16-2c1fef583226\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hcz2v"
Sep 08 07:15:35.618130 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:15:35.618113    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/02fa3eb4-e4dd-4a72-bb16-2c1fef583226-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hcz2v\" (UID: \"02fa3eb4-e4dd-4a72-bb16-2c1fef583226\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hcz2v"
Sep 08 07:15:35.618393 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:15:35.618138    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/02fa3eb4-e4dd-4a72-bb16-2c1fef583226-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hcz2v\" (UID: \"02fa3eb4-e4dd-4a72-bb16-2c1fef583226\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hcz2v"
Sep 08 07:15:35.618393 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:15:35.618161    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhvdw\" (UniqueName: \"kubernetes.io/projected/02fa3eb4-e4dd-4a72-bb16-2c1fef583226-kube-api-access-xhvdw\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hcz2v\" (UID: \"02fa3eb4-e4dd-4a72-bb16-2c1fef583226\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hcz2v"
Sep 08 07:15:35.618393 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:15:35.618203    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/02fa3eb4-e4dd-4a72-bb16-2c1fef583226-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hcz2v\" (UID: \"02fa3eb4-e4dd-4a72-bb16-2c1fef583226\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hcz2v"
Sep 08 07:15:35.618582 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:15:35.618554    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/02fa3eb4-e4dd-4a72-bb16-2c1fef583226-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hcz2v\" (UID: \"02fa3eb4-e4dd-4a72-bb16-2c1fef583226\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hcz2v"
Sep 08 07:15:35.618654 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:15:35.618586    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02fa3eb4-e4dd-4a72-bb16-2c1fef583226-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hcz2v\" (UID: \"02fa3eb4-e4dd-4a72-bb16-2c1fef583226\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hcz2v"
Sep 08 07:15:35.618654 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:15:35.618633    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/02fa3eb4-e4dd-4a72-bb16-2c1fef583226-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hcz2v\" (UID: \"02fa3eb4-e4dd-4a72-bb16-2c1fef583226\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hcz2v"
Sep 08 07:15:35.620393 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:15:35.620366    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/02fa3eb4-e4dd-4a72-bb16-2c1fef583226-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hcz2v\" (UID: \"02fa3eb4-e4dd-4a72-bb16-2c1fef583226\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hcz2v"
Sep 08 07:15:35.620669 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:15:35.620652    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/02fa3eb4-e4dd-4a72-bb16-2c1fef583226-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hcz2v\" (UID: \"02fa3eb4-e4dd-4a72-bb16-2c1fef583226\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hcz2v"
Sep 08 07:15:35.626085 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:15:35.626061    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhvdw\" (UniqueName: \"kubernetes.io/projected/02fa3eb4-e4dd-4a72-bb16-2c1fef583226-kube-api-access-xhvdw\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hcz2v\" (UID: \"02fa3eb4-e4dd-4a72-bb16-2c1fef583226\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hcz2v"
Sep 08 07:15:35.653731 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:15:35.653698    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hcz2v"
Sep 08 07:15:35.928404 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:15:35.928382    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-hcz2v"]
Sep 08 07:15:35.930727 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:15:35.930695    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02fa3eb4_e4dd_4a72_bb16_2c1fef583226.slice/crio-189aedcfe4a023a555458f18b3be01557ab967ae3c43003934216356680c17f2 WatchSource:0}: Error finding container 189aedcfe4a023a555458f18b3be01557ab967ae3c43003934216356680c17f2: Status 404 returned error can't find the container with id 189aedcfe4a023a555458f18b3be01557ab967ae3c43003934216356680c17f2
Sep 08 07:15:36.149537 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:15:36.149495    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:15:36.709414 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:15:36.709372    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hcz2v" event={"ID":"02fa3eb4-e4dd-4a72-bb16-2c1fef583226","Type":"ContainerStarted","Data":"189aedcfe4a023a555458f18b3be01557ab967ae3c43003934216356680c17f2"}
Sep 08 07:15:37.715896 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:15:37.715856    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hcz2v" event={"ID":"02fa3eb4-e4dd-4a72-bb16-2c1fef583226","Type":"ContainerStarted","Data":"52f29add72e4612163922714d983c91c17ef6ec60195fbcd77e40912aaba5625"}
Sep 08 07:15:37.731446 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:15:37.731384    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hcz2v" podStartSLOduration=1.7510522339999999 podStartE2EDuration="2.731369558s" totalImagesPullingTime="980.317324ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:15:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:15:37.730685466 +0000 UTC m=+685.711724793" watchObservedRunningTime="2026-09-08 07:15:37.731369558 +0000 UTC m=+685.712408863"
Sep 08 07:15:45.654848 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:15:45.654808    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hcz2v"
Sep 08 07:15:45.655373 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:15:45.654880    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hcz2v"
Sep 08 07:15:45.667541 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:15:45.667513    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hcz2v"
Sep 08 07:15:45.767956 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:15:45.767927    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hcz2v"
Sep 08 07:15:56.544532 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:15:56.544500    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:16:10.640837 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:16:10.640757    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:16:20.840792 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:16:20.840749    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:16:39.144438 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:16:39.144400    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:16:47.442632 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:16:47.442597    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:18:20.979007 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:20.978951    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7897-140289046384048"]
Sep 08 07:18:20.982669 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:20.982646    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7897-140289046384048"
Sep 08 07:18:20.984763 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:20.984732    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-lxxzx\""
Sep 08 07:18:20.986865 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:20.986841    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7897-140289046384048"]
Sep 08 07:18:21.079191 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:21.079159    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6wjn\" (UniqueName: \"kubernetes.io/projected/ccccf8ee-9065-4830-919a-f1c04623f074-kube-api-access-q6wjn\") pod \"test-curl-7897-140289046384048\" (UID: \"ccccf8ee-9065-4830-919a-f1c04623f074\") " pod="opendatahub/test-curl-7897-140289046384048"
Sep 08 07:18:21.180517 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:21.180482    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6wjn\" (UniqueName: \"kubernetes.io/projected/ccccf8ee-9065-4830-919a-f1c04623f074-kube-api-access-q6wjn\") pod \"test-curl-7897-140289046384048\" (UID: \"ccccf8ee-9065-4830-919a-f1c04623f074\") " pod="opendatahub/test-curl-7897-140289046384048"
Sep 08 07:18:21.191589 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:21.191551    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6wjn\" (UniqueName: \"kubernetes.io/projected/ccccf8ee-9065-4830-919a-f1c04623f074-kube-api-access-q6wjn\") pod \"test-curl-7897-140289046384048\" (UID: \"ccccf8ee-9065-4830-919a-f1c04623f074\") " pod="opendatahub/test-curl-7897-140289046384048"
Sep 08 07:18:21.294837 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:21.294802    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7897-140289046384048"
Sep 08 07:18:21.562396 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:21.562371    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7897-140289046384048"]
Sep 08 07:18:21.565170 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:18:21.565141    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podccccf8ee_9065_4830_919a_f1c04623f074.slice/crio-c69ebcc776ed6e8ba69d46d8a0d512a46a15aa4719cb7ecbebd3adb37878634f WatchSource:0}: Error finding container c69ebcc776ed6e8ba69d46d8a0d512a46a15aa4719cb7ecbebd3adb37878634f: Status 404 returned error can't find the container with id c69ebcc776ed6e8ba69d46d8a0d512a46a15aa4719cb7ecbebd3adb37878634f
Sep 08 07:18:21.566524 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:21.566501    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 07:18:22.542607 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:22.542573    2564 generic.go:356] "Generic (PLEG): container finished" podID="ccccf8ee-9065-4830-919a-f1c04623f074" containerID="df5d69b8781e27160d5016ca32a8f999122ac35f5351872e526e51e3b742e21d" exitCode=0
Sep 08 07:18:22.543018 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:22.542663    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7897-140289046384048" event={"ID":"ccccf8ee-9065-4830-919a-f1c04623f074","Type":"ContainerDied","Data":"df5d69b8781e27160d5016ca32a8f999122ac35f5351872e526e51e3b742e21d"}
Sep 08 07:18:22.543018 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:22.542699    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7897-140289046384048" event={"ID":"ccccf8ee-9065-4830-919a-f1c04623f074","Type":"ContainerStarted","Data":"c69ebcc776ed6e8ba69d46d8a0d512a46a15aa4719cb7ecbebd3adb37878634f"}
Sep 08 07:18:23.042486 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:23.042454    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:18:23.692176 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:23.692149    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7897-140289046384048"
Sep 08 07:18:23.725159 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:23.725123    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7897-140289046384048_ccccf8ee-9065-4830-919a-f1c04623f074/test-curl-7897-140289046384048/0.log"
Sep 08 07:18:23.747648 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:23.747616    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7897-140289046384048"]
Sep 08 07:18:23.750781 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:23.750755    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7897-140289046384048"]
Sep 08 07:18:23.804552 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:23.804471    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q6wjn\" (UniqueName: \"kubernetes.io/projected/ccccf8ee-9065-4830-919a-f1c04623f074-kube-api-access-q6wjn\") pod \"ccccf8ee-9065-4830-919a-f1c04623f074\" (UID: \"ccccf8ee-9065-4830-919a-f1c04623f074\") "
Sep 08 07:18:23.806692 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:23.806659    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ccccf8ee-9065-4830-919a-f1c04623f074-kube-api-access-q6wjn" (OuterVolumeSpecName: "kube-api-access-q6wjn") pod "ccccf8ee-9065-4830-919a-f1c04623f074" (UID: "ccccf8ee-9065-4830-919a-f1c04623f074"). InnerVolumeSpecName "kube-api-access-q6wjn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 07:18:23.867307 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:23.867274    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7897-140289046384048"]
Sep 08 07:18:23.867921 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:23.867896    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ccccf8ee-9065-4830-919a-f1c04623f074" containerName="test-curl-7897-140289046384048"
Sep 08 07:18:23.868111 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:23.868095    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ccccf8ee-9065-4830-919a-f1c04623f074" containerName="test-curl-7897-140289046384048"
Sep 08 07:18:23.868370 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:23.868352    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ccccf8ee-9065-4830-919a-f1c04623f074" containerName="test-curl-7897-140289046384048"
Sep 08 07:18:23.871813 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:23.871791    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-620112-76649f9577-fd8c9"]
Sep 08 07:18:23.871945 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:23.871925    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7897-140289046384048"
Sep 08 07:18:23.875715 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:23.875696    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-620112-76649f9577-fd8c9"
Sep 08 07:18:23.878185 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:23.877946    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-620112-serving-cert\""
Sep 08 07:18:23.879187 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:23.879162    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7897-140289046384048"]
Sep 08 07:18:23.882051 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:23.881999    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-620112-76649f9577-fd8c9"]
Sep 08 07:18:23.905600 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:23.905568    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdg8q\" (UniqueName: \"kubernetes.io/projected/0858afbf-87b7-4774-8780-088555948bf9-kube-api-access-hdg8q\") pod \"test-curl-7897-140289046384048\" (UID: \"0858afbf-87b7-4774-8780-088555948bf9\") " pod="opendatahub/test-curl-7897-140289046384048"
Sep 08 07:18:23.905771 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:23.905746    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q6wjn\" (UniqueName: \"kubernetes.io/projected/ccccf8ee-9065-4830-919a-f1c04623f074-kube-api-access-q6wjn\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:18:24.006885 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:24.006841    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/14e67ce3-7367-41c0-b2b0-3fd42cbc6753-maas-api-tls\") pod \"maas-api-e2e-inf-a-620112-76649f9577-fd8c9\" (UID: \"14e67ce3-7367-41c0-b2b0-3fd42cbc6753\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-620112-76649f9577-fd8c9"
Sep 08 07:18:24.007114 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:24.007028    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdg8q\" (UniqueName: \"kubernetes.io/projected/0858afbf-87b7-4774-8780-088555948bf9-kube-api-access-hdg8q\") pod \"test-curl-7897-140289046384048\" (UID: \"0858afbf-87b7-4774-8780-088555948bf9\") " pod="opendatahub/test-curl-7897-140289046384048"
Sep 08 07:18:24.007114 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:24.007074    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2rzh\" (UniqueName: \"kubernetes.io/projected/14e67ce3-7367-41c0-b2b0-3fd42cbc6753-kube-api-access-h2rzh\") pod \"maas-api-e2e-inf-a-620112-76649f9577-fd8c9\" (UID: \"14e67ce3-7367-41c0-b2b0-3fd42cbc6753\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-620112-76649f9577-fd8c9"
Sep 08 07:18:24.007235 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:24.007145    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/14e67ce3-7367-41c0-b2b0-3fd42cbc6753-openshift-service-ca\") pod \"maas-api-e2e-inf-a-620112-76649f9577-fd8c9\" (UID: \"14e67ce3-7367-41c0-b2b0-3fd42cbc6753\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-620112-76649f9577-fd8c9"
Sep 08 07:18:24.007235 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:24.007164    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14e67ce3-7367-41c0-b2b0-3fd42cbc6753-metrics-certs\") pod \"maas-api-e2e-inf-a-620112-76649f9577-fd8c9\" (UID: \"14e67ce3-7367-41c0-b2b0-3fd42cbc6753\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-620112-76649f9577-fd8c9"
Sep 08 07:18:24.014531 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:24.014508    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdg8q\" (UniqueName: \"kubernetes.io/projected/0858afbf-87b7-4774-8780-088555948bf9-kube-api-access-hdg8q\") pod \"test-curl-7897-140289046384048\" (UID: \"0858afbf-87b7-4774-8780-088555948bf9\") " pod="opendatahub/test-curl-7897-140289046384048"
Sep 08 07:18:24.108640 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:24.108553    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/14e67ce3-7367-41c0-b2b0-3fd42cbc6753-maas-api-tls\") pod \"maas-api-e2e-inf-a-620112-76649f9577-fd8c9\" (UID: \"14e67ce3-7367-41c0-b2b0-3fd42cbc6753\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-620112-76649f9577-fd8c9"
Sep 08 07:18:24.108640 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:24.108623    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2rzh\" (UniqueName: \"kubernetes.io/projected/14e67ce3-7367-41c0-b2b0-3fd42cbc6753-kube-api-access-h2rzh\") pod \"maas-api-e2e-inf-a-620112-76649f9577-fd8c9\" (UID: \"14e67ce3-7367-41c0-b2b0-3fd42cbc6753\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-620112-76649f9577-fd8c9"
Sep 08 07:18:24.108860 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:24.108667    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/14e67ce3-7367-41c0-b2b0-3fd42cbc6753-openshift-service-ca\") pod \"maas-api-e2e-inf-a-620112-76649f9577-fd8c9\" (UID: \"14e67ce3-7367-41c0-b2b0-3fd42cbc6753\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-620112-76649f9577-fd8c9"
Sep 08 07:18:24.108860 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:24.108681    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14e67ce3-7367-41c0-b2b0-3fd42cbc6753-metrics-certs\") pod \"maas-api-e2e-inf-a-620112-76649f9577-fd8c9\" (UID: \"14e67ce3-7367-41c0-b2b0-3fd42cbc6753\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-620112-76649f9577-fd8c9"
Sep 08 07:18:24.108860 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:18:24.108721    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-620112-serving-cert: secret "maas-api-e2e-inf-a-620112-serving-cert" not found
Sep 08 07:18:24.108860 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:18:24.108788    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14e67ce3-7367-41c0-b2b0-3fd42cbc6753-maas-api-tls podName:14e67ce3-7367-41c0-b2b0-3fd42cbc6753 nodeName:}" failed. No retries permitted until 2026-09-08 07:18:24.608770439 +0000 UTC m=+852.589809722 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/14e67ce3-7367-41c0-b2b0-3fd42cbc6753-maas-api-tls") pod "maas-api-e2e-inf-a-620112-76649f9577-fd8c9" (UID: "14e67ce3-7367-41c0-b2b0-3fd42cbc6753") : secret "maas-api-e2e-inf-a-620112-serving-cert" not found
Sep 08 07:18:24.109398 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:24.109380    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/14e67ce3-7367-41c0-b2b0-3fd42cbc6753-openshift-service-ca\") pod \"maas-api-e2e-inf-a-620112-76649f9577-fd8c9\" (UID: \"14e67ce3-7367-41c0-b2b0-3fd42cbc6753\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-620112-76649f9577-fd8c9"
Sep 08 07:18:24.111225 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:24.111204    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14e67ce3-7367-41c0-b2b0-3fd42cbc6753-metrics-certs\") pod \"maas-api-e2e-inf-a-620112-76649f9577-fd8c9\" (UID: \"14e67ce3-7367-41c0-b2b0-3fd42cbc6753\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-620112-76649f9577-fd8c9"
Sep 08 07:18:24.118422 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:24.118398    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2rzh\" (UniqueName: \"kubernetes.io/projected/14e67ce3-7367-41c0-b2b0-3fd42cbc6753-kube-api-access-h2rzh\") pod \"maas-api-e2e-inf-a-620112-76649f9577-fd8c9\" (UID: \"14e67ce3-7367-41c0-b2b0-3fd42cbc6753\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-620112-76649f9577-fd8c9"
Sep 08 07:18:24.188538 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:24.188506    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7897-140289046384048"
Sep 08 07:18:24.469373 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:24.469279    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7897-140289046384048"]
Sep 08 07:18:24.472072 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:18:24.472044    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0858afbf_87b7_4774_8780_088555948bf9.slice/crio-5808ad081f3c09a70bde7e90a60b11052e66ca3df07eb5ab18a2d9a2c28aac41 WatchSource:0}: Error finding container 5808ad081f3c09a70bde7e90a60b11052e66ca3df07eb5ab18a2d9a2c28aac41: Status 404 returned error can't find the container with id 5808ad081f3c09a70bde7e90a60b11052e66ca3df07eb5ab18a2d9a2c28aac41
Sep 08 07:18:24.510167 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:24.510140    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ccccf8ee-9065-4830-919a-f1c04623f074" path="/var/lib/kubelet/pods/ccccf8ee-9065-4830-919a-f1c04623f074/volumes"
Sep 08 07:18:24.553898 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:24.553859    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7897-140289046384048" event={"ID":"0858afbf-87b7-4774-8780-088555948bf9","Type":"ContainerStarted","Data":"5808ad081f3c09a70bde7e90a60b11052e66ca3df07eb5ab18a2d9a2c28aac41"}
Sep 08 07:18:24.563380 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:24.563356    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7897-140289046384048"
Sep 08 07:18:24.564079 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:24.563363    2564 scope.go:117] "RemoveContainer" containerID="df5d69b8781e27160d5016ca32a8f999122ac35f5351872e526e51e3b742e21d"
Sep 08 07:18:24.612319 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:24.612286    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/14e67ce3-7367-41c0-b2b0-3fd42cbc6753-maas-api-tls\") pod \"maas-api-e2e-inf-a-620112-76649f9577-fd8c9\" (UID: \"14e67ce3-7367-41c0-b2b0-3fd42cbc6753\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-620112-76649f9577-fd8c9"
Sep 08 07:18:24.614564 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:24.614542    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/14e67ce3-7367-41c0-b2b0-3fd42cbc6753-maas-api-tls\") pod \"maas-api-e2e-inf-a-620112-76649f9577-fd8c9\" (UID: \"14e67ce3-7367-41c0-b2b0-3fd42cbc6753\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-620112-76649f9577-fd8c9"
Sep 08 07:18:24.798912 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:24.798870    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-620112-76649f9577-fd8c9"
Sep 08 07:18:25.074454 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:25.074430    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-620112-76649f9577-fd8c9"]
Sep 08 07:18:25.076683 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:18:25.076655    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14e67ce3_7367_41c0_b2b0_3fd42cbc6753.slice/crio-07dc9cd6f1e51880d241ff3b595e5b0df9d4c2d7f2b6bedb4ccb040d9e269ef9 WatchSource:0}: Error finding container 07dc9cd6f1e51880d241ff3b595e5b0df9d4c2d7f2b6bedb4ccb040d9e269ef9: Status 404 returned error can't find the container with id 07dc9cd6f1e51880d241ff3b595e5b0df9d4c2d7f2b6bedb4ccb040d9e269ef9
Sep 08 07:18:25.569791 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:25.569761    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-620112-76649f9577-fd8c9" event={"ID":"14e67ce3-7367-41c0-b2b0-3fd42cbc6753","Type":"ContainerStarted","Data":"07dc9cd6f1e51880d241ff3b595e5b0df9d4c2d7f2b6bedb4ccb040d9e269ef9"}
Sep 08 07:18:25.571151 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:25.571125    2564 generic.go:356] "Generic (PLEG): container finished" podID="0858afbf-87b7-4774-8780-088555948bf9" containerID="ffee58c769caff2a64c5a9b0c639d9d8f89887f7c18d04bb6cde06fe8b7af21b" exitCode=0
Sep 08 07:18:25.571250 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:25.571190    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7897-140289046384048" event={"ID":"0858afbf-87b7-4774-8780-088555948bf9","Type":"ContainerDied","Data":"ffee58c769caff2a64c5a9b0c639d9d8f89887f7c18d04bb6cde06fe8b7af21b"}
Sep 08 07:18:26.578215 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:26.578178    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-620112-76649f9577-fd8c9" event={"ID":"14e67ce3-7367-41c0-b2b0-3fd42cbc6753","Type":"ContainerStarted","Data":"92932d83f1aece2725eb3d299d993cbdb4dae1b1c0af644ff448955ab9b10c53"}
Sep 08 07:18:26.578602 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:26.578352    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-620112-76649f9577-fd8c9"
Sep 08 07:18:26.594033 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:26.593982    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-620112-76649f9577-fd8c9" podStartSLOduration=3.156014886 podStartE2EDuration="3.593948379s" totalImagesPullingTime="437.933493ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:18:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:18:26.593208853 +0000 UTC m=+854.574248177" watchObservedRunningTime="2026-09-08 07:18:26.593948379 +0000 UTC m=+854.574987686"
Sep 08 07:18:26.720996 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:26.720948    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7897-140289046384048"
Sep 08 07:18:26.739297 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:26.739244    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7897-140289046384048_0858afbf-87b7-4774-8780-088555948bf9/test-curl-7897-140289046384048/0.log"
Sep 08 07:18:26.760133 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:26.760102    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7897-140289046384048"]
Sep 08 07:18:26.763437 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:26.763412    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7897-140289046384048"]
Sep 08 07:18:26.831503 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:26.831424    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hdg8q\" (UniqueName: \"kubernetes.io/projected/0858afbf-87b7-4774-8780-088555948bf9-kube-api-access-hdg8q\") pod \"0858afbf-87b7-4774-8780-088555948bf9\" (UID: \"0858afbf-87b7-4774-8780-088555948bf9\") "
Sep 08 07:18:26.833451 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:26.833427    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0858afbf-87b7-4774-8780-088555948bf9-kube-api-access-hdg8q" (OuterVolumeSpecName: "kube-api-access-hdg8q") pod "0858afbf-87b7-4774-8780-088555948bf9" (UID: "0858afbf-87b7-4774-8780-088555948bf9"). InnerVolumeSpecName "kube-api-access-hdg8q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 07:18:26.932114 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:26.932082    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hdg8q\" (UniqueName: \"kubernetes.io/projected/0858afbf-87b7-4774-8780-088555948bf9-kube-api-access-hdg8q\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:18:27.585274 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:27.584725    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-autores-638d2d-openshift-default-7989f98d88-frtkb"]
Sep 08 07:18:27.585713 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:27.585374    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0858afbf-87b7-4774-8780-088555948bf9" containerName="test-curl-7897-140289046384048"
Sep 08 07:18:27.585713 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:27.585394    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0858afbf-87b7-4774-8780-088555948bf9" containerName="test-curl-7897-140289046384048"
Sep 08 07:18:27.585713 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:27.585515    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="0858afbf-87b7-4774-8780-088555948bf9" containerName="test-curl-7897-140289046384048"
Sep 08 07:18:27.590112 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:27.589209    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-638d2d-openshift-default-7989f98d88-frtkb"
Sep 08 07:18:27.591903 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:27.591886    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-autores-638d2d-openshift-default-dockercfg-bgsh5\""
Sep 08 07:18:27.592241 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:27.592123    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5808ad081f3c09a70bde7e90a60b11052e66ca3df07eb5ab18a2d9a2c28aac41"
Sep 08 07:18:27.592322 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:27.592133    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 08 07:18:27.592555 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:27.592535    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7897-140289046384048"
Sep 08 07:18:27.600648 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:27.600529    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-638d2d-openshift-default-7989f98d88-frtkb"]
Sep 08 07:18:27.615278 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:18:27.615247    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7897-140289046384048\" is forbidden: User \"system:node:ip-10-0-133-164.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-164.ec2.internal' and this object" podUID="0858afbf-87b7-4774-8780-088555948bf9" pod="opendatahub/test-curl-7897-140289046384048"
Sep 08 07:18:27.638789 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:27.638752    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0468c0d4-448f-4520-970c-287e77790933-istio-envoy\") pod \"e2e-autores-638d2d-openshift-default-7989f98d88-frtkb\" (UID: \"0468c0d4-448f-4520-970c-287e77790933\") " pod="openshift-ingress/e2e-autores-638d2d-openshift-default-7989f98d88-frtkb"
Sep 08 07:18:27.638917 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:27.638805    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlwb6\" (UniqueName: \"kubernetes.io/projected/0468c0d4-448f-4520-970c-287e77790933-kube-api-access-rlwb6\") pod \"e2e-autores-638d2d-openshift-default-7989f98d88-frtkb\" (UID: \"0468c0d4-448f-4520-970c-287e77790933\") " pod="openshift-ingress/e2e-autores-638d2d-openshift-default-7989f98d88-frtkb"
Sep 08 07:18:27.638917 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:27.638905    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0468c0d4-448f-4520-970c-287e77790933-istio-data\") pod \"e2e-autores-638d2d-openshift-default-7989f98d88-frtkb\" (UID: \"0468c0d4-448f-4520-970c-287e77790933\") " pod="openshift-ingress/e2e-autores-638d2d-openshift-default-7989f98d88-frtkb"
Sep 08 07:18:27.639057 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:27.638945    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0468c0d4-448f-4520-970c-287e77790933-istio-podinfo\") pod \"e2e-autores-638d2d-openshift-default-7989f98d88-frtkb\" (UID: \"0468c0d4-448f-4520-970c-287e77790933\") " pod="openshift-ingress/e2e-autores-638d2d-openshift-default-7989f98d88-frtkb"
Sep 08 07:18:27.639057 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:27.639008    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0468c0d4-448f-4520-970c-287e77790933-workload-certs\") pod \"e2e-autores-638d2d-openshift-default-7989f98d88-frtkb\" (UID: \"0468c0d4-448f-4520-970c-287e77790933\") " pod="openshift-ingress/e2e-autores-638d2d-openshift-default-7989f98d88-frtkb"
Sep 08 07:18:27.639149 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:27.639061    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0468c0d4-448f-4520-970c-287e77790933-istiod-ca-cert\") pod \"e2e-autores-638d2d-openshift-default-7989f98d88-frtkb\" (UID: \"0468c0d4-448f-4520-970c-287e77790933\") " pod="openshift-ingress/e2e-autores-638d2d-openshift-default-7989f98d88-frtkb"
Sep 08 07:18:27.639190 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:27.639164    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0468c0d4-448f-4520-970c-287e77790933-workload-socket\") pod \"e2e-autores-638d2d-openshift-default-7989f98d88-frtkb\" (UID: \"0468c0d4-448f-4520-970c-287e77790933\") " pod="openshift-ingress/e2e-autores-638d2d-openshift-default-7989f98d88-frtkb"
Sep 08 07:18:27.639229 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:27.639198    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0468c0d4-448f-4520-970c-287e77790933-credential-socket\") pod \"e2e-autores-638d2d-openshift-default-7989f98d88-frtkb\" (UID: \"0468c0d4-448f-4520-970c-287e77790933\") " pod="openshift-ingress/e2e-autores-638d2d-openshift-default-7989f98d88-frtkb"
Sep 08 07:18:27.639268 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:27.639223    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0468c0d4-448f-4520-970c-287e77790933-istio-token\") pod \"e2e-autores-638d2d-openshift-default-7989f98d88-frtkb\" (UID: \"0468c0d4-448f-4520-970c-287e77790933\") " pod="openshift-ingress/e2e-autores-638d2d-openshift-default-7989f98d88-frtkb"
Sep 08 07:18:27.740447 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:27.740408    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0468c0d4-448f-4520-970c-287e77790933-istio-envoy\") pod \"e2e-autores-638d2d-openshift-default-7989f98d88-frtkb\" (UID: \"0468c0d4-448f-4520-970c-287e77790933\") " pod="openshift-ingress/e2e-autores-638d2d-openshift-default-7989f98d88-frtkb"
Sep 08 07:18:27.740447 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:27.740453    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlwb6\" (UniqueName: \"kubernetes.io/projected/0468c0d4-448f-4520-970c-287e77790933-kube-api-access-rlwb6\") pod \"e2e-autores-638d2d-openshift-default-7989f98d88-frtkb\" (UID: \"0468c0d4-448f-4520-970c-287e77790933\") " pod="openshift-ingress/e2e-autores-638d2d-openshift-default-7989f98d88-frtkb"
Sep 08 07:18:27.740781 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:27.740482    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0468c0d4-448f-4520-970c-287e77790933-istio-data\") pod \"e2e-autores-638d2d-openshift-default-7989f98d88-frtkb\" (UID: \"0468c0d4-448f-4520-970c-287e77790933\") " pod="openshift-ingress/e2e-autores-638d2d-openshift-default-7989f98d88-frtkb"
Sep 08 07:18:27.740781 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:27.740497    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0468c0d4-448f-4520-970c-287e77790933-istio-podinfo\") pod \"e2e-autores-638d2d-openshift-default-7989f98d88-frtkb\" (UID: \"0468c0d4-448f-4520-970c-287e77790933\") " pod="openshift-ingress/e2e-autores-638d2d-openshift-default-7989f98d88-frtkb"
Sep 08 07:18:27.740781 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:27.740522    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0468c0d4-448f-4520-970c-287e77790933-workload-certs\") pod \"e2e-autores-638d2d-openshift-default-7989f98d88-frtkb\" (UID: \"0468c0d4-448f-4520-970c-287e77790933\") " pod="openshift-ingress/e2e-autores-638d2d-openshift-default-7989f98d88-frtkb"
Sep 08 07:18:27.740781 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:27.740552    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0468c0d4-448f-4520-970c-287e77790933-istiod-ca-cert\") pod \"e2e-autores-638d2d-openshift-default-7989f98d88-frtkb\" (UID: \"0468c0d4-448f-4520-970c-287e77790933\") " pod="openshift-ingress/e2e-autores-638d2d-openshift-default-7989f98d88-frtkb"
Sep 08 07:18:27.740781 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:27.740622    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0468c0d4-448f-4520-970c-287e77790933-workload-socket\") pod \"e2e-autores-638d2d-openshift-default-7989f98d88-frtkb\" (UID: \"0468c0d4-448f-4520-970c-287e77790933\") " pod="openshift-ingress/e2e-autores-638d2d-openshift-default-7989f98d88-frtkb"
Sep 08 07:18:27.740781 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:27.740656    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0468c0d4-448f-4520-970c-287e77790933-credential-socket\") pod \"e2e-autores-638d2d-openshift-default-7989f98d88-frtkb\" (UID: \"0468c0d4-448f-4520-970c-287e77790933\") " pod="openshift-ingress/e2e-autores-638d2d-openshift-default-7989f98d88-frtkb"
Sep 08 07:18:27.740781 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:27.740680    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0468c0d4-448f-4520-970c-287e77790933-istio-token\") pod \"e2e-autores-638d2d-openshift-default-7989f98d88-frtkb\" (UID: \"0468c0d4-448f-4520-970c-287e77790933\") " pod="openshift-ingress/e2e-autores-638d2d-openshift-default-7989f98d88-frtkb"
Sep 08 07:18:27.741148 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:27.740934    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0468c0d4-448f-4520-970c-287e77790933-istio-data\") pod \"e2e-autores-638d2d-openshift-default-7989f98d88-frtkb\" (UID: \"0468c0d4-448f-4520-970c-287e77790933\") " pod="openshift-ingress/e2e-autores-638d2d-openshift-default-7989f98d88-frtkb"
Sep 08 07:18:27.741242 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:27.741216    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0468c0d4-448f-4520-970c-287e77790933-workload-socket\") pod \"e2e-autores-638d2d-openshift-default-7989f98d88-frtkb\" (UID: \"0468c0d4-448f-4520-970c-287e77790933\") " pod="openshift-ingress/e2e-autores-638d2d-openshift-default-7989f98d88-frtkb"
Sep 08 07:18:27.741296 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:27.741243    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0468c0d4-448f-4520-970c-287e77790933-credential-socket\") pod \"e2e-autores-638d2d-openshift-default-7989f98d88-frtkb\" (UID: \"0468c0d4-448f-4520-970c-287e77790933\") " pod="openshift-ingress/e2e-autores-638d2d-openshift-default-7989f98d88-frtkb"
Sep 08 07:18:27.741412 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:27.741330    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0468c0d4-448f-4520-970c-287e77790933-istiod-ca-cert\") pod \"e2e-autores-638d2d-openshift-default-7989f98d88-frtkb\" (UID: \"0468c0d4-448f-4520-970c-287e77790933\") " pod="openshift-ingress/e2e-autores-638d2d-openshift-default-7989f98d88-frtkb"
Sep 08 07:18:27.741412 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:27.741352    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0468c0d4-448f-4520-970c-287e77790933-workload-certs\") pod \"e2e-autores-638d2d-openshift-default-7989f98d88-frtkb\" (UID: \"0468c0d4-448f-4520-970c-287e77790933\") " pod="openshift-ingress/e2e-autores-638d2d-openshift-default-7989f98d88-frtkb"
Sep 08 07:18:27.743213 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:27.743195    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0468c0d4-448f-4520-970c-287e77790933-istio-envoy\") pod \"e2e-autores-638d2d-openshift-default-7989f98d88-frtkb\" (UID: \"0468c0d4-448f-4520-970c-287e77790933\") " pod="openshift-ingress/e2e-autores-638d2d-openshift-default-7989f98d88-frtkb"
Sep 08 07:18:27.743529 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:27.743507    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0468c0d4-448f-4520-970c-287e77790933-istio-podinfo\") pod \"e2e-autores-638d2d-openshift-default-7989f98d88-frtkb\" (UID: \"0468c0d4-448f-4520-970c-287e77790933\") " pod="openshift-ingress/e2e-autores-638d2d-openshift-default-7989f98d88-frtkb"
Sep 08 07:18:27.748895 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:27.748877    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlwb6\" (UniqueName: \"kubernetes.io/projected/0468c0d4-448f-4520-970c-287e77790933-kube-api-access-rlwb6\") pod \"e2e-autores-638d2d-openshift-default-7989f98d88-frtkb\" (UID: \"0468c0d4-448f-4520-970c-287e77790933\") " pod="openshift-ingress/e2e-autores-638d2d-openshift-default-7989f98d88-frtkb"
Sep 08 07:18:27.748993 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:27.748878    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0468c0d4-448f-4520-970c-287e77790933-istio-token\") pod \"e2e-autores-638d2d-openshift-default-7989f98d88-frtkb\" (UID: \"0468c0d4-448f-4520-970c-287e77790933\") " pod="openshift-ingress/e2e-autores-638d2d-openshift-default-7989f98d88-frtkb"
Sep 08 07:18:27.903435 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:27.903342    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-638d2d-openshift-default-7989f98d88-frtkb"
Sep 08 07:18:28.180559 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:28.180534    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-638d2d-openshift-default-7989f98d88-frtkb"]
Sep 08 07:18:28.182682 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:18:28.182648    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0468c0d4_448f_4520_970c_287e77790933.slice/crio-95c367ce6cb2c0270741f20133ac1f34386aaa007e89d30ec663d457e5607435 WatchSource:0}: Error finding container 95c367ce6cb2c0270741f20133ac1f34386aaa007e89d30ec663d457e5607435: Status 404 returned error can't find the container with id 95c367ce6cb2c0270741f20133ac1f34386aaa007e89d30ec663d457e5607435
Sep 08 07:18:28.510297 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:28.510220    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0858afbf-87b7-4774-8780-088555948bf9" path="/var/lib/kubelet/pods/0858afbf-87b7-4774-8780-088555948bf9/volumes"
Sep 08 07:18:28.598613 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:28.598574    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-638d2d-openshift-default-7989f98d88-frtkb" event={"ID":"0468c0d4-448f-4520-970c-287e77790933","Type":"ContainerStarted","Data":"95c367ce6cb2c0270741f20133ac1f34386aaa007e89d30ec663d457e5607435"}
Sep 08 07:18:31.277627 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:31.277582    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 07:18:31.277914 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:31.277657    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 07:18:31.277914 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:31.277687    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 07:18:31.379373 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:31.379316    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4a1fb56c-8678957bbd-8tmnw"]
Sep 08 07:18:31.383665 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:31.383595    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4a1fb56c-8678957bbd-8tmnw"
Sep 08 07:18:31.387120 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:31.386791    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-4a1fb56c-serving-cert\""
Sep 08 07:18:31.395870 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:31.395844    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4a1fb56c-8678957bbd-8tmnw"]
Sep 08 07:18:31.475357 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:31.475277    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c867062-ee90-4acb-b7c6-663ce4f47cbd-openshift-service-ca\") pod \"maas-api-e2e-ait-4a1fb56c-8678957bbd-8tmnw\" (UID: \"1c867062-ee90-4acb-b7c6-663ce4f47cbd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4a1fb56c-8678957bbd-8tmnw"
Sep 08 07:18:31.475357 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:31.475358    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c867062-ee90-4acb-b7c6-663ce4f47cbd-metrics-certs\") pod \"maas-api-e2e-ait-4a1fb56c-8678957bbd-8tmnw\" (UID: \"1c867062-ee90-4acb-b7c6-663ce4f47cbd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4a1fb56c-8678957bbd-8tmnw"
Sep 08 07:18:31.475595 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:31.475432    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrffh\" (UniqueName: \"kubernetes.io/projected/1c867062-ee90-4acb-b7c6-663ce4f47cbd-kube-api-access-qrffh\") pod \"maas-api-e2e-ait-4a1fb56c-8678957bbd-8tmnw\" (UID: \"1c867062-ee90-4acb-b7c6-663ce4f47cbd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4a1fb56c-8678957bbd-8tmnw"
Sep 08 07:18:31.475595 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:31.475482    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1c867062-ee90-4acb-b7c6-663ce4f47cbd-maas-api-tls\") pod \"maas-api-e2e-ait-4a1fb56c-8678957bbd-8tmnw\" (UID: \"1c867062-ee90-4acb-b7c6-663ce4f47cbd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4a1fb56c-8678957bbd-8tmnw"
Sep 08 07:18:31.576946 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:31.576856    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1c867062-ee90-4acb-b7c6-663ce4f47cbd-maas-api-tls\") pod \"maas-api-e2e-ait-4a1fb56c-8678957bbd-8tmnw\" (UID: \"1c867062-ee90-4acb-b7c6-663ce4f47cbd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4a1fb56c-8678957bbd-8tmnw"
Sep 08 07:18:31.577141 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:31.576956    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c867062-ee90-4acb-b7c6-663ce4f47cbd-openshift-service-ca\") pod \"maas-api-e2e-ait-4a1fb56c-8678957bbd-8tmnw\" (UID: \"1c867062-ee90-4acb-b7c6-663ce4f47cbd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4a1fb56c-8678957bbd-8tmnw"
Sep 08 07:18:31.577141 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:18:31.577013    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-4a1fb56c-serving-cert: secret "maas-api-e2e-ait-4a1fb56c-serving-cert" not found
Sep 08 07:18:31.577141 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:31.577049    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c867062-ee90-4acb-b7c6-663ce4f47cbd-metrics-certs\") pod \"maas-api-e2e-ait-4a1fb56c-8678957bbd-8tmnw\" (UID: \"1c867062-ee90-4acb-b7c6-663ce4f47cbd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4a1fb56c-8678957bbd-8tmnw"
Sep 08 07:18:31.577141 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:18:31.577096    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c867062-ee90-4acb-b7c6-663ce4f47cbd-maas-api-tls podName:1c867062-ee90-4acb-b7c6-663ce4f47cbd nodeName:}" failed. No retries permitted until 2026-09-08 07:18:32.077073974 +0000 UTC m=+860.058113259 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1c867062-ee90-4acb-b7c6-663ce4f47cbd-maas-api-tls") pod "maas-api-e2e-ait-4a1fb56c-8678957bbd-8tmnw" (UID: "1c867062-ee90-4acb-b7c6-663ce4f47cbd") : secret "maas-api-e2e-ait-4a1fb56c-serving-cert" not found
Sep 08 07:18:31.577371 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:31.577209    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrffh\" (UniqueName: \"kubernetes.io/projected/1c867062-ee90-4acb-b7c6-663ce4f47cbd-kube-api-access-qrffh\") pod \"maas-api-e2e-ait-4a1fb56c-8678957bbd-8tmnw\" (UID: \"1c867062-ee90-4acb-b7c6-663ce4f47cbd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4a1fb56c-8678957bbd-8tmnw"
Sep 08 07:18:31.577800 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:31.577774    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c867062-ee90-4acb-b7c6-663ce4f47cbd-openshift-service-ca\") pod \"maas-api-e2e-ait-4a1fb56c-8678957bbd-8tmnw\" (UID: \"1c867062-ee90-4acb-b7c6-663ce4f47cbd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4a1fb56c-8678957bbd-8tmnw"
Sep 08 07:18:31.579813 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:31.579784    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c867062-ee90-4acb-b7c6-663ce4f47cbd-metrics-certs\") pod \"maas-api-e2e-ait-4a1fb56c-8678957bbd-8tmnw\" (UID: \"1c867062-ee90-4acb-b7c6-663ce4f47cbd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4a1fb56c-8678957bbd-8tmnw"
Sep 08 07:18:31.585862 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:31.585817    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrffh\" (UniqueName: \"kubernetes.io/projected/1c867062-ee90-4acb-b7c6-663ce4f47cbd-kube-api-access-qrffh\") pod \"maas-api-e2e-ait-4a1fb56c-8678957bbd-8tmnw\" (UID: \"1c867062-ee90-4acb-b7c6-663ce4f47cbd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4a1fb56c-8678957bbd-8tmnw"
Sep 08 07:18:31.618193 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:31.618158    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-638d2d-openshift-default-7989f98d88-frtkb" event={"ID":"0468c0d4-448f-4520-970c-287e77790933","Type":"ContainerStarted","Data":"b545dddbe9021ab61f38c9102adfaad7be19c0b73c27bc3039258f2123f23bbe"}
Sep 08 07:18:31.639522 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:31.638854    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-autores-638d2d-openshift-default-7989f98d88-frtkb" podStartSLOduration=1.546598319 podStartE2EDuration="4.638835419s" totalImagesPullingTime="3.0922371s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:18:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:18:31.637472716 +0000 UTC m=+859.618512022" watchObservedRunningTime="2026-09-08 07:18:31.638835419 +0000 UTC m=+859.619874726"
Sep 08 07:18:31.904178 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:31.904095    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-638d2d-openshift-default-7989f98d88-frtkb"
Sep 08 07:18:32.082770 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:32.082676    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1c867062-ee90-4acb-b7c6-663ce4f47cbd-maas-api-tls\") pod \"maas-api-e2e-ait-4a1fb56c-8678957bbd-8tmnw\" (UID: \"1c867062-ee90-4acb-b7c6-663ce4f47cbd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4a1fb56c-8678957bbd-8tmnw"
Sep 08 07:18:32.085832 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:32.085803    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1c867062-ee90-4acb-b7c6-663ce4f47cbd-maas-api-tls\") pod \"maas-api-e2e-ait-4a1fb56c-8678957bbd-8tmnw\" (UID: \"1c867062-ee90-4acb-b7c6-663ce4f47cbd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4a1fb56c-8678957bbd-8tmnw"
Sep 08 07:18:32.315605 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:32.315571    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4a1fb56c-8678957bbd-8tmnw"
Sep 08 07:18:32.592110 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:32.592083    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4a1fb56c-8678957bbd-8tmnw"]
Sep 08 07:18:32.594375 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:18:32.594346    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c867062_ee90_4acb_b7c6_663ce4f47cbd.slice/crio-d931e6e769c9aecfe131835b55ee37d6e111b003676900f9b368b57b7a83502a WatchSource:0}: Error finding container d931e6e769c9aecfe131835b55ee37d6e111b003676900f9b368b57b7a83502a: Status 404 returned error can't find the container with id d931e6e769c9aecfe131835b55ee37d6e111b003676900f9b368b57b7a83502a
Sep 08 07:18:32.599061 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:32.599041    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-620112-76649f9577-fd8c9"
Sep 08 07:18:32.625625 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:32.625589    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4a1fb56c-8678957bbd-8tmnw" event={"ID":"1c867062-ee90-4acb-b7c6-663ce4f47cbd","Type":"ContainerStarted","Data":"d931e6e769c9aecfe131835b55ee37d6e111b003676900f9b368b57b7a83502a"}
Sep 08 07:18:32.909895 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:32.909813    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-638d2d-openshift-default-7989f98d88-frtkb"
Sep 08 07:18:33.632024 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:33.631982    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4a1fb56c-8678957bbd-8tmnw" event={"ID":"1c867062-ee90-4acb-b7c6-663ce4f47cbd","Type":"ContainerStarted","Data":"159e59dff3d46ea96dc09f3fa80a9053363605eed0a74bad4ca395cba1867faf"}
Sep 08 07:18:33.632420 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:33.632221    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4a1fb56c-8678957bbd-8tmnw"
Sep 08 07:18:33.632420 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:33.632257    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-638d2d-openshift-default-7989f98d88-frtkb"
Sep 08 07:18:33.633088 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:33.633067    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-638d2d-openshift-default-7989f98d88-frtkb"
Sep 08 07:18:33.650422 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:33.650377    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4a1fb56c-8678957bbd-8tmnw" podStartSLOduration=2.289021778 podStartE2EDuration="2.650363486s" totalImagesPullingTime="361.341708ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:18:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:18:33.649180556 +0000 UTC m=+861.630219917" watchObservedRunningTime="2026-09-08 07:18:33.650363486 +0000 UTC m=+861.631402792"
Sep 08 07:18:34.645922 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:34.645890    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-638d2d-55f9bf5cfb-zk6xx"]
Sep 08 07:18:34.650345 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:34.650322    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-638d2d-55f9bf5cfb-zk6xx"
Sep 08 07:18:34.652205 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:34.652183    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-autores-638d2d-serving-cert\""
Sep 08 07:18:34.659566 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:34.659512    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-638d2d-55f9bf5cfb-zk6xx"]
Sep 08 07:18:34.714277 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:34.714235    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfvrs\" (UniqueName: \"kubernetes.io/projected/8eda0886-2b18-4312-bf33-821771eb5828-kube-api-access-mfvrs\") pod \"maas-api-e2e-autores-638d2d-55f9bf5cfb-zk6xx\" (UID: \"8eda0886-2b18-4312-bf33-821771eb5828\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-638d2d-55f9bf5cfb-zk6xx"
Sep 08 07:18:34.714472 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:34.714446    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8eda0886-2b18-4312-bf33-821771eb5828-openshift-service-ca\") pod \"maas-api-e2e-autores-638d2d-55f9bf5cfb-zk6xx\" (UID: \"8eda0886-2b18-4312-bf33-821771eb5828\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-638d2d-55f9bf5cfb-zk6xx"
Sep 08 07:18:34.714713 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:34.714693    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8eda0886-2b18-4312-bf33-821771eb5828-maas-api-tls\") pod \"maas-api-e2e-autores-638d2d-55f9bf5cfb-zk6xx\" (UID: \"8eda0886-2b18-4312-bf33-821771eb5828\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-638d2d-55f9bf5cfb-zk6xx"
Sep 08 07:18:34.714814 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:34.714770    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8eda0886-2b18-4312-bf33-821771eb5828-metrics-certs\") pod \"maas-api-e2e-autores-638d2d-55f9bf5cfb-zk6xx\" (UID: \"8eda0886-2b18-4312-bf33-821771eb5828\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-638d2d-55f9bf5cfb-zk6xx"
Sep 08 07:18:34.815622 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:34.815579    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8eda0886-2b18-4312-bf33-821771eb5828-maas-api-tls\") pod \"maas-api-e2e-autores-638d2d-55f9bf5cfb-zk6xx\" (UID: \"8eda0886-2b18-4312-bf33-821771eb5828\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-638d2d-55f9bf5cfb-zk6xx"
Sep 08 07:18:34.815622 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:34.815629    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8eda0886-2b18-4312-bf33-821771eb5828-metrics-certs\") pod \"maas-api-e2e-autores-638d2d-55f9bf5cfb-zk6xx\" (UID: \"8eda0886-2b18-4312-bf33-821771eb5828\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-638d2d-55f9bf5cfb-zk6xx"
Sep 08 07:18:34.815809 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:34.815667    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfvrs\" (UniqueName: \"kubernetes.io/projected/8eda0886-2b18-4312-bf33-821771eb5828-kube-api-access-mfvrs\") pod \"maas-api-e2e-autores-638d2d-55f9bf5cfb-zk6xx\" (UID: \"8eda0886-2b18-4312-bf33-821771eb5828\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-638d2d-55f9bf5cfb-zk6xx"
Sep 08 07:18:34.815809 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:18:34.815685    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-autores-638d2d-serving-cert: secret "maas-api-e2e-autores-638d2d-serving-cert" not found
Sep 08 07:18:34.815809 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:18:34.815758    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8eda0886-2b18-4312-bf33-821771eb5828-maas-api-tls podName:8eda0886-2b18-4312-bf33-821771eb5828 nodeName:}" failed. No retries permitted until 2026-09-08 07:18:35.31573669 +0000 UTC m=+863.296775994 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8eda0886-2b18-4312-bf33-821771eb5828-maas-api-tls") pod "maas-api-e2e-autores-638d2d-55f9bf5cfb-zk6xx" (UID: "8eda0886-2b18-4312-bf33-821771eb5828") : secret "maas-api-e2e-autores-638d2d-serving-cert" not found
Sep 08 07:18:34.816010 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:34.815877    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8eda0886-2b18-4312-bf33-821771eb5828-openshift-service-ca\") pod \"maas-api-e2e-autores-638d2d-55f9bf5cfb-zk6xx\" (UID: \"8eda0886-2b18-4312-bf33-821771eb5828\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-638d2d-55f9bf5cfb-zk6xx"
Sep 08 07:18:34.816631 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:34.816608    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8eda0886-2b18-4312-bf33-821771eb5828-openshift-service-ca\") pod \"maas-api-e2e-autores-638d2d-55f9bf5cfb-zk6xx\" (UID: \"8eda0886-2b18-4312-bf33-821771eb5828\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-638d2d-55f9bf5cfb-zk6xx"
Sep 08 07:18:34.818005 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:34.817987    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8eda0886-2b18-4312-bf33-821771eb5828-metrics-certs\") pod \"maas-api-e2e-autores-638d2d-55f9bf5cfb-zk6xx\" (UID: \"8eda0886-2b18-4312-bf33-821771eb5828\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-638d2d-55f9bf5cfb-zk6xx"
Sep 08 07:18:34.823347 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:34.823311    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfvrs\" (UniqueName: \"kubernetes.io/projected/8eda0886-2b18-4312-bf33-821771eb5828-kube-api-access-mfvrs\") pod \"maas-api-e2e-autores-638d2d-55f9bf5cfb-zk6xx\" (UID: \"8eda0886-2b18-4312-bf33-821771eb5828\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-638d2d-55f9bf5cfb-zk6xx"
Sep 08 07:18:35.321263 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:35.321219    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8eda0886-2b18-4312-bf33-821771eb5828-maas-api-tls\") pod \"maas-api-e2e-autores-638d2d-55f9bf5cfb-zk6xx\" (UID: \"8eda0886-2b18-4312-bf33-821771eb5828\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-638d2d-55f9bf5cfb-zk6xx"
Sep 08 07:18:35.323763 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:35.323740    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8eda0886-2b18-4312-bf33-821771eb5828-maas-api-tls\") pod \"maas-api-e2e-autores-638d2d-55f9bf5cfb-zk6xx\" (UID: \"8eda0886-2b18-4312-bf33-821771eb5828\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-638d2d-55f9bf5cfb-zk6xx"
Sep 08 07:18:35.566748 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:35.566715    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-638d2d-55f9bf5cfb-zk6xx"
Sep 08 07:18:35.844713 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:35.844689    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-638d2d-55f9bf5cfb-zk6xx"]
Sep 08 07:18:35.847123 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:18:35.847095    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8eda0886_2b18_4312_bf33_821771eb5828.slice/crio-826f74ed5047ddab75eeea9b28d522bf22aa2732e71ef8de26b65d8b96e01f17 WatchSource:0}: Error finding container 826f74ed5047ddab75eeea9b28d522bf22aa2732e71ef8de26b65d8b96e01f17: Status 404 returned error can't find the container with id 826f74ed5047ddab75eeea9b28d522bf22aa2732e71ef8de26b65d8b96e01f17
Sep 08 07:18:36.652449 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:36.652366    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-638d2d-55f9bf5cfb-zk6xx" event={"ID":"8eda0886-2b18-4312-bf33-821771eb5828","Type":"ContainerStarted","Data":"ab714d54a8fe076f0e27deb2119bf308ed95ded67f50a0a3e4064c8d35e263c7"}
Sep 08 07:18:36.652449 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:36.652424    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-638d2d-55f9bf5cfb-zk6xx"
Sep 08 07:18:36.652449 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:36.652445    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-638d2d-55f9bf5cfb-zk6xx" event={"ID":"8eda0886-2b18-4312-bf33-821771eb5828","Type":"ContainerStarted","Data":"826f74ed5047ddab75eeea9b28d522bf22aa2732e71ef8de26b65d8b96e01f17"}
Sep 08 07:18:36.671080 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:36.671021    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-autores-638d2d-55f9bf5cfb-zk6xx" podStartSLOduration=2.211726853 podStartE2EDuration="2.671002356s" totalImagesPullingTime="459.275503ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:18:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:18:36.669539671 +0000 UTC m=+864.650579032" watchObservedRunningTime="2026-09-08 07:18:36.671002356 +0000 UTC m=+864.652041661"
Sep 08 07:18:38.154616 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:38.154575    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:18:39.644342 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:39.644315    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4a1fb56c-8678957bbd-8tmnw"
Sep 08 07:18:42.664409 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:42.664380    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-638d2d-55f9bf5cfb-zk6xx"
Sep 08 07:18:48.634534 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:48.634501    2564 patch_prober.go:28] interesting pod/e2e-autores-638d2d-openshift-default-7989f98d88-frtkb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Sep 08 07:18:48.634906 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:48.634567    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-autores-638d2d-openshift-default-7989f98d88-frtkb" podUID="0468c0d4-448f-4520-970c-287e77790933" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Sep 08 07:18:48.729540 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:48.729459    2564 generic.go:356] "Generic (PLEG): container finished" podID="0468c0d4-448f-4520-970c-287e77790933" containerID="b545dddbe9021ab61f38c9102adfaad7be19c0b73c27bc3039258f2123f23bbe" exitCode=0
Sep 08 07:18:48.729686 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:48.729532    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-638d2d-openshift-default-7989f98d88-frtkb" event={"ID":"0468c0d4-448f-4520-970c-287e77790933","Type":"ContainerDied","Data":"b545dddbe9021ab61f38c9102adfaad7be19c0b73c27bc3039258f2123f23bbe"}
Sep 08 07:18:48.729936 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:48.729920    2564 scope.go:117] "RemoveContainer" containerID="b545dddbe9021ab61f38c9102adfaad7be19c0b73c27bc3039258f2123f23bbe"
Sep 08 07:18:48.731031 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:48.731001    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 07:18:48.731111 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:48.731074    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 07:18:48.731150 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:48.731133    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 07:18:49.738029 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:49.737988    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-638d2d-openshift-default-7989f98d88-frtkb" event={"ID":"0468c0d4-448f-4520-970c-287e77790933","Type":"ContainerStarted","Data":"3d7d8d6c7df112fb0be9dd54cf1d4986ae5c4c1b46e29097a43f22dd5c0daa60"}
Sep 08 07:18:49.903980 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:49.903919    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-638d2d-openshift-default-7989f98d88-frtkb"
Sep 08 07:18:49.904490 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:49.904461    2564 patch_prober.go:28] interesting pod/e2e-autores-638d2d-openshift-default-7989f98d88-frtkb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Sep 08 07:18:49.904683 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:49.904659    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-638d2d-openshift-default-7989f98d88-frtkb" podUID="0468c0d4-448f-4520-970c-287e77790933" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Sep 08 07:18:50.904473 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:50.904437    2564 patch_prober.go:28] interesting pod/e2e-autores-638d2d-openshift-default-7989f98d88-frtkb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Sep 08 07:18:50.905063 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:50.905029    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-638d2d-openshift-default-7989f98d88-frtkb" podUID="0468c0d4-448f-4520-970c-287e77790933" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Sep 08 07:18:51.904741 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:51.904699    2564 patch_prober.go:28] interesting pod/e2e-autores-638d2d-openshift-default-7989f98d88-frtkb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Sep 08 07:18:51.905529 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:51.905495    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-638d2d-openshift-default-7989f98d88-frtkb" podUID="0468c0d4-448f-4520-970c-287e77790933" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Sep 08 07:18:52.080855 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:52.080824    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6f5c4f-5b6fc9fb74-t6tm5"]
Sep 08 07:18:52.084866 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:52.084843    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6f5c4f-5b6fc9fb74-t6tm5"
Sep 08 07:18:52.090997 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:52.090954    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-6f5c4f-serving-cert\""
Sep 08 07:18:52.104307 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:52.104234    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6f5c4f-5b6fc9fb74-t6tm5"]
Sep 08 07:18:52.183790 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:52.183711    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dfb1d217-1805-4996-8ba9-46a484affdba-maas-api-tls\") pod \"maas-api-e2e-inf-b-6f5c4f-5b6fc9fb74-t6tm5\" (UID: \"dfb1d217-1805-4996-8ba9-46a484affdba\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6f5c4f-5b6fc9fb74-t6tm5"
Sep 08 07:18:52.183961 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:52.183789    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dfb1d217-1805-4996-8ba9-46a484affdba-metrics-certs\") pod \"maas-api-e2e-inf-b-6f5c4f-5b6fc9fb74-t6tm5\" (UID: \"dfb1d217-1805-4996-8ba9-46a484affdba\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6f5c4f-5b6fc9fb74-t6tm5"
Sep 08 07:18:52.183961 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:52.183826    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9j6w\" (UniqueName: \"kubernetes.io/projected/dfb1d217-1805-4996-8ba9-46a484affdba-kube-api-access-x9j6w\") pod \"maas-api-e2e-inf-b-6f5c4f-5b6fc9fb74-t6tm5\" (UID: \"dfb1d217-1805-4996-8ba9-46a484affdba\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6f5c4f-5b6fc9fb74-t6tm5"
Sep 08 07:18:52.183961 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:52.183906    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dfb1d217-1805-4996-8ba9-46a484affdba-openshift-service-ca\") pod \"maas-api-e2e-inf-b-6f5c4f-5b6fc9fb74-t6tm5\" (UID: \"dfb1d217-1805-4996-8ba9-46a484affdba\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6f5c4f-5b6fc9fb74-t6tm5"
Sep 08 07:18:52.288485 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:52.288435    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dfb1d217-1805-4996-8ba9-46a484affdba-metrics-certs\") pod \"maas-api-e2e-inf-b-6f5c4f-5b6fc9fb74-t6tm5\" (UID: \"dfb1d217-1805-4996-8ba9-46a484affdba\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6f5c4f-5b6fc9fb74-t6tm5"
Sep 08 07:18:52.288682 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:52.288509    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9j6w\" (UniqueName: \"kubernetes.io/projected/dfb1d217-1805-4996-8ba9-46a484affdba-kube-api-access-x9j6w\") pod \"maas-api-e2e-inf-b-6f5c4f-5b6fc9fb74-t6tm5\" (UID: \"dfb1d217-1805-4996-8ba9-46a484affdba\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6f5c4f-5b6fc9fb74-t6tm5"
Sep 08 07:18:52.288682 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:52.288604    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dfb1d217-1805-4996-8ba9-46a484affdba-openshift-service-ca\") pod \"maas-api-e2e-inf-b-6f5c4f-5b6fc9fb74-t6tm5\" (UID: \"dfb1d217-1805-4996-8ba9-46a484affdba\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6f5c4f-5b6fc9fb74-t6tm5"
Sep 08 07:18:52.288682 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:52.288677    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dfb1d217-1805-4996-8ba9-46a484affdba-maas-api-tls\") pod \"maas-api-e2e-inf-b-6f5c4f-5b6fc9fb74-t6tm5\" (UID: \"dfb1d217-1805-4996-8ba9-46a484affdba\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6f5c4f-5b6fc9fb74-t6tm5"
Sep 08 07:18:52.300990 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:52.290748    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dfb1d217-1805-4996-8ba9-46a484affdba-openshift-service-ca\") pod \"maas-api-e2e-inf-b-6f5c4f-5b6fc9fb74-t6tm5\" (UID: \"dfb1d217-1805-4996-8ba9-46a484affdba\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6f5c4f-5b6fc9fb74-t6tm5"
Sep 08 07:18:52.300990 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:52.293509    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dfb1d217-1805-4996-8ba9-46a484affdba-metrics-certs\") pod \"maas-api-e2e-inf-b-6f5c4f-5b6fc9fb74-t6tm5\" (UID: \"dfb1d217-1805-4996-8ba9-46a484affdba\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6f5c4f-5b6fc9fb74-t6tm5"
Sep 08 07:18:52.302616 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:52.302589    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9j6w\" (UniqueName: \"kubernetes.io/projected/dfb1d217-1805-4996-8ba9-46a484affdba-kube-api-access-x9j6w\") pod \"maas-api-e2e-inf-b-6f5c4f-5b6fc9fb74-t6tm5\" (UID: \"dfb1d217-1805-4996-8ba9-46a484affdba\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6f5c4f-5b6fc9fb74-t6tm5"
Sep 08 07:18:52.303221 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:52.303197    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dfb1d217-1805-4996-8ba9-46a484affdba-maas-api-tls\") pod \"maas-api-e2e-inf-b-6f5c4f-5b6fc9fb74-t6tm5\" (UID: \"dfb1d217-1805-4996-8ba9-46a484affdba\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6f5c4f-5b6fc9fb74-t6tm5"
Sep 08 07:18:52.432995 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:52.432922    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6f5c4f-5b6fc9fb74-t6tm5"
Sep 08 07:18:52.737778 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:52.737685    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6f5c4f-5b6fc9fb74-t6tm5"]
Sep 08 07:18:52.740457 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:18:52.740410    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfb1d217_1805_4996_8ba9_46a484affdba.slice/crio-5ee12373327827c811166e93e069f078974844726e4a166dcc38acae3e470d5e WatchSource:0}: Error finding container 5ee12373327827c811166e93e069f078974844726e4a166dcc38acae3e470d5e: Status 404 returned error can't find the container with id 5ee12373327827c811166e93e069f078974844726e4a166dcc38acae3e470d5e
Sep 08 07:18:52.755150 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:52.755120    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6f5c4f-5b6fc9fb74-t6tm5" event={"ID":"dfb1d217-1805-4996-8ba9-46a484affdba","Type":"ContainerStarted","Data":"5ee12373327827c811166e93e069f078974844726e4a166dcc38acae3e470d5e"}
Sep 08 07:18:52.907403 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:52.907352    2564 patch_prober.go:28] interesting pod/e2e-autores-638d2d-openshift-default-7989f98d88-frtkb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Sep 08 07:18:52.907869 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:52.907443    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-638d2d-openshift-default-7989f98d88-frtkb" podUID="0468c0d4-448f-4520-970c-287e77790933" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Sep 08 07:18:53.762888 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:53.762839    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6f5c4f-5b6fc9fb74-t6tm5" event={"ID":"dfb1d217-1805-4996-8ba9-46a484affdba","Type":"ContainerStarted","Data":"ee4cc23159fb5375a8154858962cef0a26e4d33b073dd5aa842a170ecadb0761"}
Sep 08 07:18:53.763105 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:53.762927    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6f5c4f-5b6fc9fb74-t6tm5"
Sep 08 07:18:53.779434 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:53.779374    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6f5c4f-5b6fc9fb74-t6tm5" podStartSLOduration=1.043100954 podStartE2EDuration="1.77935805s" totalImagesPullingTime="736.257096ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:18:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:18:53.778529429 +0000 UTC m=+881.759568755" watchObservedRunningTime="2026-09-08 07:18:53.77935805 +0000 UTC m=+881.760397355"
Sep 08 07:18:53.904142 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:53.904099    2564 patch_prober.go:28] interesting pod/e2e-autores-638d2d-openshift-default-7989f98d88-frtkb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Sep 08 07:18:53.904342 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:53.904169    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-638d2d-openshift-default-7989f98d88-frtkb" podUID="0468c0d4-448f-4520-970c-287e77790933" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Sep 08 07:18:54.904777 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:54.904729    2564 patch_prober.go:28] interesting pod/e2e-autores-638d2d-openshift-default-7989f98d88-frtkb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Sep 08 07:18:54.905304 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:54.904801    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-638d2d-openshift-default-7989f98d88-frtkb" podUID="0468c0d4-448f-4520-970c-287e77790933" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Sep 08 07:18:55.658787 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:55.658750    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:18:55.908301 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:55.908270    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-638d2d-openshift-default-7989f98d88-frtkb"
Sep 08 07:18:55.908751 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:55.908649    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-638d2d-openshift-default-7989f98d88-frtkb"
Sep 08 07:18:55.909385 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:55.909323    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-638d2d-openshift-default-7989f98d88-frtkb"
Sep 08 07:18:59.773555 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:18:59.773527    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6f5c4f-5b6fc9fb74-t6tm5"
Sep 08 07:19:12.235779 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:12.235691    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4a1fb56c-8678957bbd-8tmnw"]
Sep 08 07:19:12.236236 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:12.235925    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4a1fb56c-8678957bbd-8tmnw" podUID="1c867062-ee90-4acb-b7c6-663ce4f47cbd" containerName="maas-api" containerID="cri-o://159e59dff3d46ea96dc09f3fa80a9053363605eed0a74bad4ca395cba1867faf" gracePeriod=30
Sep 08 07:19:12.513713 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:12.513682    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4a1fb56c-8678957bbd-8tmnw"
Sep 08 07:19:12.520372 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:12.520346    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-8d4lx_5cf68f79-8fda-42e2-92c1-05a5a601f505/console-operator/1.log"
Sep 08 07:19:12.522152 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:12.522128    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-8d4lx_5cf68f79-8fda-42e2-92c1-05a5a601f505/console-operator/1.log"
Sep 08 07:19:12.587985 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:12.585697    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qrffh\" (UniqueName: \"kubernetes.io/projected/1c867062-ee90-4acb-b7c6-663ce4f47cbd-kube-api-access-qrffh\") pod \"1c867062-ee90-4acb-b7c6-663ce4f47cbd\" (UID: \"1c867062-ee90-4acb-b7c6-663ce4f47cbd\") "
Sep 08 07:19:12.587985 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:12.585781    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c867062-ee90-4acb-b7c6-663ce4f47cbd-openshift-service-ca\") pod \"1c867062-ee90-4acb-b7c6-663ce4f47cbd\" (UID: \"1c867062-ee90-4acb-b7c6-663ce4f47cbd\") "
Sep 08 07:19:12.587985 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:12.585936    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c867062-ee90-4acb-b7c6-663ce4f47cbd-metrics-certs\") pod \"1c867062-ee90-4acb-b7c6-663ce4f47cbd\" (UID: \"1c867062-ee90-4acb-b7c6-663ce4f47cbd\") "
Sep 08 07:19:12.587985 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:12.586000    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1c867062-ee90-4acb-b7c6-663ce4f47cbd-maas-api-tls\") pod \"1c867062-ee90-4acb-b7c6-663ce4f47cbd\" (UID: \"1c867062-ee90-4acb-b7c6-663ce4f47cbd\") "
Sep 08 07:19:12.587985 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:12.586293    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c867062-ee90-4acb-b7c6-663ce4f47cbd-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1c867062-ee90-4acb-b7c6-663ce4f47cbd" (UID: "1c867062-ee90-4acb-b7c6-663ce4f47cbd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 07:19:12.587985 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:12.586402    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c867062-ee90-4acb-b7c6-663ce4f47cbd-openshift-service-ca\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:19:12.589821 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:12.589785    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c867062-ee90-4acb-b7c6-663ce4f47cbd-kube-api-access-qrffh" (OuterVolumeSpecName: "kube-api-access-qrffh") pod "1c867062-ee90-4acb-b7c6-663ce4f47cbd" (UID: "1c867062-ee90-4acb-b7c6-663ce4f47cbd"). InnerVolumeSpecName "kube-api-access-qrffh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 07:19:12.590914 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:12.590883    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c867062-ee90-4acb-b7c6-663ce4f47cbd-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1c867062-ee90-4acb-b7c6-663ce4f47cbd" (UID: "1c867062-ee90-4acb-b7c6-663ce4f47cbd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 07:19:12.592005 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:12.591984    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c867062-ee90-4acb-b7c6-663ce4f47cbd-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "1c867062-ee90-4acb-b7c6-663ce4f47cbd" (UID: "1c867062-ee90-4acb-b7c6-663ce4f47cbd"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 07:19:12.687244 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:12.687212    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qrffh\" (UniqueName: \"kubernetes.io/projected/1c867062-ee90-4acb-b7c6-663ce4f47cbd-kube-api-access-qrffh\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:19:12.687244 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:12.687240    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c867062-ee90-4acb-b7c6-663ce4f47cbd-metrics-certs\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:19:12.687244 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:12.687254    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1c867062-ee90-4acb-b7c6-663ce4f47cbd-maas-api-tls\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:19:12.865069 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:12.865032    2564 generic.go:356] "Generic (PLEG): container finished" podID="1c867062-ee90-4acb-b7c6-663ce4f47cbd" containerID="159e59dff3d46ea96dc09f3fa80a9053363605eed0a74bad4ca395cba1867faf" exitCode=0
Sep 08 07:19:12.865233 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:12.865089    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4a1fb56c-8678957bbd-8tmnw"
Sep 08 07:19:12.865233 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:12.865119    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4a1fb56c-8678957bbd-8tmnw" event={"ID":"1c867062-ee90-4acb-b7c6-663ce4f47cbd","Type":"ContainerDied","Data":"159e59dff3d46ea96dc09f3fa80a9053363605eed0a74bad4ca395cba1867faf"}
Sep 08 07:19:12.865233 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:12.865197    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4a1fb56c-8678957bbd-8tmnw" event={"ID":"1c867062-ee90-4acb-b7c6-663ce4f47cbd","Type":"ContainerDied","Data":"d931e6e769c9aecfe131835b55ee37d6e111b003676900f9b368b57b7a83502a"}
Sep 08 07:19:12.865233 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:12.865219    2564 scope.go:117] "RemoveContainer" containerID="159e59dff3d46ea96dc09f3fa80a9053363605eed0a74bad4ca395cba1867faf"
Sep 08 07:19:12.874207 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:12.874187    2564 scope.go:117] "RemoveContainer" containerID="159e59dff3d46ea96dc09f3fa80a9053363605eed0a74bad4ca395cba1867faf"
Sep 08 07:19:12.874494 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:19:12.874473    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"159e59dff3d46ea96dc09f3fa80a9053363605eed0a74bad4ca395cba1867faf\": container with ID starting with 159e59dff3d46ea96dc09f3fa80a9053363605eed0a74bad4ca395cba1867faf not found: ID does not exist" containerID="159e59dff3d46ea96dc09f3fa80a9053363605eed0a74bad4ca395cba1867faf"
Sep 08 07:19:12.874536 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:12.874502    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"159e59dff3d46ea96dc09f3fa80a9053363605eed0a74bad4ca395cba1867faf"} err="failed to get container status \"159e59dff3d46ea96dc09f3fa80a9053363605eed0a74bad4ca395cba1867faf\": rpc error: code = NotFound desc = could not find container \"159e59dff3d46ea96dc09f3fa80a9053363605eed0a74bad4ca395cba1867faf\": container with ID starting with 159e59dff3d46ea96dc09f3fa80a9053363605eed0a74bad4ca395cba1867faf not found: ID does not exist"
Sep 08 07:19:12.891423 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:12.891383    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4a1fb56c-8678957bbd-8tmnw"]
Sep 08 07:19:12.893441 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:12.893420    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4a1fb56c-8678957bbd-8tmnw"]
Sep 08 07:19:13.531508 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:13.531475    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s"]
Sep 08 07:19:13.531948 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:13.531934    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c867062-ee90-4acb-b7c6-663ce4f47cbd" containerName="maas-api"
Sep 08 07:19:13.532026 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:13.531951    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c867062-ee90-4acb-b7c6-663ce4f47cbd" containerName="maas-api"
Sep 08 07:19:13.532090 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:13.532078    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c867062-ee90-4acb-b7c6-663ce4f47cbd" containerName="maas-api"
Sep 08 07:19:13.536589 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:13.536567    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s"
Sep 08 07:19:13.539233 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:13.539213    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-c3da4827-gw-openshift-default-dockercfg-2wvzw\""
Sep 08 07:19:13.548112 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:13.548089    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s"]
Sep 08 07:19:13.595434 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:13.595403    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72de8212-3915-41c4-aba2-3fdf48349b61-istio-data\") pod \"e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s\" (UID: \"72de8212-3915-41c4-aba2-3fdf48349b61\") " pod="openshift-ingress/e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s"
Sep 08 07:19:13.595434 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:13.595448    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72de8212-3915-41c4-aba2-3fdf48349b61-workload-certs\") pod \"e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s\" (UID: \"72de8212-3915-41c4-aba2-3fdf48349b61\") " pod="openshift-ingress/e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s"
Sep 08 07:19:13.595656 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:13.595503    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72de8212-3915-41c4-aba2-3fdf48349b61-istio-podinfo\") pod \"e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s\" (UID: \"72de8212-3915-41c4-aba2-3fdf48349b61\") " pod="openshift-ingress/e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s"
Sep 08 07:19:13.595656 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:13.595518    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72de8212-3915-41c4-aba2-3fdf48349b61-istio-token\") pod \"e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s\" (UID: \"72de8212-3915-41c4-aba2-3fdf48349b61\") " pod="openshift-ingress/e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s"
Sep 08 07:19:13.595656 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:13.595537    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72de8212-3915-41c4-aba2-3fdf48349b61-istio-envoy\") pod \"e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s\" (UID: \"72de8212-3915-41c4-aba2-3fdf48349b61\") " pod="openshift-ingress/e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s"
Sep 08 07:19:13.595656 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:13.595597    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72de8212-3915-41c4-aba2-3fdf48349b61-workload-socket\") pod \"e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s\" (UID: \"72de8212-3915-41c4-aba2-3fdf48349b61\") " pod="openshift-ingress/e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s"
Sep 08 07:19:13.595656 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:13.595654    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72de8212-3915-41c4-aba2-3fdf48349b61-credential-socket\") pod \"e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s\" (UID: \"72de8212-3915-41c4-aba2-3fdf48349b61\") " pod="openshift-ingress/e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s"
Sep 08 07:19:13.595839 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:13.595688    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72de8212-3915-41c4-aba2-3fdf48349b61-istiod-ca-cert\") pod \"e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s\" (UID: \"72de8212-3915-41c4-aba2-3fdf48349b61\") " pod="openshift-ingress/e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s"
Sep 08 07:19:13.595839 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:13.595718    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qz7r6\" (UniqueName: \"kubernetes.io/projected/72de8212-3915-41c4-aba2-3fdf48349b61-kube-api-access-qz7r6\") pod \"e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s\" (UID: \"72de8212-3915-41c4-aba2-3fdf48349b61\") " pod="openshift-ingress/e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s"
Sep 08 07:19:13.696363 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:13.696333    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72de8212-3915-41c4-aba2-3fdf48349b61-istio-envoy\") pod \"e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s\" (UID: \"72de8212-3915-41c4-aba2-3fdf48349b61\") " pod="openshift-ingress/e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s"
Sep 08 07:19:13.696514 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:13.696378    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72de8212-3915-41c4-aba2-3fdf48349b61-workload-socket\") pod \"e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s\" (UID: \"72de8212-3915-41c4-aba2-3fdf48349b61\") " pod="openshift-ingress/e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s"
Sep 08 07:19:13.696514 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:13.696425    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72de8212-3915-41c4-aba2-3fdf48349b61-credential-socket\") pod \"e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s\" (UID: \"72de8212-3915-41c4-aba2-3fdf48349b61\") " pod="openshift-ingress/e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s"
Sep 08 07:19:13.696514 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:13.696454    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72de8212-3915-41c4-aba2-3fdf48349b61-istiod-ca-cert\") pod \"e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s\" (UID: \"72de8212-3915-41c4-aba2-3fdf48349b61\") " pod="openshift-ingress/e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s"
Sep 08 07:19:13.696514 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:13.696484    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qz7r6\" (UniqueName: \"kubernetes.io/projected/72de8212-3915-41c4-aba2-3fdf48349b61-kube-api-access-qz7r6\") pod \"e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s\" (UID: \"72de8212-3915-41c4-aba2-3fdf48349b61\") " pod="openshift-ingress/e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s"
Sep 08 07:19:13.696826 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:13.696798    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72de8212-3915-41c4-aba2-3fdf48349b61-istio-data\") pod \"e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s\" (UID: \"72de8212-3915-41c4-aba2-3fdf48349b61\") " pod="openshift-ingress/e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s"
Sep 08 07:19:13.697016 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:13.696874    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72de8212-3915-41c4-aba2-3fdf48349b61-credential-socket\") pod \"e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s\" (UID: \"72de8212-3915-41c4-aba2-3fdf48349b61\") " pod="openshift-ingress/e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s"
Sep 08 07:19:13.697016 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:13.697001    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72de8212-3915-41c4-aba2-3fdf48349b61-workload-certs\") pod \"e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s\" (UID: \"72de8212-3915-41c4-aba2-3fdf48349b61\") " pod="openshift-ingress/e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s"
Sep 08 07:19:13.697205 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:13.697125    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72de8212-3915-41c4-aba2-3fdf48349b61-workload-socket\") pod \"e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s\" (UID: \"72de8212-3915-41c4-aba2-3fdf48349b61\") " pod="openshift-ingress/e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s"
Sep 08 07:19:13.697205 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:13.697135    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72de8212-3915-41c4-aba2-3fdf48349b61-istio-podinfo\") pod \"e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s\" (UID: \"72de8212-3915-41c4-aba2-3fdf48349b61\") " pod="openshift-ingress/e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s"
Sep 08 07:19:13.697205 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:13.697165    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72de8212-3915-41c4-aba2-3fdf48349b61-istio-token\") pod \"e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s\" (UID: \"72de8212-3915-41c4-aba2-3fdf48349b61\") " pod="openshift-ingress/e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s"
Sep 08 07:19:13.697362 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:13.697261    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72de8212-3915-41c4-aba2-3fdf48349b61-istio-data\") pod \"e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s\" (UID: \"72de8212-3915-41c4-aba2-3fdf48349b61\") " pod="openshift-ingress/e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s"
Sep 08 07:19:13.697362 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:13.697269    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72de8212-3915-41c4-aba2-3fdf48349b61-istiod-ca-cert\") pod \"e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s\" (UID: \"72de8212-3915-41c4-aba2-3fdf48349b61\") " pod="openshift-ingress/e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s"
Sep 08 07:19:13.697521 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:13.697471    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72de8212-3915-41c4-aba2-3fdf48349b61-workload-certs\") pod \"e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s\" (UID: \"72de8212-3915-41c4-aba2-3fdf48349b61\") " pod="openshift-ingress/e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s"
Sep 08 07:19:13.698776 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:13.698753    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72de8212-3915-41c4-aba2-3fdf48349b61-istio-envoy\") pod \"e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s\" (UID: \"72de8212-3915-41c4-aba2-3fdf48349b61\") " pod="openshift-ingress/e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s"
Sep 08 07:19:13.699572 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:13.699549    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72de8212-3915-41c4-aba2-3fdf48349b61-istio-podinfo\") pod \"e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s\" (UID: \"72de8212-3915-41c4-aba2-3fdf48349b61\") " pod="openshift-ingress/e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s"
Sep 08 07:19:13.704539 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:13.704516    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72de8212-3915-41c4-aba2-3fdf48349b61-istio-token\") pod \"e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s\" (UID: \"72de8212-3915-41c4-aba2-3fdf48349b61\") " pod="openshift-ingress/e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s"
Sep 08 07:19:13.705255 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:13.705233    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qz7r6\" (UniqueName: \"kubernetes.io/projected/72de8212-3915-41c4-aba2-3fdf48349b61-kube-api-access-qz7r6\") pod \"e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s\" (UID: \"72de8212-3915-41c4-aba2-3fdf48349b61\") " pod="openshift-ingress/e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s"
Sep 08 07:19:13.850134 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:13.850042    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s"
Sep 08 07:19:14.135928 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:14.135897    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s"]
Sep 08 07:19:14.138332 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:19:14.138300    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72de8212_3915_41c4_aba2_3fdf48349b61.slice/crio-813f33f423cd57a14a27bd187d38802c81f4aee46c5f5a698ca43dbbaba1c50e WatchSource:0}: Error finding container 813f33f423cd57a14a27bd187d38802c81f4aee46c5f5a698ca43dbbaba1c50e: Status 404 returned error can't find the container with id 813f33f423cd57a14a27bd187d38802c81f4aee46c5f5a698ca43dbbaba1c50e
Sep 08 07:19:14.140575 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:14.140537    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 07:19:14.140683 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:14.140625    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 07:19:14.140683 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:14.140669    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 07:19:14.511751 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:14.511715    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c867062-ee90-4acb-b7c6-663ce4f47cbd" path="/var/lib/kubelet/pods/1c867062-ee90-4acb-b7c6-663ce4f47cbd/volumes"
Sep 08 07:19:14.879124 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:14.879035    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s" event={"ID":"72de8212-3915-41c4-aba2-3fdf48349b61","Type":"ContainerStarted","Data":"4d55f8cdc8c8b19c2afefc6ea0b538eb3246e44b8ed712e982a57522192abda3"}
Sep 08 07:19:14.879124 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:14.879087    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s" event={"ID":"72de8212-3915-41c4-aba2-3fdf48349b61","Type":"ContainerStarted","Data":"813f33f423cd57a14a27bd187d38802c81f4aee46c5f5a698ca43dbbaba1c50e"}
Sep 08 07:19:14.898310 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:14.898259    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s" podStartSLOduration=1.898242838 podStartE2EDuration="1.898242838s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:19:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:19:14.896471996 +0000 UTC m=+902.877511325" watchObservedRunningTime="2026-09-08 07:19:14.898242838 +0000 UTC m=+902.879282144"
Sep 08 07:19:15.850475 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:15.850444    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s"
Sep 08 07:19:15.855670 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:15.855643    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s"
Sep 08 07:19:15.884342 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:15.884312    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s"
Sep 08 07:19:15.885226 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:15.885198    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s"
Sep 08 07:19:16.438030 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:16.437999    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c3da4827-59d98d5777-jw4zp"]
Sep 08 07:19:16.442320 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:16.442291    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c3da4827-59d98d5777-jw4zp"
Sep 08 07:19:16.444190 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:16.444164    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-c3da4827-serving-cert\""
Sep 08 07:19:16.453640 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:16.453527    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c3da4827-59d98d5777-jw4zp"]
Sep 08 07:19:16.523381 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:16.523344    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/39b8022e-dbd1-4978-9817-dc2fcf97f705-openshift-service-ca\") pod \"maas-api-e2e-migrate-c3da4827-59d98d5777-jw4zp\" (UID: \"39b8022e-dbd1-4978-9817-dc2fcf97f705\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c3da4827-59d98d5777-jw4zp"
Sep 08 07:19:16.523539 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:16.523388    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/39b8022e-dbd1-4978-9817-dc2fcf97f705-metrics-certs\") pod \"maas-api-e2e-migrate-c3da4827-59d98d5777-jw4zp\" (UID: \"39b8022e-dbd1-4978-9817-dc2fcf97f705\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c3da4827-59d98d5777-jw4zp"
Sep 08 07:19:16.523539 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:16.523500    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nj2hn\" (UniqueName: \"kubernetes.io/projected/39b8022e-dbd1-4978-9817-dc2fcf97f705-kube-api-access-nj2hn\") pod \"maas-api-e2e-migrate-c3da4827-59d98d5777-jw4zp\" (UID: \"39b8022e-dbd1-4978-9817-dc2fcf97f705\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c3da4827-59d98d5777-jw4zp"
Sep 08 07:19:16.523674 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:16.523571    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/39b8022e-dbd1-4978-9817-dc2fcf97f705-maas-api-tls\") pod \"maas-api-e2e-migrate-c3da4827-59d98d5777-jw4zp\" (UID: \"39b8022e-dbd1-4978-9817-dc2fcf97f705\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c3da4827-59d98d5777-jw4zp"
Sep 08 07:19:16.624410 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:16.624372    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/39b8022e-dbd1-4978-9817-dc2fcf97f705-openshift-service-ca\") pod \"maas-api-e2e-migrate-c3da4827-59d98d5777-jw4zp\" (UID: \"39b8022e-dbd1-4978-9817-dc2fcf97f705\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c3da4827-59d98d5777-jw4zp"
Sep 08 07:19:16.624600 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:16.624426    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/39b8022e-dbd1-4978-9817-dc2fcf97f705-metrics-certs\") pod \"maas-api-e2e-migrate-c3da4827-59d98d5777-jw4zp\" (UID: \"39b8022e-dbd1-4978-9817-dc2fcf97f705\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c3da4827-59d98d5777-jw4zp"
Sep 08 07:19:16.624600 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:16.624499    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nj2hn\" (UniqueName: \"kubernetes.io/projected/39b8022e-dbd1-4978-9817-dc2fcf97f705-kube-api-access-nj2hn\") pod \"maas-api-e2e-migrate-c3da4827-59d98d5777-jw4zp\" (UID: \"39b8022e-dbd1-4978-9817-dc2fcf97f705\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c3da4827-59d98d5777-jw4zp"
Sep 08 07:19:16.624727 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:16.624664    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/39b8022e-dbd1-4978-9817-dc2fcf97f705-maas-api-tls\") pod \"maas-api-e2e-migrate-c3da4827-59d98d5777-jw4zp\" (UID: \"39b8022e-dbd1-4978-9817-dc2fcf97f705\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c3da4827-59d98d5777-jw4zp"
Sep 08 07:19:16.624783 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:19:16.624756    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-c3da4827-serving-cert: secret "maas-api-e2e-migrate-c3da4827-serving-cert" not found
Sep 08 07:19:16.624836 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:19:16.624808    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39b8022e-dbd1-4978-9817-dc2fcf97f705-maas-api-tls podName:39b8022e-dbd1-4978-9817-dc2fcf97f705 nodeName:}" failed. No retries permitted until 2026-09-08 07:19:17.124791303 +0000 UTC m=+905.105830586 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/39b8022e-dbd1-4978-9817-dc2fcf97f705-maas-api-tls") pod "maas-api-e2e-migrate-c3da4827-59d98d5777-jw4zp" (UID: "39b8022e-dbd1-4978-9817-dc2fcf97f705") : secret "maas-api-e2e-migrate-c3da4827-serving-cert" not found
Sep 08 07:19:16.625850 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:16.625820    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/39b8022e-dbd1-4978-9817-dc2fcf97f705-openshift-service-ca\") pod \"maas-api-e2e-migrate-c3da4827-59d98d5777-jw4zp\" (UID: \"39b8022e-dbd1-4978-9817-dc2fcf97f705\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c3da4827-59d98d5777-jw4zp"
Sep 08 07:19:16.634020 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:16.633996    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nj2hn\" (UniqueName: \"kubernetes.io/projected/39b8022e-dbd1-4978-9817-dc2fcf97f705-kube-api-access-nj2hn\") pod \"maas-api-e2e-migrate-c3da4827-59d98d5777-jw4zp\" (UID: \"39b8022e-dbd1-4978-9817-dc2fcf97f705\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c3da4827-59d98d5777-jw4zp"
Sep 08 07:19:16.634140 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:16.634028    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/39b8022e-dbd1-4978-9817-dc2fcf97f705-metrics-certs\") pod \"maas-api-e2e-migrate-c3da4827-59d98d5777-jw4zp\" (UID: \"39b8022e-dbd1-4978-9817-dc2fcf97f705\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c3da4827-59d98d5777-jw4zp"
Sep 08 07:19:17.130235 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:17.130200    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/39b8022e-dbd1-4978-9817-dc2fcf97f705-maas-api-tls\") pod \"maas-api-e2e-migrate-c3da4827-59d98d5777-jw4zp\" (UID: \"39b8022e-dbd1-4978-9817-dc2fcf97f705\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c3da4827-59d98d5777-jw4zp"
Sep 08 07:19:17.132723 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:17.132697    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/39b8022e-dbd1-4978-9817-dc2fcf97f705-maas-api-tls\") pod \"maas-api-e2e-migrate-c3da4827-59d98d5777-jw4zp\" (UID: \"39b8022e-dbd1-4978-9817-dc2fcf97f705\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c3da4827-59d98d5777-jw4zp"
Sep 08 07:19:17.358050 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:17.358014    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c3da4827-59d98d5777-jw4zp"
Sep 08 07:19:17.640995 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:17.640956    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c3da4827-59d98d5777-jw4zp"]
Sep 08 07:19:17.643711 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:19:17.643683    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39b8022e_dbd1_4978_9817_dc2fcf97f705.slice/crio-86adebb00e15d8c32902fe9e29921d3a9a7250ddb0ce2652cb2ce5a4de02e448 WatchSource:0}: Error finding container 86adebb00e15d8c32902fe9e29921d3a9a7250ddb0ce2652cb2ce5a4de02e448: Status 404 returned error can't find the container with id 86adebb00e15d8c32902fe9e29921d3a9a7250ddb0ce2652cb2ce5a4de02e448
Sep 08 07:19:17.896838 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:17.896795    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c3da4827-59d98d5777-jw4zp" event={"ID":"39b8022e-dbd1-4978-9817-dc2fcf97f705","Type":"ContainerStarted","Data":"86adebb00e15d8c32902fe9e29921d3a9a7250ddb0ce2652cb2ce5a4de02e448"}
Sep 08 07:19:18.140873 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:18.140847    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:19:18.904189 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:18.904155    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c3da4827-59d98d5777-jw4zp" event={"ID":"39b8022e-dbd1-4978-9817-dc2fcf97f705","Type":"ContainerStarted","Data":"37b7515cef1e4cc6d698824c22d2ca6473c2081e645b2671528c636a53178d47"}
Sep 08 07:19:18.904366 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:18.904263    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c3da4827-59d98d5777-jw4zp"
Sep 08 07:19:18.920807 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:18.920760    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c3da4827-59d98d5777-jw4zp" podStartSLOduration=2.515865045 podStartE2EDuration="2.920744374s" totalImagesPullingTime="404.879329ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:19:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:19:18.919483286 +0000 UTC m=+906.900522613" watchObservedRunningTime="2026-09-08 07:19:18.920744374 +0000 UTC m=+906.901783680"
Sep 08 07:19:24.913984 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:24.913940    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c3da4827-59d98d5777-jw4zp"
Sep 08 07:19:36.003123 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:36.003086    2564 generic.go:356] "Generic (PLEG): container finished" podID="72de8212-3915-41c4-aba2-3fdf48349b61" containerID="4d55f8cdc8c8b19c2afefc6ea0b538eb3246e44b8ed712e982a57522192abda3" exitCode=0
Sep 08 07:19:36.003561 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:36.003156    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s" event={"ID":"72de8212-3915-41c4-aba2-3fdf48349b61","Type":"ContainerDied","Data":"4d55f8cdc8c8b19c2afefc6ea0b538eb3246e44b8ed712e982a57522192abda3"}
Sep 08 07:19:36.003608 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:36.003563    2564 scope.go:117] "RemoveContainer" containerID="4d55f8cdc8c8b19c2afefc6ea0b538eb3246e44b8ed712e982a57522192abda3"
Sep 08 07:19:36.004627 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:36.004600    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 07:19:36.004676 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:36.004666    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 07:19:36.004711 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:36.004697    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 07:19:37.010207 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:37.010173    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s" event={"ID":"72de8212-3915-41c4-aba2-3fdf48349b61","Type":"ContainerStarted","Data":"c403b32dc17e0e13f2541a669c28f40e32c813ebbc90eab384cd6c6cfa438086"}
Sep 08 07:19:37.353196 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:37.353159    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:19:37.851158 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:37.851125    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s"
Sep 08 07:19:37.851340 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:37.851300    2564 patch_prober.go:28] interesting pod/e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Sep 08 07:19:37.851385 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:37.851349    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s" podUID="72de8212-3915-41c4-aba2-3fdf48349b61" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Sep 08 07:19:38.850938 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:38.850904    2564 patch_prober.go:28] interesting pod/e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Sep 08 07:19:38.851337 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:38.850998    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s" podUID="72de8212-3915-41c4-aba2-3fdf48349b61" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Sep 08 07:19:39.850683 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:39.850651    2564 patch_prober.go:28] interesting pod/e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Sep 08 07:19:39.850857 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:39.850704    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s" podUID="72de8212-3915-41c4-aba2-3fdf48349b61" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Sep 08 07:19:40.851214 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:40.851172    2564 patch_prober.go:28] interesting pod/e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Sep 08 07:19:40.851623 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:40.851234    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s" podUID="72de8212-3915-41c4-aba2-3fdf48349b61" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Sep 08 07:19:41.851116 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:41.851076    2564 patch_prober.go:28] interesting pod/e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Sep 08 07:19:41.851281 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:41.851146    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s" podUID="72de8212-3915-41c4-aba2-3fdf48349b61" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Sep 08 07:19:43.111127 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:43.111077    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s"
Sep 08 07:19:43.111631 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:43.111613    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s"
Sep 08 07:19:43.112681 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:43.112659    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s"
Sep 08 07:19:53.846086 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:53.846047    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:19:58.155416 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:58.155374    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c3da4827-59d98d5777-jw4zp"]
Sep 08 07:19:58.156018 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:58.155633    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c3da4827-59d98d5777-jw4zp" podUID="39b8022e-dbd1-4978-9817-dc2fcf97f705" containerName="maas-api" containerID="cri-o://37b7515cef1e4cc6d698824c22d2ca6473c2081e645b2671528c636a53178d47" gracePeriod=30
Sep 08 07:19:58.435730 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:58.435698    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c3da4827-59d98d5777-jw4zp"
Sep 08 07:19:58.520191 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:58.520161    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/39b8022e-dbd1-4978-9817-dc2fcf97f705-maas-api-tls\") pod \"39b8022e-dbd1-4978-9817-dc2fcf97f705\" (UID: \"39b8022e-dbd1-4978-9817-dc2fcf97f705\") "
Sep 08 07:19:58.520372 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:58.520214    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/39b8022e-dbd1-4978-9817-dc2fcf97f705-openshift-service-ca\") pod \"39b8022e-dbd1-4978-9817-dc2fcf97f705\" (UID: \"39b8022e-dbd1-4978-9817-dc2fcf97f705\") "
Sep 08 07:19:58.520372 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:58.520235    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nj2hn\" (UniqueName: \"kubernetes.io/projected/39b8022e-dbd1-4978-9817-dc2fcf97f705-kube-api-access-nj2hn\") pod \"39b8022e-dbd1-4978-9817-dc2fcf97f705\" (UID: \"39b8022e-dbd1-4978-9817-dc2fcf97f705\") "
Sep 08 07:19:58.520372 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:58.520263    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/39b8022e-dbd1-4978-9817-dc2fcf97f705-metrics-certs\") pod \"39b8022e-dbd1-4978-9817-dc2fcf97f705\" (UID: \"39b8022e-dbd1-4978-9817-dc2fcf97f705\") "
Sep 08 07:19:58.520674 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:58.520640    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39b8022e-dbd1-4978-9817-dc2fcf97f705-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "39b8022e-dbd1-4978-9817-dc2fcf97f705" (UID: "39b8022e-dbd1-4978-9817-dc2fcf97f705"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 07:19:58.522555 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:58.522510    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39b8022e-dbd1-4978-9817-dc2fcf97f705-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "39b8022e-dbd1-4978-9817-dc2fcf97f705" (UID: "39b8022e-dbd1-4978-9817-dc2fcf97f705"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 07:19:58.522658 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:58.522608    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39b8022e-dbd1-4978-9817-dc2fcf97f705-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "39b8022e-dbd1-4978-9817-dc2fcf97f705" (UID: "39b8022e-dbd1-4978-9817-dc2fcf97f705"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 07:19:58.522717 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:58.522698    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39b8022e-dbd1-4978-9817-dc2fcf97f705-kube-api-access-nj2hn" (OuterVolumeSpecName: "kube-api-access-nj2hn") pod "39b8022e-dbd1-4978-9817-dc2fcf97f705" (UID: "39b8022e-dbd1-4978-9817-dc2fcf97f705"). InnerVolumeSpecName "kube-api-access-nj2hn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 07:19:58.622073 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:58.622038    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/39b8022e-dbd1-4978-9817-dc2fcf97f705-maas-api-tls\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:19:58.622073 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:58.622078    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/39b8022e-dbd1-4978-9817-dc2fcf97f705-openshift-service-ca\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:19:58.622331 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:58.622097    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nj2hn\" (UniqueName: \"kubernetes.io/projected/39b8022e-dbd1-4978-9817-dc2fcf97f705-kube-api-access-nj2hn\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:19:58.622331 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:58.622114    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/39b8022e-dbd1-4978-9817-dc2fcf97f705-metrics-certs\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:19:58.678306 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:58.678225    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s"]
Sep 08 07:19:58.678518 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:58.678494    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s" podUID="72de8212-3915-41c4-aba2-3fdf48349b61" containerName="istio-proxy" containerID="cri-o://c403b32dc17e0e13f2541a669c28f40e32c813ebbc90eab384cd6c6cfa438086" gracePeriod=30
Sep 08 07:19:59.129118 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:59.129082    2564 generic.go:356] "Generic (PLEG): container finished" podID="39b8022e-dbd1-4978-9817-dc2fcf97f705" containerID="37b7515cef1e4cc6d698824c22d2ca6473c2081e645b2671528c636a53178d47" exitCode=0
Sep 08 07:19:59.129289 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:59.129145    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c3da4827-59d98d5777-jw4zp"
Sep 08 07:19:59.129289 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:59.129169    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c3da4827-59d98d5777-jw4zp" event={"ID":"39b8022e-dbd1-4978-9817-dc2fcf97f705","Type":"ContainerDied","Data":"37b7515cef1e4cc6d698824c22d2ca6473c2081e645b2671528c636a53178d47"}
Sep 08 07:19:59.129289 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:59.129232    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c3da4827-59d98d5777-jw4zp" event={"ID":"39b8022e-dbd1-4978-9817-dc2fcf97f705","Type":"ContainerDied","Data":"86adebb00e15d8c32902fe9e29921d3a9a7250ddb0ce2652cb2ce5a4de02e448"}
Sep 08 07:19:59.129289 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:59.129262    2564 scope.go:117] "RemoveContainer" containerID="37b7515cef1e4cc6d698824c22d2ca6473c2081e645b2671528c636a53178d47"
Sep 08 07:19:59.139262 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:59.139245    2564 scope.go:117] "RemoveContainer" containerID="37b7515cef1e4cc6d698824c22d2ca6473c2081e645b2671528c636a53178d47"
Sep 08 07:19:59.139515 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:19:59.139495    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37b7515cef1e4cc6d698824c22d2ca6473c2081e645b2671528c636a53178d47\": container with ID starting with 37b7515cef1e4cc6d698824c22d2ca6473c2081e645b2671528c636a53178d47 not found: ID does not exist" containerID="37b7515cef1e4cc6d698824c22d2ca6473c2081e645b2671528c636a53178d47"
Sep 08 07:19:59.139573 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:59.139523    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37b7515cef1e4cc6d698824c22d2ca6473c2081e645b2671528c636a53178d47"} err="failed to get container status \"37b7515cef1e4cc6d698824c22d2ca6473c2081e645b2671528c636a53178d47\": rpc error: code = NotFound desc = could not find container \"37b7515cef1e4cc6d698824c22d2ca6473c2081e645b2671528c636a53178d47\": container with ID starting with 37b7515cef1e4cc6d698824c22d2ca6473c2081e645b2671528c636a53178d47 not found: ID does not exist"
Sep 08 07:19:59.155102 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:59.155075    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c3da4827-59d98d5777-jw4zp"]
Sep 08 07:19:59.163858 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:59.163837    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c3da4827-59d98d5777-jw4zp"]
Sep 08 07:19:59.399095 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:59.399009    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-576ac2af-openshift-default-78949b8854-srkvv"]
Sep 08 07:19:59.399500 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:59.399483    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39b8022e-dbd1-4978-9817-dc2fcf97f705" containerName="maas-api"
Sep 08 07:19:59.399500 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:59.399499    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="39b8022e-dbd1-4978-9817-dc2fcf97f705" containerName="maas-api"
Sep 08 07:19:59.399658 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:59.399592    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="39b8022e-dbd1-4978-9817-dc2fcf97f705" containerName="maas-api"
Sep 08 07:19:59.404186 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:59.404168    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-576ac2af-openshift-default-78949b8854-srkvv"
Sep 08 07:19:59.406279 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:59.406262    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-576ac2af-openshift-default-dockercfg-v9xb9\""
Sep 08 07:19:59.429716 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:59.429690    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grm6z\" (UniqueName: \"kubernetes.io/projected/feb1c664-75cd-4c22-b5ca-90ae131b1114-kube-api-access-grm6z\") pod \"e2e-ait-576ac2af-openshift-default-78949b8854-srkvv\" (UID: \"feb1c664-75cd-4c22-b5ca-90ae131b1114\") " pod="openshift-ingress/e2e-ait-576ac2af-openshift-default-78949b8854-srkvv"
Sep 08 07:19:59.429819 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:59.429721    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/feb1c664-75cd-4c22-b5ca-90ae131b1114-credential-socket\") pod \"e2e-ait-576ac2af-openshift-default-78949b8854-srkvv\" (UID: \"feb1c664-75cd-4c22-b5ca-90ae131b1114\") " pod="openshift-ingress/e2e-ait-576ac2af-openshift-default-78949b8854-srkvv"
Sep 08 07:19:59.429819 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:59.429790    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/feb1c664-75cd-4c22-b5ca-90ae131b1114-istio-podinfo\") pod \"e2e-ait-576ac2af-openshift-default-78949b8854-srkvv\" (UID: \"feb1c664-75cd-4c22-b5ca-90ae131b1114\") " pod="openshift-ingress/e2e-ait-576ac2af-openshift-default-78949b8854-srkvv"
Sep 08 07:19:59.429819 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:59.429809    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/feb1c664-75cd-4c22-b5ca-90ae131b1114-istio-token\") pod \"e2e-ait-576ac2af-openshift-default-78949b8854-srkvv\" (UID: \"feb1c664-75cd-4c22-b5ca-90ae131b1114\") " pod="openshift-ingress/e2e-ait-576ac2af-openshift-default-78949b8854-srkvv"
Sep 08 07:19:59.430004 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:59.429840    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/feb1c664-75cd-4c22-b5ca-90ae131b1114-workload-certs\") pod \"e2e-ait-576ac2af-openshift-default-78949b8854-srkvv\" (UID: \"feb1c664-75cd-4c22-b5ca-90ae131b1114\") " pod="openshift-ingress/e2e-ait-576ac2af-openshift-default-78949b8854-srkvv"
Sep 08 07:19:59.430004 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:59.429916    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/feb1c664-75cd-4c22-b5ca-90ae131b1114-istio-envoy\") pod \"e2e-ait-576ac2af-openshift-default-78949b8854-srkvv\" (UID: \"feb1c664-75cd-4c22-b5ca-90ae131b1114\") " pod="openshift-ingress/e2e-ait-576ac2af-openshift-default-78949b8854-srkvv"
Sep 08 07:19:59.430081 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:59.430020    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/feb1c664-75cd-4c22-b5ca-90ae131b1114-workload-socket\") pod \"e2e-ait-576ac2af-openshift-default-78949b8854-srkvv\" (UID: \"feb1c664-75cd-4c22-b5ca-90ae131b1114\") " pod="openshift-ingress/e2e-ait-576ac2af-openshift-default-78949b8854-srkvv"
Sep 08 07:19:59.430081 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:59.430049    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/feb1c664-75cd-4c22-b5ca-90ae131b1114-istiod-ca-cert\") pod \"e2e-ait-576ac2af-openshift-default-78949b8854-srkvv\" (UID: \"feb1c664-75cd-4c22-b5ca-90ae131b1114\") " pod="openshift-ingress/e2e-ait-576ac2af-openshift-default-78949b8854-srkvv"
Sep 08 07:19:59.430081 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:59.430073    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/feb1c664-75cd-4c22-b5ca-90ae131b1114-istio-data\") pod \"e2e-ait-576ac2af-openshift-default-78949b8854-srkvv\" (UID: \"feb1c664-75cd-4c22-b5ca-90ae131b1114\") " pod="openshift-ingress/e2e-ait-576ac2af-openshift-default-78949b8854-srkvv"
Sep 08 07:19:59.437062 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:59.437038    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-576ac2af-openshift-default-78949b8854-srkvv"]
Sep 08 07:19:59.531297 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:59.531255    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/feb1c664-75cd-4c22-b5ca-90ae131b1114-workload-certs\") pod \"e2e-ait-576ac2af-openshift-default-78949b8854-srkvv\" (UID: \"feb1c664-75cd-4c22-b5ca-90ae131b1114\") " pod="openshift-ingress/e2e-ait-576ac2af-openshift-default-78949b8854-srkvv"
Sep 08 07:19:59.531511 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:59.531316    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/feb1c664-75cd-4c22-b5ca-90ae131b1114-istio-envoy\") pod \"e2e-ait-576ac2af-openshift-default-78949b8854-srkvv\" (UID: \"feb1c664-75cd-4c22-b5ca-90ae131b1114\") " pod="openshift-ingress/e2e-ait-576ac2af-openshift-default-78949b8854-srkvv"
Sep 08 07:19:59.531511 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:59.531409    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/feb1c664-75cd-4c22-b5ca-90ae131b1114-workload-socket\") pod \"e2e-ait-576ac2af-openshift-default-78949b8854-srkvv\" (UID: \"feb1c664-75cd-4c22-b5ca-90ae131b1114\") " pod="openshift-ingress/e2e-ait-576ac2af-openshift-default-78949b8854-srkvv"
Sep 08 07:19:59.531699 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:59.531668    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/feb1c664-75cd-4c22-b5ca-90ae131b1114-istiod-ca-cert\") pod \"e2e-ait-576ac2af-openshift-default-78949b8854-srkvv\" (UID: \"feb1c664-75cd-4c22-b5ca-90ae131b1114\") " pod="openshift-ingress/e2e-ait-576ac2af-openshift-default-78949b8854-srkvv"
Sep 08 07:19:59.531841 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:59.531735    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/feb1c664-75cd-4c22-b5ca-90ae131b1114-istio-data\") pod \"e2e-ait-576ac2af-openshift-default-78949b8854-srkvv\" (UID: \"feb1c664-75cd-4c22-b5ca-90ae131b1114\") " pod="openshift-ingress/e2e-ait-576ac2af-openshift-default-78949b8854-srkvv"
Sep 08 07:19:59.531841 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:59.531770    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/feb1c664-75cd-4c22-b5ca-90ae131b1114-workload-certs\") pod \"e2e-ait-576ac2af-openshift-default-78949b8854-srkvv\" (UID: \"feb1c664-75cd-4c22-b5ca-90ae131b1114\") " pod="openshift-ingress/e2e-ait-576ac2af-openshift-default-78949b8854-srkvv"
Sep 08 07:19:59.531841 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:59.531777    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grm6z\" (UniqueName: \"kubernetes.io/projected/feb1c664-75cd-4c22-b5ca-90ae131b1114-kube-api-access-grm6z\") pod \"e2e-ait-576ac2af-openshift-default-78949b8854-srkvv\" (UID: \"feb1c664-75cd-4c22-b5ca-90ae131b1114\") " pod="openshift-ingress/e2e-ait-576ac2af-openshift-default-78949b8854-srkvv"
Sep 08 07:19:59.532031 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:59.531849    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/feb1c664-75cd-4c22-b5ca-90ae131b1114-credential-socket\") pod \"e2e-ait-576ac2af-openshift-default-78949b8854-srkvv\" (UID: \"feb1c664-75cd-4c22-b5ca-90ae131b1114\") " pod="openshift-ingress/e2e-ait-576ac2af-openshift-default-78949b8854-srkvv"
Sep 08 07:19:59.532031 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:59.531863    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/feb1c664-75cd-4c22-b5ca-90ae131b1114-workload-socket\") pod \"e2e-ait-576ac2af-openshift-default-78949b8854-srkvv\" (UID: \"feb1c664-75cd-4c22-b5ca-90ae131b1114\") " pod="openshift-ingress/e2e-ait-576ac2af-openshift-default-78949b8854-srkvv"
Sep 08 07:19:59.532031 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:59.531985    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/feb1c664-75cd-4c22-b5ca-90ae131b1114-istio-podinfo\") pod \"e2e-ait-576ac2af-openshift-default-78949b8854-srkvv\" (UID: \"feb1c664-75cd-4c22-b5ca-90ae131b1114\") " pod="openshift-ingress/e2e-ait-576ac2af-openshift-default-78949b8854-srkvv"
Sep 08 07:19:59.532188 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:59.532030    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/feb1c664-75cd-4c22-b5ca-90ae131b1114-istio-token\") pod \"e2e-ait-576ac2af-openshift-default-78949b8854-srkvv\" (UID: \"feb1c664-75cd-4c22-b5ca-90ae131b1114\") " pod="openshift-ingress/e2e-ait-576ac2af-openshift-default-78949b8854-srkvv"
Sep 08 07:19:59.532188 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:59.532064    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/feb1c664-75cd-4c22-b5ca-90ae131b1114-istio-data\") pod \"e2e-ait-576ac2af-openshift-default-78949b8854-srkvv\" (UID: \"feb1c664-75cd-4c22-b5ca-90ae131b1114\") " pod="openshift-ingress/e2e-ait-576ac2af-openshift-default-78949b8854-srkvv"
Sep 08 07:19:59.532188 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:59.532125    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/feb1c664-75cd-4c22-b5ca-90ae131b1114-credential-socket\") pod \"e2e-ait-576ac2af-openshift-default-78949b8854-srkvv\" (UID: \"feb1c664-75cd-4c22-b5ca-90ae131b1114\") " pod="openshift-ingress/e2e-ait-576ac2af-openshift-default-78949b8854-srkvv"
Sep 08 07:19:59.532342 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:59.532260    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/feb1c664-75cd-4c22-b5ca-90ae131b1114-istiod-ca-cert\") pod \"e2e-ait-576ac2af-openshift-default-78949b8854-srkvv\" (UID: \"feb1c664-75cd-4c22-b5ca-90ae131b1114\") " pod="openshift-ingress/e2e-ait-576ac2af-openshift-default-78949b8854-srkvv"
Sep 08 07:19:59.533798 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:59.533779    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/feb1c664-75cd-4c22-b5ca-90ae131b1114-istio-envoy\") pod \"e2e-ait-576ac2af-openshift-default-78949b8854-srkvv\" (UID: \"feb1c664-75cd-4c22-b5ca-90ae131b1114\") " pod="openshift-ingress/e2e-ait-576ac2af-openshift-default-78949b8854-srkvv"
Sep 08 07:19:59.534433 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:59.534416    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/feb1c664-75cd-4c22-b5ca-90ae131b1114-istio-podinfo\") pod \"e2e-ait-576ac2af-openshift-default-78949b8854-srkvv\" (UID: \"feb1c664-75cd-4c22-b5ca-90ae131b1114\") " pod="openshift-ingress/e2e-ait-576ac2af-openshift-default-78949b8854-srkvv"
Sep 08 07:19:59.543703 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:59.543679    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/feb1c664-75cd-4c22-b5ca-90ae131b1114-istio-token\") pod \"e2e-ait-576ac2af-openshift-default-78949b8854-srkvv\" (UID: \"feb1c664-75cd-4c22-b5ca-90ae131b1114\") " pod="openshift-ingress/e2e-ait-576ac2af-openshift-default-78949b8854-srkvv"
Sep 08 07:19:59.545695 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:59.545674    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grm6z\" (UniqueName: \"kubernetes.io/projected/feb1c664-75cd-4c22-b5ca-90ae131b1114-kube-api-access-grm6z\") pod \"e2e-ait-576ac2af-openshift-default-78949b8854-srkvv\" (UID: \"feb1c664-75cd-4c22-b5ca-90ae131b1114\") " pod="openshift-ingress/e2e-ait-576ac2af-openshift-default-78949b8854-srkvv"
Sep 08 07:19:59.715363 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:59.715274    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-576ac2af-openshift-default-78949b8854-srkvv"
Sep 08 07:19:59.998885 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:19:59.998860    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-576ac2af-openshift-default-78949b8854-srkvv"]
Sep 08 07:20:00.001100 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:20:00.001070    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfeb1c664_75cd_4c22_b5ca_90ae131b1114.slice/crio-ed76520dd8d9f90ae182f1b6938720866ca5fa659a0dc29ae8231bf5a3952629 WatchSource:0}: Error finding container ed76520dd8d9f90ae182f1b6938720866ca5fa659a0dc29ae8231bf5a3952629: Status 404 returned error can't find the container with id ed76520dd8d9f90ae182f1b6938720866ca5fa659a0dc29ae8231bf5a3952629
Sep 08 07:20:00.003446 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:00.003408    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 07:20:00.003537 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:00.003480    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 07:20:00.003537 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:00.003511    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 07:20:00.139017 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:00.138955    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-576ac2af-openshift-default-78949b8854-srkvv" event={"ID":"feb1c664-75cd-4c22-b5ca-90ae131b1114","Type":"ContainerStarted","Data":"8870668e37bab9250c66d53444a8b68be874de96278211e8c67025fb717f9352"}
Sep 08 07:20:00.139215 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:00.139043    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-576ac2af-openshift-default-78949b8854-srkvv" event={"ID":"feb1c664-75cd-4c22-b5ca-90ae131b1114","Type":"ContainerStarted","Data":"ed76520dd8d9f90ae182f1b6938720866ca5fa659a0dc29ae8231bf5a3952629"}
Sep 08 07:20:00.166135 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:00.166078    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-576ac2af-openshift-default-78949b8854-srkvv" podStartSLOduration=1.166059945 podStartE2EDuration="1.166059945s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:19:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:20:00.164197918 +0000 UTC m=+948.145237244" watchObservedRunningTime="2026-09-08 07:20:00.166059945 +0000 UTC m=+948.147099310"
Sep 08 07:20:00.512255 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:00.512222    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39b8022e-dbd1-4978-9817-dc2fcf97f705" path="/var/lib/kubelet/pods/39b8022e-dbd1-4978-9817-dc2fcf97f705/volumes"
Sep 08 07:20:00.715775 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:00.715727    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-576ac2af-openshift-default-78949b8854-srkvv"
Sep 08 07:20:01.722478 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:01.722445    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-576ac2af-openshift-default-78949b8854-srkvv"
Sep 08 07:20:02.150728 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:02.150698    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-576ac2af-openshift-default-78949b8854-srkvv"
Sep 08 07:20:02.151759 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:02.151738    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-576ac2af-openshift-default-78949b8854-srkvv"
Sep 08 07:20:02.697207 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:02.697171    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-576ac2af-8688df7c5f-6s6hb"]
Sep 08 07:20:02.701061 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:02.701042    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-576ac2af-8688df7c5f-6s6hb"
Sep 08 07:20:02.703037 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:02.703016    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-576ac2af-serving-cert\""
Sep 08 07:20:02.712956 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:02.712925    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-576ac2af-8688df7c5f-6s6hb"]
Sep 08 07:20:02.763538 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:02.763495    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d1d0ffd-cbf3-42ac-bc0a-0b9142140191-openshift-service-ca\") pod \"maas-api-e2e-ait-576ac2af-8688df7c5f-6s6hb\" (UID: \"6d1d0ffd-cbf3-42ac-bc0a-0b9142140191\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-576ac2af-8688df7c5f-6s6hb"
Sep 08 07:20:02.763936 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:02.763572    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d1d0ffd-cbf3-42ac-bc0a-0b9142140191-maas-api-tls\") pod \"maas-api-e2e-ait-576ac2af-8688df7c5f-6s6hb\" (UID: \"6d1d0ffd-cbf3-42ac-bc0a-0b9142140191\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-576ac2af-8688df7c5f-6s6hb"
Sep 08 07:20:02.763936 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:02.763609    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d1d0ffd-cbf3-42ac-bc0a-0b9142140191-metrics-certs\") pod \"maas-api-e2e-ait-576ac2af-8688df7c5f-6s6hb\" (UID: \"6d1d0ffd-cbf3-42ac-bc0a-0b9142140191\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-576ac2af-8688df7c5f-6s6hb"
Sep 08 07:20:02.763936 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:02.763736    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24cqx\" (UniqueName: \"kubernetes.io/projected/6d1d0ffd-cbf3-42ac-bc0a-0b9142140191-kube-api-access-24cqx\") pod \"maas-api-e2e-ait-576ac2af-8688df7c5f-6s6hb\" (UID: \"6d1d0ffd-cbf3-42ac-bc0a-0b9142140191\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-576ac2af-8688df7c5f-6s6hb"
Sep 08 07:20:02.864626 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:02.864587    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d1d0ffd-cbf3-42ac-bc0a-0b9142140191-openshift-service-ca\") pod \"maas-api-e2e-ait-576ac2af-8688df7c5f-6s6hb\" (UID: \"6d1d0ffd-cbf3-42ac-bc0a-0b9142140191\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-576ac2af-8688df7c5f-6s6hb"
Sep 08 07:20:02.864828 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:02.864649    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d1d0ffd-cbf3-42ac-bc0a-0b9142140191-maas-api-tls\") pod \"maas-api-e2e-ait-576ac2af-8688df7c5f-6s6hb\" (UID: \"6d1d0ffd-cbf3-42ac-bc0a-0b9142140191\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-576ac2af-8688df7c5f-6s6hb"
Sep 08 07:20:02.864828 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:02.864681    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d1d0ffd-cbf3-42ac-bc0a-0b9142140191-metrics-certs\") pod \"maas-api-e2e-ait-576ac2af-8688df7c5f-6s6hb\" (UID: \"6d1d0ffd-cbf3-42ac-bc0a-0b9142140191\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-576ac2af-8688df7c5f-6s6hb"
Sep 08 07:20:02.864828 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:02.864744    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24cqx\" (UniqueName: \"kubernetes.io/projected/6d1d0ffd-cbf3-42ac-bc0a-0b9142140191-kube-api-access-24cqx\") pod \"maas-api-e2e-ait-576ac2af-8688df7c5f-6s6hb\" (UID: \"6d1d0ffd-cbf3-42ac-bc0a-0b9142140191\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-576ac2af-8688df7c5f-6s6hb"
Sep 08 07:20:02.865050 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:20:02.864881    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-576ac2af-serving-cert: secret "maas-api-e2e-ait-576ac2af-serving-cert" not found
Sep 08 07:20:02.865114 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:20:02.865056    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d1d0ffd-cbf3-42ac-bc0a-0b9142140191-maas-api-tls podName:6d1d0ffd-cbf3-42ac-bc0a-0b9142140191 nodeName:}" failed. No retries permitted until 2026-09-08 07:20:03.36503469 +0000 UTC m=+951.346073990 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6d1d0ffd-cbf3-42ac-bc0a-0b9142140191-maas-api-tls") pod "maas-api-e2e-ait-576ac2af-8688df7c5f-6s6hb" (UID: "6d1d0ffd-cbf3-42ac-bc0a-0b9142140191") : secret "maas-api-e2e-ait-576ac2af-serving-cert" not found
Sep 08 07:20:02.865466 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:02.865446    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d1d0ffd-cbf3-42ac-bc0a-0b9142140191-openshift-service-ca\") pod \"maas-api-e2e-ait-576ac2af-8688df7c5f-6s6hb\" (UID: \"6d1d0ffd-cbf3-42ac-bc0a-0b9142140191\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-576ac2af-8688df7c5f-6s6hb"
Sep 08 07:20:02.867314 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:02.867290    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d1d0ffd-cbf3-42ac-bc0a-0b9142140191-metrics-certs\") pod \"maas-api-e2e-ait-576ac2af-8688df7c5f-6s6hb\" (UID: \"6d1d0ffd-cbf3-42ac-bc0a-0b9142140191\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-576ac2af-8688df7c5f-6s6hb"
Sep 08 07:20:02.878395 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:02.878366    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24cqx\" (UniqueName: \"kubernetes.io/projected/6d1d0ffd-cbf3-42ac-bc0a-0b9142140191-kube-api-access-24cqx\") pod \"maas-api-e2e-ait-576ac2af-8688df7c5f-6s6hb\" (UID: \"6d1d0ffd-cbf3-42ac-bc0a-0b9142140191\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-576ac2af-8688df7c5f-6s6hb"
Sep 08 07:20:03.371154 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:03.371120    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d1d0ffd-cbf3-42ac-bc0a-0b9142140191-maas-api-tls\") pod \"maas-api-e2e-ait-576ac2af-8688df7c5f-6s6hb\" (UID: \"6d1d0ffd-cbf3-42ac-bc0a-0b9142140191\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-576ac2af-8688df7c5f-6s6hb"
Sep 08 07:20:03.373653 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:03.373625    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d1d0ffd-cbf3-42ac-bc0a-0b9142140191-maas-api-tls\") pod \"maas-api-e2e-ait-576ac2af-8688df7c5f-6s6hb\" (UID: \"6d1d0ffd-cbf3-42ac-bc0a-0b9142140191\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-576ac2af-8688df7c5f-6s6hb"
Sep 08 07:20:03.621862 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:03.621760    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-576ac2af-8688df7c5f-6s6hb"
Sep 08 07:20:03.913085 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:03.912959    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-576ac2af-8688df7c5f-6s6hb"]
Sep 08 07:20:03.915831 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:20:03.915798    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d1d0ffd_cbf3_42ac_bc0a_0b9142140191.slice/crio-e29ddf05bd89a14b1bb66a5ceaac16150b75ef6b7b768027cf5cefb2d811c8c3 WatchSource:0}: Error finding container e29ddf05bd89a14b1bb66a5ceaac16150b75ef6b7b768027cf5cefb2d811c8c3: Status 404 returned error can't find the container with id e29ddf05bd89a14b1bb66a5ceaac16150b75ef6b7b768027cf5cefb2d811c8c3
Sep 08 07:20:03.958947 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:03.958921    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s"
Sep 08 07:20:04.078643 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:04.078604    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72de8212-3915-41c4-aba2-3fdf48349b61-istio-podinfo\") pod \"72de8212-3915-41c4-aba2-3fdf48349b61\" (UID: \"72de8212-3915-41c4-aba2-3fdf48349b61\") "
Sep 08 07:20:04.078807 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:04.078662    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72de8212-3915-41c4-aba2-3fdf48349b61-credential-socket\") pod \"72de8212-3915-41c4-aba2-3fdf48349b61\" (UID: \"72de8212-3915-41c4-aba2-3fdf48349b61\") "
Sep 08 07:20:04.078807 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:04.078710    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72de8212-3915-41c4-aba2-3fdf48349b61-istio-token\") pod \"72de8212-3915-41c4-aba2-3fdf48349b61\" (UID: \"72de8212-3915-41c4-aba2-3fdf48349b61\") "
Sep 08 07:20:04.078807 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:04.078749    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72de8212-3915-41c4-aba2-3fdf48349b61-istiod-ca-cert\") pod \"72de8212-3915-41c4-aba2-3fdf48349b61\" (UID: \"72de8212-3915-41c4-aba2-3fdf48349b61\") "
Sep 08 07:20:04.078807 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:04.078769    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72de8212-3915-41c4-aba2-3fdf48349b61-istio-envoy\") pod \"72de8212-3915-41c4-aba2-3fdf48349b61\" (UID: \"72de8212-3915-41c4-aba2-3fdf48349b61\") "
Sep 08 07:20:04.078807 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:04.078791    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72de8212-3915-41c4-aba2-3fdf48349b61-workload-socket\") pod \"72de8212-3915-41c4-aba2-3fdf48349b61\" (UID: \"72de8212-3915-41c4-aba2-3fdf48349b61\") "
Sep 08 07:20:04.079130 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:04.078815    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qz7r6\" (UniqueName: \"kubernetes.io/projected/72de8212-3915-41c4-aba2-3fdf48349b61-kube-api-access-qz7r6\") pod \"72de8212-3915-41c4-aba2-3fdf48349b61\" (UID: \"72de8212-3915-41c4-aba2-3fdf48349b61\") "
Sep 08 07:20:04.079130 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:04.078846    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72de8212-3915-41c4-aba2-3fdf48349b61-workload-certs\") pod \"72de8212-3915-41c4-aba2-3fdf48349b61\" (UID: \"72de8212-3915-41c4-aba2-3fdf48349b61\") "
Sep 08 07:20:04.079130 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:04.078868    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72de8212-3915-41c4-aba2-3fdf48349b61-istio-data\") pod \"72de8212-3915-41c4-aba2-3fdf48349b61\" (UID: \"72de8212-3915-41c4-aba2-3fdf48349b61\") "
Sep 08 07:20:04.079288 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:04.079127    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72de8212-3915-41c4-aba2-3fdf48349b61-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "72de8212-3915-41c4-aba2-3fdf48349b61" (UID: "72de8212-3915-41c4-aba2-3fdf48349b61"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 07:20:04.079288 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:04.079243    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72de8212-3915-41c4-aba2-3fdf48349b61-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "72de8212-3915-41c4-aba2-3fdf48349b61" (UID: "72de8212-3915-41c4-aba2-3fdf48349b61"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 07:20:04.079288 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:04.079261    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72de8212-3915-41c4-aba2-3fdf48349b61-credential-socket\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:20:04.079460 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:04.079335    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72de8212-3915-41c4-aba2-3fdf48349b61-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "72de8212-3915-41c4-aba2-3fdf48349b61" (UID: "72de8212-3915-41c4-aba2-3fdf48349b61"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 07:20:04.079460 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:04.079351    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72de8212-3915-41c4-aba2-3fdf48349b61-istio-data" (OuterVolumeSpecName: "istio-data") pod "72de8212-3915-41c4-aba2-3fdf48349b61" (UID: "72de8212-3915-41c4-aba2-3fdf48349b61"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 07:20:04.079568 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:04.079466    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72de8212-3915-41c4-aba2-3fdf48349b61-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "72de8212-3915-41c4-aba2-3fdf48349b61" (UID: "72de8212-3915-41c4-aba2-3fdf48349b61"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 07:20:04.081255 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:04.081229    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72de8212-3915-41c4-aba2-3fdf48349b61-istio-token" (OuterVolumeSpecName: "istio-token") pod "72de8212-3915-41c4-aba2-3fdf48349b61" (UID: "72de8212-3915-41c4-aba2-3fdf48349b61"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 07:20:04.081337 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:04.081292    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72de8212-3915-41c4-aba2-3fdf48349b61-kube-api-access-qz7r6" (OuterVolumeSpecName: "kube-api-access-qz7r6") pod "72de8212-3915-41c4-aba2-3fdf48349b61" (UID: "72de8212-3915-41c4-aba2-3fdf48349b61"). InnerVolumeSpecName "kube-api-access-qz7r6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 07:20:04.081463 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:04.081442    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72de8212-3915-41c4-aba2-3fdf48349b61-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "72de8212-3915-41c4-aba2-3fdf48349b61" (UID: "72de8212-3915-41c4-aba2-3fdf48349b61"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 07:20:04.081519 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:04.081449    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/72de8212-3915-41c4-aba2-3fdf48349b61-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "72de8212-3915-41c4-aba2-3fdf48349b61" (UID: "72de8212-3915-41c4-aba2-3fdf48349b61"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 07:20:04.163705 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:04.163612    2564 generic.go:356] "Generic (PLEG): container finished" podID="72de8212-3915-41c4-aba2-3fdf48349b61" containerID="c403b32dc17e0e13f2541a669c28f40e32c813ebbc90eab384cd6c6cfa438086" exitCode=0
Sep 08 07:20:04.163705 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:04.163673    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s"
Sep 08 07:20:04.163705 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:04.163697    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s" event={"ID":"72de8212-3915-41c4-aba2-3fdf48349b61","Type":"ContainerDied","Data":"c403b32dc17e0e13f2541a669c28f40e32c813ebbc90eab384cd6c6cfa438086"}
Sep 08 07:20:04.164009 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:04.163758    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s" event={"ID":"72de8212-3915-41c4-aba2-3fdf48349b61","Type":"ContainerDied","Data":"813f33f423cd57a14a27bd187d38802c81f4aee46c5f5a698ca43dbbaba1c50e"}
Sep 08 07:20:04.164009 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:04.163790    2564 scope.go:117] "RemoveContainer" containerID="c403b32dc17e0e13f2541a669c28f40e32c813ebbc90eab384cd6c6cfa438086"
Sep 08 07:20:04.165662 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:04.165635    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-576ac2af-8688df7c5f-6s6hb" event={"ID":"6d1d0ffd-cbf3-42ac-bc0a-0b9142140191","Type":"ContainerStarted","Data":"e29ddf05bd89a14b1bb66a5ceaac16150b75ef6b7b768027cf5cefb2d811c8c3"}
Sep 08 07:20:04.174053 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:04.174015    2564 scope.go:117] "RemoveContainer" containerID="4d55f8cdc8c8b19c2afefc6ea0b538eb3246e44b8ed712e982a57522192abda3"
Sep 08 07:20:04.180571 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:04.180544    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72de8212-3915-41c4-aba2-3fdf48349b61-istio-podinfo\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:20:04.180571 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:04.180566    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72de8212-3915-41c4-aba2-3fdf48349b61-istio-token\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:20:04.180699 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:04.180577    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72de8212-3915-41c4-aba2-3fdf48349b61-istiod-ca-cert\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:20:04.180699 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:04.180585    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72de8212-3915-41c4-aba2-3fdf48349b61-istio-envoy\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:20:04.180699 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:04.180592    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72de8212-3915-41c4-aba2-3fdf48349b61-workload-socket\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:20:04.180699 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:04.180600    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qz7r6\" (UniqueName: \"kubernetes.io/projected/72de8212-3915-41c4-aba2-3fdf48349b61-kube-api-access-qz7r6\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:20:04.180699 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:04.180609    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72de8212-3915-41c4-aba2-3fdf48349b61-workload-certs\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:20:04.180699 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:04.180617    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72de8212-3915-41c4-aba2-3fdf48349b61-istio-data\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:20:04.183612 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:04.183595    2564 scope.go:117] "RemoveContainer" containerID="c403b32dc17e0e13f2541a669c28f40e32c813ebbc90eab384cd6c6cfa438086"
Sep 08 07:20:04.183892 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:20:04.183876    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c403b32dc17e0e13f2541a669c28f40e32c813ebbc90eab384cd6c6cfa438086\": container with ID starting with c403b32dc17e0e13f2541a669c28f40e32c813ebbc90eab384cd6c6cfa438086 not found: ID does not exist" containerID="c403b32dc17e0e13f2541a669c28f40e32c813ebbc90eab384cd6c6cfa438086"
Sep 08 07:20:04.183938 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:04.183902    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c403b32dc17e0e13f2541a669c28f40e32c813ebbc90eab384cd6c6cfa438086"} err="failed to get container status \"c403b32dc17e0e13f2541a669c28f40e32c813ebbc90eab384cd6c6cfa438086\": rpc error: code = NotFound desc = could not find container \"c403b32dc17e0e13f2541a669c28f40e32c813ebbc90eab384cd6c6cfa438086\": container with ID starting with c403b32dc17e0e13f2541a669c28f40e32c813ebbc90eab384cd6c6cfa438086 not found: ID does not exist"
Sep 08 07:20:04.183938 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:04.183920    2564 scope.go:117] "RemoveContainer" containerID="4d55f8cdc8c8b19c2afefc6ea0b538eb3246e44b8ed712e982a57522192abda3"
Sep 08 07:20:04.184258 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:20:04.184234    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d55f8cdc8c8b19c2afefc6ea0b538eb3246e44b8ed712e982a57522192abda3\": container with ID starting with 4d55f8cdc8c8b19c2afefc6ea0b538eb3246e44b8ed712e982a57522192abda3 not found: ID does not exist" containerID="4d55f8cdc8c8b19c2afefc6ea0b538eb3246e44b8ed712e982a57522192abda3"
Sep 08 07:20:04.184337 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:04.184266    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d55f8cdc8c8b19c2afefc6ea0b538eb3246e44b8ed712e982a57522192abda3"} err="failed to get container status \"4d55f8cdc8c8b19c2afefc6ea0b538eb3246e44b8ed712e982a57522192abda3\": rpc error: code = NotFound desc = could not find container \"4d55f8cdc8c8b19c2afefc6ea0b538eb3246e44b8ed712e982a57522192abda3\": container with ID starting with 4d55f8cdc8c8b19c2afefc6ea0b538eb3246e44b8ed712e982a57522192abda3 not found: ID does not exist"
Sep 08 07:20:04.193849 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:04.193793    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s"]
Sep 08 07:20:04.195982 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:04.195942    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-c3da4827-gw-openshift-default-5bf8865cfb-dtt7s"]
Sep 08 07:20:04.510269 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:04.510227    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72de8212-3915-41c4-aba2-3fdf48349b61" path="/var/lib/kubelet/pods/72de8212-3915-41c4-aba2-3fdf48349b61/volumes"
Sep 08 07:20:05.173353 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:05.173316    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-576ac2af-8688df7c5f-6s6hb" event={"ID":"6d1d0ffd-cbf3-42ac-bc0a-0b9142140191","Type":"ContainerStarted","Data":"6d9aa9f4080a8c9738581d1d10f64de000c07027eeb0ce9fd893639a2221d08e"}
Sep 08 07:20:05.173735 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:05.173452    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-576ac2af-8688df7c5f-6s6hb"
Sep 08 07:20:05.199110 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:05.199055    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-576ac2af-8688df7c5f-6s6hb" podStartSLOduration=2.742745673 podStartE2EDuration="3.199038357s" totalImagesPullingTime="456.292684ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:20:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:20:05.197534575 +0000 UTC m=+953.178573882" watchObservedRunningTime="2026-09-08 07:20:05.199038357 +0000 UTC m=+953.180077663"
Sep 08 07:20:11.185130 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:11.185095    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-576ac2af-8688df7c5f-6s6hb"
Sep 08 07:20:13.060598 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:13.060551    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:20:24.278692 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:24.278654    2564 generic.go:356] "Generic (PLEG): container finished" podID="feb1c664-75cd-4c22-b5ca-90ae131b1114" containerID="8870668e37bab9250c66d53444a8b68be874de96278211e8c67025fb717f9352" exitCode=0
Sep 08 07:20:24.279255 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:24.278713    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-576ac2af-openshift-default-78949b8854-srkvv" event={"ID":"feb1c664-75cd-4c22-b5ca-90ae131b1114","Type":"ContainerDied","Data":"8870668e37bab9250c66d53444a8b68be874de96278211e8c67025fb717f9352"}
Sep 08 07:20:24.279255 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:24.279239    2564 scope.go:117] "RemoveContainer" containerID="8870668e37bab9250c66d53444a8b68be874de96278211e8c67025fb717f9352"
Sep 08 07:20:24.280407 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:24.280362    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 07:20:24.280491 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:24.280453    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 07:20:24.280533 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:24.280490    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 07:20:25.288381 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:25.287595    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-576ac2af-openshift-default-78949b8854-srkvv" event={"ID":"feb1c664-75cd-4c22-b5ca-90ae131b1114","Type":"ContainerStarted","Data":"54eca618ef45d1f98aa00cdef3e59277cf402e2a13d10cbb5ce4a8204a743969"}
Sep 08 07:20:25.715845 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:25.715751    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-576ac2af-openshift-default-78949b8854-srkvv"
Sep 08 07:20:25.716120 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:25.716097    2564 patch_prober.go:28] interesting pod/e2e-ait-576ac2af-openshift-default-78949b8854-srkvv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 08 07:20:25.716180 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:25.716151    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-576ac2af-openshift-default-78949b8854-srkvv" podUID="feb1c664-75cd-4c22-b5ca-90ae131b1114" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 08 07:20:26.716192 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:26.716156    2564 patch_prober.go:28] interesting pod/e2e-ait-576ac2af-openshift-default-78949b8854-srkvv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 08 07:20:26.716583 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:26.716228    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-576ac2af-openshift-default-78949b8854-srkvv" podUID="feb1c664-75cd-4c22-b5ca-90ae131b1114" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 08 07:20:27.716534 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:27.716486    2564 patch_prober.go:28] interesting pod/e2e-ait-576ac2af-openshift-default-78949b8854-srkvv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 08 07:20:27.716925 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:27.716580    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-576ac2af-openshift-default-78949b8854-srkvv" podUID="feb1c664-75cd-4c22-b5ca-90ae131b1114" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 08 07:20:28.716439 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:28.716395    2564 patch_prober.go:28] interesting pod/e2e-ait-576ac2af-openshift-default-78949b8854-srkvv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 08 07:20:28.716669 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:28.716472    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-576ac2af-openshift-default-78949b8854-srkvv" podUID="feb1c664-75cd-4c22-b5ca-90ae131b1114" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 08 07:20:29.716605 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:29.716565    2564 patch_prober.go:28] interesting pod/e2e-ait-576ac2af-openshift-default-78949b8854-srkvv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 08 07:20:29.716784 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:29.716624    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-576ac2af-openshift-default-78949b8854-srkvv" podUID="feb1c664-75cd-4c22-b5ca-90ae131b1114" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 08 07:20:30.719893 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:30.719856    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-576ac2af-openshift-default-78949b8854-srkvv"
Sep 08 07:20:30.720364 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:30.720256    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-576ac2af-openshift-default-78949b8854-srkvv"
Sep 08 07:20:30.720952 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:30.720933    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-576ac2af-openshift-default-78949b8854-srkvv"
Sep 08 07:20:32.438482 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:32.438446    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:20:33.158941 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:33.158862    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-576ac2af-8688df7c5f-6s6hb"]
Sep 08 07:20:33.159160 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:33.159131    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-576ac2af-8688df7c5f-6s6hb" podUID="6d1d0ffd-cbf3-42ac-bc0a-0b9142140191" containerName="maas-api" containerID="cri-o://6d9aa9f4080a8c9738581d1d10f64de000c07027eeb0ce9fd893639a2221d08e" gracePeriod=30
Sep 08 07:20:33.341402 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:33.341368    2564 generic.go:356] "Generic (PLEG): container finished" podID="6d1d0ffd-cbf3-42ac-bc0a-0b9142140191" containerID="6d9aa9f4080a8c9738581d1d10f64de000c07027eeb0ce9fd893639a2221d08e" exitCode=0
Sep 08 07:20:33.341548 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:33.341429    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-576ac2af-8688df7c5f-6s6hb" event={"ID":"6d1d0ffd-cbf3-42ac-bc0a-0b9142140191","Type":"ContainerDied","Data":"6d9aa9f4080a8c9738581d1d10f64de000c07027eeb0ce9fd893639a2221d08e"}
Sep 08 07:20:33.420237 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:33.420176    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-576ac2af-8688df7c5f-6s6hb"
Sep 08 07:20:33.475573 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:33.475541    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-24cqx\" (UniqueName: \"kubernetes.io/projected/6d1d0ffd-cbf3-42ac-bc0a-0b9142140191-kube-api-access-24cqx\") pod \"6d1d0ffd-cbf3-42ac-bc0a-0b9142140191\" (UID: \"6d1d0ffd-cbf3-42ac-bc0a-0b9142140191\") "
Sep 08 07:20:33.475965 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:33.475599    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d1d0ffd-cbf3-42ac-bc0a-0b9142140191-metrics-certs\") pod \"6d1d0ffd-cbf3-42ac-bc0a-0b9142140191\" (UID: \"6d1d0ffd-cbf3-42ac-bc0a-0b9142140191\") "
Sep 08 07:20:33.475965 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:33.475657    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d1d0ffd-cbf3-42ac-bc0a-0b9142140191-openshift-service-ca\") pod \"6d1d0ffd-cbf3-42ac-bc0a-0b9142140191\" (UID: \"6d1d0ffd-cbf3-42ac-bc0a-0b9142140191\") "
Sep 08 07:20:33.475965 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:33.475699    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d1d0ffd-cbf3-42ac-bc0a-0b9142140191-maas-api-tls\") pod \"6d1d0ffd-cbf3-42ac-bc0a-0b9142140191\" (UID: \"6d1d0ffd-cbf3-42ac-bc0a-0b9142140191\") "
Sep 08 07:20:33.476185 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:33.476099    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d1d0ffd-cbf3-42ac-bc0a-0b9142140191-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6d1d0ffd-cbf3-42ac-bc0a-0b9142140191" (UID: "6d1d0ffd-cbf3-42ac-bc0a-0b9142140191"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 07:20:33.477682 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:33.477648    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d1d0ffd-cbf3-42ac-bc0a-0b9142140191-kube-api-access-24cqx" (OuterVolumeSpecName: "kube-api-access-24cqx") pod "6d1d0ffd-cbf3-42ac-bc0a-0b9142140191" (UID: "6d1d0ffd-cbf3-42ac-bc0a-0b9142140191"). InnerVolumeSpecName "kube-api-access-24cqx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 07:20:33.477682 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:33.477651    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d1d0ffd-cbf3-42ac-bc0a-0b9142140191-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "6d1d0ffd-cbf3-42ac-bc0a-0b9142140191" (UID: "6d1d0ffd-cbf3-42ac-bc0a-0b9142140191"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 07:20:33.477808 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:33.477704    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d1d0ffd-cbf3-42ac-bc0a-0b9142140191-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6d1d0ffd-cbf3-42ac-bc0a-0b9142140191" (UID: "6d1d0ffd-cbf3-42ac-bc0a-0b9142140191"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 07:20:33.577141 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:33.577099    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d1d0ffd-cbf3-42ac-bc0a-0b9142140191-metrics-certs\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:20:33.577141 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:33.577134    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d1d0ffd-cbf3-42ac-bc0a-0b9142140191-openshift-service-ca\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:20:33.577141 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:33.577151    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d1d0ffd-cbf3-42ac-bc0a-0b9142140191-maas-api-tls\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:20:33.577422 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:33.577164    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-24cqx\" (UniqueName: \"kubernetes.io/projected/6d1d0ffd-cbf3-42ac-bc0a-0b9142140191-kube-api-access-24cqx\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:20:34.347229 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:34.347201    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-576ac2af-8688df7c5f-6s6hb"
Sep 08 07:20:34.347411 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:34.347236    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-576ac2af-8688df7c5f-6s6hb" event={"ID":"6d1d0ffd-cbf3-42ac-bc0a-0b9142140191","Type":"ContainerDied","Data":"e29ddf05bd89a14b1bb66a5ceaac16150b75ef6b7b768027cf5cefb2d811c8c3"}
Sep 08 07:20:34.347411 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:34.347299    2564 scope.go:117] "RemoveContainer" containerID="6d9aa9f4080a8c9738581d1d10f64de000c07027eeb0ce9fd893639a2221d08e"
Sep 08 07:20:34.370269 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:34.370240    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-576ac2af-8688df7c5f-6s6hb"]
Sep 08 07:20:34.373644 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:34.373619    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-576ac2af-8688df7c5f-6s6hb"]
Sep 08 07:20:34.439628 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:34.439592    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-576ac2af-openshift-default-78949b8854-srkvv"]
Sep 08 07:20:34.439825 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:34.439800    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-576ac2af-openshift-default-78949b8854-srkvv" podUID="feb1c664-75cd-4c22-b5ca-90ae131b1114" containerName="istio-proxy" containerID="cri-o://54eca618ef45d1f98aa00cdef3e59277cf402e2a13d10cbb5ce4a8204a743969" gracePeriod=30
Sep 08 07:20:34.509840 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:34.509809    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d1d0ffd-cbf3-42ac-bc0a-0b9142140191" path="/var/lib/kubelet/pods/6d1d0ffd-cbf3-42ac-bc0a-0b9142140191/volumes"
Sep 08 07:20:35.115034 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:35.114933    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt"]
Sep 08 07:20:35.115429 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:35.115411    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72de8212-3915-41c4-aba2-3fdf48349b61" containerName="istio-proxy"
Sep 08 07:20:35.115429 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:35.115428    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="72de8212-3915-41c4-aba2-3fdf48349b61" containerName="istio-proxy"
Sep 08 07:20:35.115574 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:35.115436    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72de8212-3915-41c4-aba2-3fdf48349b61" containerName="istio-proxy"
Sep 08 07:20:35.115574 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:35.115442    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="72de8212-3915-41c4-aba2-3fdf48349b61" containerName="istio-proxy"
Sep 08 07:20:35.115574 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:35.115450    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d1d0ffd-cbf3-42ac-bc0a-0b9142140191" containerName="maas-api"
Sep 08 07:20:35.115574 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:35.115456    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d1d0ffd-cbf3-42ac-bc0a-0b9142140191" containerName="maas-api"
Sep 08 07:20:35.115574 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:35.115542    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="72de8212-3915-41c4-aba2-3fdf48349b61" containerName="istio-proxy"
Sep 08 07:20:35.115574 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:35.115553    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d1d0ffd-cbf3-42ac-bc0a-0b9142140191" containerName="maas-api"
Sep 08 07:20:35.120028 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:35.120012    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt"
Sep 08 07:20:35.122209 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:35.122190    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-da54544b-openshift-default-dockercfg-pfptb\""
Sep 08 07:20:35.131261 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:35.131242    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt"]
Sep 08 07:20:35.193305 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:35.193267    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e3bee0d6-4554-46be-a443-d6ae77c10001-istio-podinfo\") pod \"e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt\" (UID: \"e3bee0d6-4554-46be-a443-d6ae77c10001\") " pod="openshift-ingress/e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt"
Sep 08 07:20:35.193463 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:35.193308    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69n74\" (UniqueName: \"kubernetes.io/projected/e3bee0d6-4554-46be-a443-d6ae77c10001-kube-api-access-69n74\") pod \"e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt\" (UID: \"e3bee0d6-4554-46be-a443-d6ae77c10001\") " pod="openshift-ingress/e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt"
Sep 08 07:20:35.193463 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:35.193409    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e3bee0d6-4554-46be-a443-d6ae77c10001-istio-envoy\") pod \"e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt\" (UID: \"e3bee0d6-4554-46be-a443-d6ae77c10001\") " pod="openshift-ingress/e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt"
Sep 08 07:20:35.193539 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:35.193466    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e3bee0d6-4554-46be-a443-d6ae77c10001-istiod-ca-cert\") pod \"e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt\" (UID: \"e3bee0d6-4554-46be-a443-d6ae77c10001\") " pod="openshift-ingress/e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt"
Sep 08 07:20:35.193539 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:35.193509    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3bee0d6-4554-46be-a443-d6ae77c10001-credential-socket\") pod \"e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt\" (UID: \"e3bee0d6-4554-46be-a443-d6ae77c10001\") " pod="openshift-ingress/e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt"
Sep 08 07:20:35.193620 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:35.193576    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e3bee0d6-4554-46be-a443-d6ae77c10001-workload-certs\") pod \"e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt\" (UID: \"e3bee0d6-4554-46be-a443-d6ae77c10001\") " pod="openshift-ingress/e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt"
Sep 08 07:20:35.193620 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:35.193596    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e3bee0d6-4554-46be-a443-d6ae77c10001-istio-token\") pod \"e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt\" (UID: \"e3bee0d6-4554-46be-a443-d6ae77c10001\") " pod="openshift-ingress/e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt"
Sep 08 07:20:35.193687 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:35.193620    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e3bee0d6-4554-46be-a443-d6ae77c10001-istio-data\") pod \"e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt\" (UID: \"e3bee0d6-4554-46be-a443-d6ae77c10001\") " pod="openshift-ingress/e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt"
Sep 08 07:20:35.193687 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:35.193665    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3bee0d6-4554-46be-a443-d6ae77c10001-workload-socket\") pod \"e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt\" (UID: \"e3bee0d6-4554-46be-a443-d6ae77c10001\") " pod="openshift-ingress/e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt"
Sep 08 07:20:35.294361 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:35.294321    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3bee0d6-4554-46be-a443-d6ae77c10001-workload-socket\") pod \"e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt\" (UID: \"e3bee0d6-4554-46be-a443-d6ae77c10001\") " pod="openshift-ingress/e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt"
Sep 08 07:20:35.294546 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:35.294373    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e3bee0d6-4554-46be-a443-d6ae77c10001-istio-podinfo\") pod \"e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt\" (UID: \"e3bee0d6-4554-46be-a443-d6ae77c10001\") " pod="openshift-ingress/e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt"
Sep 08 07:20:35.294546 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:35.294442    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69n74\" (UniqueName: \"kubernetes.io/projected/e3bee0d6-4554-46be-a443-d6ae77c10001-kube-api-access-69n74\") pod \"e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt\" (UID: \"e3bee0d6-4554-46be-a443-d6ae77c10001\") " pod="openshift-ingress/e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt"
Sep 08 07:20:35.294546 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:35.294492    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e3bee0d6-4554-46be-a443-d6ae77c10001-istio-envoy\") pod \"e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt\" (UID: \"e3bee0d6-4554-46be-a443-d6ae77c10001\") " pod="openshift-ingress/e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt"
Sep 08 07:20:35.294546 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:35.294524    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e3bee0d6-4554-46be-a443-d6ae77c10001-istiod-ca-cert\") pod \"e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt\" (UID: \"e3bee0d6-4554-46be-a443-d6ae77c10001\") " pod="openshift-ingress/e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt"
Sep 08 07:20:35.294774 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:35.294580    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3bee0d6-4554-46be-a443-d6ae77c10001-credential-socket\") pod \"e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt\" (UID: \"e3bee0d6-4554-46be-a443-d6ae77c10001\") " pod="openshift-ingress/e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt"
Sep 08 07:20:35.294774 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:35.294670    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e3bee0d6-4554-46be-a443-d6ae77c10001-workload-certs\") pod \"e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt\" (UID: \"e3bee0d6-4554-46be-a443-d6ae77c10001\") " pod="openshift-ingress/e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt"
Sep 08 07:20:35.294774 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:35.294697    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e3bee0d6-4554-46be-a443-d6ae77c10001-istio-token\") pod \"e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt\" (UID: \"e3bee0d6-4554-46be-a443-d6ae77c10001\") " pod="openshift-ingress/e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt"
Sep 08 07:20:35.294774 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:35.294740    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e3bee0d6-4554-46be-a443-d6ae77c10001-istio-data\") pod \"e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt\" (UID: \"e3bee0d6-4554-46be-a443-d6ae77c10001\") " pod="openshift-ingress/e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt"
Sep 08 07:20:35.295006 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:35.294772    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3bee0d6-4554-46be-a443-d6ae77c10001-workload-socket\") pod \"e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt\" (UID: \"e3bee0d6-4554-46be-a443-d6ae77c10001\") " pod="openshift-ingress/e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt"
Sep 08 07:20:35.295109 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:35.295086    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3bee0d6-4554-46be-a443-d6ae77c10001-credential-socket\") pod \"e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt\" (UID: \"e3bee0d6-4554-46be-a443-d6ae77c10001\") " pod="openshift-ingress/e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt"
Sep 08 07:20:35.295155 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:35.295135    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e3bee0d6-4554-46be-a443-d6ae77c10001-workload-certs\") pod \"e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt\" (UID: \"e3bee0d6-4554-46be-a443-d6ae77c10001\") " pod="openshift-ingress/e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt"
Sep 08 07:20:35.295205 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:35.295184    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e3bee0d6-4554-46be-a443-d6ae77c10001-istio-data\") pod \"e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt\" (UID: \"e3bee0d6-4554-46be-a443-d6ae77c10001\") " pod="openshift-ingress/e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt"
Sep 08 07:20:35.295301 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:35.295283    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e3bee0d6-4554-46be-a443-d6ae77c10001-istiod-ca-cert\") pod \"e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt\" (UID: \"e3bee0d6-4554-46be-a443-d6ae77c10001\") " pod="openshift-ingress/e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt"
Sep 08 07:20:35.297094 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:35.297072    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e3bee0d6-4554-46be-a443-d6ae77c10001-istio-envoy\") pod \"e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt\" (UID: \"e3bee0d6-4554-46be-a443-d6ae77c10001\") " pod="openshift-ingress/e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt"
Sep 08 07:20:35.297413 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:35.297394    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e3bee0d6-4554-46be-a443-d6ae77c10001-istio-podinfo\") pod \"e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt\" (UID: \"e3bee0d6-4554-46be-a443-d6ae77c10001\") " pod="openshift-ingress/e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt"
Sep 08 07:20:35.302282 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:35.302258    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69n74\" (UniqueName: \"kubernetes.io/projected/e3bee0d6-4554-46be-a443-d6ae77c10001-kube-api-access-69n74\") pod \"e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt\" (UID: \"e3bee0d6-4554-46be-a443-d6ae77c10001\") " pod="openshift-ingress/e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt"
Sep 08 07:20:35.302410 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:35.302390    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e3bee0d6-4554-46be-a443-d6ae77c10001-istio-token\") pod \"e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt\" (UID: \"e3bee0d6-4554-46be-a443-d6ae77c10001\") " pod="openshift-ingress/e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt"
Sep 08 07:20:35.431892 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:35.431802    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt"
Sep 08 07:20:35.710089 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:35.710058    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt"]
Sep 08 07:20:35.712080 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:20:35.712051    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3bee0d6_4554_46be_a443_d6ae77c10001.slice/crio-0db2da18a1916a04acd4505290c79d2f68f7d75b9d4d6ebf8ec0086384978e40 WatchSource:0}: Error finding container 0db2da18a1916a04acd4505290c79d2f68f7d75b9d4d6ebf8ec0086384978e40: Status 404 returned error can't find the container with id 0db2da18a1916a04acd4505290c79d2f68f7d75b9d4d6ebf8ec0086384978e40
Sep 08 07:20:35.714468 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:35.714433    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 07:20:35.714551 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:35.714499    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 07:20:35.714551 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:35.714530    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 07:20:36.360615 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:36.360580    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt" event={"ID":"e3bee0d6-4554-46be-a443-d6ae77c10001","Type":"ContainerStarted","Data":"ebb0fd5559ed416880915b3612f1c94e2a80358b665798f3db8c1d8098b2bc6a"}
Sep 08 07:20:36.360783 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:36.360636    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt" event={"ID":"e3bee0d6-4554-46be-a443-d6ae77c10001","Type":"ContainerStarted","Data":"0db2da18a1916a04acd4505290c79d2f68f7d75b9d4d6ebf8ec0086384978e40"}
Sep 08 07:20:36.381996 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:36.381936    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt" podStartSLOduration=1.381920982 podStartE2EDuration="1.381920982s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:20:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:20:36.379500163 +0000 UTC m=+984.360539490" watchObservedRunningTime="2026-09-08 07:20:36.381920982 +0000 UTC m=+984.362960288"
Sep 08 07:20:36.432412 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:36.432384    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt"
Sep 08 07:20:36.437046 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:36.437022    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt"
Sep 08 07:20:37.365764 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:37.365730    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt"
Sep 08 07:20:37.366650 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:37.366631    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt"
Sep 08 07:20:38.862094 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:38.862063    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-da54544b-5558dc4b86-vdjrg"]
Sep 08 07:20:38.862798 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:38.862774    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="72de8212-3915-41c4-aba2-3fdf48349b61" containerName="istio-proxy"
Sep 08 07:20:38.866207 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:38.866185    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-da54544b-5558dc4b86-vdjrg"
Sep 08 07:20:38.868672 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:38.868653    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-da54544b-serving-cert\""
Sep 08 07:20:38.888428 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:38.888401    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-da54544b-5558dc4b86-vdjrg"]
Sep 08 07:20:38.928810 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:38.928780    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/58133282-ba17-46c0-815c-59ef847e5f6c-openshift-service-ca\") pod \"maas-api-e2e-derive-da54544b-5558dc4b86-vdjrg\" (UID: \"58133282-ba17-46c0-815c-59ef847e5f6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-da54544b-5558dc4b86-vdjrg"
Sep 08 07:20:38.928957 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:38.928838    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58133282-ba17-46c0-815c-59ef847e5f6c-maas-api-tls\") pod \"maas-api-e2e-derive-da54544b-5558dc4b86-vdjrg\" (UID: \"58133282-ba17-46c0-815c-59ef847e5f6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-da54544b-5558dc4b86-vdjrg"
Sep 08 07:20:38.928957 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:38.928865    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58133282-ba17-46c0-815c-59ef847e5f6c-metrics-certs\") pod \"maas-api-e2e-derive-da54544b-5558dc4b86-vdjrg\" (UID: \"58133282-ba17-46c0-815c-59ef847e5f6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-da54544b-5558dc4b86-vdjrg"
Sep 08 07:20:38.928957 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:38.928881    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpmpb\" (UniqueName: \"kubernetes.io/projected/58133282-ba17-46c0-815c-59ef847e5f6c-kube-api-access-qpmpb\") pod \"maas-api-e2e-derive-da54544b-5558dc4b86-vdjrg\" (UID: \"58133282-ba17-46c0-815c-59ef847e5f6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-da54544b-5558dc4b86-vdjrg"
Sep 08 07:20:39.029748 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:39.029713    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/58133282-ba17-46c0-815c-59ef847e5f6c-openshift-service-ca\") pod \"maas-api-e2e-derive-da54544b-5558dc4b86-vdjrg\" (UID: \"58133282-ba17-46c0-815c-59ef847e5f6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-da54544b-5558dc4b86-vdjrg"
Sep 08 07:20:39.029941 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:39.029777    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58133282-ba17-46c0-815c-59ef847e5f6c-maas-api-tls\") pod \"maas-api-e2e-derive-da54544b-5558dc4b86-vdjrg\" (UID: \"58133282-ba17-46c0-815c-59ef847e5f6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-da54544b-5558dc4b86-vdjrg"
Sep 08 07:20:39.029941 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:39.029808    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58133282-ba17-46c0-815c-59ef847e5f6c-metrics-certs\") pod \"maas-api-e2e-derive-da54544b-5558dc4b86-vdjrg\" (UID: \"58133282-ba17-46c0-815c-59ef847e5f6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-da54544b-5558dc4b86-vdjrg"
Sep 08 07:20:39.029941 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:39.029828    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpmpb\" (UniqueName: \"kubernetes.io/projected/58133282-ba17-46c0-815c-59ef847e5f6c-kube-api-access-qpmpb\") pod \"maas-api-e2e-derive-da54544b-5558dc4b86-vdjrg\" (UID: \"58133282-ba17-46c0-815c-59ef847e5f6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-da54544b-5558dc4b86-vdjrg"
Sep 08 07:20:39.030148 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:20:39.029957    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-da54544b-serving-cert: secret "maas-api-e2e-derive-da54544b-serving-cert" not found
Sep 08 07:20:39.030148 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:20:39.030062    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58133282-ba17-46c0-815c-59ef847e5f6c-maas-api-tls podName:58133282-ba17-46c0-815c-59ef847e5f6c nodeName:}" failed. No retries permitted until 2026-09-08 07:20:39.53003668 +0000 UTC m=+987.511075969 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/58133282-ba17-46c0-815c-59ef847e5f6c-maas-api-tls") pod "maas-api-e2e-derive-da54544b-5558dc4b86-vdjrg" (UID: "58133282-ba17-46c0-815c-59ef847e5f6c") : secret "maas-api-e2e-derive-da54544b-serving-cert" not found
Sep 08 07:20:39.030431 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:39.030412    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/58133282-ba17-46c0-815c-59ef847e5f6c-openshift-service-ca\") pod \"maas-api-e2e-derive-da54544b-5558dc4b86-vdjrg\" (UID: \"58133282-ba17-46c0-815c-59ef847e5f6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-da54544b-5558dc4b86-vdjrg"
Sep 08 07:20:39.032492 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:39.032471    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58133282-ba17-46c0-815c-59ef847e5f6c-metrics-certs\") pod \"maas-api-e2e-derive-da54544b-5558dc4b86-vdjrg\" (UID: \"58133282-ba17-46c0-815c-59ef847e5f6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-da54544b-5558dc4b86-vdjrg"
Sep 08 07:20:39.041331 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:39.041305    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpmpb\" (UniqueName: \"kubernetes.io/projected/58133282-ba17-46c0-815c-59ef847e5f6c-kube-api-access-qpmpb\") pod \"maas-api-e2e-derive-da54544b-5558dc4b86-vdjrg\" (UID: \"58133282-ba17-46c0-815c-59ef847e5f6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-da54544b-5558dc4b86-vdjrg"
Sep 08 07:20:39.534632 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:39.534599    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58133282-ba17-46c0-815c-59ef847e5f6c-maas-api-tls\") pod \"maas-api-e2e-derive-da54544b-5558dc4b86-vdjrg\" (UID: \"58133282-ba17-46c0-815c-59ef847e5f6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-da54544b-5558dc4b86-vdjrg"
Sep 08 07:20:39.537189 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:39.537164    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58133282-ba17-46c0-815c-59ef847e5f6c-maas-api-tls\") pod \"maas-api-e2e-derive-da54544b-5558dc4b86-vdjrg\" (UID: \"58133282-ba17-46c0-815c-59ef847e5f6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-da54544b-5558dc4b86-vdjrg"
Sep 08 07:20:39.704426 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:39.704373    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-576ac2af-openshift-default-78949b8854-srkvv"
Sep 08 07:20:39.737659 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:39.737634    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/feb1c664-75cd-4c22-b5ca-90ae131b1114-istio-envoy\") pod \"feb1c664-75cd-4c22-b5ca-90ae131b1114\" (UID: \"feb1c664-75cd-4c22-b5ca-90ae131b1114\") "
Sep 08 07:20:39.737820 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:39.737679    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/feb1c664-75cd-4c22-b5ca-90ae131b1114-istio-token\") pod \"feb1c664-75cd-4c22-b5ca-90ae131b1114\" (UID: \"feb1c664-75cd-4c22-b5ca-90ae131b1114\") "
Sep 08 07:20:39.737820 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:39.737711    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/feb1c664-75cd-4c22-b5ca-90ae131b1114-credential-socket\") pod \"feb1c664-75cd-4c22-b5ca-90ae131b1114\" (UID: \"feb1c664-75cd-4c22-b5ca-90ae131b1114\") "
Sep 08 07:20:39.737820 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:39.737781    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/feb1c664-75cd-4c22-b5ca-90ae131b1114-istio-podinfo\") pod \"feb1c664-75cd-4c22-b5ca-90ae131b1114\" (UID: \"feb1c664-75cd-4c22-b5ca-90ae131b1114\") "
Sep 08 07:20:39.737820 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:39.737811    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/feb1c664-75cd-4c22-b5ca-90ae131b1114-istiod-ca-cert\") pod \"feb1c664-75cd-4c22-b5ca-90ae131b1114\" (UID: \"feb1c664-75cd-4c22-b5ca-90ae131b1114\") "
Sep 08 07:20:39.738055 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:39.737851    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/feb1c664-75cd-4c22-b5ca-90ae131b1114-istio-data\") pod \"feb1c664-75cd-4c22-b5ca-90ae131b1114\" (UID: \"feb1c664-75cd-4c22-b5ca-90ae131b1114\") "
Sep 08 07:20:39.738055 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:39.737908    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/feb1c664-75cd-4c22-b5ca-90ae131b1114-workload-certs\") pod \"feb1c664-75cd-4c22-b5ca-90ae131b1114\" (UID: \"feb1c664-75cd-4c22-b5ca-90ae131b1114\") "
Sep 08 07:20:39.738055 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:39.737957    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/feb1c664-75cd-4c22-b5ca-90ae131b1114-workload-socket\") pod \"feb1c664-75cd-4c22-b5ca-90ae131b1114\" (UID: \"feb1c664-75cd-4c22-b5ca-90ae131b1114\") "
Sep 08 07:20:39.738055 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:39.738017    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-grm6z\" (UniqueName: \"kubernetes.io/projected/feb1c664-75cd-4c22-b5ca-90ae131b1114-kube-api-access-grm6z\") pod \"feb1c664-75cd-4c22-b5ca-90ae131b1114\" (UID: \"feb1c664-75cd-4c22-b5ca-90ae131b1114\") "
Sep 08 07:20:39.738369 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:39.738279    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/feb1c664-75cd-4c22-b5ca-90ae131b1114-istio-data" (OuterVolumeSpecName: "istio-data") pod "feb1c664-75cd-4c22-b5ca-90ae131b1114" (UID: "feb1c664-75cd-4c22-b5ca-90ae131b1114"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 07:20:39.738440 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:39.738385    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/feb1c664-75cd-4c22-b5ca-90ae131b1114-istio-data\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:20:39.738498 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:39.738440    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/feb1c664-75cd-4c22-b5ca-90ae131b1114-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "feb1c664-75cd-4c22-b5ca-90ae131b1114" (UID: "feb1c664-75cd-4c22-b5ca-90ae131b1114"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 07:20:39.738725 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:39.738632    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/feb1c664-75cd-4c22-b5ca-90ae131b1114-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "feb1c664-75cd-4c22-b5ca-90ae131b1114" (UID: "feb1c664-75cd-4c22-b5ca-90ae131b1114"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 07:20:39.738827 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:39.738748    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/feb1c664-75cd-4c22-b5ca-90ae131b1114-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "feb1c664-75cd-4c22-b5ca-90ae131b1114" (UID: "feb1c664-75cd-4c22-b5ca-90ae131b1114"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 07:20:39.738827 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:39.738787    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/feb1c664-75cd-4c22-b5ca-90ae131b1114-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "feb1c664-75cd-4c22-b5ca-90ae131b1114" (UID: "feb1c664-75cd-4c22-b5ca-90ae131b1114"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 07:20:39.740474 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:39.740444    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/feb1c664-75cd-4c22-b5ca-90ae131b1114-kube-api-access-grm6z" (OuterVolumeSpecName: "kube-api-access-grm6z") pod "feb1c664-75cd-4c22-b5ca-90ae131b1114" (UID: "feb1c664-75cd-4c22-b5ca-90ae131b1114"). InnerVolumeSpecName "kube-api-access-grm6z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 07:20:39.740791 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:39.740770    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/feb1c664-75cd-4c22-b5ca-90ae131b1114-istio-token" (OuterVolumeSpecName: "istio-token") pod "feb1c664-75cd-4c22-b5ca-90ae131b1114" (UID: "feb1c664-75cd-4c22-b5ca-90ae131b1114"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 07:20:39.740909 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:39.740880    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/feb1c664-75cd-4c22-b5ca-90ae131b1114-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "feb1c664-75cd-4c22-b5ca-90ae131b1114" (UID: "feb1c664-75cd-4c22-b5ca-90ae131b1114"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 07:20:39.741913 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:39.741893    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/feb1c664-75cd-4c22-b5ca-90ae131b1114-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "feb1c664-75cd-4c22-b5ca-90ae131b1114" (UID: "feb1c664-75cd-4c22-b5ca-90ae131b1114"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 07:20:39.779359 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:39.779326    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-da54544b-5558dc4b86-vdjrg"
Sep 08 07:20:39.843605 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:39.843575    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/feb1c664-75cd-4c22-b5ca-90ae131b1114-istio-envoy\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:20:39.843734 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:39.843609    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/feb1c664-75cd-4c22-b5ca-90ae131b1114-istio-token\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:20:39.843734 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:39.843622    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/feb1c664-75cd-4c22-b5ca-90ae131b1114-credential-socket\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:20:39.843734 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:39.843638    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/feb1c664-75cd-4c22-b5ca-90ae131b1114-istio-podinfo\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:20:39.843734 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:39.843656    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/feb1c664-75cd-4c22-b5ca-90ae131b1114-istiod-ca-cert\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:20:39.843734 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:39.843669    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/feb1c664-75cd-4c22-b5ca-90ae131b1114-workload-certs\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:20:39.843734 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:39.843682    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/feb1c664-75cd-4c22-b5ca-90ae131b1114-workload-socket\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:20:39.843734 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:39.843698    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-grm6z\" (UniqueName: \"kubernetes.io/projected/feb1c664-75cd-4c22-b5ca-90ae131b1114-kube-api-access-grm6z\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:20:40.053449 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:40.053421    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-da54544b-5558dc4b86-vdjrg"]
Sep 08 07:20:40.056086 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:20:40.056053    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58133282_ba17_46c0_815c_59ef847e5f6c.slice/crio-496276c0116142a0a924b025722aaa4ed2684a636ef630c5b7495ce9fb34a817 WatchSource:0}: Error finding container 496276c0116142a0a924b025722aaa4ed2684a636ef630c5b7495ce9fb34a817: Status 404 returned error can't find the container with id 496276c0116142a0a924b025722aaa4ed2684a636ef630c5b7495ce9fb34a817
Sep 08 07:20:40.388842 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:40.388748    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-da54544b-5558dc4b86-vdjrg" event={"ID":"58133282-ba17-46c0-815c-59ef847e5f6c","Type":"ContainerStarted","Data":"496276c0116142a0a924b025722aaa4ed2684a636ef630c5b7495ce9fb34a817"}
Sep 08 07:20:40.390705 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:40.390676    2564 generic.go:356] "Generic (PLEG): container finished" podID="feb1c664-75cd-4c22-b5ca-90ae131b1114" containerID="54eca618ef45d1f98aa00cdef3e59277cf402e2a13d10cbb5ce4a8204a743969" exitCode=0
Sep 08 07:20:40.390839 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:40.390739    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-576ac2af-openshift-default-78949b8854-srkvv"
Sep 08 07:20:40.390839 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:40.390740    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-576ac2af-openshift-default-78949b8854-srkvv" event={"ID":"feb1c664-75cd-4c22-b5ca-90ae131b1114","Type":"ContainerDied","Data":"54eca618ef45d1f98aa00cdef3e59277cf402e2a13d10cbb5ce4a8204a743969"}
Sep 08 07:20:40.390956 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:40.390874    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-576ac2af-openshift-default-78949b8854-srkvv" event={"ID":"feb1c664-75cd-4c22-b5ca-90ae131b1114","Type":"ContainerDied","Data":"ed76520dd8d9f90ae182f1b6938720866ca5fa659a0dc29ae8231bf5a3952629"}
Sep 08 07:20:40.390956 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:40.390912    2564 scope.go:117] "RemoveContainer" containerID="54eca618ef45d1f98aa00cdef3e59277cf402e2a13d10cbb5ce4a8204a743969"
Sep 08 07:20:40.406687 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:40.406657    2564 scope.go:117] "RemoveContainer" containerID="8870668e37bab9250c66d53444a8b68be874de96278211e8c67025fb717f9352"
Sep 08 07:20:40.415462 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:40.415446    2564 scope.go:117] "RemoveContainer" containerID="54eca618ef45d1f98aa00cdef3e59277cf402e2a13d10cbb5ce4a8204a743969"
Sep 08 07:20:40.415744 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:20:40.415718    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54eca618ef45d1f98aa00cdef3e59277cf402e2a13d10cbb5ce4a8204a743969\": container with ID starting with 54eca618ef45d1f98aa00cdef3e59277cf402e2a13d10cbb5ce4a8204a743969 not found: ID does not exist" containerID="54eca618ef45d1f98aa00cdef3e59277cf402e2a13d10cbb5ce4a8204a743969"
Sep 08 07:20:40.415826 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:40.415753    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54eca618ef45d1f98aa00cdef3e59277cf402e2a13d10cbb5ce4a8204a743969"} err="failed to get container status \"54eca618ef45d1f98aa00cdef3e59277cf402e2a13d10cbb5ce4a8204a743969\": rpc error: code = NotFound desc = could not find container \"54eca618ef45d1f98aa00cdef3e59277cf402e2a13d10cbb5ce4a8204a743969\": container with ID starting with 54eca618ef45d1f98aa00cdef3e59277cf402e2a13d10cbb5ce4a8204a743969 not found: ID does not exist"
Sep 08 07:20:40.415826 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:40.415770    2564 scope.go:117] "RemoveContainer" containerID="8870668e37bab9250c66d53444a8b68be874de96278211e8c67025fb717f9352"
Sep 08 07:20:40.416094 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:20:40.416078    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8870668e37bab9250c66d53444a8b68be874de96278211e8c67025fb717f9352\": container with ID starting with 8870668e37bab9250c66d53444a8b68be874de96278211e8c67025fb717f9352 not found: ID does not exist" containerID="8870668e37bab9250c66d53444a8b68be874de96278211e8c67025fb717f9352"
Sep 08 07:20:40.416167 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:40.416099    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8870668e37bab9250c66d53444a8b68be874de96278211e8c67025fb717f9352"} err="failed to get container status \"8870668e37bab9250c66d53444a8b68be874de96278211e8c67025fb717f9352\": rpc error: code = NotFound desc = could not find container \"8870668e37bab9250c66d53444a8b68be874de96278211e8c67025fb717f9352\": container with ID starting with 8870668e37bab9250c66d53444a8b68be874de96278211e8c67025fb717f9352 not found: ID does not exist"
Sep 08 07:20:40.419197 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:40.419178    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-576ac2af-openshift-default-78949b8854-srkvv"]
Sep 08 07:20:40.423616 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:40.423596    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-576ac2af-openshift-default-78949b8854-srkvv"]
Sep 08 07:20:40.511121 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:40.511094    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="feb1c664-75cd-4c22-b5ca-90ae131b1114" path="/var/lib/kubelet/pods/feb1c664-75cd-4c22-b5ca-90ae131b1114/volumes"
Sep 08 07:20:41.398763 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:41.398715    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-da54544b-5558dc4b86-vdjrg" event={"ID":"58133282-ba17-46c0-815c-59ef847e5f6c","Type":"ContainerStarted","Data":"89fd9c3a0c817168663ed697bc4192c2b413ba0e55b84e8898fa68cb1cb14423"}
Sep 08 07:20:41.399216 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:41.398784    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-da54544b-5558dc4b86-vdjrg"
Sep 08 07:20:41.416080 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:41.416032    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-da54544b-5558dc4b86-vdjrg" podStartSLOduration=2.982405984 podStartE2EDuration="3.416014373s" totalImagesPullingTime="433.608389ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:20:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:20:41.415157307 +0000 UTC m=+989.396196648" watchObservedRunningTime="2026-09-08 07:20:41.416014373 +0000 UTC m=+989.397053679"
Sep 08 07:20:42.544157 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:42.544122    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-638d2d-55f9bf5cfb-zk6xx"]
Sep 08 07:20:42.544563 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:42.544365    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-autores-638d2d-55f9bf5cfb-zk6xx" podUID="8eda0886-2b18-4312-bf33-821771eb5828" containerName="maas-api" containerID="cri-o://ab714d54a8fe076f0e27deb2119bf308ed95ded67f50a0a3e4064c8d35e263c7" gracePeriod=30
Sep 08 07:20:42.659705 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:42.659668    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-autores-638d2d-55f9bf5cfb-zk6xx" podUID="8eda0886-2b18-4312-bf33-821771eb5828" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.50:8443/health\": dial tcp 10.132.0.50:8443: connect: connection refused"
Sep 08 07:20:42.828322 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:42.828298    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-638d2d-55f9bf5cfb-zk6xx"
Sep 08 07:20:42.873861 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:42.873825    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8eda0886-2b18-4312-bf33-821771eb5828-openshift-service-ca\") pod \"8eda0886-2b18-4312-bf33-821771eb5828\" (UID: \"8eda0886-2b18-4312-bf33-821771eb5828\") "
Sep 08 07:20:42.874071 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:42.873877    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8eda0886-2b18-4312-bf33-821771eb5828-metrics-certs\") pod \"8eda0886-2b18-4312-bf33-821771eb5828\" (UID: \"8eda0886-2b18-4312-bf33-821771eb5828\") "
Sep 08 07:20:42.874071 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:42.873903    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mfvrs\" (UniqueName: \"kubernetes.io/projected/8eda0886-2b18-4312-bf33-821771eb5828-kube-api-access-mfvrs\") pod \"8eda0886-2b18-4312-bf33-821771eb5828\" (UID: \"8eda0886-2b18-4312-bf33-821771eb5828\") "
Sep 08 07:20:42.874071 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:42.874005    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8eda0886-2b18-4312-bf33-821771eb5828-maas-api-tls\") pod \"8eda0886-2b18-4312-bf33-821771eb5828\" (UID: \"8eda0886-2b18-4312-bf33-821771eb5828\") "
Sep 08 07:20:42.874329 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:42.874301    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8eda0886-2b18-4312-bf33-821771eb5828-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8eda0886-2b18-4312-bf33-821771eb5828" (UID: "8eda0886-2b18-4312-bf33-821771eb5828"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 07:20:42.874457 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:42.874434    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8eda0886-2b18-4312-bf33-821771eb5828-openshift-service-ca\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:20:42.876579 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:42.876548    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8eda0886-2b18-4312-bf33-821771eb5828-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "8eda0886-2b18-4312-bf33-821771eb5828" (UID: "8eda0886-2b18-4312-bf33-821771eb5828"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 07:20:42.876682 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:42.876659    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8eda0886-2b18-4312-bf33-821771eb5828-kube-api-access-mfvrs" (OuterVolumeSpecName: "kube-api-access-mfvrs") pod "8eda0886-2b18-4312-bf33-821771eb5828" (UID: "8eda0886-2b18-4312-bf33-821771eb5828"). InnerVolumeSpecName "kube-api-access-mfvrs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 07:20:42.877260 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:42.877214    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8eda0886-2b18-4312-bf33-821771eb5828-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8eda0886-2b18-4312-bf33-821771eb5828" (UID: "8eda0886-2b18-4312-bf33-821771eb5828"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 07:20:42.975560 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:42.975523    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8eda0886-2b18-4312-bf33-821771eb5828-maas-api-tls\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:20:42.975560 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:42.975549    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8eda0886-2b18-4312-bf33-821771eb5828-metrics-certs\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:20:42.975560 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:42.975562    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mfvrs\" (UniqueName: \"kubernetes.io/projected/8eda0886-2b18-4312-bf33-821771eb5828-kube-api-access-mfvrs\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:20:43.411131 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:43.411102    2564 generic.go:356] "Generic (PLEG): container finished" podID="8eda0886-2b18-4312-bf33-821771eb5828" containerID="ab714d54a8fe076f0e27deb2119bf308ed95ded67f50a0a3e4064c8d35e263c7" exitCode=0
Sep 08 07:20:43.411302 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:43.411143    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-638d2d-55f9bf5cfb-zk6xx"
Sep 08 07:20:43.411302 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:43.411190    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-638d2d-55f9bf5cfb-zk6xx" event={"ID":"8eda0886-2b18-4312-bf33-821771eb5828","Type":"ContainerDied","Data":"ab714d54a8fe076f0e27deb2119bf308ed95ded67f50a0a3e4064c8d35e263c7"}
Sep 08 07:20:43.411302 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:43.411241    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-638d2d-55f9bf5cfb-zk6xx" event={"ID":"8eda0886-2b18-4312-bf33-821771eb5828","Type":"ContainerDied","Data":"826f74ed5047ddab75eeea9b28d522bf22aa2732e71ef8de26b65d8b96e01f17"}
Sep 08 07:20:43.411302 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:43.411264    2564 scope.go:117] "RemoveContainer" containerID="ab714d54a8fe076f0e27deb2119bf308ed95ded67f50a0a3e4064c8d35e263c7"
Sep 08 07:20:43.423132 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:43.421343    2564 scope.go:117] "RemoveContainer" containerID="ab714d54a8fe076f0e27deb2119bf308ed95ded67f50a0a3e4064c8d35e263c7"
Sep 08 07:20:43.423132 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:20:43.421705    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab714d54a8fe076f0e27deb2119bf308ed95ded67f50a0a3e4064c8d35e263c7\": container with ID starting with ab714d54a8fe076f0e27deb2119bf308ed95ded67f50a0a3e4064c8d35e263c7 not found: ID does not exist" containerID="ab714d54a8fe076f0e27deb2119bf308ed95ded67f50a0a3e4064c8d35e263c7"
Sep 08 07:20:43.423132 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:43.421737    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab714d54a8fe076f0e27deb2119bf308ed95ded67f50a0a3e4064c8d35e263c7"} err="failed to get container status \"ab714d54a8fe076f0e27deb2119bf308ed95ded67f50a0a3e4064c8d35e263c7\": rpc error: code = NotFound desc = could not find container \"ab714d54a8fe076f0e27deb2119bf308ed95ded67f50a0a3e4064c8d35e263c7\": container with ID starting with ab714d54a8fe076f0e27deb2119bf308ed95ded67f50a0a3e4064c8d35e263c7 not found: ID does not exist"
Sep 08 07:20:43.433329 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:43.433306    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-638d2d-55f9bf5cfb-zk6xx"]
Sep 08 07:20:43.437232 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:43.437210    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-638d2d-55f9bf5cfb-zk6xx"]
Sep 08 07:20:44.513134 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:44.513093    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8eda0886-2b18-4312-bf33-821771eb5828" path="/var/lib/kubelet/pods/8eda0886-2b18-4312-bf33-821771eb5828/volumes"
Sep 08 07:20:47.409327 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:47.409296    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-da54544b-5558dc4b86-vdjrg"
Sep 08 07:20:50.140124 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:20:50.140093    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:21:00.508531 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:00.508430    2564 generic.go:356] "Generic (PLEG): container finished" podID="e3bee0d6-4554-46be-a443-d6ae77c10001" containerID="ebb0fd5559ed416880915b3612f1c94e2a80358b665798f3db8c1d8098b2bc6a" exitCode=0
Sep 08 07:21:00.509894 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:00.509868    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt" event={"ID":"e3bee0d6-4554-46be-a443-d6ae77c10001","Type":"ContainerDied","Data":"ebb0fd5559ed416880915b3612f1c94e2a80358b665798f3db8c1d8098b2bc6a"}
Sep 08 07:21:00.510292 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:00.510267    2564 scope.go:117] "RemoveContainer" containerID="ebb0fd5559ed416880915b3612f1c94e2a80358b665798f3db8c1d8098b2bc6a"
Sep 08 07:21:00.511398 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:00.511364    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 07:21:00.511495 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:00.511441    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 07:21:00.511495 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:00.511474    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 07:21:01.518605 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:01.518569    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt" event={"ID":"e3bee0d6-4554-46be-a443-d6ae77c10001","Type":"ContainerStarted","Data":"3e73482647a8a6de0fb10321827545b4f6c1db85c932ae342bfd2fa96f62eb30"}
Sep 08 07:21:02.432058 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:02.432019    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt"
Sep 08 07:21:02.432298 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:02.432279    2564 patch_prober.go:28] interesting pod/e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Sep 08 07:21:02.432350 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:02.432322    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt" podUID="e3bee0d6-4554-46be-a443-d6ae77c10001" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Sep 08 07:21:03.432540 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:03.432497    2564 patch_prober.go:28] interesting pod/e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Sep 08 07:21:03.433002 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:03.432563    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt" podUID="e3bee0d6-4554-46be-a443-d6ae77c10001" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Sep 08 07:21:04.433241 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:04.433206    2564 patch_prober.go:28] interesting pod/e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Sep 08 07:21:04.433618 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:04.433264    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt" podUID="e3bee0d6-4554-46be-a443-d6ae77c10001" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Sep 08 07:21:05.432720 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:05.432686    2564 patch_prober.go:28] interesting pod/e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Sep 08 07:21:05.432900 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:05.432743    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt" podUID="e3bee0d6-4554-46be-a443-d6ae77c10001" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Sep 08 07:21:06.433094 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:06.433054    2564 patch_prober.go:28] interesting pod/e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Sep 08 07:21:06.433575 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:06.433125    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt" podUID="e3bee0d6-4554-46be-a443-d6ae77c10001" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Sep 08 07:21:07.365925 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:07.365886    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt"
Sep 08 07:21:07.436053 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:07.436025    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt"
Sep 08 07:21:07.554108 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:07.554080    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt"
Sep 08 07:21:09.579274 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:09.579229    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-da54544b-5558dc4b86-vdjrg"]
Sep 08 07:21:09.579750 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:09.579491    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-da54544b-5558dc4b86-vdjrg" podUID="58133282-ba17-46c0-815c-59ef847e5f6c" containerName="maas-api" containerID="cri-o://89fd9c3a0c817168663ed697bc4192c2b413ba0e55b84e8898fa68cb1cb14423" gracePeriod=30
Sep 08 07:21:09.849304 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:09.849282    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-da54544b-5558dc4b86-vdjrg"
Sep 08 07:21:09.859512 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:09.859488    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58133282-ba17-46c0-815c-59ef847e5f6c-maas-api-tls\") pod \"58133282-ba17-46c0-815c-59ef847e5f6c\" (UID: \"58133282-ba17-46c0-815c-59ef847e5f6c\") "
Sep 08 07:21:09.859593 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:09.859530    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/58133282-ba17-46c0-815c-59ef847e5f6c-openshift-service-ca\") pod \"58133282-ba17-46c0-815c-59ef847e5f6c\" (UID: \"58133282-ba17-46c0-815c-59ef847e5f6c\") "
Sep 08 07:21:09.859593 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:09.859555    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58133282-ba17-46c0-815c-59ef847e5f6c-metrics-certs\") pod \"58133282-ba17-46c0-815c-59ef847e5f6c\" (UID: \"58133282-ba17-46c0-815c-59ef847e5f6c\") "
Sep 08 07:21:09.859696 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:09.859600    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qpmpb\" (UniqueName: \"kubernetes.io/projected/58133282-ba17-46c0-815c-59ef847e5f6c-kube-api-access-qpmpb\") pod \"58133282-ba17-46c0-815c-59ef847e5f6c\" (UID: \"58133282-ba17-46c0-815c-59ef847e5f6c\") "
Sep 08 07:21:09.859916 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:09.859888    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58133282-ba17-46c0-815c-59ef847e5f6c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "58133282-ba17-46c0-815c-59ef847e5f6c" (UID: "58133282-ba17-46c0-815c-59ef847e5f6c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 07:21:09.861507 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:09.861478    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58133282-ba17-46c0-815c-59ef847e5f6c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "58133282-ba17-46c0-815c-59ef847e5f6c" (UID: "58133282-ba17-46c0-815c-59ef847e5f6c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 07:21:09.861598 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:09.861524    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58133282-ba17-46c0-815c-59ef847e5f6c-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "58133282-ba17-46c0-815c-59ef847e5f6c" (UID: "58133282-ba17-46c0-815c-59ef847e5f6c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 07:21:09.861640 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:09.861613    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58133282-ba17-46c0-815c-59ef847e5f6c-kube-api-access-qpmpb" (OuterVolumeSpecName: "kube-api-access-qpmpb") pod "58133282-ba17-46c0-815c-59ef847e5f6c" (UID: "58133282-ba17-46c0-815c-59ef847e5f6c"). InnerVolumeSpecName "kube-api-access-qpmpb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 07:21:09.916630 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:09.916589    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt"]
Sep 08 07:21:09.917924 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:09.917846    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt" podUID="e3bee0d6-4554-46be-a443-d6ae77c10001" containerName="istio-proxy" containerID="cri-o://3e73482647a8a6de0fb10321827545b4f6c1db85c932ae342bfd2fa96f62eb30" gracePeriod=30
Sep 08 07:21:09.960682 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:09.960654    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qpmpb\" (UniqueName: \"kubernetes.io/projected/58133282-ba17-46c0-815c-59ef847e5f6c-kube-api-access-qpmpb\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:21:09.960682 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:09.960679    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58133282-ba17-46c0-815c-59ef847e5f6c-maas-api-tls\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:21:09.960682 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:09.960689    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/58133282-ba17-46c0-815c-59ef847e5f6c-openshift-service-ca\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:21:09.960943 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:09.960697    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/58133282-ba17-46c0-815c-59ef847e5f6c-metrics-certs\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:21:10.571632 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:10.571596    2564 generic.go:356] "Generic (PLEG): container finished" podID="58133282-ba17-46c0-815c-59ef847e5f6c" containerID="89fd9c3a0c817168663ed697bc4192c2b413ba0e55b84e8898fa68cb1cb14423" exitCode=0
Sep 08 07:21:10.571840 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:10.571648    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-da54544b-5558dc4b86-vdjrg"
Sep 08 07:21:10.571840 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:10.571665    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-da54544b-5558dc4b86-vdjrg" event={"ID":"58133282-ba17-46c0-815c-59ef847e5f6c","Type":"ContainerDied","Data":"89fd9c3a0c817168663ed697bc4192c2b413ba0e55b84e8898fa68cb1cb14423"}
Sep 08 07:21:10.571840 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:10.571705    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-da54544b-5558dc4b86-vdjrg" event={"ID":"58133282-ba17-46c0-815c-59ef847e5f6c","Type":"ContainerDied","Data":"496276c0116142a0a924b025722aaa4ed2684a636ef630c5b7495ce9fb34a817"}
Sep 08 07:21:10.571840 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:10.571726    2564 scope.go:117] "RemoveContainer" containerID="89fd9c3a0c817168663ed697bc4192c2b413ba0e55b84e8898fa68cb1cb14423"
Sep 08 07:21:10.581374 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:10.581183    2564 scope.go:117] "RemoveContainer" containerID="89fd9c3a0c817168663ed697bc4192c2b413ba0e55b84e8898fa68cb1cb14423"
Sep 08 07:21:10.581609 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:21:10.581454    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89fd9c3a0c817168663ed697bc4192c2b413ba0e55b84e8898fa68cb1cb14423\": container with ID starting with 89fd9c3a0c817168663ed697bc4192c2b413ba0e55b84e8898fa68cb1cb14423 not found: ID does not exist" containerID="89fd9c3a0c817168663ed697bc4192c2b413ba0e55b84e8898fa68cb1cb14423"
Sep 08 07:21:10.581609 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:10.581479    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89fd9c3a0c817168663ed697bc4192c2b413ba0e55b84e8898fa68cb1cb14423"} err="failed to get container status \"89fd9c3a0c817168663ed697bc4192c2b413ba0e55b84e8898fa68cb1cb14423\": rpc error: code = NotFound desc = could not find container \"89fd9c3a0c817168663ed697bc4192c2b413ba0e55b84e8898fa68cb1cb14423\": container with ID starting with 89fd9c3a0c817168663ed697bc4192c2b413ba0e55b84e8898fa68cb1cb14423 not found: ID does not exist"
Sep 08 07:21:10.593608 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:10.593584    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-da54544b-5558dc4b86-vdjrg"]
Sep 08 07:21:10.597668 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:10.597649    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-da54544b-5558dc4b86-vdjrg"]
Sep 08 07:21:12.511091 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:12.511060    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58133282-ba17-46c0-815c-59ef847e5f6c" path="/var/lib/kubelet/pods/58133282-ba17-46c0-815c-59ef847e5f6c/volumes"
Sep 08 07:21:15.172274 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:15.172245    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt"
Sep 08 07:21:15.211505 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:15.211406    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-69n74\" (UniqueName: \"kubernetes.io/projected/e3bee0d6-4554-46be-a443-d6ae77c10001-kube-api-access-69n74\") pod \"e3bee0d6-4554-46be-a443-d6ae77c10001\" (UID: \"e3bee0d6-4554-46be-a443-d6ae77c10001\") "
Sep 08 07:21:15.211505 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:15.211454    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e3bee0d6-4554-46be-a443-d6ae77c10001-istio-token\") pod \"e3bee0d6-4554-46be-a443-d6ae77c10001\" (UID: \"e3bee0d6-4554-46be-a443-d6ae77c10001\") "
Sep 08 07:21:15.211505 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:15.211492    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e3bee0d6-4554-46be-a443-d6ae77c10001-istio-podinfo\") pod \"e3bee0d6-4554-46be-a443-d6ae77c10001\" (UID: \"e3bee0d6-4554-46be-a443-d6ae77c10001\") "
Sep 08 07:21:15.211788 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:15.211557    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3bee0d6-4554-46be-a443-d6ae77c10001-credential-socket\") pod \"e3bee0d6-4554-46be-a443-d6ae77c10001\" (UID: \"e3bee0d6-4554-46be-a443-d6ae77c10001\") "
Sep 08 07:21:15.211788 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:15.211607    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e3bee0d6-4554-46be-a443-d6ae77c10001-workload-certs\") pod \"e3bee0d6-4554-46be-a443-d6ae77c10001\" (UID: \"e3bee0d6-4554-46be-a443-d6ae77c10001\") "
Sep 08 07:21:15.211788 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:15.211691    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e3bee0d6-4554-46be-a443-d6ae77c10001-istio-envoy\") pod \"e3bee0d6-4554-46be-a443-d6ae77c10001\" (UID: \"e3bee0d6-4554-46be-a443-d6ae77c10001\") "
Sep 08 07:21:15.211788 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:15.211728    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e3bee0d6-4554-46be-a443-d6ae77c10001-istiod-ca-cert\") pod \"e3bee0d6-4554-46be-a443-d6ae77c10001\" (UID: \"e3bee0d6-4554-46be-a443-d6ae77c10001\") "
Sep 08 07:21:15.211788 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:15.211750    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3bee0d6-4554-46be-a443-d6ae77c10001-workload-socket\") pod \"e3bee0d6-4554-46be-a443-d6ae77c10001\" (UID: \"e3bee0d6-4554-46be-a443-d6ae77c10001\") "
Sep 08 07:21:15.211788 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:15.211783    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e3bee0d6-4554-46be-a443-d6ae77c10001-istio-data\") pod \"e3bee0d6-4554-46be-a443-d6ae77c10001\" (UID: \"e3bee0d6-4554-46be-a443-d6ae77c10001\") "
Sep 08 07:21:15.212269 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:15.212202    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3bee0d6-4554-46be-a443-d6ae77c10001-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e3bee0d6-4554-46be-a443-d6ae77c10001" (UID: "e3bee0d6-4554-46be-a443-d6ae77c10001"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 07:21:15.212269 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:15.212220    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3bee0d6-4554-46be-a443-d6ae77c10001-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e3bee0d6-4554-46be-a443-d6ae77c10001" (UID: "e3bee0d6-4554-46be-a443-d6ae77c10001"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 07:21:15.212436 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:15.212414    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3bee0d6-4554-46be-a443-d6ae77c10001-istio-data" (OuterVolumeSpecName: "istio-data") pod "e3bee0d6-4554-46be-a443-d6ae77c10001" (UID: "e3bee0d6-4554-46be-a443-d6ae77c10001"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 07:21:15.212603 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:15.212567    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3bee0d6-4554-46be-a443-d6ae77c10001-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e3bee0d6-4554-46be-a443-d6ae77c10001" (UID: "e3bee0d6-4554-46be-a443-d6ae77c10001"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 07:21:15.212739 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:15.212715    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3bee0d6-4554-46be-a443-d6ae77c10001-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e3bee0d6-4554-46be-a443-d6ae77c10001" (UID: "e3bee0d6-4554-46be-a443-d6ae77c10001"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 07:21:15.213830 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:15.213807    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e3bee0d6-4554-46be-a443-d6ae77c10001-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e3bee0d6-4554-46be-a443-d6ae77c10001" (UID: "e3bee0d6-4554-46be-a443-d6ae77c10001"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 07:21:15.214092 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:15.214070    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3bee0d6-4554-46be-a443-d6ae77c10001-kube-api-access-69n74" (OuterVolumeSpecName: "kube-api-access-69n74") pod "e3bee0d6-4554-46be-a443-d6ae77c10001" (UID: "e3bee0d6-4554-46be-a443-d6ae77c10001"). InnerVolumeSpecName "kube-api-access-69n74". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 07:21:15.214210 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:15.214159    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3bee0d6-4554-46be-a443-d6ae77c10001-istio-token" (OuterVolumeSpecName: "istio-token") pod "e3bee0d6-4554-46be-a443-d6ae77c10001" (UID: "e3bee0d6-4554-46be-a443-d6ae77c10001"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 07:21:15.214269 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:15.214254    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3bee0d6-4554-46be-a443-d6ae77c10001-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e3bee0d6-4554-46be-a443-d6ae77c10001" (UID: "e3bee0d6-4554-46be-a443-d6ae77c10001"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 07:21:15.313114 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:15.313079    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e3bee0d6-4554-46be-a443-d6ae77c10001-istio-envoy\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:21:15.313114 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:15.313109    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e3bee0d6-4554-46be-a443-d6ae77c10001-istiod-ca-cert\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:21:15.313114 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:15.313119    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3bee0d6-4554-46be-a443-d6ae77c10001-workload-socket\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:21:15.313348 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:15.313130    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e3bee0d6-4554-46be-a443-d6ae77c10001-istio-data\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:21:15.313348 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:15.313138    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-69n74\" (UniqueName: \"kubernetes.io/projected/e3bee0d6-4554-46be-a443-d6ae77c10001-kube-api-access-69n74\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:21:15.313348 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:15.313147    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e3bee0d6-4554-46be-a443-d6ae77c10001-istio-token\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:21:15.313348 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:15.313155    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e3bee0d6-4554-46be-a443-d6ae77c10001-istio-podinfo\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:21:15.313348 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:15.313164    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3bee0d6-4554-46be-a443-d6ae77c10001-credential-socket\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:21:15.313348 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:15.313172    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e3bee0d6-4554-46be-a443-d6ae77c10001-workload-certs\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:21:15.600509 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:15.600473    2564 generic.go:356] "Generic (PLEG): container finished" podID="e3bee0d6-4554-46be-a443-d6ae77c10001" containerID="3e73482647a8a6de0fb10321827545b4f6c1db85c932ae342bfd2fa96f62eb30" exitCode=0
Sep 08 07:21:15.600671 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:15.600527    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt"
Sep 08 07:21:15.600671 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:15.600569    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt" event={"ID":"e3bee0d6-4554-46be-a443-d6ae77c10001","Type":"ContainerDied","Data":"3e73482647a8a6de0fb10321827545b4f6c1db85c932ae342bfd2fa96f62eb30"}
Sep 08 07:21:15.600671 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:15.600626    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt" event={"ID":"e3bee0d6-4554-46be-a443-d6ae77c10001","Type":"ContainerDied","Data":"0db2da18a1916a04acd4505290c79d2f68f7d75b9d4d6ebf8ec0086384978e40"}
Sep 08 07:21:15.600671 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:15.600657    2564 scope.go:117] "RemoveContainer" containerID="3e73482647a8a6de0fb10321827545b4f6c1db85c932ae342bfd2fa96f62eb30"
Sep 08 07:21:15.610197 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:15.610178    2564 scope.go:117] "RemoveContainer" containerID="ebb0fd5559ed416880915b3612f1c94e2a80358b665798f3db8c1d8098b2bc6a"
Sep 08 07:21:15.619147 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:15.619129    2564 scope.go:117] "RemoveContainer" containerID="3e73482647a8a6de0fb10321827545b4f6c1db85c932ae342bfd2fa96f62eb30"
Sep 08 07:21:15.619418 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:21:15.619387    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e73482647a8a6de0fb10321827545b4f6c1db85c932ae342bfd2fa96f62eb30\": container with ID starting with 3e73482647a8a6de0fb10321827545b4f6c1db85c932ae342bfd2fa96f62eb30 not found: ID does not exist" containerID="3e73482647a8a6de0fb10321827545b4f6c1db85c932ae342bfd2fa96f62eb30"
Sep 08 07:21:15.619497 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:15.619432    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e73482647a8a6de0fb10321827545b4f6c1db85c932ae342bfd2fa96f62eb30"} err="failed to get container status \"3e73482647a8a6de0fb10321827545b4f6c1db85c932ae342bfd2fa96f62eb30\": rpc error: code = NotFound desc = could not find container \"3e73482647a8a6de0fb10321827545b4f6c1db85c932ae342bfd2fa96f62eb30\": container with ID starting with 3e73482647a8a6de0fb10321827545b4f6c1db85c932ae342bfd2fa96f62eb30 not found: ID does not exist"
Sep 08 07:21:15.619497 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:15.619456    2564 scope.go:117] "RemoveContainer" containerID="ebb0fd5559ed416880915b3612f1c94e2a80358b665798f3db8c1d8098b2bc6a"
Sep 08 07:21:15.619735 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:21:15.619710    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ebb0fd5559ed416880915b3612f1c94e2a80358b665798f3db8c1d8098b2bc6a\": container with ID starting with ebb0fd5559ed416880915b3612f1c94e2a80358b665798f3db8c1d8098b2bc6a not found: ID does not exist" containerID="ebb0fd5559ed416880915b3612f1c94e2a80358b665798f3db8c1d8098b2bc6a"
Sep 08 07:21:15.619833 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:15.619742    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebb0fd5559ed416880915b3612f1c94e2a80358b665798f3db8c1d8098b2bc6a"} err="failed to get container status \"ebb0fd5559ed416880915b3612f1c94e2a80358b665798f3db8c1d8098b2bc6a\": rpc error: code = NotFound desc = could not find container \"ebb0fd5559ed416880915b3612f1c94e2a80358b665798f3db8c1d8098b2bc6a\": container with ID starting with ebb0fd5559ed416880915b3612f1c94e2a80358b665798f3db8c1d8098b2bc6a not found: ID does not exist"
Sep 08 07:21:15.623519 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:15.623491    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt"]
Sep 08 07:21:15.627323 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:15.627302    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-da54544b-openshift-default-854f9bdc6d-55wkt"]
Sep 08 07:21:16.510856 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:16.510821    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3bee0d6-4554-46be-a443-d6ae77c10001" path="/var/lib/kubelet/pods/e3bee0d6-4554-46be-a443-d6ae77c10001/volumes"
Sep 08 07:21:16.650436 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:16.650398    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:21:25.761457 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:25.761420    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-638d2d-openshift-default-7989f98d88-frtkb"]
Sep 08 07:21:25.761946 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:25.761676    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-autores-638d2d-openshift-default-7989f98d88-frtkb" podUID="0468c0d4-448f-4520-970c-287e77790933" containerName="istio-proxy" containerID="cri-o://3d7d8d6c7df112fb0be9dd54cf1d4986ae5c4c1b46e29097a43f22dd5c0daa60" gracePeriod=30
Sep 08 07:21:25.911151 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:25.911110    2564 patch_prober.go:28] interesting pod/e2e-autores-638d2d-openshift-default-7989f98d88-frtkb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 07:21:25.911315 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:25.911196    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-autores-638d2d-openshift-default-7989f98d88-frtkb" podUID="0468c0d4-448f-4520-970c-287e77790933" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 07:21:26.436245 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:26.436208    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm"]
Sep 08 07:21:26.436708 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:26.436690    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8eda0886-2b18-4312-bf33-821771eb5828" containerName="maas-api"
Sep 08 07:21:26.436798 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:26.436711    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8eda0886-2b18-4312-bf33-821771eb5828" containerName="maas-api"
Sep 08 07:21:26.436798 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:26.436721    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3bee0d6-4554-46be-a443-d6ae77c10001" containerName="istio-proxy"
Sep 08 07:21:26.436798 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:26.436730    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3bee0d6-4554-46be-a443-d6ae77c10001" containerName="istio-proxy"
Sep 08 07:21:26.436798 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:26.436751    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3bee0d6-4554-46be-a443-d6ae77c10001" containerName="istio-proxy"
Sep 08 07:21:26.436798 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:26.436760    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3bee0d6-4554-46be-a443-d6ae77c10001" containerName="istio-proxy"
Sep 08 07:21:26.436798 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:26.436774    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="feb1c664-75cd-4c22-b5ca-90ae131b1114" containerName="istio-proxy"
Sep 08 07:21:26.436798 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:26.436782    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="feb1c664-75cd-4c22-b5ca-90ae131b1114" containerName="istio-proxy"
Sep 08 07:21:26.436798 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:26.436798    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="feb1c664-75cd-4c22-b5ca-90ae131b1114" containerName="istio-proxy"
Sep 08 07:21:26.437217 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:26.436807    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="feb1c664-75cd-4c22-b5ca-90ae131b1114" containerName="istio-proxy"
Sep 08 07:21:26.437217 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:26.436827    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58133282-ba17-46c0-815c-59ef847e5f6c" containerName="maas-api"
Sep 08 07:21:26.437217 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:26.436836    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="58133282-ba17-46c0-815c-59ef847e5f6c" containerName="maas-api"
Sep 08 07:21:26.437217 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:26.436930    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="feb1c664-75cd-4c22-b5ca-90ae131b1114" containerName="istio-proxy"
Sep 08 07:21:26.437217 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:26.436944    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="8eda0886-2b18-4312-bf33-821771eb5828" containerName="maas-api"
Sep 08 07:21:26.437217 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:26.436954    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="58133282-ba17-46c0-815c-59ef847e5f6c" containerName="maas-api"
Sep 08 07:21:26.437217 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:26.436963    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3bee0d6-4554-46be-a443-d6ae77c10001" containerName="istio-proxy"
Sep 08 07:21:26.441849 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:26.441827    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm"
Sep 08 07:21:26.443751 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:26.443731    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-48a836-openshift-default-dockercfg-ggf24\""
Sep 08 07:21:26.450514 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:26.450474    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm"]
Sep 08 07:21:26.518374 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:26.518337    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rb8jr\" (UniqueName: \"kubernetes.io/projected/71b7384d-aec5-42c8-8ff4-8d7c5d445818-kube-api-access-rb8jr\") pod \"e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm\" (UID: \"71b7384d-aec5-42c8-8ff4-8d7c5d445818\") " pod="openshift-ingress/e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm"
Sep 08 07:21:26.518550 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:26.518382    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71b7384d-aec5-42c8-8ff4-8d7c5d445818-istio-envoy\") pod \"e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm\" (UID: \"71b7384d-aec5-42c8-8ff4-8d7c5d445818\") " pod="openshift-ingress/e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm"
Sep 08 07:21:26.518550 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:26.518450    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71b7384d-aec5-42c8-8ff4-8d7c5d445818-workload-certs\") pod \"e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm\" (UID: \"71b7384d-aec5-42c8-8ff4-8d7c5d445818\") " pod="openshift-ingress/e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm"
Sep 08 07:21:26.518550 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:26.518487    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71b7384d-aec5-42c8-8ff4-8d7c5d445818-workload-socket\") pod \"e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm\" (UID: \"71b7384d-aec5-42c8-8ff4-8d7c5d445818\") " pod="openshift-ingress/e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm"
Sep 08 07:21:26.518550 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:26.518532    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71b7384d-aec5-42c8-8ff4-8d7c5d445818-istiod-ca-cert\") pod \"e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm\" (UID: \"71b7384d-aec5-42c8-8ff4-8d7c5d445818\") " pod="openshift-ingress/e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm"
Sep 08 07:21:26.518708 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:26.518568    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71b7384d-aec5-42c8-8ff4-8d7c5d445818-istio-podinfo\") pod \"e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm\" (UID: \"71b7384d-aec5-42c8-8ff4-8d7c5d445818\") " pod="openshift-ingress/e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm"
Sep 08 07:21:26.518708 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:26.518624    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71b7384d-aec5-42c8-8ff4-8d7c5d445818-istio-token\") pod \"e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm\" (UID: \"71b7384d-aec5-42c8-8ff4-8d7c5d445818\") " pod="openshift-ingress/e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm"
Sep 08 07:21:26.518708 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:26.518666    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71b7384d-aec5-42c8-8ff4-8d7c5d445818-credential-socket\") pod \"e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm\" (UID: \"71b7384d-aec5-42c8-8ff4-8d7c5d445818\") " pod="openshift-ingress/e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm"
Sep 08 07:21:26.518811 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:26.518732    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71b7384d-aec5-42c8-8ff4-8d7c5d445818-istio-data\") pod \"e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm\" (UID: \"71b7384d-aec5-42c8-8ff4-8d7c5d445818\") " pod="openshift-ingress/e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm"
Sep 08 07:21:26.619485 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:26.619447    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rb8jr\" (UniqueName: \"kubernetes.io/projected/71b7384d-aec5-42c8-8ff4-8d7c5d445818-kube-api-access-rb8jr\") pod \"e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm\" (UID: \"71b7384d-aec5-42c8-8ff4-8d7c5d445818\") " pod="openshift-ingress/e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm"
Sep 08 07:21:26.619485 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:26.619490    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71b7384d-aec5-42c8-8ff4-8d7c5d445818-istio-envoy\") pod \"e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm\" (UID: \"71b7384d-aec5-42c8-8ff4-8d7c5d445818\") " pod="openshift-ingress/e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm"
Sep 08 07:21:26.619753 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:26.619510    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71b7384d-aec5-42c8-8ff4-8d7c5d445818-workload-certs\") pod \"e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm\" (UID: \"71b7384d-aec5-42c8-8ff4-8d7c5d445818\") " pod="openshift-ingress/e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm"
Sep 08 07:21:26.619753 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:26.619528    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71b7384d-aec5-42c8-8ff4-8d7c5d445818-workload-socket\") pod \"e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm\" (UID: \"71b7384d-aec5-42c8-8ff4-8d7c5d445818\") " pod="openshift-ingress/e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm"
Sep 08 07:21:26.619753 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:26.619563    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71b7384d-aec5-42c8-8ff4-8d7c5d445818-istiod-ca-cert\") pod \"e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm\" (UID: \"71b7384d-aec5-42c8-8ff4-8d7c5d445818\") " pod="openshift-ingress/e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm"
Sep 08 07:21:26.619753 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:26.619598    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71b7384d-aec5-42c8-8ff4-8d7c5d445818-istio-podinfo\") pod \"e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm\" (UID: \"71b7384d-aec5-42c8-8ff4-8d7c5d445818\") " pod="openshift-ingress/e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm"
Sep 08 07:21:26.619753 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:26.619626    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71b7384d-aec5-42c8-8ff4-8d7c5d445818-istio-token\") pod \"e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm\" (UID: \"71b7384d-aec5-42c8-8ff4-8d7c5d445818\") " pod="openshift-ingress/e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm"
Sep 08 07:21:26.620025 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:26.619794    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71b7384d-aec5-42c8-8ff4-8d7c5d445818-credential-socket\") pod \"e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm\" (UID: \"71b7384d-aec5-42c8-8ff4-8d7c5d445818\") " pod="openshift-ingress/e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm"
Sep 08 07:21:26.620080 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:26.620039    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71b7384d-aec5-42c8-8ff4-8d7c5d445818-workload-socket\") pod \"e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm\" (UID: \"71b7384d-aec5-42c8-8ff4-8d7c5d445818\") " pod="openshift-ingress/e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm"
Sep 08 07:21:26.620142 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:26.620104    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71b7384d-aec5-42c8-8ff4-8d7c5d445818-istio-data\") pod \"e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm\" (UID: \"71b7384d-aec5-42c8-8ff4-8d7c5d445818\") " pod="openshift-ingress/e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm"
Sep 08 07:21:26.620198 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:26.620129    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71b7384d-aec5-42c8-8ff4-8d7c5d445818-workload-certs\") pod \"e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm\" (UID: \"71b7384d-aec5-42c8-8ff4-8d7c5d445818\") " pod="openshift-ingress/e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm"
Sep 08 07:21:26.620198 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:26.620168    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71b7384d-aec5-42c8-8ff4-8d7c5d445818-credential-socket\") pod \"e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm\" (UID: \"71b7384d-aec5-42c8-8ff4-8d7c5d445818\") " pod="openshift-ingress/e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm"
Sep 08 07:21:26.620486 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:26.620462    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71b7384d-aec5-42c8-8ff4-8d7c5d445818-istiod-ca-cert\") pod \"e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm\" (UID: \"71b7384d-aec5-42c8-8ff4-8d7c5d445818\") " pod="openshift-ingress/e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm"
Sep 08 07:21:26.620576 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:26.620466    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71b7384d-aec5-42c8-8ff4-8d7c5d445818-istio-data\") pod \"e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm\" (UID: \"71b7384d-aec5-42c8-8ff4-8d7c5d445818\") " pod="openshift-ingress/e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm"
Sep 08 07:21:26.621876 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:26.621857    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71b7384d-aec5-42c8-8ff4-8d7c5d445818-istio-envoy\") pod \"e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm\" (UID: \"71b7384d-aec5-42c8-8ff4-8d7c5d445818\") " pod="openshift-ingress/e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm"
Sep 08 07:21:26.622138 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:26.622119    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71b7384d-aec5-42c8-8ff4-8d7c5d445818-istio-podinfo\") pod \"e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm\" (UID: \"71b7384d-aec5-42c8-8ff4-8d7c5d445818\") " pod="openshift-ingress/e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm"
Sep 08 07:21:26.627199 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:26.627174    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rb8jr\" (UniqueName: \"kubernetes.io/projected/71b7384d-aec5-42c8-8ff4-8d7c5d445818-kube-api-access-rb8jr\") pod \"e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm\" (UID: \"71b7384d-aec5-42c8-8ff4-8d7c5d445818\") " pod="openshift-ingress/e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm"
Sep 08 07:21:26.627476 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:26.627459    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71b7384d-aec5-42c8-8ff4-8d7c5d445818-istio-token\") pod \"e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm\" (UID: \"71b7384d-aec5-42c8-8ff4-8d7c5d445818\") " pod="openshift-ingress/e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm"
Sep 08 07:21:26.756158 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:26.756071    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm"
Sep 08 07:21:27.031926 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:27.031832    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm"]
Sep 08 07:21:27.034534 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:21:27.034507    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71b7384d_aec5_42c8_8ff4_8d7c5d445818.slice/crio-fe6496f4948c0028bfe1afa6a34f9b8a480a10a2dcd9e6a290a47cfa60fd3b5d WatchSource:0}: Error finding container fe6496f4948c0028bfe1afa6a34f9b8a480a10a2dcd9e6a290a47cfa60fd3b5d: Status 404 returned error can't find the container with id fe6496f4948c0028bfe1afa6a34f9b8a480a10a2dcd9e6a290a47cfa60fd3b5d
Sep 08 07:21:27.037144 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:27.037100    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 07:21:27.037227 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:27.037185    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 07:21:27.037284 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:27.037235    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 07:21:27.671755 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:27.671717    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm" event={"ID":"71b7384d-aec5-42c8-8ff4-8d7c5d445818","Type":"ContainerStarted","Data":"fbb982eb734fd9d7d04b96474fb52889e589630c3a878f9b7647d4ea8cbdfc04"}
Sep 08 07:21:27.671996 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:27.671775    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm" event={"ID":"71b7384d-aec5-42c8-8ff4-8d7c5d445818","Type":"ContainerStarted","Data":"fe6496f4948c0028bfe1afa6a34f9b8a480a10a2dcd9e6a290a47cfa60fd3b5d"}
Sep 08 07:21:27.692842 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:27.692790    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm" podStartSLOduration=1.692773149 podStartE2EDuration="1.692773149s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:21:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:21:27.690604898 +0000 UTC m=+1035.671644225" watchObservedRunningTime="2026-09-08 07:21:27.692773149 +0000 UTC m=+1035.673812454"
Sep 08 07:21:27.756615 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:27.756586    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm"
Sep 08 07:21:28.762503 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:28.762467    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm"
Sep 08 07:21:29.682585 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:29.682548    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm"
Sep 08 07:21:29.683511 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:29.683487    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm"
Sep 08 07:21:30.664788 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:30.664084    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-48a836-59dd484d46-6clrw"]
Sep 08 07:21:30.665374 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:30.664856    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="feb1c664-75cd-4c22-b5ca-90ae131b1114" containerName="istio-proxy"
Sep 08 07:21:30.665374 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:30.664880    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3bee0d6-4554-46be-a443-d6ae77c10001" containerName="istio-proxy"
Sep 08 07:21:30.668502 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:30.668478    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-48a836-59dd484d46-6clrw"
Sep 08 07:21:30.670461 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:30.670431    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-explicit-48a836-serving-cert\""
Sep 08 07:21:30.678401 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:30.678374    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-48a836-59dd484d46-6clrw"]
Sep 08 07:21:30.767441 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:30.767407    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlcll\" (UniqueName: \"kubernetes.io/projected/19c3449e-04f1-4765-9e37-95cf0e0cbc46-kube-api-access-rlcll\") pod \"maas-api-e2e-explicit-48a836-59dd484d46-6clrw\" (UID: \"19c3449e-04f1-4765-9e37-95cf0e0cbc46\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-48a836-59dd484d46-6clrw"
Sep 08 07:21:30.767617 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:30.767559    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19c3449e-04f1-4765-9e37-95cf0e0cbc46-metrics-certs\") pod \"maas-api-e2e-explicit-48a836-59dd484d46-6clrw\" (UID: \"19c3449e-04f1-4765-9e37-95cf0e0cbc46\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-48a836-59dd484d46-6clrw"
Sep 08 07:21:30.767680 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:30.767623    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/19c3449e-04f1-4765-9e37-95cf0e0cbc46-openshift-service-ca\") pod \"maas-api-e2e-explicit-48a836-59dd484d46-6clrw\" (UID: \"19c3449e-04f1-4765-9e37-95cf0e0cbc46\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-48a836-59dd484d46-6clrw"
Sep 08 07:21:30.767680 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:30.767660    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/19c3449e-04f1-4765-9e37-95cf0e0cbc46-maas-api-tls\") pod \"maas-api-e2e-explicit-48a836-59dd484d46-6clrw\" (UID: \"19c3449e-04f1-4765-9e37-95cf0e0cbc46\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-48a836-59dd484d46-6clrw"
Sep 08 07:21:30.868326 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:30.868284    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlcll\" (UniqueName: \"kubernetes.io/projected/19c3449e-04f1-4765-9e37-95cf0e0cbc46-kube-api-access-rlcll\") pod \"maas-api-e2e-explicit-48a836-59dd484d46-6clrw\" (UID: \"19c3449e-04f1-4765-9e37-95cf0e0cbc46\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-48a836-59dd484d46-6clrw"
Sep 08 07:21:30.868508 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:30.868381    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19c3449e-04f1-4765-9e37-95cf0e0cbc46-metrics-certs\") pod \"maas-api-e2e-explicit-48a836-59dd484d46-6clrw\" (UID: \"19c3449e-04f1-4765-9e37-95cf0e0cbc46\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-48a836-59dd484d46-6clrw"
Sep 08 07:21:30.868508 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:30.868420    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/19c3449e-04f1-4765-9e37-95cf0e0cbc46-openshift-service-ca\") pod \"maas-api-e2e-explicit-48a836-59dd484d46-6clrw\" (UID: \"19c3449e-04f1-4765-9e37-95cf0e0cbc46\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-48a836-59dd484d46-6clrw"
Sep 08 07:21:30.868508 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:30.868453    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/19c3449e-04f1-4765-9e37-95cf0e0cbc46-maas-api-tls\") pod \"maas-api-e2e-explicit-48a836-59dd484d46-6clrw\" (UID: \"19c3449e-04f1-4765-9e37-95cf0e0cbc46\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-48a836-59dd484d46-6clrw"
Sep 08 07:21:30.868681 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:21:30.868602    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-explicit-48a836-serving-cert: secret "maas-api-e2e-explicit-48a836-serving-cert" not found
Sep 08 07:21:30.868681 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:21:30.868671    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19c3449e-04f1-4765-9e37-95cf0e0cbc46-maas-api-tls podName:19c3449e-04f1-4765-9e37-95cf0e0cbc46 nodeName:}" failed. No retries permitted until 2026-09-08 07:21:31.368649954 +0000 UTC m=+1039.349689254 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/19c3449e-04f1-4765-9e37-95cf0e0cbc46-maas-api-tls") pod "maas-api-e2e-explicit-48a836-59dd484d46-6clrw" (UID: "19c3449e-04f1-4765-9e37-95cf0e0cbc46") : secret "maas-api-e2e-explicit-48a836-serving-cert" not found
Sep 08 07:21:30.869366 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:30.869333    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/19c3449e-04f1-4765-9e37-95cf0e0cbc46-openshift-service-ca\") pod \"maas-api-e2e-explicit-48a836-59dd484d46-6clrw\" (UID: \"19c3449e-04f1-4765-9e37-95cf0e0cbc46\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-48a836-59dd484d46-6clrw"
Sep 08 07:21:30.870767 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:30.870743    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19c3449e-04f1-4765-9e37-95cf0e0cbc46-metrics-certs\") pod \"maas-api-e2e-explicit-48a836-59dd484d46-6clrw\" (UID: \"19c3449e-04f1-4765-9e37-95cf0e0cbc46\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-48a836-59dd484d46-6clrw"
Sep 08 07:21:30.876356 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:30.876325    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlcll\" (UniqueName: \"kubernetes.io/projected/19c3449e-04f1-4765-9e37-95cf0e0cbc46-kube-api-access-rlcll\") pod \"maas-api-e2e-explicit-48a836-59dd484d46-6clrw\" (UID: \"19c3449e-04f1-4765-9e37-95cf0e0cbc46\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-48a836-59dd484d46-6clrw"
Sep 08 07:21:31.019553 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:31.019525    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-638d2d-openshift-default-7989f98d88-frtkb"
Sep 08 07:21:31.171160 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:31.171122    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0468c0d4-448f-4520-970c-287e77790933-istiod-ca-cert\") pod \"0468c0d4-448f-4520-970c-287e77790933\" (UID: \"0468c0d4-448f-4520-970c-287e77790933\") "
Sep 08 07:21:31.171160 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:31.171165    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0468c0d4-448f-4520-970c-287e77790933-workload-certs\") pod \"0468c0d4-448f-4520-970c-287e77790933\" (UID: \"0468c0d4-448f-4520-970c-287e77790933\") "
Sep 08 07:21:31.171403 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:31.171183    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0468c0d4-448f-4520-970c-287e77790933-credential-socket\") pod \"0468c0d4-448f-4520-970c-287e77790933\" (UID: \"0468c0d4-448f-4520-970c-287e77790933\") "
Sep 08 07:21:31.171403 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:31.171224    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rlwb6\" (UniqueName: \"kubernetes.io/projected/0468c0d4-448f-4520-970c-287e77790933-kube-api-access-rlwb6\") pod \"0468c0d4-448f-4520-970c-287e77790933\" (UID: \"0468c0d4-448f-4520-970c-287e77790933\") "
Sep 08 07:21:31.171403 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:31.171267    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0468c0d4-448f-4520-970c-287e77790933-istio-token\") pod \"0468c0d4-448f-4520-970c-287e77790933\" (UID: \"0468c0d4-448f-4520-970c-287e77790933\") "
Sep 08 07:21:31.171403 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:31.171286    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0468c0d4-448f-4520-970c-287e77790933-istio-envoy\") pod \"0468c0d4-448f-4520-970c-287e77790933\" (UID: \"0468c0d4-448f-4520-970c-287e77790933\") "
Sep 08 07:21:31.171403 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:31.171323    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0468c0d4-448f-4520-970c-287e77790933-istio-podinfo\") pod \"0468c0d4-448f-4520-970c-287e77790933\" (UID: \"0468c0d4-448f-4520-970c-287e77790933\") "
Sep 08 07:21:31.171403 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:31.171372    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0468c0d4-448f-4520-970c-287e77790933-workload-socket\") pod \"0468c0d4-448f-4520-970c-287e77790933\" (UID: \"0468c0d4-448f-4520-970c-287e77790933\") "
Sep 08 07:21:31.171998 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:31.171418    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0468c0d4-448f-4520-970c-287e77790933-istio-data\") pod \"0468c0d4-448f-4520-970c-287e77790933\" (UID: \"0468c0d4-448f-4520-970c-287e77790933\") "
Sep 08 07:21:31.171998 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:31.171436    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0468c0d4-448f-4520-970c-287e77790933-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0468c0d4-448f-4520-970c-287e77790933" (UID: "0468c0d4-448f-4520-970c-287e77790933"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 07:21:31.171998 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:31.171544    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0468c0d4-448f-4520-970c-287e77790933-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0468c0d4-448f-4520-970c-287e77790933" (UID: "0468c0d4-448f-4520-970c-287e77790933"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 07:21:31.171998 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:31.171614    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0468c0d4-448f-4520-970c-287e77790933-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0468c0d4-448f-4520-970c-287e77790933" (UID: "0468c0d4-448f-4520-970c-287e77790933"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 07:21:31.171998 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:31.171665    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0468c0d4-448f-4520-970c-287e77790933-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0468c0d4-448f-4520-970c-287e77790933" (UID: "0468c0d4-448f-4520-970c-287e77790933"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 07:21:31.171998 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:31.171755    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0468c0d4-448f-4520-970c-287e77790933-istio-data" (OuterVolumeSpecName: "istio-data") pod "0468c0d4-448f-4520-970c-287e77790933" (UID: "0468c0d4-448f-4520-970c-287e77790933"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 07:21:31.171998 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:31.171779    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0468c0d4-448f-4520-970c-287e77790933-workload-socket\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:21:31.171998 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:31.171800    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0468c0d4-448f-4520-970c-287e77790933-istiod-ca-cert\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:21:31.171998 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:31.171814    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0468c0d4-448f-4520-970c-287e77790933-workload-certs\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:21:31.171998 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:31.171827    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0468c0d4-448f-4520-970c-287e77790933-credential-socket\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:21:31.173670 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:31.173642    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0468c0d4-448f-4520-970c-287e77790933-istio-token" (OuterVolumeSpecName: "istio-token") pod "0468c0d4-448f-4520-970c-287e77790933" (UID: "0468c0d4-448f-4520-970c-287e77790933"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 07:21:31.173767 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:31.173676    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0468c0d4-448f-4520-970c-287e77790933-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0468c0d4-448f-4520-970c-287e77790933" (UID: "0468c0d4-448f-4520-970c-287e77790933"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 07:21:31.173767 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:31.173691    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0468c0d4-448f-4520-970c-287e77790933-kube-api-access-rlwb6" (OuterVolumeSpecName: "kube-api-access-rlwb6") pod "0468c0d4-448f-4520-970c-287e77790933" (UID: "0468c0d4-448f-4520-970c-287e77790933"). InnerVolumeSpecName "kube-api-access-rlwb6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 07:21:31.173767 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:31.173695    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0468c0d4-448f-4520-970c-287e77790933-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0468c0d4-448f-4520-970c-287e77790933" (UID: "0468c0d4-448f-4520-970c-287e77790933"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 07:21:31.272711 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:31.272676    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0468c0d4-448f-4520-970c-287e77790933-istio-token\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:21:31.272711 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:31.272709    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0468c0d4-448f-4520-970c-287e77790933-istio-envoy\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:21:31.272711 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:31.272718    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0468c0d4-448f-4520-970c-287e77790933-istio-podinfo\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:21:31.272939 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:31.272726    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0468c0d4-448f-4520-970c-287e77790933-istio-data\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:21:31.272939 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:31.272735    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rlwb6\" (UniqueName: \"kubernetes.io/projected/0468c0d4-448f-4520-970c-287e77790933-kube-api-access-rlwb6\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:21:31.374153 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:31.374120    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/19c3449e-04f1-4765-9e37-95cf0e0cbc46-maas-api-tls\") pod \"maas-api-e2e-explicit-48a836-59dd484d46-6clrw\" (UID: \"19c3449e-04f1-4765-9e37-95cf0e0cbc46\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-48a836-59dd484d46-6clrw"
Sep 08 07:21:31.376689 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:31.376662    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/19c3449e-04f1-4765-9e37-95cf0e0cbc46-maas-api-tls\") pod \"maas-api-e2e-explicit-48a836-59dd484d46-6clrw\" (UID: \"19c3449e-04f1-4765-9e37-95cf0e0cbc46\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-48a836-59dd484d46-6clrw"
Sep 08 07:21:31.584291 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:31.584197    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-48a836-59dd484d46-6clrw"
Sep 08 07:21:31.700732 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:31.700694    2564 generic.go:356] "Generic (PLEG): container finished" podID="0468c0d4-448f-4520-970c-287e77790933" containerID="3d7d8d6c7df112fb0be9dd54cf1d4986ae5c4c1b46e29097a43f22dd5c0daa60" exitCode=0
Sep 08 07:21:31.701198 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:31.700750    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-638d2d-openshift-default-7989f98d88-frtkb"
Sep 08 07:21:31.701198 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:31.700776    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-638d2d-openshift-default-7989f98d88-frtkb" event={"ID":"0468c0d4-448f-4520-970c-287e77790933","Type":"ContainerDied","Data":"3d7d8d6c7df112fb0be9dd54cf1d4986ae5c4c1b46e29097a43f22dd5c0daa60"}
Sep 08 07:21:31.701198 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:31.700838    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-638d2d-openshift-default-7989f98d88-frtkb" event={"ID":"0468c0d4-448f-4520-970c-287e77790933","Type":"ContainerDied","Data":"95c367ce6cb2c0270741f20133ac1f34386aaa007e89d30ec663d457e5607435"}
Sep 08 07:21:31.701198 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:31.700869    2564 scope.go:117] "RemoveContainer" containerID="3d7d8d6c7df112fb0be9dd54cf1d4986ae5c4c1b46e29097a43f22dd5c0daa60"
Sep 08 07:21:31.711713 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:31.711690    2564 scope.go:117] "RemoveContainer" containerID="b545dddbe9021ab61f38c9102adfaad7be19c0b73c27bc3039258f2123f23bbe"
Sep 08 07:21:31.720333 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:31.720311    2564 scope.go:117] "RemoveContainer" containerID="3d7d8d6c7df112fb0be9dd54cf1d4986ae5c4c1b46e29097a43f22dd5c0daa60"
Sep 08 07:21:31.720589 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:21:31.720569    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d7d8d6c7df112fb0be9dd54cf1d4986ae5c4c1b46e29097a43f22dd5c0daa60\": container with ID starting with 3d7d8d6c7df112fb0be9dd54cf1d4986ae5c4c1b46e29097a43f22dd5c0daa60 not found: ID does not exist" containerID="3d7d8d6c7df112fb0be9dd54cf1d4986ae5c4c1b46e29097a43f22dd5c0daa60"
Sep 08 07:21:31.720653 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:31.720602    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d7d8d6c7df112fb0be9dd54cf1d4986ae5c4c1b46e29097a43f22dd5c0daa60"} err="failed to get container status \"3d7d8d6c7df112fb0be9dd54cf1d4986ae5c4c1b46e29097a43f22dd5c0daa60\": rpc error: code = NotFound desc = could not find container \"3d7d8d6c7df112fb0be9dd54cf1d4986ae5c4c1b46e29097a43f22dd5c0daa60\": container with ID starting with 3d7d8d6c7df112fb0be9dd54cf1d4986ae5c4c1b46e29097a43f22dd5c0daa60 not found: ID does not exist"
Sep 08 07:21:31.720653 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:31.720626    2564 scope.go:117] "RemoveContainer" containerID="b545dddbe9021ab61f38c9102adfaad7be19c0b73c27bc3039258f2123f23bbe"
Sep 08 07:21:31.720946 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:21:31.720918    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b545dddbe9021ab61f38c9102adfaad7be19c0b73c27bc3039258f2123f23bbe\": container with ID starting with b545dddbe9021ab61f38c9102adfaad7be19c0b73c27bc3039258f2123f23bbe not found: ID does not exist" containerID="b545dddbe9021ab61f38c9102adfaad7be19c0b73c27bc3039258f2123f23bbe"
Sep 08 07:21:31.721080 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:31.720952    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b545dddbe9021ab61f38c9102adfaad7be19c0b73c27bc3039258f2123f23bbe"} err="failed to get container status \"b545dddbe9021ab61f38c9102adfaad7be19c0b73c27bc3039258f2123f23bbe\": rpc error: code = NotFound desc = could not find container \"b545dddbe9021ab61f38c9102adfaad7be19c0b73c27bc3039258f2123f23bbe\": container with ID starting with b545dddbe9021ab61f38c9102adfaad7be19c0b73c27bc3039258f2123f23bbe not found: ID does not exist"
Sep 08 07:21:31.723680 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:31.723656    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-638d2d-openshift-default-7989f98d88-frtkb"]
Sep 08 07:21:31.725827 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:31.725803    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-autores-638d2d-openshift-default-7989f98d88-frtkb"]
Sep 08 07:21:31.862293 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:31.862246    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-48a836-59dd484d46-6clrw"]
Sep 08 07:21:31.863962 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:21:31.863936    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19c3449e_04f1_4765_9e37_95cf0e0cbc46.slice/crio-f0d70839aebc032fb86f256421a28d9904427f2c1180445db33ce96be3e04db6 WatchSource:0}: Error finding container f0d70839aebc032fb86f256421a28d9904427f2c1180445db33ce96be3e04db6: Status 404 returned error can't find the container with id f0d70839aebc032fb86f256421a28d9904427f2c1180445db33ce96be3e04db6
Sep 08 07:21:32.510566 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:32.510536    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0468c0d4-448f-4520-970c-287e77790933" path="/var/lib/kubelet/pods/0468c0d4-448f-4520-970c-287e77790933/volumes"
Sep 08 07:21:32.571722 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:32.571674    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:21:32.708330 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:32.708295    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-48a836-59dd484d46-6clrw" event={"ID":"19c3449e-04f1-4765-9e37-95cf0e0cbc46","Type":"ContainerStarted","Data":"24df30648dfca76909766b8c40677125476ff3df858b2bc21cf78ea611821550"}
Sep 08 07:21:32.708805 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:32.708355    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-48a836-59dd484d46-6clrw" event={"ID":"19c3449e-04f1-4765-9e37-95cf0e0cbc46","Type":"ContainerStarted","Data":"f0d70839aebc032fb86f256421a28d9904427f2c1180445db33ce96be3e04db6"}
Sep 08 07:21:32.708805 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:32.708406    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-48a836-59dd484d46-6clrw"
Sep 08 07:21:32.726725 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:32.726514    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-48a836-59dd484d46-6clrw" podStartSLOduration=2.089098284 podStartE2EDuration="2.726497754s" totalImagesPullingTime="637.39947ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:21:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:21:32.725684256 +0000 UTC m=+1040.706723563" watchObservedRunningTime="2026-09-08 07:21:32.726497754 +0000 UTC m=+1040.707537059"
Sep 08 07:21:38.727354 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:38.727322    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-48a836-59dd484d46-6clrw"
Sep 08 07:21:46.640065 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:46.640032    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:21:48.806760 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:48.806726    2564 generic.go:356] "Generic (PLEG): container finished" podID="71b7384d-aec5-42c8-8ff4-8d7c5d445818" containerID="fbb982eb734fd9d7d04b96474fb52889e589630c3a878f9b7647d4ea8cbdfc04" exitCode=0
Sep 08 07:21:48.807203 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:48.806800    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm" event={"ID":"71b7384d-aec5-42c8-8ff4-8d7c5d445818","Type":"ContainerDied","Data":"fbb982eb734fd9d7d04b96474fb52889e589630c3a878f9b7647d4ea8cbdfc04"}
Sep 08 07:21:48.807249 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:48.807230    2564 scope.go:117] "RemoveContainer" containerID="fbb982eb734fd9d7d04b96474fb52889e589630c3a878f9b7647d4ea8cbdfc04"
Sep 08 07:21:48.808227 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:48.808201    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 07:21:48.808289 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:48.808265    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 07:21:48.808329 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:48.808295    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 07:21:49.817641 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:49.817606    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm" event={"ID":"71b7384d-aec5-42c8-8ff4-8d7c5d445818","Type":"ContainerStarted","Data":"6f26bd354ac35d379b2c67e01501b2bdf26ef6cbe7776240caf9d8595fe9d64a"}
Sep 08 07:21:50.757137 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:50.757095    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm"
Sep 08 07:21:50.757324 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:50.757302    2564 patch_prober.go:28] interesting pod/e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Sep 08 07:21:50.757375 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:50.757348    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm" podUID="71b7384d-aec5-42c8-8ff4-8d7c5d445818" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Sep 08 07:21:51.756703 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:51.756660    2564 patch_prober.go:28] interesting pod/e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Sep 08 07:21:51.757154 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:51.756721    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm" podUID="71b7384d-aec5-42c8-8ff4-8d7c5d445818" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Sep 08 07:21:52.757310 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:52.757268    2564 patch_prober.go:28] interesting pod/e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Sep 08 07:21:52.757692 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:52.757331    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm" podUID="71b7384d-aec5-42c8-8ff4-8d7c5d445818" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Sep 08 07:21:53.756779 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:53.756730    2564 patch_prober.go:28] interesting pod/e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Sep 08 07:21:53.757007 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:53.756789    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm" podUID="71b7384d-aec5-42c8-8ff4-8d7c5d445818" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Sep 08 07:21:54.756409 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:54.756374    2564 patch_prober.go:28] interesting pod/e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Sep 08 07:21:54.756820 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:54.756450    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm" podUID="71b7384d-aec5-42c8-8ff4-8d7c5d445818" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Sep 08 07:21:55.760739 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:55.760706    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm"
Sep 08 07:21:55.761255 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:55.761094    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm"
Sep 08 07:21:55.761854 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:21:55.761835    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm"
Sep 08 07:22:02.049658 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:02.049615    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:22:18.244777 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:18.244739    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:22:27.965205 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:27.964640    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-48a836-59dd484d46-6clrw"]
Sep 08 07:22:27.965205 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:27.964883    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-48a836-59dd484d46-6clrw" podUID="19c3449e-04f1-4765-9e37-95cf0e0cbc46" containerName="maas-api" containerID="cri-o://24df30648dfca76909766b8c40677125476ff3df858b2bc21cf78ea611821550" gracePeriod=30
Sep 08 07:22:28.234808 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:28.234783    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-48a836-59dd484d46-6clrw"
Sep 08 07:22:28.332267 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:28.332235    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/19c3449e-04f1-4765-9e37-95cf0e0cbc46-openshift-service-ca\") pod \"19c3449e-04f1-4765-9e37-95cf0e0cbc46\" (UID: \"19c3449e-04f1-4765-9e37-95cf0e0cbc46\") "
Sep 08 07:22:28.332267 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:28.332272    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/19c3449e-04f1-4765-9e37-95cf0e0cbc46-maas-api-tls\") pod \"19c3449e-04f1-4765-9e37-95cf0e0cbc46\" (UID: \"19c3449e-04f1-4765-9e37-95cf0e0cbc46\") "
Sep 08 07:22:28.332516 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:28.332293    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19c3449e-04f1-4765-9e37-95cf0e0cbc46-metrics-certs\") pod \"19c3449e-04f1-4765-9e37-95cf0e0cbc46\" (UID: \"19c3449e-04f1-4765-9e37-95cf0e0cbc46\") "
Sep 08 07:22:28.332516 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:28.332338    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rlcll\" (UniqueName: \"kubernetes.io/projected/19c3449e-04f1-4765-9e37-95cf0e0cbc46-kube-api-access-rlcll\") pod \"19c3449e-04f1-4765-9e37-95cf0e0cbc46\" (UID: \"19c3449e-04f1-4765-9e37-95cf0e0cbc46\") "
Sep 08 07:22:28.332708 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:28.332658    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19c3449e-04f1-4765-9e37-95cf0e0cbc46-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "19c3449e-04f1-4765-9e37-95cf0e0cbc46" (UID: "19c3449e-04f1-4765-9e37-95cf0e0cbc46"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 07:22:28.334600 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:28.334567    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19c3449e-04f1-4765-9e37-95cf0e0cbc46-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "19c3449e-04f1-4765-9e37-95cf0e0cbc46" (UID: "19c3449e-04f1-4765-9e37-95cf0e0cbc46"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 07:22:28.334876 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:28.334852    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19c3449e-04f1-4765-9e37-95cf0e0cbc46-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "19c3449e-04f1-4765-9e37-95cf0e0cbc46" (UID: "19c3449e-04f1-4765-9e37-95cf0e0cbc46"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 07:22:28.334938 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:28.334883    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19c3449e-04f1-4765-9e37-95cf0e0cbc46-kube-api-access-rlcll" (OuterVolumeSpecName: "kube-api-access-rlcll") pod "19c3449e-04f1-4765-9e37-95cf0e0cbc46" (UID: "19c3449e-04f1-4765-9e37-95cf0e0cbc46"). InnerVolumeSpecName "kube-api-access-rlcll". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 07:22:28.433186 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:28.433151    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/19c3449e-04f1-4765-9e37-95cf0e0cbc46-openshift-service-ca\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:22:28.433186 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:28.433179    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/19c3449e-04f1-4765-9e37-95cf0e0cbc46-maas-api-tls\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:22:28.433186 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:28.433188    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19c3449e-04f1-4765-9e37-95cf0e0cbc46-metrics-certs\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:22:28.433406 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:28.433195    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rlcll\" (UniqueName: \"kubernetes.io/projected/19c3449e-04f1-4765-9e37-95cf0e0cbc46-kube-api-access-rlcll\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:22:29.026534 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:29.026503    2564 generic.go:356] "Generic (PLEG): container finished" podID="19c3449e-04f1-4765-9e37-95cf0e0cbc46" containerID="24df30648dfca76909766b8c40677125476ff3df858b2bc21cf78ea611821550" exitCode=0
Sep 08 07:22:29.026917 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:29.026540    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-48a836-59dd484d46-6clrw" event={"ID":"19c3449e-04f1-4765-9e37-95cf0e0cbc46","Type":"ContainerDied","Data":"24df30648dfca76909766b8c40677125476ff3df858b2bc21cf78ea611821550"}
Sep 08 07:22:29.026917 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:29.026552    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-48a836-59dd484d46-6clrw"
Sep 08 07:22:29.026917 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:29.026577    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-48a836-59dd484d46-6clrw" event={"ID":"19c3449e-04f1-4765-9e37-95cf0e0cbc46","Type":"ContainerDied","Data":"f0d70839aebc032fb86f256421a28d9904427f2c1180445db33ce96be3e04db6"}
Sep 08 07:22:29.026917 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:29.026598    2564 scope.go:117] "RemoveContainer" containerID="24df30648dfca76909766b8c40677125476ff3df858b2bc21cf78ea611821550"
Sep 08 07:22:29.035908 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:29.035892    2564 scope.go:117] "RemoveContainer" containerID="24df30648dfca76909766b8c40677125476ff3df858b2bc21cf78ea611821550"
Sep 08 07:22:29.036191 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:22:29.036168    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24df30648dfca76909766b8c40677125476ff3df858b2bc21cf78ea611821550\": container with ID starting with 24df30648dfca76909766b8c40677125476ff3df858b2bc21cf78ea611821550 not found: ID does not exist" containerID="24df30648dfca76909766b8c40677125476ff3df858b2bc21cf78ea611821550"
Sep 08 07:22:29.036280 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:29.036200    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24df30648dfca76909766b8c40677125476ff3df858b2bc21cf78ea611821550"} err="failed to get container status \"24df30648dfca76909766b8c40677125476ff3df858b2bc21cf78ea611821550\": rpc error: code = NotFound desc = could not find container \"24df30648dfca76909766b8c40677125476ff3df858b2bc21cf78ea611821550\": container with ID starting with 24df30648dfca76909766b8c40677125476ff3df858b2bc21cf78ea611821550 not found: ID does not exist"
Sep 08 07:22:29.045010 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:29.044985    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-48a836-59dd484d46-6clrw"]
Sep 08 07:22:29.050939 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:29.050919    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-48a836-59dd484d46-6clrw"]
Sep 08 07:22:30.510210 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:30.510178    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19c3449e-04f1-4765-9e37-95cf0e0cbc46" path="/var/lib/kubelet/pods/19c3449e-04f1-4765-9e37-95cf0e0cbc46/volumes"
Sep 08 07:22:34.718782 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:34.718747    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm"]
Sep 08 07:22:34.719294 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:34.718984    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm" podUID="71b7384d-aec5-42c8-8ff4-8d7c5d445818" containerName="istio-proxy" containerID="cri-o://6f26bd354ac35d379b2c67e01501b2bdf26ef6cbe7776240caf9d8595fe9d64a" gracePeriod=30
Sep 08 07:22:35.393907 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:35.393869    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-6d29c3-openshift-default-78696d457d-zkkdp"]
Sep 08 07:22:35.394874 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:35.394847    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0468c0d4-448f-4520-970c-287e77790933" containerName="istio-proxy"
Sep 08 07:22:35.395068 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:35.395043    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0468c0d4-448f-4520-970c-287e77790933" containerName="istio-proxy"
Sep 08 07:22:35.395187 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:35.395077    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19c3449e-04f1-4765-9e37-95cf0e0cbc46" containerName="maas-api"
Sep 08 07:22:35.395187 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:35.395087    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="19c3449e-04f1-4765-9e37-95cf0e0cbc46" containerName="maas-api"
Sep 08 07:22:35.395302 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:35.395233    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="0468c0d4-448f-4520-970c-287e77790933" containerName="istio-proxy"
Sep 08 07:22:35.395302 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:35.395247    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="0468c0d4-448f-4520-970c-287e77790933" containerName="istio-proxy"
Sep 08 07:22:35.395302 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:35.395260    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="19c3449e-04f1-4765-9e37-95cf0e0cbc46" containerName="maas-api"
Sep 08 07:22:35.399878 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:35.399857    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-6d29c3-openshift-default-78696d457d-zkkdp"
Sep 08 07:22:35.402065 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:35.402044    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-6d29c3-openshift-default-dockercfg-822gl\""
Sep 08 07:22:35.410712 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:35.410691    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-6d29c3-openshift-default-78696d457d-zkkdp"]
Sep 08 07:22:35.500095 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:35.500056    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67286433-20dd-4ee5-aaad-9d003dce7089-istio-token\") pod \"e2e-noten-6d29c3-openshift-default-78696d457d-zkkdp\" (UID: \"67286433-20dd-4ee5-aaad-9d003dce7089\") " pod="openshift-ingress/e2e-noten-6d29c3-openshift-default-78696d457d-zkkdp"
Sep 08 07:22:35.500304 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:35.500119    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67286433-20dd-4ee5-aaad-9d003dce7089-istio-envoy\") pod \"e2e-noten-6d29c3-openshift-default-78696d457d-zkkdp\" (UID: \"67286433-20dd-4ee5-aaad-9d003dce7089\") " pod="openshift-ingress/e2e-noten-6d29c3-openshift-default-78696d457d-zkkdp"
Sep 08 07:22:35.500304 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:35.500183    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67286433-20dd-4ee5-aaad-9d003dce7089-workload-socket\") pod \"e2e-noten-6d29c3-openshift-default-78696d457d-zkkdp\" (UID: \"67286433-20dd-4ee5-aaad-9d003dce7089\") " pod="openshift-ingress/e2e-noten-6d29c3-openshift-default-78696d457d-zkkdp"
Sep 08 07:22:35.500304 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:35.500241    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67286433-20dd-4ee5-aaad-9d003dce7089-istio-data\") pod \"e2e-noten-6d29c3-openshift-default-78696d457d-zkkdp\" (UID: \"67286433-20dd-4ee5-aaad-9d003dce7089\") " pod="openshift-ingress/e2e-noten-6d29c3-openshift-default-78696d457d-zkkdp"
Sep 08 07:22:35.500304 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:35.500273    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncqvt\" (UniqueName: \"kubernetes.io/projected/67286433-20dd-4ee5-aaad-9d003dce7089-kube-api-access-ncqvt\") pod \"e2e-noten-6d29c3-openshift-default-78696d457d-zkkdp\" (UID: \"67286433-20dd-4ee5-aaad-9d003dce7089\") " pod="openshift-ingress/e2e-noten-6d29c3-openshift-default-78696d457d-zkkdp"
Sep 08 07:22:35.500540 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:35.500308    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67286433-20dd-4ee5-aaad-9d003dce7089-credential-socket\") pod \"e2e-noten-6d29c3-openshift-default-78696d457d-zkkdp\" (UID: \"67286433-20dd-4ee5-aaad-9d003dce7089\") " pod="openshift-ingress/e2e-noten-6d29c3-openshift-default-78696d457d-zkkdp"
Sep 08 07:22:35.500540 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:35.500348    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67286433-20dd-4ee5-aaad-9d003dce7089-workload-certs\") pod \"e2e-noten-6d29c3-openshift-default-78696d457d-zkkdp\" (UID: \"67286433-20dd-4ee5-aaad-9d003dce7089\") " pod="openshift-ingress/e2e-noten-6d29c3-openshift-default-78696d457d-zkkdp"
Sep 08 07:22:35.500540 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:35.500369    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67286433-20dd-4ee5-aaad-9d003dce7089-istio-podinfo\") pod \"e2e-noten-6d29c3-openshift-default-78696d457d-zkkdp\" (UID: \"67286433-20dd-4ee5-aaad-9d003dce7089\") " pod="openshift-ingress/e2e-noten-6d29c3-openshift-default-78696d457d-zkkdp"
Sep 08 07:22:35.500540 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:35.500384    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67286433-20dd-4ee5-aaad-9d003dce7089-istiod-ca-cert\") pod \"e2e-noten-6d29c3-openshift-default-78696d457d-zkkdp\" (UID: \"67286433-20dd-4ee5-aaad-9d003dce7089\") " pod="openshift-ingress/e2e-noten-6d29c3-openshift-default-78696d457d-zkkdp"
Sep 08 07:22:35.601868 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:35.601832    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67286433-20dd-4ee5-aaad-9d003dce7089-istio-token\") pod \"e2e-noten-6d29c3-openshift-default-78696d457d-zkkdp\" (UID: \"67286433-20dd-4ee5-aaad-9d003dce7089\") " pod="openshift-ingress/e2e-noten-6d29c3-openshift-default-78696d457d-zkkdp"
Sep 08 07:22:35.602067 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:35.601883    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67286433-20dd-4ee5-aaad-9d003dce7089-istio-envoy\") pod \"e2e-noten-6d29c3-openshift-default-78696d457d-zkkdp\" (UID: \"67286433-20dd-4ee5-aaad-9d003dce7089\") " pod="openshift-ingress/e2e-noten-6d29c3-openshift-default-78696d457d-zkkdp"
Sep 08 07:22:35.602067 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:35.602012    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67286433-20dd-4ee5-aaad-9d003dce7089-workload-socket\") pod \"e2e-noten-6d29c3-openshift-default-78696d457d-zkkdp\" (UID: \"67286433-20dd-4ee5-aaad-9d003dce7089\") " pod="openshift-ingress/e2e-noten-6d29c3-openshift-default-78696d457d-zkkdp"
Sep 08 07:22:35.602163 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:35.602083    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67286433-20dd-4ee5-aaad-9d003dce7089-istio-data\") pod \"e2e-noten-6d29c3-openshift-default-78696d457d-zkkdp\" (UID: \"67286433-20dd-4ee5-aaad-9d003dce7089\") " pod="openshift-ingress/e2e-noten-6d29c3-openshift-default-78696d457d-zkkdp"
Sep 08 07:22:35.602163 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:35.602119    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncqvt\" (UniqueName: \"kubernetes.io/projected/67286433-20dd-4ee5-aaad-9d003dce7089-kube-api-access-ncqvt\") pod \"e2e-noten-6d29c3-openshift-default-78696d457d-zkkdp\" (UID: \"67286433-20dd-4ee5-aaad-9d003dce7089\") " pod="openshift-ingress/e2e-noten-6d29c3-openshift-default-78696d457d-zkkdp"
Sep 08 07:22:35.602163 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:35.602154    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67286433-20dd-4ee5-aaad-9d003dce7089-credential-socket\") pod \"e2e-noten-6d29c3-openshift-default-78696d457d-zkkdp\" (UID: \"67286433-20dd-4ee5-aaad-9d003dce7089\") " pod="openshift-ingress/e2e-noten-6d29c3-openshift-default-78696d457d-zkkdp"
Sep 08 07:22:35.602315 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:35.602189    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67286433-20dd-4ee5-aaad-9d003dce7089-workload-certs\") pod \"e2e-noten-6d29c3-openshift-default-78696d457d-zkkdp\" (UID: \"67286433-20dd-4ee5-aaad-9d003dce7089\") " pod="openshift-ingress/e2e-noten-6d29c3-openshift-default-78696d457d-zkkdp"
Sep 08 07:22:35.602315 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:35.602212    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67286433-20dd-4ee5-aaad-9d003dce7089-istio-podinfo\") pod \"e2e-noten-6d29c3-openshift-default-78696d457d-zkkdp\" (UID: \"67286433-20dd-4ee5-aaad-9d003dce7089\") " pod="openshift-ingress/e2e-noten-6d29c3-openshift-default-78696d457d-zkkdp"
Sep 08 07:22:35.602315 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:35.602237    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67286433-20dd-4ee5-aaad-9d003dce7089-istiod-ca-cert\") pod \"e2e-noten-6d29c3-openshift-default-78696d457d-zkkdp\" (UID: \"67286433-20dd-4ee5-aaad-9d003dce7089\") " pod="openshift-ingress/e2e-noten-6d29c3-openshift-default-78696d457d-zkkdp"
Sep 08 07:22:35.602476 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:35.602431    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67286433-20dd-4ee5-aaad-9d003dce7089-workload-socket\") pod \"e2e-noten-6d29c3-openshift-default-78696d457d-zkkdp\" (UID: \"67286433-20dd-4ee5-aaad-9d003dce7089\") " pod="openshift-ingress/e2e-noten-6d29c3-openshift-default-78696d457d-zkkdp"
Sep 08 07:22:35.602476 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:35.602461    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67286433-20dd-4ee5-aaad-9d003dce7089-credential-socket\") pod \"e2e-noten-6d29c3-openshift-default-78696d457d-zkkdp\" (UID: \"67286433-20dd-4ee5-aaad-9d003dce7089\") " pod="openshift-ingress/e2e-noten-6d29c3-openshift-default-78696d457d-zkkdp"
Sep 08 07:22:35.602594 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:35.602578    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67286433-20dd-4ee5-aaad-9d003dce7089-istio-data\") pod \"e2e-noten-6d29c3-openshift-default-78696d457d-zkkdp\" (UID: \"67286433-20dd-4ee5-aaad-9d003dce7089\") " pod="openshift-ingress/e2e-noten-6d29c3-openshift-default-78696d457d-zkkdp"
Sep 08 07:22:35.602725 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:35.602704    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67286433-20dd-4ee5-aaad-9d003dce7089-workload-certs\") pod \"e2e-noten-6d29c3-openshift-default-78696d457d-zkkdp\" (UID: \"67286433-20dd-4ee5-aaad-9d003dce7089\") " pod="openshift-ingress/e2e-noten-6d29c3-openshift-default-78696d457d-zkkdp"
Sep 08 07:22:35.603120 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:35.603100    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67286433-20dd-4ee5-aaad-9d003dce7089-istiod-ca-cert\") pod \"e2e-noten-6d29c3-openshift-default-78696d457d-zkkdp\" (UID: \"67286433-20dd-4ee5-aaad-9d003dce7089\") " pod="openshift-ingress/e2e-noten-6d29c3-openshift-default-78696d457d-zkkdp"
Sep 08 07:22:35.604383 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:35.604359    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67286433-20dd-4ee5-aaad-9d003dce7089-istio-envoy\") pod \"e2e-noten-6d29c3-openshift-default-78696d457d-zkkdp\" (UID: \"67286433-20dd-4ee5-aaad-9d003dce7089\") " pod="openshift-ingress/e2e-noten-6d29c3-openshift-default-78696d457d-zkkdp"
Sep 08 07:22:35.604803 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:35.604783    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67286433-20dd-4ee5-aaad-9d003dce7089-istio-podinfo\") pod \"e2e-noten-6d29c3-openshift-default-78696d457d-zkkdp\" (UID: \"67286433-20dd-4ee5-aaad-9d003dce7089\") " pod="openshift-ingress/e2e-noten-6d29c3-openshift-default-78696d457d-zkkdp"
Sep 08 07:22:35.618500 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:35.618476    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67286433-20dd-4ee5-aaad-9d003dce7089-istio-token\") pod \"e2e-noten-6d29c3-openshift-default-78696d457d-zkkdp\" (UID: \"67286433-20dd-4ee5-aaad-9d003dce7089\") " pod="openshift-ingress/e2e-noten-6d29c3-openshift-default-78696d457d-zkkdp"
Sep 08 07:22:35.618608 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:35.618525    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncqvt\" (UniqueName: \"kubernetes.io/projected/67286433-20dd-4ee5-aaad-9d003dce7089-kube-api-access-ncqvt\") pod \"e2e-noten-6d29c3-openshift-default-78696d457d-zkkdp\" (UID: \"67286433-20dd-4ee5-aaad-9d003dce7089\") " pod="openshift-ingress/e2e-noten-6d29c3-openshift-default-78696d457d-zkkdp"
Sep 08 07:22:35.712688 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:35.712605    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-6d29c3-openshift-default-78696d457d-zkkdp"
Sep 08 07:22:35.995240 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:35.995212    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-6d29c3-openshift-default-78696d457d-zkkdp"]
Sep 08 07:22:35.997680 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:22:35.997654    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67286433_20dd_4ee5_aaad_9d003dce7089.slice/crio-845977154fc2a61a05d63799b3e536dd644c0c99052f43d177e8d582e1c7469f WatchSource:0}: Error finding container 845977154fc2a61a05d63799b3e536dd644c0c99052f43d177e8d582e1c7469f: Status 404 returned error can't find the container with id 845977154fc2a61a05d63799b3e536dd644c0c99052f43d177e8d582e1c7469f
Sep 08 07:22:35.999814 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:35.999779    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 07:22:35.999896 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:35.999843    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 07:22:35.999896 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:35.999873    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 07:22:36.066593 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:36.066565    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-6d29c3-openshift-default-78696d457d-zkkdp" event={"ID":"67286433-20dd-4ee5-aaad-9d003dce7089","Type":"ContainerStarted","Data":"6c536366a996eacc974a76c8fe27d34a96786e9bde77df874eaa45a8f465e2e2"}
Sep 08 07:22:36.066726 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:36.066617    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-6d29c3-openshift-default-78696d457d-zkkdp" event={"ID":"67286433-20dd-4ee5-aaad-9d003dce7089","Type":"ContainerStarted","Data":"845977154fc2a61a05d63799b3e536dd644c0c99052f43d177e8d582e1c7469f"}
Sep 08 07:22:36.083903 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:36.083850    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-6d29c3-openshift-default-78696d457d-zkkdp" podStartSLOduration=1.083830594 podStartE2EDuration="1.083830594s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:22:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:22:36.082286749 +0000 UTC m=+1104.063326056" watchObservedRunningTime="2026-09-08 07:22:36.083830594 +0000 UTC m=+1104.064869902"
Sep 08 07:22:36.713302 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:36.713266    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-6d29c3-openshift-default-78696d457d-zkkdp"
Sep 08 07:22:37.718070 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:37.718034    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-6d29c3-openshift-default-78696d457d-zkkdp"
Sep 08 07:22:38.077138 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:38.077109    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-6d29c3-openshift-default-78696d457d-zkkdp"
Sep 08 07:22:38.078159 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:38.078138    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-6d29c3-openshift-default-78696d457d-zkkdp"
Sep 08 07:22:38.249936 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:38.249901    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:22:39.968180 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:39.968158    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm"
Sep 08 07:22:40.047229 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:40.047195    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71b7384d-aec5-42c8-8ff4-8d7c5d445818-workload-socket\") pod \"71b7384d-aec5-42c8-8ff4-8d7c5d445818\" (UID: \"71b7384d-aec5-42c8-8ff4-8d7c5d445818\") "
Sep 08 07:22:40.047425 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:40.047242    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71b7384d-aec5-42c8-8ff4-8d7c5d445818-istiod-ca-cert\") pod \"71b7384d-aec5-42c8-8ff4-8d7c5d445818\" (UID: \"71b7384d-aec5-42c8-8ff4-8d7c5d445818\") "
Sep 08 07:22:40.047425 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:40.047277    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71b7384d-aec5-42c8-8ff4-8d7c5d445818-istio-envoy\") pod \"71b7384d-aec5-42c8-8ff4-8d7c5d445818\" (UID: \"71b7384d-aec5-42c8-8ff4-8d7c5d445818\") "
Sep 08 07:22:40.047425 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:40.047329    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71b7384d-aec5-42c8-8ff4-8d7c5d445818-istio-podinfo\") pod \"71b7384d-aec5-42c8-8ff4-8d7c5d445818\" (UID: \"71b7384d-aec5-42c8-8ff4-8d7c5d445818\") "
Sep 08 07:22:40.047425 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:40.047402    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71b7384d-aec5-42c8-8ff4-8d7c5d445818-istio-data\") pod \"71b7384d-aec5-42c8-8ff4-8d7c5d445818\" (UID: \"71b7384d-aec5-42c8-8ff4-8d7c5d445818\") "
Sep 08 07:22:40.047642 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:40.047440    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rb8jr\" (UniqueName: \"kubernetes.io/projected/71b7384d-aec5-42c8-8ff4-8d7c5d445818-kube-api-access-rb8jr\") pod \"71b7384d-aec5-42c8-8ff4-8d7c5d445818\" (UID: \"71b7384d-aec5-42c8-8ff4-8d7c5d445818\") "
Sep 08 07:22:40.047642 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:40.047465    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71b7384d-aec5-42c8-8ff4-8d7c5d445818-istio-token\") pod \"71b7384d-aec5-42c8-8ff4-8d7c5d445818\" (UID: \"71b7384d-aec5-42c8-8ff4-8d7c5d445818\") "
Sep 08 07:22:40.047642 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:40.047500    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71b7384d-aec5-42c8-8ff4-8d7c5d445818-workload-certs\") pod \"71b7384d-aec5-42c8-8ff4-8d7c5d445818\" (UID: \"71b7384d-aec5-42c8-8ff4-8d7c5d445818\") "
Sep 08 07:22:40.047642 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:40.047520    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71b7384d-aec5-42c8-8ff4-8d7c5d445818-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "71b7384d-aec5-42c8-8ff4-8d7c5d445818" (UID: "71b7384d-aec5-42c8-8ff4-8d7c5d445818"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 07:22:40.047642 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:40.047543    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71b7384d-aec5-42c8-8ff4-8d7c5d445818-credential-socket\") pod \"71b7384d-aec5-42c8-8ff4-8d7c5d445818\" (UID: \"71b7384d-aec5-42c8-8ff4-8d7c5d445818\") "
Sep 08 07:22:40.047885 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:40.047718    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71b7384d-aec5-42c8-8ff4-8d7c5d445818-istio-data" (OuterVolumeSpecName: "istio-data") pod "71b7384d-aec5-42c8-8ff4-8d7c5d445818" (UID: "71b7384d-aec5-42c8-8ff4-8d7c5d445818"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 07:22:40.047885 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:40.047758    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71b7384d-aec5-42c8-8ff4-8d7c5d445818-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "71b7384d-aec5-42c8-8ff4-8d7c5d445818" (UID: "71b7384d-aec5-42c8-8ff4-8d7c5d445818"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 07:22:40.047885 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:40.047807    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71b7384d-aec5-42c8-8ff4-8d7c5d445818-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "71b7384d-aec5-42c8-8ff4-8d7c5d445818" (UID: "71b7384d-aec5-42c8-8ff4-8d7c5d445818"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 07:22:40.047885 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:40.047851    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71b7384d-aec5-42c8-8ff4-8d7c5d445818-workload-socket\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:22:40.047885 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:40.047865    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71b7384d-aec5-42c8-8ff4-8d7c5d445818-istio-data\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:22:40.047885 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:40.047874    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71b7384d-aec5-42c8-8ff4-8d7c5d445818-workload-certs\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:22:40.048234 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:40.047964    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71b7384d-aec5-42c8-8ff4-8d7c5d445818-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "71b7384d-aec5-42c8-8ff4-8d7c5d445818" (UID: "71b7384d-aec5-42c8-8ff4-8d7c5d445818"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 07:22:40.049567 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:40.049539    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71b7384d-aec5-42c8-8ff4-8d7c5d445818-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "71b7384d-aec5-42c8-8ff4-8d7c5d445818" (UID: "71b7384d-aec5-42c8-8ff4-8d7c5d445818"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 07:22:40.049696 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:40.049616    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71b7384d-aec5-42c8-8ff4-8d7c5d445818-kube-api-access-rb8jr" (OuterVolumeSpecName: "kube-api-access-rb8jr") pod "71b7384d-aec5-42c8-8ff4-8d7c5d445818" (UID: "71b7384d-aec5-42c8-8ff4-8d7c5d445818"). InnerVolumeSpecName "kube-api-access-rb8jr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 07:22:40.049696 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:40.049677    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71b7384d-aec5-42c8-8ff4-8d7c5d445818-istio-token" (OuterVolumeSpecName: "istio-token") pod "71b7384d-aec5-42c8-8ff4-8d7c5d445818" (UID: "71b7384d-aec5-42c8-8ff4-8d7c5d445818"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 07:22:40.049840 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:40.049822    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/71b7384d-aec5-42c8-8ff4-8d7c5d445818-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "71b7384d-aec5-42c8-8ff4-8d7c5d445818" (UID: "71b7384d-aec5-42c8-8ff4-8d7c5d445818"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 07:22:40.091701 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:40.091666    2564 generic.go:356] "Generic (PLEG): container finished" podID="71b7384d-aec5-42c8-8ff4-8d7c5d445818" containerID="6f26bd354ac35d379b2c67e01501b2bdf26ef6cbe7776240caf9d8595fe9d64a" exitCode=0
Sep 08 07:22:40.091848 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:40.091731    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm"
Sep 08 07:22:40.091848 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:40.091749    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm" event={"ID":"71b7384d-aec5-42c8-8ff4-8d7c5d445818","Type":"ContainerDied","Data":"6f26bd354ac35d379b2c67e01501b2bdf26ef6cbe7776240caf9d8595fe9d64a"}
Sep 08 07:22:40.091848 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:40.091808    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm" event={"ID":"71b7384d-aec5-42c8-8ff4-8d7c5d445818","Type":"ContainerDied","Data":"fe6496f4948c0028bfe1afa6a34f9b8a480a10a2dcd9e6a290a47cfa60fd3b5d"}
Sep 08 07:22:40.091848 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:40.091834    2564 scope.go:117] "RemoveContainer" containerID="6f26bd354ac35d379b2c67e01501b2bdf26ef6cbe7776240caf9d8595fe9d64a"
Sep 08 07:22:40.101692 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:40.101676    2564 scope.go:117] "RemoveContainer" containerID="fbb982eb734fd9d7d04b96474fb52889e589630c3a878f9b7647d4ea8cbdfc04"
Sep 08 07:22:40.109479 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:40.109462    2564 scope.go:117] "RemoveContainer" containerID="6f26bd354ac35d379b2c67e01501b2bdf26ef6cbe7776240caf9d8595fe9d64a"
Sep 08 07:22:40.109725 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:22:40.109708    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f26bd354ac35d379b2c67e01501b2bdf26ef6cbe7776240caf9d8595fe9d64a\": container with ID starting with 6f26bd354ac35d379b2c67e01501b2bdf26ef6cbe7776240caf9d8595fe9d64a not found: ID does not exist" containerID="6f26bd354ac35d379b2c67e01501b2bdf26ef6cbe7776240caf9d8595fe9d64a"
Sep 08 07:22:40.109766 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:40.109733    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f26bd354ac35d379b2c67e01501b2bdf26ef6cbe7776240caf9d8595fe9d64a"} err="failed to get container status \"6f26bd354ac35d379b2c67e01501b2bdf26ef6cbe7776240caf9d8595fe9d64a\": rpc error: code = NotFound desc = could not find container \"6f26bd354ac35d379b2c67e01501b2bdf26ef6cbe7776240caf9d8595fe9d64a\": container with ID starting with 6f26bd354ac35d379b2c67e01501b2bdf26ef6cbe7776240caf9d8595fe9d64a not found: ID does not exist"
Sep 08 07:22:40.109766 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:40.109748    2564 scope.go:117] "RemoveContainer" containerID="fbb982eb734fd9d7d04b96474fb52889e589630c3a878f9b7647d4ea8cbdfc04"
Sep 08 07:22:40.110018 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:22:40.109997    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fbb982eb734fd9d7d04b96474fb52889e589630c3a878f9b7647d4ea8cbdfc04\": container with ID starting with fbb982eb734fd9d7d04b96474fb52889e589630c3a878f9b7647d4ea8cbdfc04 not found: ID does not exist" containerID="fbb982eb734fd9d7d04b96474fb52889e589630c3a878f9b7647d4ea8cbdfc04"
Sep 08 07:22:40.110083 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:40.110024    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbb982eb734fd9d7d04b96474fb52889e589630c3a878f9b7647d4ea8cbdfc04"} err="failed to get container status \"fbb982eb734fd9d7d04b96474fb52889e589630c3a878f9b7647d4ea8cbdfc04\": rpc error: code = NotFound desc = could not find container \"fbb982eb734fd9d7d04b96474fb52889e589630c3a878f9b7647d4ea8cbdfc04\": container with ID starting with fbb982eb734fd9d7d04b96474fb52889e589630c3a878f9b7647d4ea8cbdfc04 not found: ID does not exist"
Sep 08 07:22:40.113578 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:40.113559    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm"]
Sep 08 07:22:40.117890 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:40.117867    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-48a836-openshift-default-6c55f4984d-95nlm"]
Sep 08 07:22:40.148370 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:40.148339    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71b7384d-aec5-42c8-8ff4-8d7c5d445818-istiod-ca-cert\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:22:40.148370 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:40.148368    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71b7384d-aec5-42c8-8ff4-8d7c5d445818-istio-envoy\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:22:40.148370 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:40.148377    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71b7384d-aec5-42c8-8ff4-8d7c5d445818-istio-podinfo\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:22:40.148558 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:40.148386    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rb8jr\" (UniqueName: \"kubernetes.io/projected/71b7384d-aec5-42c8-8ff4-8d7c5d445818-kube-api-access-rb8jr\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:22:40.148558 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:40.148397    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71b7384d-aec5-42c8-8ff4-8d7c5d445818-istio-token\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:22:40.148558 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:40.148405    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71b7384d-aec5-42c8-8ff4-8d7c5d445818-credential-socket\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:22:40.511261 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:40.511237    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71b7384d-aec5-42c8-8ff4-8d7c5d445818" path="/var/lib/kubelet/pods/71b7384d-aec5-42c8-8ff4-8d7c5d445818/volumes"
Sep 08 07:22:45.292911 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:45.292877    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn"]
Sep 08 07:22:45.293545 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:45.293518    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0468c0d4-448f-4520-970c-287e77790933" containerName="istio-proxy"
Sep 08 07:22:45.293545 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:45.293546    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0468c0d4-448f-4520-970c-287e77790933" containerName="istio-proxy"
Sep 08 07:22:45.293740 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:45.293587    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71b7384d-aec5-42c8-8ff4-8d7c5d445818" containerName="istio-proxy"
Sep 08 07:22:45.293740 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:45.293598    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="71b7384d-aec5-42c8-8ff4-8d7c5d445818" containerName="istio-proxy"
Sep 08 07:22:45.293740 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:45.293719    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="71b7384d-aec5-42c8-8ff4-8d7c5d445818" containerName="istio-proxy"
Sep 08 07:22:45.293740 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:45.293732    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="71b7384d-aec5-42c8-8ff4-8d7c5d445818" containerName="istio-proxy"
Sep 08 07:22:45.298344 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:45.298322    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn"
Sep 08 07:22:45.300551 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:45.300530    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-9988a479-openshift-default-dockercfg-fn47n\""
Sep 08 07:22:45.312418 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:45.312388    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn"]
Sep 08 07:22:45.398339 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:45.398301    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1df8b5e5-e31d-4117-bd49-e5e508fc6a38-istio-data\") pod \"e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn\" (UID: \"1df8b5e5-e31d-4117-bd49-e5e508fc6a38\") " pod="openshift-ingress/e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn"
Sep 08 07:22:45.398339 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:45.398345    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1df8b5e5-e31d-4117-bd49-e5e508fc6a38-workload-certs\") pod \"e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn\" (UID: \"1df8b5e5-e31d-4117-bd49-e5e508fc6a38\") " pod="openshift-ingress/e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn"
Sep 08 07:22:45.398556 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:45.398405    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1df8b5e5-e31d-4117-bd49-e5e508fc6a38-istiod-ca-cert\") pod \"e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn\" (UID: \"1df8b5e5-e31d-4117-bd49-e5e508fc6a38\") " pod="openshift-ingress/e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn"
Sep 08 07:22:45.398556 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:45.398428    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hkrz\" (UniqueName: \"kubernetes.io/projected/1df8b5e5-e31d-4117-bd49-e5e508fc6a38-kube-api-access-4hkrz\") pod \"e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn\" (UID: \"1df8b5e5-e31d-4117-bd49-e5e508fc6a38\") " pod="openshift-ingress/e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn"
Sep 08 07:22:45.398556 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:45.398486    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1df8b5e5-e31d-4117-bd49-e5e508fc6a38-istio-envoy\") pod \"e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn\" (UID: \"1df8b5e5-e31d-4117-bd49-e5e508fc6a38\") " pod="openshift-ingress/e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn"
Sep 08 07:22:45.398556 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:45.398520    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1df8b5e5-e31d-4117-bd49-e5e508fc6a38-credential-socket\") pod \"e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn\" (UID: \"1df8b5e5-e31d-4117-bd49-e5e508fc6a38\") " pod="openshift-ingress/e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn"
Sep 08 07:22:45.398556 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:45.398543    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1df8b5e5-e31d-4117-bd49-e5e508fc6a38-istio-podinfo\") pod \"e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn\" (UID: \"1df8b5e5-e31d-4117-bd49-e5e508fc6a38\") " pod="openshift-ingress/e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn"
Sep 08 07:22:45.398762 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:45.398655    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1df8b5e5-e31d-4117-bd49-e5e508fc6a38-workload-socket\") pod \"e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn\" (UID: \"1df8b5e5-e31d-4117-bd49-e5e508fc6a38\") " pod="openshift-ingress/e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn"
Sep 08 07:22:45.398762 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:45.398734    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1df8b5e5-e31d-4117-bd49-e5e508fc6a38-istio-token\") pod \"e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn\" (UID: \"1df8b5e5-e31d-4117-bd49-e5e508fc6a38\") " pod="openshift-ingress/e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn"
Sep 08 07:22:45.499492 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:45.499442    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1df8b5e5-e31d-4117-bd49-e5e508fc6a38-workload-socket\") pod \"e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn\" (UID: \"1df8b5e5-e31d-4117-bd49-e5e508fc6a38\") " pod="openshift-ingress/e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn"
Sep 08 07:22:45.499674 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:45.499503    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1df8b5e5-e31d-4117-bd49-e5e508fc6a38-istio-token\") pod \"e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn\" (UID: \"1df8b5e5-e31d-4117-bd49-e5e508fc6a38\") " pod="openshift-ingress/e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn"
Sep 08 07:22:45.499674 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:45.499559    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1df8b5e5-e31d-4117-bd49-e5e508fc6a38-istio-data\") pod \"e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn\" (UID: \"1df8b5e5-e31d-4117-bd49-e5e508fc6a38\") " pod="openshift-ingress/e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn"
Sep 08 07:22:45.499674 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:45.499585    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1df8b5e5-e31d-4117-bd49-e5e508fc6a38-workload-certs\") pod \"e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn\" (UID: \"1df8b5e5-e31d-4117-bd49-e5e508fc6a38\") " pod="openshift-ingress/e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn"
Sep 08 07:22:45.499674 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:45.499627    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1df8b5e5-e31d-4117-bd49-e5e508fc6a38-istiod-ca-cert\") pod \"e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn\" (UID: \"1df8b5e5-e31d-4117-bd49-e5e508fc6a38\") " pod="openshift-ingress/e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn"
Sep 08 07:22:45.499674 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:45.499651    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hkrz\" (UniqueName: \"kubernetes.io/projected/1df8b5e5-e31d-4117-bd49-e5e508fc6a38-kube-api-access-4hkrz\") pod \"e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn\" (UID: \"1df8b5e5-e31d-4117-bd49-e5e508fc6a38\") " pod="openshift-ingress/e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn"
Sep 08 07:22:45.499924 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:45.499684    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1df8b5e5-e31d-4117-bd49-e5e508fc6a38-istio-envoy\") pod \"e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn\" (UID: \"1df8b5e5-e31d-4117-bd49-e5e508fc6a38\") " pod="openshift-ingress/e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn"
Sep 08 07:22:45.499924 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:45.499736    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1df8b5e5-e31d-4117-bd49-e5e508fc6a38-credential-socket\") pod \"e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn\" (UID: \"1df8b5e5-e31d-4117-bd49-e5e508fc6a38\") " pod="openshift-ingress/e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn"
Sep 08 07:22:45.499924 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:45.499768    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1df8b5e5-e31d-4117-bd49-e5e508fc6a38-istio-podinfo\") pod \"e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn\" (UID: \"1df8b5e5-e31d-4117-bd49-e5e508fc6a38\") " pod="openshift-ingress/e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn"
Sep 08 07:22:45.500120 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:45.500020    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1df8b5e5-e31d-4117-bd49-e5e508fc6a38-workload-certs\") pod \"e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn\" (UID: \"1df8b5e5-e31d-4117-bd49-e5e508fc6a38\") " pod="openshift-ingress/e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn"
Sep 08 07:22:45.500413 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:45.500385    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1df8b5e5-e31d-4117-bd49-e5e508fc6a38-istio-data\") pod \"e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn\" (UID: \"1df8b5e5-e31d-4117-bd49-e5e508fc6a38\") " pod="openshift-ingress/e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn"
Sep 08 07:22:45.500511 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:45.500447    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1df8b5e5-e31d-4117-bd49-e5e508fc6a38-credential-socket\") pod \"e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn\" (UID: \"1df8b5e5-e31d-4117-bd49-e5e508fc6a38\") " pod="openshift-ingress/e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn"
Sep 08 07:22:45.500692 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:45.500664    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1df8b5e5-e31d-4117-bd49-e5e508fc6a38-workload-socket\") pod \"e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn\" (UID: \"1df8b5e5-e31d-4117-bd49-e5e508fc6a38\") " pod="openshift-ingress/e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn"
Sep 08 07:22:45.500815 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:45.500707    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1df8b5e5-e31d-4117-bd49-e5e508fc6a38-istiod-ca-cert\") pod \"e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn\" (UID: \"1df8b5e5-e31d-4117-bd49-e5e508fc6a38\") " pod="openshift-ingress/e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn"
Sep 08 07:22:45.502119 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:45.502095    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1df8b5e5-e31d-4117-bd49-e5e508fc6a38-istio-envoy\") pod \"e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn\" (UID: \"1df8b5e5-e31d-4117-bd49-e5e508fc6a38\") " pod="openshift-ingress/e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn"
Sep 08 07:22:45.502372 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:45.502353    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1df8b5e5-e31d-4117-bd49-e5e508fc6a38-istio-podinfo\") pod \"e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn\" (UID: \"1df8b5e5-e31d-4117-bd49-e5e508fc6a38\") " pod="openshift-ingress/e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn"
Sep 08 07:22:45.506781 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:45.506756    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1df8b5e5-e31d-4117-bd49-e5e508fc6a38-istio-token\") pod \"e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn\" (UID: \"1df8b5e5-e31d-4117-bd49-e5e508fc6a38\") " pod="openshift-ingress/e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn"
Sep 08 07:22:45.507029 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:45.507011    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hkrz\" (UniqueName: \"kubernetes.io/projected/1df8b5e5-e31d-4117-bd49-e5e508fc6a38-kube-api-access-4hkrz\") pod \"e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn\" (UID: \"1df8b5e5-e31d-4117-bd49-e5e508fc6a38\") " pod="openshift-ingress/e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn"
Sep 08 07:22:45.610060 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:45.609925    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn"
Sep 08 07:22:45.891451 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:45.891426    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn"]
Sep 08 07:22:45.893398 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:22:45.893365    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1df8b5e5_e31d_4117_bd49_e5e508fc6a38.slice/crio-c845e16a7936e309117c6cc5f3e34f4c8629cdb28a5f6b543b5c49d2a5ee38bb WatchSource:0}: Error finding container c845e16a7936e309117c6cc5f3e34f4c8629cdb28a5f6b543b5c49d2a5ee38bb: Status 404 returned error can't find the container with id c845e16a7936e309117c6cc5f3e34f4c8629cdb28a5f6b543b5c49d2a5ee38bb
Sep 08 07:22:45.895513 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:45.895477    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 07:22:45.895606 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:45.895549    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 07:22:45.895606 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:45.895579    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 07:22:46.128420 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:46.128380    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn" event={"ID":"1df8b5e5-e31d-4117-bd49-e5e508fc6a38","Type":"ContainerStarted","Data":"f1a38b008537abf0d472b42dff20f107600086735d257b7f79749fbce799ccd1"}
Sep 08 07:22:46.128596 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:46.128437    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn" event={"ID":"1df8b5e5-e31d-4117-bd49-e5e508fc6a38","Type":"ContainerStarted","Data":"c845e16a7936e309117c6cc5f3e34f4c8629cdb28a5f6b543b5c49d2a5ee38bb"}
Sep 08 07:22:46.146455 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:46.146367    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn" podStartSLOduration=1.146350804 podStartE2EDuration="1.146350804s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:22:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:22:46.144924306 +0000 UTC m=+1114.125963639" watchObservedRunningTime="2026-09-08 07:22:46.146350804 +0000 UTC m=+1114.127390109"
Sep 08 07:22:46.610727 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:46.610689    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn"
Sep 08 07:22:46.616654 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:46.616630    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn"
Sep 08 07:22:47.133781 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:47.133748    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn"
Sep 08 07:22:47.134694 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:47.134674    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn"
Sep 08 07:22:49.136508 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:49.136456    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9988a479-74fbbd57d6-nxn87"]
Sep 08 07:22:49.136964 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:49.136883    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71b7384d-aec5-42c8-8ff4-8d7c5d445818" containerName="istio-proxy"
Sep 08 07:22:49.136964 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:49.136895    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="71b7384d-aec5-42c8-8ff4-8d7c5d445818" containerName="istio-proxy"
Sep 08 07:22:49.140391 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:49.140370    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9988a479-74fbbd57d6-nxn87"
Sep 08 07:22:49.142613 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:49.142558    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-9988a479-serving-cert\""
Sep 08 07:22:49.151237 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:49.150959    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9988a479-74fbbd57d6-nxn87"]
Sep 08 07:22:49.234478 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:49.234444    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2288326-27cd-43f4-8f8f-e6dac18373e8-metrics-certs\") pod \"maas-api-e2e-mt-9988a479-74fbbd57d6-nxn87\" (UID: \"f2288326-27cd-43f4-8f8f-e6dac18373e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9988a479-74fbbd57d6-nxn87"
Sep 08 07:22:49.234654 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:49.234571    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2288326-27cd-43f4-8f8f-e6dac18373e8-maas-api-tls\") pod \"maas-api-e2e-mt-9988a479-74fbbd57d6-nxn87\" (UID: \"f2288326-27cd-43f4-8f8f-e6dac18373e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9988a479-74fbbd57d6-nxn87"
Sep 08 07:22:49.234654 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:49.234598    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2288326-27cd-43f4-8f8f-e6dac18373e8-openshift-service-ca\") pod \"maas-api-e2e-mt-9988a479-74fbbd57d6-nxn87\" (UID: \"f2288326-27cd-43f4-8f8f-e6dac18373e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9988a479-74fbbd57d6-nxn87"
Sep 08 07:22:49.234836 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:49.234813    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqwwf\" (UniqueName: \"kubernetes.io/projected/f2288326-27cd-43f4-8f8f-e6dac18373e8-kube-api-access-bqwwf\") pod \"maas-api-e2e-mt-9988a479-74fbbd57d6-nxn87\" (UID: \"f2288326-27cd-43f4-8f8f-e6dac18373e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9988a479-74fbbd57d6-nxn87"
Sep 08 07:22:49.335957 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:49.335918    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2288326-27cd-43f4-8f8f-e6dac18373e8-maas-api-tls\") pod \"maas-api-e2e-mt-9988a479-74fbbd57d6-nxn87\" (UID: \"f2288326-27cd-43f4-8f8f-e6dac18373e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9988a479-74fbbd57d6-nxn87"
Sep 08 07:22:49.336154 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:49.335989    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2288326-27cd-43f4-8f8f-e6dac18373e8-openshift-service-ca\") pod \"maas-api-e2e-mt-9988a479-74fbbd57d6-nxn87\" (UID: \"f2288326-27cd-43f4-8f8f-e6dac18373e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9988a479-74fbbd57d6-nxn87"
Sep 08 07:22:49.336154 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:49.336039    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqwwf\" (UniqueName: \"kubernetes.io/projected/f2288326-27cd-43f4-8f8f-e6dac18373e8-kube-api-access-bqwwf\") pod \"maas-api-e2e-mt-9988a479-74fbbd57d6-nxn87\" (UID: \"f2288326-27cd-43f4-8f8f-e6dac18373e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9988a479-74fbbd57d6-nxn87"
Sep 08 07:22:49.336154 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:49.336066    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2288326-27cd-43f4-8f8f-e6dac18373e8-metrics-certs\") pod \"maas-api-e2e-mt-9988a479-74fbbd57d6-nxn87\" (UID: \"f2288326-27cd-43f4-8f8f-e6dac18373e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9988a479-74fbbd57d6-nxn87"
Sep 08 07:22:49.336154 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:22:49.336093    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-9988a479-serving-cert: secret "maas-api-e2e-mt-9988a479-serving-cert" not found
Sep 08 07:22:49.336322 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:22:49.336176    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2288326-27cd-43f4-8f8f-e6dac18373e8-maas-api-tls podName:f2288326-27cd-43f4-8f8f-e6dac18373e8 nodeName:}" failed. No retries permitted until 2026-09-08 07:22:49.836154904 +0000 UTC m=+1117.817194189 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f2288326-27cd-43f4-8f8f-e6dac18373e8-maas-api-tls") pod "maas-api-e2e-mt-9988a479-74fbbd57d6-nxn87" (UID: "f2288326-27cd-43f4-8f8f-e6dac18373e8") : secret "maas-api-e2e-mt-9988a479-serving-cert" not found
Sep 08 07:22:49.336762 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:49.336735    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2288326-27cd-43f4-8f8f-e6dac18373e8-openshift-service-ca\") pod \"maas-api-e2e-mt-9988a479-74fbbd57d6-nxn87\" (UID: \"f2288326-27cd-43f4-8f8f-e6dac18373e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9988a479-74fbbd57d6-nxn87"
Sep 08 07:22:49.338351 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:49.338332    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2288326-27cd-43f4-8f8f-e6dac18373e8-metrics-certs\") pod \"maas-api-e2e-mt-9988a479-74fbbd57d6-nxn87\" (UID: \"f2288326-27cd-43f4-8f8f-e6dac18373e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9988a479-74fbbd57d6-nxn87"
Sep 08 07:22:49.347025 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:49.347000    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqwwf\" (UniqueName: \"kubernetes.io/projected/f2288326-27cd-43f4-8f8f-e6dac18373e8-kube-api-access-bqwwf\") pod \"maas-api-e2e-mt-9988a479-74fbbd57d6-nxn87\" (UID: \"f2288326-27cd-43f4-8f8f-e6dac18373e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9988a479-74fbbd57d6-nxn87"
Sep 08 07:22:49.842704 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:49.842667    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2288326-27cd-43f4-8f8f-e6dac18373e8-maas-api-tls\") pod \"maas-api-e2e-mt-9988a479-74fbbd57d6-nxn87\" (UID: \"f2288326-27cd-43f4-8f8f-e6dac18373e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9988a479-74fbbd57d6-nxn87"
Sep 08 07:22:49.845143 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:49.845117    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2288326-27cd-43f4-8f8f-e6dac18373e8-maas-api-tls\") pod \"maas-api-e2e-mt-9988a479-74fbbd57d6-nxn87\" (UID: \"f2288326-27cd-43f4-8f8f-e6dac18373e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9988a479-74fbbd57d6-nxn87"
Sep 08 07:22:50.056335 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:50.056300    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9988a479-74fbbd57d6-nxn87"
Sep 08 07:22:50.333637 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:50.333613    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9988a479-74fbbd57d6-nxn87"]
Sep 08 07:22:50.335656 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:22:50.335633    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2288326_27cd_43f4_8f8f_e6dac18373e8.slice/crio-4620e6c98765be4566595250914645c20919c51ac7ced1e1a8427ae61d579f16 WatchSource:0}: Error finding container 4620e6c98765be4566595250914645c20919c51ac7ced1e1a8427ae61d579f16: Status 404 returned error can't find the container with id 4620e6c98765be4566595250914645c20919c51ac7ced1e1a8427ae61d579f16
Sep 08 07:22:51.161928 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:51.161835    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9988a479-74fbbd57d6-nxn87" event={"ID":"f2288326-27cd-43f4-8f8f-e6dac18373e8","Type":"ContainerStarted","Data":"7dca500cf4b623385ba36f2169ff4f3165b37119c4aba88da4d87b3982b0bd0f"}
Sep 08 07:22:51.161928 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:51.161891    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9988a479-74fbbd57d6-nxn87" event={"ID":"f2288326-27cd-43f4-8f8f-e6dac18373e8","Type":"ContainerStarted","Data":"4620e6c98765be4566595250914645c20919c51ac7ced1e1a8427ae61d579f16"}
Sep 08 07:22:51.161928 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:51.161921    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9988a479-74fbbd57d6-nxn87"
Sep 08 07:22:51.178570 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:51.178521    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9988a479-74fbbd57d6-nxn87" podStartSLOduration=1.677841143 podStartE2EDuration="2.178505607s" totalImagesPullingTime="500.664464ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:22:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:22:51.177193153 +0000 UTC m=+1119.158232479" watchObservedRunningTime="2026-09-08 07:22:51.178505607 +0000 UTC m=+1119.159544914"
Sep 08 07:22:56.141104 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:56.141070    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:22:57.172311 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:22:57.172277    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9988a479-74fbbd57d6-nxn87"
Sep 08 07:23:07.251848 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:07.251762    2564 generic.go:356] "Generic (PLEG): container finished" podID="1df8b5e5-e31d-4117-bd49-e5e508fc6a38" containerID="f1a38b008537abf0d472b42dff20f107600086735d257b7f79749fbce799ccd1" exitCode=0
Sep 08 07:23:07.252275 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:07.251842    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn" event={"ID":"1df8b5e5-e31d-4117-bd49-e5e508fc6a38","Type":"ContainerDied","Data":"f1a38b008537abf0d472b42dff20f107600086735d257b7f79749fbce799ccd1"}
Sep 08 07:23:07.252356 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:07.252339    2564 scope.go:117] "RemoveContainer" containerID="f1a38b008537abf0d472b42dff20f107600086735d257b7f79749fbce799ccd1"
Sep 08 07:23:07.253445 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:07.253412    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 07:23:07.253545 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:07.253482    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 07:23:07.253545 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:07.253512    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 07:23:08.259147 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:08.259110    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn" event={"ID":"1df8b5e5-e31d-4117-bd49-e5e508fc6a38","Type":"ContainerStarted","Data":"823374ccfa161a005f378e6b7951f3995eaf7ec650f340a5e7fe9f98b20e6205"}
Sep 08 07:23:08.456451 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:08.456415    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-6d29c3-openshift-default-78696d457d-zkkdp"]
Sep 08 07:23:08.456643 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:08.456607    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-6d29c3-openshift-default-78696d457d-zkkdp" podUID="67286433-20dd-4ee5-aaad-9d003dce7089" containerName="istio-proxy" containerID="cri-o://6c536366a996eacc974a76c8fe27d34a96786e9bde77df874eaa45a8f465e2e2" gracePeriod=30
Sep 08 07:23:08.610141 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:08.610034    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn"
Sep 08 07:23:08.610466 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:08.610429    2564 patch_prober.go:28] interesting pod/e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Sep 08 07:23:08.610561 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:08.610517    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn" podUID="1df8b5e5-e31d-4117-bd49-e5e508fc6a38" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Sep 08 07:23:09.610895 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:09.610856    2564 patch_prober.go:28] interesting pod/e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Sep 08 07:23:09.611508 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:09.611475    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn" podUID="1df8b5e5-e31d-4117-bd49-e5e508fc6a38" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Sep 08 07:23:10.610541 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:10.610497    2564 patch_prober.go:28] interesting pod/e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Sep 08 07:23:10.610746 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:10.610568    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn" podUID="1df8b5e5-e31d-4117-bd49-e5e508fc6a38" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Sep 08 07:23:11.611411 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:11.611359    2564 patch_prober.go:28] interesting pod/e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Sep 08 07:23:11.611896 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:11.611440    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn" podUID="1df8b5e5-e31d-4117-bd49-e5e508fc6a38" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Sep 08 07:23:12.611220 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:12.610737    2564 patch_prober.go:28] interesting pod/e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Sep 08 07:23:12.611220 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:12.610811    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn" podUID="1df8b5e5-e31d-4117-bd49-e5e508fc6a38" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Sep 08 07:23:13.615736 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:13.615699    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn"
Sep 08 07:23:13.616099 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:13.616071    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn"
Sep 08 07:23:13.616781 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:13.616758    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn"
Sep 08 07:23:13.735227 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:13.735203    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-6d29c3-openshift-default-78696d457d-zkkdp"
Sep 08 07:23:13.875522 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:13.875488    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67286433-20dd-4ee5-aaad-9d003dce7089-istio-token\") pod \"67286433-20dd-4ee5-aaad-9d003dce7089\" (UID: \"67286433-20dd-4ee5-aaad-9d003dce7089\") "
Sep 08 07:23:13.875690 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:13.875561    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67286433-20dd-4ee5-aaad-9d003dce7089-workload-socket\") pod \"67286433-20dd-4ee5-aaad-9d003dce7089\" (UID: \"67286433-20dd-4ee5-aaad-9d003dce7089\") "
Sep 08 07:23:13.875690 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:13.875663    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67286433-20dd-4ee5-aaad-9d003dce7089-istiod-ca-cert\") pod \"67286433-20dd-4ee5-aaad-9d003dce7089\" (UID: \"67286433-20dd-4ee5-aaad-9d003dce7089\") "
Sep 08 07:23:13.875776 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:13.875694    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67286433-20dd-4ee5-aaad-9d003dce7089-credential-socket\") pod \"67286433-20dd-4ee5-aaad-9d003dce7089\" (UID: \"67286433-20dd-4ee5-aaad-9d003dce7089\") "
Sep 08 07:23:13.875776 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:13.875744    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67286433-20dd-4ee5-aaad-9d003dce7089-istio-data\") pod \"67286433-20dd-4ee5-aaad-9d003dce7089\" (UID: \"67286433-20dd-4ee5-aaad-9d003dce7089\") "
Sep 08 07:23:13.875776 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:13.875769    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ncqvt\" (UniqueName: \"kubernetes.io/projected/67286433-20dd-4ee5-aaad-9d003dce7089-kube-api-access-ncqvt\") pod \"67286433-20dd-4ee5-aaad-9d003dce7089\" (UID: \"67286433-20dd-4ee5-aaad-9d003dce7089\") "
Sep 08 07:23:13.875926 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:13.875793    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67286433-20dd-4ee5-aaad-9d003dce7089-istio-envoy\") pod \"67286433-20dd-4ee5-aaad-9d003dce7089\" (UID: \"67286433-20dd-4ee5-aaad-9d003dce7089\") "
Sep 08 07:23:13.875926 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:13.875831    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67286433-20dd-4ee5-aaad-9d003dce7089-workload-certs\") pod \"67286433-20dd-4ee5-aaad-9d003dce7089\" (UID: \"67286433-20dd-4ee5-aaad-9d003dce7089\") "
Sep 08 07:23:13.875926 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:13.875868    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67286433-20dd-4ee5-aaad-9d003dce7089-istio-podinfo\") pod \"67286433-20dd-4ee5-aaad-9d003dce7089\" (UID: \"67286433-20dd-4ee5-aaad-9d003dce7089\") "
Sep 08 07:23:13.876130 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:13.875827    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67286433-20dd-4ee5-aaad-9d003dce7089-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "67286433-20dd-4ee5-aaad-9d003dce7089" (UID: "67286433-20dd-4ee5-aaad-9d003dce7089"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 07:23:13.876130 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:13.876043    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67286433-20dd-4ee5-aaad-9d003dce7089-istio-data" (OuterVolumeSpecName: "istio-data") pod "67286433-20dd-4ee5-aaad-9d003dce7089" (UID: "67286433-20dd-4ee5-aaad-9d003dce7089"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 07:23:13.876130 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:13.876062    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67286433-20dd-4ee5-aaad-9d003dce7089-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "67286433-20dd-4ee5-aaad-9d003dce7089" (UID: "67286433-20dd-4ee5-aaad-9d003dce7089"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 07:23:13.876130 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:13.876105    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67286433-20dd-4ee5-aaad-9d003dce7089-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "67286433-20dd-4ee5-aaad-9d003dce7089" (UID: "67286433-20dd-4ee5-aaad-9d003dce7089"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 07:23:13.876335 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:13.876196    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67286433-20dd-4ee5-aaad-9d003dce7089-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "67286433-20dd-4ee5-aaad-9d003dce7089" (UID: "67286433-20dd-4ee5-aaad-9d003dce7089"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 07:23:13.876335 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:13.876293    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67286433-20dd-4ee5-aaad-9d003dce7089-workload-socket\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:23:13.876335 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:13.876316    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67286433-20dd-4ee5-aaad-9d003dce7089-istiod-ca-cert\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:23:13.876335 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:13.876330    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67286433-20dd-4ee5-aaad-9d003dce7089-credential-socket\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:23:13.876531 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:13.876343    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67286433-20dd-4ee5-aaad-9d003dce7089-istio-data\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:23:13.876531 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:13.876356    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67286433-20dd-4ee5-aaad-9d003dce7089-workload-certs\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:23:13.877900 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:13.877857    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67286433-20dd-4ee5-aaad-9d003dce7089-kube-api-access-ncqvt" (OuterVolumeSpecName: "kube-api-access-ncqvt") pod "67286433-20dd-4ee5-aaad-9d003dce7089" (UID: "67286433-20dd-4ee5-aaad-9d003dce7089"). InnerVolumeSpecName "kube-api-access-ncqvt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 07:23:13.878082 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:13.877902    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/67286433-20dd-4ee5-aaad-9d003dce7089-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "67286433-20dd-4ee5-aaad-9d003dce7089" (UID: "67286433-20dd-4ee5-aaad-9d003dce7089"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 07:23:13.878223 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:13.878203    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67286433-20dd-4ee5-aaad-9d003dce7089-istio-token" (OuterVolumeSpecName: "istio-token") pod "67286433-20dd-4ee5-aaad-9d003dce7089" (UID: "67286433-20dd-4ee5-aaad-9d003dce7089"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 07:23:13.878286 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:13.878204    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67286433-20dd-4ee5-aaad-9d003dce7089-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "67286433-20dd-4ee5-aaad-9d003dce7089" (UID: "67286433-20dd-4ee5-aaad-9d003dce7089"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 07:23:13.977118 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:13.977045    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67286433-20dd-4ee5-aaad-9d003dce7089-istio-token\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:23:13.977118 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:13.977070    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ncqvt\" (UniqueName: \"kubernetes.io/projected/67286433-20dd-4ee5-aaad-9d003dce7089-kube-api-access-ncqvt\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:23:13.977118 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:13.977080    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67286433-20dd-4ee5-aaad-9d003dce7089-istio-envoy\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:23:13.977118 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:13.977088    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67286433-20dd-4ee5-aaad-9d003dce7089-istio-podinfo\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:23:14.295425 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:14.295386    2564 generic.go:356] "Generic (PLEG): container finished" podID="67286433-20dd-4ee5-aaad-9d003dce7089" containerID="6c536366a996eacc974a76c8fe27d34a96786e9bde77df874eaa45a8f465e2e2" exitCode=0
Sep 08 07:23:14.295620 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:14.295439    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-6d29c3-openshift-default-78696d457d-zkkdp"
Sep 08 07:23:14.295620 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:14.295454    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-6d29c3-openshift-default-78696d457d-zkkdp" event={"ID":"67286433-20dd-4ee5-aaad-9d003dce7089","Type":"ContainerDied","Data":"6c536366a996eacc974a76c8fe27d34a96786e9bde77df874eaa45a8f465e2e2"}
Sep 08 07:23:14.295620 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:14.295508    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-6d29c3-openshift-default-78696d457d-zkkdp" event={"ID":"67286433-20dd-4ee5-aaad-9d003dce7089","Type":"ContainerDied","Data":"845977154fc2a61a05d63799b3e536dd644c0c99052f43d177e8d582e1c7469f"}
Sep 08 07:23:14.295620 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:14.295531    2564 scope.go:117] "RemoveContainer" containerID="6c536366a996eacc974a76c8fe27d34a96786e9bde77df874eaa45a8f465e2e2"
Sep 08 07:23:14.305401 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:14.305384    2564 scope.go:117] "RemoveContainer" containerID="6c536366a996eacc974a76c8fe27d34a96786e9bde77df874eaa45a8f465e2e2"
Sep 08 07:23:14.305671 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:23:14.305653    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c536366a996eacc974a76c8fe27d34a96786e9bde77df874eaa45a8f465e2e2\": container with ID starting with 6c536366a996eacc974a76c8fe27d34a96786e9bde77df874eaa45a8f465e2e2 not found: ID does not exist" containerID="6c536366a996eacc974a76c8fe27d34a96786e9bde77df874eaa45a8f465e2e2"
Sep 08 07:23:14.305718 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:14.305680    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c536366a996eacc974a76c8fe27d34a96786e9bde77df874eaa45a8f465e2e2"} err="failed to get container status \"6c536366a996eacc974a76c8fe27d34a96786e9bde77df874eaa45a8f465e2e2\": rpc error: code = NotFound desc = could not find container \"6c536366a996eacc974a76c8fe27d34a96786e9bde77df874eaa45a8f465e2e2\": container with ID starting with 6c536366a996eacc974a76c8fe27d34a96786e9bde77df874eaa45a8f465e2e2 not found: ID does not exist"
Sep 08 07:23:14.319260 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:14.319230    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-6d29c3-openshift-default-78696d457d-zkkdp"]
Sep 08 07:23:14.323935 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:14.323912    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-6d29c3-openshift-default-78696d457d-zkkdp"]
Sep 08 07:23:14.509704 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:14.509670    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67286433-20dd-4ee5-aaad-9d003dce7089" path="/var/lib/kubelet/pods/67286433-20dd-4ee5-aaad-9d003dce7089/volumes"
Sep 08 07:23:16.641886 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:16.641855    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:23:28.542386 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:28.542351    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:23:30.005138 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:30.005098    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-620112-76649f9577-fd8c9"]
Sep 08 07:23:30.006040 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:30.005619    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-620112-76649f9577-fd8c9" podUID="14e67ce3-7367-41c0-b2b0-3fd42cbc6753" containerName="maas-api" containerID="cri-o://92932d83f1aece2725eb3d299d993cbdb4dae1b1c0af644ff448955ab9b10c53" gracePeriod=30
Sep 08 07:23:30.275257 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:30.275227    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-620112-76649f9577-fd8c9"
Sep 08 07:23:30.383121 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:30.383088    2564 generic.go:356] "Generic (PLEG): container finished" podID="14e67ce3-7367-41c0-b2b0-3fd42cbc6753" containerID="92932d83f1aece2725eb3d299d993cbdb4dae1b1c0af644ff448955ab9b10c53" exitCode=0
Sep 08 07:23:30.383303 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:30.383133    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-620112-76649f9577-fd8c9"
Sep 08 07:23:30.383303 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:30.383173    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-620112-76649f9577-fd8c9" event={"ID":"14e67ce3-7367-41c0-b2b0-3fd42cbc6753","Type":"ContainerDied","Data":"92932d83f1aece2725eb3d299d993cbdb4dae1b1c0af644ff448955ab9b10c53"}
Sep 08 07:23:30.383303 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:30.383236    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-620112-76649f9577-fd8c9" event={"ID":"14e67ce3-7367-41c0-b2b0-3fd42cbc6753","Type":"ContainerDied","Data":"07dc9cd6f1e51880d241ff3b595e5b0df9d4c2d7f2b6bedb4ccb040d9e269ef9"}
Sep 08 07:23:30.383303 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:30.383266    2564 scope.go:117] "RemoveContainer" containerID="92932d83f1aece2725eb3d299d993cbdb4dae1b1c0af644ff448955ab9b10c53"
Sep 08 07:23:30.394034 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:30.394015    2564 scope.go:117] "RemoveContainer" containerID="92932d83f1aece2725eb3d299d993cbdb4dae1b1c0af644ff448955ab9b10c53"
Sep 08 07:23:30.394342 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:23:30.394312    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92932d83f1aece2725eb3d299d993cbdb4dae1b1c0af644ff448955ab9b10c53\": container with ID starting with 92932d83f1aece2725eb3d299d993cbdb4dae1b1c0af644ff448955ab9b10c53 not found: ID does not exist" containerID="92932d83f1aece2725eb3d299d993cbdb4dae1b1c0af644ff448955ab9b10c53"
Sep 08 07:23:30.394440 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:30.394349    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92932d83f1aece2725eb3d299d993cbdb4dae1b1c0af644ff448955ab9b10c53"} err="failed to get container status \"92932d83f1aece2725eb3d299d993cbdb4dae1b1c0af644ff448955ab9b10c53\": rpc error: code = NotFound desc = could not find container \"92932d83f1aece2725eb3d299d993cbdb4dae1b1c0af644ff448955ab9b10c53\": container with ID starting with 92932d83f1aece2725eb3d299d993cbdb4dae1b1c0af644ff448955ab9b10c53 not found: ID does not exist"
Sep 08 07:23:30.430496 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:30.430473    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/14e67ce3-7367-41c0-b2b0-3fd42cbc6753-openshift-service-ca\") pod \"14e67ce3-7367-41c0-b2b0-3fd42cbc6753\" (UID: \"14e67ce3-7367-41c0-b2b0-3fd42cbc6753\") "
Sep 08 07:23:30.430646 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:30.430504    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14e67ce3-7367-41c0-b2b0-3fd42cbc6753-metrics-certs\") pod \"14e67ce3-7367-41c0-b2b0-3fd42cbc6753\" (UID: \"14e67ce3-7367-41c0-b2b0-3fd42cbc6753\") "
Sep 08 07:23:30.430646 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:30.430538    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/14e67ce3-7367-41c0-b2b0-3fd42cbc6753-maas-api-tls\") pod \"14e67ce3-7367-41c0-b2b0-3fd42cbc6753\" (UID: \"14e67ce3-7367-41c0-b2b0-3fd42cbc6753\") "
Sep 08 07:23:30.430646 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:30.430572    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h2rzh\" (UniqueName: \"kubernetes.io/projected/14e67ce3-7367-41c0-b2b0-3fd42cbc6753-kube-api-access-h2rzh\") pod \"14e67ce3-7367-41c0-b2b0-3fd42cbc6753\" (UID: \"14e67ce3-7367-41c0-b2b0-3fd42cbc6753\") "
Sep 08 07:23:30.430901 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:30.430861    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14e67ce3-7367-41c0-b2b0-3fd42cbc6753-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "14e67ce3-7367-41c0-b2b0-3fd42cbc6753" (UID: "14e67ce3-7367-41c0-b2b0-3fd42cbc6753"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 07:23:30.432698 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:30.432677    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14e67ce3-7367-41c0-b2b0-3fd42cbc6753-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "14e67ce3-7367-41c0-b2b0-3fd42cbc6753" (UID: "14e67ce3-7367-41c0-b2b0-3fd42cbc6753"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 07:23:30.432698 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:30.432697    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14e67ce3-7367-41c0-b2b0-3fd42cbc6753-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "14e67ce3-7367-41c0-b2b0-3fd42cbc6753" (UID: "14e67ce3-7367-41c0-b2b0-3fd42cbc6753"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 07:23:30.432815 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:30.432755    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14e67ce3-7367-41c0-b2b0-3fd42cbc6753-kube-api-access-h2rzh" (OuterVolumeSpecName: "kube-api-access-h2rzh") pod "14e67ce3-7367-41c0-b2b0-3fd42cbc6753" (UID: "14e67ce3-7367-41c0-b2b0-3fd42cbc6753"). InnerVolumeSpecName "kube-api-access-h2rzh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 07:23:30.531706 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:30.531673    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/14e67ce3-7367-41c0-b2b0-3fd42cbc6753-openshift-service-ca\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:23:30.531706 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:30.531703    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14e67ce3-7367-41c0-b2b0-3fd42cbc6753-metrics-certs\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:23:30.531851 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:30.531716    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/14e67ce3-7367-41c0-b2b0-3fd42cbc6753-maas-api-tls\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:23:30.531851 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:30.531727    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h2rzh\" (UniqueName: \"kubernetes.io/projected/14e67ce3-7367-41c0-b2b0-3fd42cbc6753-kube-api-access-h2rzh\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:23:30.700936 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:30.700900    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-620112-76649f9577-fd8c9"]
Sep 08 07:23:30.705162 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:30.705136    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-620112-76649f9577-fd8c9"]
Sep 08 07:23:31.621696 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:31.621661    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9988a479-74fbbd57d6-nxn87"]
Sep 08 07:23:31.622185 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:31.621879    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9988a479-74fbbd57d6-nxn87" podUID="f2288326-27cd-43f4-8f8f-e6dac18373e8" containerName="maas-api" containerID="cri-o://7dca500cf4b623385ba36f2169ff4f3165b37119c4aba88da4d87b3982b0bd0f" gracePeriod=30
Sep 08 07:23:31.877799 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:31.877733    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9988a479-74fbbd57d6-nxn87"
Sep 08 07:23:32.049784 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:32.049748    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2288326-27cd-43f4-8f8f-e6dac18373e8-metrics-certs\") pod \"f2288326-27cd-43f4-8f8f-e6dac18373e8\" (UID: \"f2288326-27cd-43f4-8f8f-e6dac18373e8\") "
Sep 08 07:23:32.049954 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:32.049820    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2288326-27cd-43f4-8f8f-e6dac18373e8-openshift-service-ca\") pod \"f2288326-27cd-43f4-8f8f-e6dac18373e8\" (UID: \"f2288326-27cd-43f4-8f8f-e6dac18373e8\") "
Sep 08 07:23:32.049954 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:32.049880    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bqwwf\" (UniqueName: \"kubernetes.io/projected/f2288326-27cd-43f4-8f8f-e6dac18373e8-kube-api-access-bqwwf\") pod \"f2288326-27cd-43f4-8f8f-e6dac18373e8\" (UID: \"f2288326-27cd-43f4-8f8f-e6dac18373e8\") "
Sep 08 07:23:32.049954 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:32.049911    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2288326-27cd-43f4-8f8f-e6dac18373e8-maas-api-tls\") pod \"f2288326-27cd-43f4-8f8f-e6dac18373e8\" (UID: \"f2288326-27cd-43f4-8f8f-e6dac18373e8\") "
Sep 08 07:23:32.050246 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:32.050210    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2288326-27cd-43f4-8f8f-e6dac18373e8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f2288326-27cd-43f4-8f8f-e6dac18373e8" (UID: "f2288326-27cd-43f4-8f8f-e6dac18373e8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 07:23:32.051979 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:32.051940    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f2288326-27cd-43f4-8f8f-e6dac18373e8-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f2288326-27cd-43f4-8f8f-e6dac18373e8" (UID: "f2288326-27cd-43f4-8f8f-e6dac18373e8"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 07:23:32.052152 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:32.052129    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f2288326-27cd-43f4-8f8f-e6dac18373e8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f2288326-27cd-43f4-8f8f-e6dac18373e8" (UID: "f2288326-27cd-43f4-8f8f-e6dac18373e8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 07:23:32.052257 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:32.052190    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2288326-27cd-43f4-8f8f-e6dac18373e8-kube-api-access-bqwwf" (OuterVolumeSpecName: "kube-api-access-bqwwf") pod "f2288326-27cd-43f4-8f8f-e6dac18373e8" (UID: "f2288326-27cd-43f4-8f8f-e6dac18373e8"). InnerVolumeSpecName "kube-api-access-bqwwf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 07:23:32.150795 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:32.150715    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2288326-27cd-43f4-8f8f-e6dac18373e8-metrics-certs\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:23:32.150795 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:32.150741    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2288326-27cd-43f4-8f8f-e6dac18373e8-openshift-service-ca\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:23:32.150795 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:32.150750    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bqwwf\" (UniqueName: \"kubernetes.io/projected/f2288326-27cd-43f4-8f8f-e6dac18373e8-kube-api-access-bqwwf\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:23:32.150795 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:32.150758    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2288326-27cd-43f4-8f8f-e6dac18373e8-maas-api-tls\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:23:32.397951 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:32.397916    2564 generic.go:356] "Generic (PLEG): container finished" podID="f2288326-27cd-43f4-8f8f-e6dac18373e8" containerID="7dca500cf4b623385ba36f2169ff4f3165b37119c4aba88da4d87b3982b0bd0f" exitCode=0
Sep 08 07:23:32.398124 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:32.397959    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9988a479-74fbbd57d6-nxn87" event={"ID":"f2288326-27cd-43f4-8f8f-e6dac18373e8","Type":"ContainerDied","Data":"7dca500cf4b623385ba36f2169ff4f3165b37119c4aba88da4d87b3982b0bd0f"}
Sep 08 07:23:32.398124 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:32.397992    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9988a479-74fbbd57d6-nxn87"
Sep 08 07:23:32.398124 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:32.398026    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9988a479-74fbbd57d6-nxn87" event={"ID":"f2288326-27cd-43f4-8f8f-e6dac18373e8","Type":"ContainerDied","Data":"4620e6c98765be4566595250914645c20919c51ac7ced1e1a8427ae61d579f16"}
Sep 08 07:23:32.398124 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:32.398047    2564 scope.go:117] "RemoveContainer" containerID="7dca500cf4b623385ba36f2169ff4f3165b37119c4aba88da4d87b3982b0bd0f"
Sep 08 07:23:32.407166 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:32.407149    2564 scope.go:117] "RemoveContainer" containerID="7dca500cf4b623385ba36f2169ff4f3165b37119c4aba88da4d87b3982b0bd0f"
Sep 08 07:23:32.407413 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:23:32.407395    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7dca500cf4b623385ba36f2169ff4f3165b37119c4aba88da4d87b3982b0bd0f\": container with ID starting with 7dca500cf4b623385ba36f2169ff4f3165b37119c4aba88da4d87b3982b0bd0f not found: ID does not exist" containerID="7dca500cf4b623385ba36f2169ff4f3165b37119c4aba88da4d87b3982b0bd0f"
Sep 08 07:23:32.407458 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:32.407420    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7dca500cf4b623385ba36f2169ff4f3165b37119c4aba88da4d87b3982b0bd0f"} err="failed to get container status \"7dca500cf4b623385ba36f2169ff4f3165b37119c4aba88da4d87b3982b0bd0f\": rpc error: code = NotFound desc = could not find container \"7dca500cf4b623385ba36f2169ff4f3165b37119c4aba88da4d87b3982b0bd0f\": container with ID starting with 7dca500cf4b623385ba36f2169ff4f3165b37119c4aba88da4d87b3982b0bd0f not found: ID does not exist"
Sep 08 07:23:32.425634 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:32.425612    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9988a479-74fbbd57d6-nxn87"]
Sep 08 07:23:32.435236 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:32.435215    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9988a479-74fbbd57d6-nxn87"]
Sep 08 07:23:32.510391 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:32.510362    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14e67ce3-7367-41c0-b2b0-3fd42cbc6753" path="/var/lib/kubelet/pods/14e67ce3-7367-41c0-b2b0-3fd42cbc6753/volumes"
Sep 08 07:23:32.510774 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:32.510761    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2288326-27cd-43f4-8f8f-e6dac18373e8" path="/var/lib/kubelet/pods/f2288326-27cd-43f4-8f8f-e6dac18373e8/volumes"
Sep 08 07:23:39.140548 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:39.140463    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:23:39.266480 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:39.266445    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn"]
Sep 08 07:23:39.266715 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:39.266683    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn" podUID="1df8b5e5-e31d-4117-bd49-e5e508fc6a38" containerName="istio-proxy" containerID="cri-o://823374ccfa161a005f378e6b7951f3995eaf7ec650f340a5e7fe9f98b20e6205" gracePeriod=30
Sep 08 07:23:43.618633 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:43.618589    2564 patch_prober.go:28] interesting pod/e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 07:23:43.619023 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:43.618659    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn" podUID="1df8b5e5-e31d-4117-bd49-e5e508fc6a38" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 07:23:44.463557 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:44.463513    2564 generic.go:356] "Generic (PLEG): container finished" podID="1df8b5e5-e31d-4117-bd49-e5e508fc6a38" containerID="823374ccfa161a005f378e6b7951f3995eaf7ec650f340a5e7fe9f98b20e6205" exitCode=0
Sep 08 07:23:44.463720 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:44.463575    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn" event={"ID":"1df8b5e5-e31d-4117-bd49-e5e508fc6a38","Type":"ContainerDied","Data":"823374ccfa161a005f378e6b7951f3995eaf7ec650f340a5e7fe9f98b20e6205"}
Sep 08 07:23:44.463720 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:44.463636    2564 scope.go:117] "RemoveContainer" containerID="f1a38b008537abf0d472b42dff20f107600086735d257b7f79749fbce799ccd1"
Sep 08 07:23:44.519225 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:44.519199    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn"
Sep 08 07:23:44.549797 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:44.549727    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1df8b5e5-e31d-4117-bd49-e5e508fc6a38-istio-envoy\") pod \"1df8b5e5-e31d-4117-bd49-e5e508fc6a38\" (UID: \"1df8b5e5-e31d-4117-bd49-e5e508fc6a38\") "
Sep 08 07:23:44.549797 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:44.549762    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1df8b5e5-e31d-4117-bd49-e5e508fc6a38-workload-socket\") pod \"1df8b5e5-e31d-4117-bd49-e5e508fc6a38\" (UID: \"1df8b5e5-e31d-4117-bd49-e5e508fc6a38\") "
Sep 08 07:23:44.549797 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:44.549785    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1df8b5e5-e31d-4117-bd49-e5e508fc6a38-istio-data\") pod \"1df8b5e5-e31d-4117-bd49-e5e508fc6a38\" (UID: \"1df8b5e5-e31d-4117-bd49-e5e508fc6a38\") "
Sep 08 07:23:44.550163 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:44.549816    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1df8b5e5-e31d-4117-bd49-e5e508fc6a38-credential-socket\") pod \"1df8b5e5-e31d-4117-bd49-e5e508fc6a38\" (UID: \"1df8b5e5-e31d-4117-bd49-e5e508fc6a38\") "
Sep 08 07:23:44.550163 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:44.549868    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4hkrz\" (UniqueName: \"kubernetes.io/projected/1df8b5e5-e31d-4117-bd49-e5e508fc6a38-kube-api-access-4hkrz\") pod \"1df8b5e5-e31d-4117-bd49-e5e508fc6a38\" (UID: \"1df8b5e5-e31d-4117-bd49-e5e508fc6a38\") "
Sep 08 07:23:44.550163 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:44.549899    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1df8b5e5-e31d-4117-bd49-e5e508fc6a38-workload-certs\") pod \"1df8b5e5-e31d-4117-bd49-e5e508fc6a38\" (UID: \"1df8b5e5-e31d-4117-bd49-e5e508fc6a38\") "
Sep 08 07:23:44.550163 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:44.549925    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1df8b5e5-e31d-4117-bd49-e5e508fc6a38-istio-token\") pod \"1df8b5e5-e31d-4117-bd49-e5e508fc6a38\" (UID: \"1df8b5e5-e31d-4117-bd49-e5e508fc6a38\") "
Sep 08 07:23:44.550163 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:44.549992    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1df8b5e5-e31d-4117-bd49-e5e508fc6a38-istio-podinfo\") pod \"1df8b5e5-e31d-4117-bd49-e5e508fc6a38\" (UID: \"1df8b5e5-e31d-4117-bd49-e5e508fc6a38\") "
Sep 08 07:23:44.550163 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:44.550035    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1df8b5e5-e31d-4117-bd49-e5e508fc6a38-istiod-ca-cert\") pod \"1df8b5e5-e31d-4117-bd49-e5e508fc6a38\" (UID: \"1df8b5e5-e31d-4117-bd49-e5e508fc6a38\") "
Sep 08 07:23:44.550163 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:44.550104    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1df8b5e5-e31d-4117-bd49-e5e508fc6a38-istio-data" (OuterVolumeSpecName: "istio-data") pod "1df8b5e5-e31d-4117-bd49-e5e508fc6a38" (UID: "1df8b5e5-e31d-4117-bd49-e5e508fc6a38"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 07:23:44.550163 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:44.550137    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1df8b5e5-e31d-4117-bd49-e5e508fc6a38-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1df8b5e5-e31d-4117-bd49-e5e508fc6a38" (UID: "1df8b5e5-e31d-4117-bd49-e5e508fc6a38"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 07:23:44.550697 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:44.550165    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1df8b5e5-e31d-4117-bd49-e5e508fc6a38-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1df8b5e5-e31d-4117-bd49-e5e508fc6a38" (UID: "1df8b5e5-e31d-4117-bd49-e5e508fc6a38"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 07:23:44.550697 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:44.550411    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1df8b5e5-e31d-4117-bd49-e5e508fc6a38-workload-socket\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:23:44.550697 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:44.550441    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1df8b5e5-e31d-4117-bd49-e5e508fc6a38-istio-data\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:23:44.550697 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:44.550458    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1df8b5e5-e31d-4117-bd49-e5e508fc6a38-credential-socket\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:23:44.550697 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:44.550408    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1df8b5e5-e31d-4117-bd49-e5e508fc6a38-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1df8b5e5-e31d-4117-bd49-e5e508fc6a38" (UID: "1df8b5e5-e31d-4117-bd49-e5e508fc6a38"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 07:23:44.550697 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:44.550445    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1df8b5e5-e31d-4117-bd49-e5e508fc6a38-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1df8b5e5-e31d-4117-bd49-e5e508fc6a38" (UID: "1df8b5e5-e31d-4117-bd49-e5e508fc6a38"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 07:23:44.552613 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:44.552575    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1df8b5e5-e31d-4117-bd49-e5e508fc6a38-istio-token" (OuterVolumeSpecName: "istio-token") pod "1df8b5e5-e31d-4117-bd49-e5e508fc6a38" (UID: "1df8b5e5-e31d-4117-bd49-e5e508fc6a38"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 07:23:44.552729 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:44.552657    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1df8b5e5-e31d-4117-bd49-e5e508fc6a38-kube-api-access-4hkrz" (OuterVolumeSpecName: "kube-api-access-4hkrz") pod "1df8b5e5-e31d-4117-bd49-e5e508fc6a38" (UID: "1df8b5e5-e31d-4117-bd49-e5e508fc6a38"). InnerVolumeSpecName "kube-api-access-4hkrz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 07:23:44.552797 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:44.552721    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1df8b5e5-e31d-4117-bd49-e5e508fc6a38-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1df8b5e5-e31d-4117-bd49-e5e508fc6a38" (UID: "1df8b5e5-e31d-4117-bd49-e5e508fc6a38"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 07:23:44.552797 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:44.552721    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1df8b5e5-e31d-4117-bd49-e5e508fc6a38-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1df8b5e5-e31d-4117-bd49-e5e508fc6a38" (UID: "1df8b5e5-e31d-4117-bd49-e5e508fc6a38"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 07:23:44.651182 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:44.651152    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1df8b5e5-e31d-4117-bd49-e5e508fc6a38-istio-envoy\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:23:44.651182 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:44.651177    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4hkrz\" (UniqueName: \"kubernetes.io/projected/1df8b5e5-e31d-4117-bd49-e5e508fc6a38-kube-api-access-4hkrz\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:23:44.651182 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:44.651187    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1df8b5e5-e31d-4117-bd49-e5e508fc6a38-workload-certs\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:23:44.651577 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:44.651195    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1df8b5e5-e31d-4117-bd49-e5e508fc6a38-istio-token\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:23:44.651577 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:44.651203    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1df8b5e5-e31d-4117-bd49-e5e508fc6a38-istio-podinfo\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:23:44.651577 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:44.651210    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1df8b5e5-e31d-4117-bd49-e5e508fc6a38-istiod-ca-cert\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:23:45.470312 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:45.470280    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn" event={"ID":"1df8b5e5-e31d-4117-bd49-e5e508fc6a38","Type":"ContainerDied","Data":"c845e16a7936e309117c6cc5f3e34f4c8629cdb28a5f6b543b5c49d2a5ee38bb"}
Sep 08 07:23:45.470492 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:45.470334    2564 scope.go:117] "RemoveContainer" containerID="823374ccfa161a005f378e6b7951f3995eaf7ec650f340a5e7fe9f98b20e6205"
Sep 08 07:23:45.470492 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:45.470293    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn"
Sep 08 07:23:45.493888 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:45.493856    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn"]
Sep 08 07:23:45.498051 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:45.498027    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-9988a479-openshift-default-8fcbcbd8d-csvcn"]
Sep 08 07:23:46.510397 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:46.510363    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1df8b5e5-e31d-4117-bd49-e5e508fc6a38" path="/var/lib/kubelet/pods/1df8b5e5-e31d-4117-bd49-e5e508fc6a38/volumes"
Sep 08 07:23:48.187629 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:48.187595    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6f5c4f-5b6fc9fb74-t6tm5"]
Sep 08 07:23:48.188095 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:48.187857    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6f5c4f-5b6fc9fb74-t6tm5" podUID="dfb1d217-1805-4996-8ba9-46a484affdba" containerName="maas-api" containerID="cri-o://ee4cc23159fb5375a8154858962cef0a26e4d33b073dd5aa842a170ecadb0761" gracePeriod=30
Sep 08 07:23:48.438518 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:48.438449    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6f5c4f-5b6fc9fb74-t6tm5"
Sep 08 07:23:48.485073 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:48.485041    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dfb1d217-1805-4996-8ba9-46a484affdba-metrics-certs\") pod \"dfb1d217-1805-4996-8ba9-46a484affdba\" (UID: \"dfb1d217-1805-4996-8ba9-46a484affdba\") "
Sep 08 07:23:48.485294 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:48.485105    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dfb1d217-1805-4996-8ba9-46a484affdba-openshift-service-ca\") pod \"dfb1d217-1805-4996-8ba9-46a484affdba\" (UID: \"dfb1d217-1805-4996-8ba9-46a484affdba\") "
Sep 08 07:23:48.485294 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:48.485159    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dfb1d217-1805-4996-8ba9-46a484affdba-maas-api-tls\") pod \"dfb1d217-1805-4996-8ba9-46a484affdba\" (UID: \"dfb1d217-1805-4996-8ba9-46a484affdba\") "
Sep 08 07:23:48.485294 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:48.485208    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x9j6w\" (UniqueName: \"kubernetes.io/projected/dfb1d217-1805-4996-8ba9-46a484affdba-kube-api-access-x9j6w\") pod \"dfb1d217-1805-4996-8ba9-46a484affdba\" (UID: \"dfb1d217-1805-4996-8ba9-46a484affdba\") "
Sep 08 07:23:48.488032 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:48.487835    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dfb1d217-1805-4996-8ba9-46a484affdba-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "dfb1d217-1805-4996-8ba9-46a484affdba" (UID: "dfb1d217-1805-4996-8ba9-46a484affdba"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 07:23:48.488563 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:48.488463    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dfb1d217-1805-4996-8ba9-46a484affdba-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "dfb1d217-1805-4996-8ba9-46a484affdba" (UID: "dfb1d217-1805-4996-8ba9-46a484affdba"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 07:23:48.488563 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:48.488538    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfb1d217-1805-4996-8ba9-46a484affdba-kube-api-access-x9j6w" (OuterVolumeSpecName: "kube-api-access-x9j6w") pod "dfb1d217-1805-4996-8ba9-46a484affdba" (UID: "dfb1d217-1805-4996-8ba9-46a484affdba"). InnerVolumeSpecName "kube-api-access-x9j6w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 07:23:48.489447 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:48.489418    2564 generic.go:356] "Generic (PLEG): container finished" podID="dfb1d217-1805-4996-8ba9-46a484affdba" containerID="ee4cc23159fb5375a8154858962cef0a26e4d33b073dd5aa842a170ecadb0761" exitCode=0
Sep 08 07:23:48.489590 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:48.489522    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6f5c4f-5b6fc9fb74-t6tm5" event={"ID":"dfb1d217-1805-4996-8ba9-46a484affdba","Type":"ContainerDied","Data":"ee4cc23159fb5375a8154858962cef0a26e4d33b073dd5aa842a170ecadb0761"}
Sep 08 07:23:48.489590 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:48.489567    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6f5c4f-5b6fc9fb74-t6tm5" event={"ID":"dfb1d217-1805-4996-8ba9-46a484affdba","Type":"ContainerDied","Data":"5ee12373327827c811166e93e069f078974844726e4a166dcc38acae3e470d5e"}
Sep 08 07:23:48.489709 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:48.489596    2564 scope.go:117] "RemoveContainer" containerID="ee4cc23159fb5375a8154858962cef0a26e4d33b073dd5aa842a170ecadb0761"
Sep 08 07:23:48.489709 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:48.489639    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dfb1d217-1805-4996-8ba9-46a484affdba-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "dfb1d217-1805-4996-8ba9-46a484affdba" (UID: "dfb1d217-1805-4996-8ba9-46a484affdba"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 07:23:48.489812 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:48.489724    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6f5c4f-5b6fc9fb74-t6tm5"
Sep 08 07:23:48.507785 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:48.507759    2564 scope.go:117] "RemoveContainer" containerID="ee4cc23159fb5375a8154858962cef0a26e4d33b073dd5aa842a170ecadb0761"
Sep 08 07:23:48.508089 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:23:48.508066    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee4cc23159fb5375a8154858962cef0a26e4d33b073dd5aa842a170ecadb0761\": container with ID starting with ee4cc23159fb5375a8154858962cef0a26e4d33b073dd5aa842a170ecadb0761 not found: ID does not exist" containerID="ee4cc23159fb5375a8154858962cef0a26e4d33b073dd5aa842a170ecadb0761"
Sep 08 07:23:48.508167 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:48.508097    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee4cc23159fb5375a8154858962cef0a26e4d33b073dd5aa842a170ecadb0761"} err="failed to get container status \"ee4cc23159fb5375a8154858962cef0a26e4d33b073dd5aa842a170ecadb0761\": rpc error: code = NotFound desc = could not find container \"ee4cc23159fb5375a8154858962cef0a26e4d33b073dd5aa842a170ecadb0761\": container with ID starting with ee4cc23159fb5375a8154858962cef0a26e4d33b073dd5aa842a170ecadb0761 not found: ID does not exist"
Sep 08 07:23:48.519191 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:48.519165    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6f5c4f-5b6fc9fb74-t6tm5"]
Sep 08 07:23:48.520946 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:48.520925    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6f5c4f-5b6fc9fb74-t6tm5"]
Sep 08 07:23:48.586224 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:48.586121    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dfb1d217-1805-4996-8ba9-46a484affdba-openshift-service-ca\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:23:48.586224 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:48.586154    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dfb1d217-1805-4996-8ba9-46a484affdba-maas-api-tls\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:23:48.586224 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:48.586170    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x9j6w\" (UniqueName: \"kubernetes.io/projected/dfb1d217-1805-4996-8ba9-46a484affdba-kube-api-access-x9j6w\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:23:48.586224 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:48.586183    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dfb1d217-1805-4996-8ba9-46a484affdba-metrics-certs\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:23:50.509052 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:50.508952    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dfb1d217-1805-4996-8ba9-46a484affdba" path="/var/lib/kubelet/pods/dfb1d217-1805-4996-8ba9-46a484affdba/volumes"
Sep 08 07:23:50.835807 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:50.835770    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:23:53.853629 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:53.853593    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c"]
Sep 08 07:23:53.854179 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:53.854159    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67286433-20dd-4ee5-aaad-9d003dce7089" containerName="istio-proxy"
Sep 08 07:23:53.854265 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:53.854181    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="67286433-20dd-4ee5-aaad-9d003dce7089" containerName="istio-proxy"
Sep 08 07:23:53.854265 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:53.854197    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1df8b5e5-e31d-4117-bd49-e5e508fc6a38" containerName="istio-proxy"
Sep 08 07:23:53.854265 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:53.854205    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="1df8b5e5-e31d-4117-bd49-e5e508fc6a38" containerName="istio-proxy"
Sep 08 07:23:53.854265 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:53.854219    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfb1d217-1805-4996-8ba9-46a484affdba" containerName="maas-api"
Sep 08 07:23:53.854265 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:53.854227    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfb1d217-1805-4996-8ba9-46a484affdba" containerName="maas-api"
Sep 08 07:23:53.854265 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:53.854240    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14e67ce3-7367-41c0-b2b0-3fd42cbc6753" containerName="maas-api"
Sep 08 07:23:53.854265 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:53.854248    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="14e67ce3-7367-41c0-b2b0-3fd42cbc6753" containerName="maas-api"
Sep 08 07:23:53.854608 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:53.854278    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2288326-27cd-43f4-8f8f-e6dac18373e8" containerName="maas-api"
Sep 08 07:23:53.854608 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:53.854286    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2288326-27cd-43f4-8f8f-e6dac18373e8" containerName="maas-api"
Sep 08 07:23:53.854608 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:53.854379    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="67286433-20dd-4ee5-aaad-9d003dce7089" containerName="istio-proxy"
Sep 08 07:23:53.854608 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:53.854393    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfb1d217-1805-4996-8ba9-46a484affdba" containerName="maas-api"
Sep 08 07:23:53.854608 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:53.854402    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="1df8b5e5-e31d-4117-bd49-e5e508fc6a38" containerName="istio-proxy"
Sep 08 07:23:53.854608 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:53.854409    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="1df8b5e5-e31d-4117-bd49-e5e508fc6a38" containerName="istio-proxy"
Sep 08 07:23:53.854608 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:53.854419    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="14e67ce3-7367-41c0-b2b0-3fd42cbc6753" containerName="maas-api"
Sep 08 07:23:53.854608 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:53.854428    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2288326-27cd-43f4-8f8f-e6dac18373e8" containerName="maas-api"
Sep 08 07:23:53.859068 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:53.859049    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c"
Sep 08 07:23:53.861596 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:53.861571    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 08 07:23:53.861715 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:53.861580    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-37abc6-openshift-default-dockercfg-mwp9n\""
Sep 08 07:23:53.869270 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:53.869244    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c"]
Sep 08 07:23:53.934126 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:53.934084    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/256362b2-f2b0-457a-beb7-12752bc16b41-istio-token\") pod \"e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c\" (UID: \"256362b2-f2b0-457a-beb7-12752bc16b41\") " pod="openshift-ingress/e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c"
Sep 08 07:23:53.934126 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:53.934128    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/256362b2-f2b0-457a-beb7-12752bc16b41-istio-podinfo\") pod \"e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c\" (UID: \"256362b2-f2b0-457a-beb7-12752bc16b41\") " pod="openshift-ingress/e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c"
Sep 08 07:23:53.934310 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:53.934148    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/256362b2-f2b0-457a-beb7-12752bc16b41-istio-envoy\") pod \"e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c\" (UID: \"256362b2-f2b0-457a-beb7-12752bc16b41\") " pod="openshift-ingress/e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c"
Sep 08 07:23:53.934310 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:53.934186    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/256362b2-f2b0-457a-beb7-12752bc16b41-workload-certs\") pod \"e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c\" (UID: \"256362b2-f2b0-457a-beb7-12752bc16b41\") " pod="openshift-ingress/e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c"
Sep 08 07:23:53.934310 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:53.934255    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/256362b2-f2b0-457a-beb7-12752bc16b41-istiod-ca-cert\") pod \"e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c\" (UID: \"256362b2-f2b0-457a-beb7-12752bc16b41\") " pod="openshift-ingress/e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c"
Sep 08 07:23:53.934310 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:53.934294    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/256362b2-f2b0-457a-beb7-12752bc16b41-workload-socket\") pod \"e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c\" (UID: \"256362b2-f2b0-457a-beb7-12752bc16b41\") " pod="openshift-ingress/e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c"
Sep 08 07:23:53.934466 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:53.934316    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/256362b2-f2b0-457a-beb7-12752bc16b41-istio-data\") pod \"e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c\" (UID: \"256362b2-f2b0-457a-beb7-12752bc16b41\") " pod="openshift-ingress/e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c"
Sep 08 07:23:53.934466 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:53.934359    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/256362b2-f2b0-457a-beb7-12752bc16b41-credential-socket\") pod \"e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c\" (UID: \"256362b2-f2b0-457a-beb7-12752bc16b41\") " pod="openshift-ingress/e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c"
Sep 08 07:23:53.934466 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:53.934381    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cvlh\" (UniqueName: \"kubernetes.io/projected/256362b2-f2b0-457a-beb7-12752bc16b41-kube-api-access-8cvlh\") pod \"e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c\" (UID: \"256362b2-f2b0-457a-beb7-12752bc16b41\") " pod="openshift-ingress/e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c"
Sep 08 07:23:54.035094 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:54.035056    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/256362b2-f2b0-457a-beb7-12752bc16b41-istiod-ca-cert\") pod \"e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c\" (UID: \"256362b2-f2b0-457a-beb7-12752bc16b41\") " pod="openshift-ingress/e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c"
Sep 08 07:23:54.035258 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:54.035215    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/256362b2-f2b0-457a-beb7-12752bc16b41-workload-socket\") pod \"e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c\" (UID: \"256362b2-f2b0-457a-beb7-12752bc16b41\") " pod="openshift-ingress/e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c"
Sep 08 07:23:54.035307 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:54.035257    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/256362b2-f2b0-457a-beb7-12752bc16b41-istio-data\") pod \"e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c\" (UID: \"256362b2-f2b0-457a-beb7-12752bc16b41\") " pod="openshift-ingress/e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c"
Sep 08 07:23:54.035307 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:54.035288    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/256362b2-f2b0-457a-beb7-12752bc16b41-credential-socket\") pod \"e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c\" (UID: \"256362b2-f2b0-457a-beb7-12752bc16b41\") " pod="openshift-ingress/e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c"
Sep 08 07:23:54.035424 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:54.035319    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cvlh\" (UniqueName: \"kubernetes.io/projected/256362b2-f2b0-457a-beb7-12752bc16b41-kube-api-access-8cvlh\") pod \"e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c\" (UID: \"256362b2-f2b0-457a-beb7-12752bc16b41\") " pod="openshift-ingress/e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c"
Sep 08 07:23:54.035424 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:54.035364    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/256362b2-f2b0-457a-beb7-12752bc16b41-istio-token\") pod \"e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c\" (UID: \"256362b2-f2b0-457a-beb7-12752bc16b41\") " pod="openshift-ingress/e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c"
Sep 08 07:23:54.035424 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:54.035416    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/256362b2-f2b0-457a-beb7-12752bc16b41-istio-podinfo\") pod \"e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c\" (UID: \"256362b2-f2b0-457a-beb7-12752bc16b41\") " pod="openshift-ingress/e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c"
Sep 08 07:23:54.035639 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:54.035618    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/256362b2-f2b0-457a-beb7-12752bc16b41-istio-envoy\") pod \"e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c\" (UID: \"256362b2-f2b0-457a-beb7-12752bc16b41\") " pod="openshift-ingress/e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c"
Sep 08 07:23:54.035732 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:54.035658    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/256362b2-f2b0-457a-beb7-12752bc16b41-workload-certs\") pod \"e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c\" (UID: \"256362b2-f2b0-457a-beb7-12752bc16b41\") " pod="openshift-ingress/e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c"
Sep 08 07:23:54.035732 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:54.035685    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/256362b2-f2b0-457a-beb7-12752bc16b41-istio-data\") pod \"e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c\" (UID: \"256362b2-f2b0-457a-beb7-12752bc16b41\") " pod="openshift-ingress/e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c"
Sep 08 07:23:54.035843 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:54.035764    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/256362b2-f2b0-457a-beb7-12752bc16b41-credential-socket\") pod \"e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c\" (UID: \"256362b2-f2b0-457a-beb7-12752bc16b41\") " pod="openshift-ingress/e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c"
Sep 08 07:23:54.035895 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:54.035867    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/256362b2-f2b0-457a-beb7-12752bc16b41-workload-socket\") pod \"e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c\" (UID: \"256362b2-f2b0-457a-beb7-12752bc16b41\") " pod="openshift-ingress/e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c"
Sep 08 07:23:54.035895 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:54.035880    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/256362b2-f2b0-457a-beb7-12752bc16b41-istiod-ca-cert\") pod \"e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c\" (UID: \"256362b2-f2b0-457a-beb7-12752bc16b41\") " pod="openshift-ingress/e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c"
Sep 08 07:23:54.036065 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:54.036036    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/256362b2-f2b0-457a-beb7-12752bc16b41-workload-certs\") pod \"e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c\" (UID: \"256362b2-f2b0-457a-beb7-12752bc16b41\") " pod="openshift-ingress/e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c"
Sep 08 07:23:54.037744 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:54.037727    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/256362b2-f2b0-457a-beb7-12752bc16b41-istio-envoy\") pod \"e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c\" (UID: \"256362b2-f2b0-457a-beb7-12752bc16b41\") " pod="openshift-ingress/e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c"
Sep 08 07:23:54.038053 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:54.038033    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/256362b2-f2b0-457a-beb7-12752bc16b41-istio-podinfo\") pod \"e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c\" (UID: \"256362b2-f2b0-457a-beb7-12752bc16b41\") " pod="openshift-ingress/e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c"
Sep 08 07:23:54.043233 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:54.043199    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/256362b2-f2b0-457a-beb7-12752bc16b41-istio-token\") pod \"e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c\" (UID: \"256362b2-f2b0-457a-beb7-12752bc16b41\") " pod="openshift-ingress/e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c"
Sep 08 07:23:54.043324 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:54.043253    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cvlh\" (UniqueName: \"kubernetes.io/projected/256362b2-f2b0-457a-beb7-12752bc16b41-kube-api-access-8cvlh\") pod \"e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c\" (UID: \"256362b2-f2b0-457a-beb7-12752bc16b41\") " pod="openshift-ingress/e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c"
Sep 08 07:23:54.170934 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:54.170847    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c"
Sep 08 07:23:54.447038 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:54.447007    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c"]
Sep 08 07:23:54.449543 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:23:54.449514    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod256362b2_f2b0_457a_beb7_12752bc16b41.slice/crio-321e5d4699b733bee0db1e1fd2b1773132373a80189f3bc15c758d666826db52 WatchSource:0}: Error finding container 321e5d4699b733bee0db1e1fd2b1773132373a80189f3bc15c758d666826db52: Status 404 returned error can't find the container with id 321e5d4699b733bee0db1e1fd2b1773132373a80189f3bc15c758d666826db52
Sep 08 07:23:54.451735 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:54.451700    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 07:23:54.451825 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:54.451773    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 07:23:54.451825 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:54.451804    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 07:23:54.527495 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:54.527457    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c" event={"ID":"256362b2-f2b0-457a-beb7-12752bc16b41","Type":"ContainerStarted","Data":"a7248397509d4192b32dcca099c05d8fd9f6c65c6276c04f579af8145cf83bd7"}
Sep 08 07:23:54.527625 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:54.527522    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c" event={"ID":"256362b2-f2b0-457a-beb7-12752bc16b41","Type":"ContainerStarted","Data":"321e5d4699b733bee0db1e1fd2b1773132373a80189f3bc15c758d666826db52"}
Sep 08 07:23:54.550013 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:54.549939    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c" podStartSLOduration=1.549918101 podStartE2EDuration="1.549918101s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:23:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:23:54.54806778 +0000 UTC m=+1182.529107114" watchObservedRunningTime="2026-09-08 07:23:54.549918101 +0000 UTC m=+1182.530957409"
Sep 08 07:23:55.171591 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:55.171556    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c"
Sep 08 07:23:55.176458 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:55.176428    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c"
Sep 08 07:23:55.534473 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:55.534445    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c"
Sep 08 07:23:55.535636 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:55.535613    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c"
Sep 08 07:23:56.327249 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:56.327213    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f"]
Sep 08 07:23:56.327870 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:56.327848    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1df8b5e5-e31d-4117-bd49-e5e508fc6a38" containerName="istio-proxy"
Sep 08 07:23:56.327939 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:56.327874    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="1df8b5e5-e31d-4117-bd49-e5e508fc6a38" containerName="istio-proxy"
Sep 08 07:23:56.331682 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:56.331658    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f"
Sep 08 07:23:56.333745 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:56.333723    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-fb59c2-openshift-default-dockercfg-ccfps\""
Sep 08 07:23:56.341649 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:56.341626    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f"]
Sep 08 07:23:56.455065 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:56.455020    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e-istio-token\") pod \"e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f\" (UID: \"d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e\") " pod="openshift-ingress/e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f"
Sep 08 07:23:56.455240 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:56.455073    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e-istiod-ca-cert\") pod \"e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f\" (UID: \"d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e\") " pod="openshift-ingress/e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f"
Sep 08 07:23:56.455240 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:56.455144    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e-workload-certs\") pod \"e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f\" (UID: \"d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e\") " pod="openshift-ingress/e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f"
Sep 08 07:23:56.455240 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:56.455188    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twcnw\" (UniqueName: \"kubernetes.io/projected/d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e-kube-api-access-twcnw\") pod \"e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f\" (UID: \"d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e\") " pod="openshift-ingress/e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f"
Sep 08 07:23:56.455240 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:56.455225    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e-credential-socket\") pod \"e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f\" (UID: \"d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e\") " pod="openshift-ingress/e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f"
Sep 08 07:23:56.455458 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:56.455281    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e-istio-data\") pod \"e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f\" (UID: \"d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e\") " pod="openshift-ingress/e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f"
Sep 08 07:23:56.455458 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:56.455323    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e-istio-podinfo\") pod \"e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f\" (UID: \"d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e\") " pod="openshift-ingress/e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f"
Sep 08 07:23:56.455458 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:56.455365    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e-workload-socket\") pod \"e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f\" (UID: \"d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e\") " pod="openshift-ingress/e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f"
Sep 08 07:23:56.455576 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:56.455458    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e-istio-envoy\") pod \"e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f\" (UID: \"d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e\") " pod="openshift-ingress/e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f"
Sep 08 07:23:56.556252 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:56.556222    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e-istio-envoy\") pod \"e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f\" (UID: \"d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e\") " pod="openshift-ingress/e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f"
Sep 08 07:23:56.556421 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:56.556270    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e-istio-token\") pod \"e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f\" (UID: \"d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e\") " pod="openshift-ingress/e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f"
Sep 08 07:23:56.556421 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:56.556388    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e-istiod-ca-cert\") pod \"e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f\" (UID: \"d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e\") " pod="openshift-ingress/e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f"
Sep 08 07:23:56.556493 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:56.556446    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e-workload-certs\") pod \"e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f\" (UID: \"d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e\") " pod="openshift-ingress/e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f"
Sep 08 07:23:56.556534 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:56.556497    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twcnw\" (UniqueName: \"kubernetes.io/projected/d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e-kube-api-access-twcnw\") pod \"e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f\" (UID: \"d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e\") " pod="openshift-ingress/e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f"
Sep 08 07:23:56.556592 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:56.556554    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e-credential-socket\") pod \"e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f\" (UID: \"d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e\") " pod="openshift-ingress/e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f"
Sep 08 07:23:56.556645 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:56.556596    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e-istio-data\") pod \"e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f\" (UID: \"d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e\") " pod="openshift-ingress/e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f"
Sep 08 07:23:56.556645 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:56.556632    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e-istio-podinfo\") pod \"e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f\" (UID: \"d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e\") " pod="openshift-ingress/e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f"
Sep 08 07:23:56.556782 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:56.556671    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e-workload-socket\") pod \"e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f\" (UID: \"d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e\") " pod="openshift-ingress/e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f"
Sep 08 07:23:56.556870 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:56.556844    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e-workload-certs\") pod \"e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f\" (UID: \"d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e\") " pod="openshift-ingress/e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f"
Sep 08 07:23:56.556987 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:56.556940    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e-istio-data\") pod \"e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f\" (UID: \"d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e\") " pod="openshift-ingress/e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f"
Sep 08 07:23:56.557211 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:56.557186    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e-istiod-ca-cert\") pod \"e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f\" (UID: \"d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e\") " pod="openshift-ingress/e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f"
Sep 08 07:23:56.557273 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:56.557231    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e-workload-socket\") pod \"e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f\" (UID: \"d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e\") " pod="openshift-ingress/e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f"
Sep 08 07:23:56.557319 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:56.557290    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e-credential-socket\") pod \"e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f\" (UID: \"d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e\") " pod="openshift-ingress/e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f"
Sep 08 07:23:56.558668 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:56.558650    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e-istio-envoy\") pod \"e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f\" (UID: \"d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e\") " pod="openshift-ingress/e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f"
Sep 08 07:23:56.559229 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:56.559208    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e-istio-podinfo\") pod \"e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f\" (UID: \"d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e\") " pod="openshift-ingress/e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f"
Sep 08 07:23:56.563963 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:56.563932    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-twcnw\" (UniqueName: \"kubernetes.io/projected/d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e-kube-api-access-twcnw\") pod \"e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f\" (UID: \"d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e\") " pod="openshift-ingress/e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f"
Sep 08 07:23:56.564143 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:56.564092    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e-istio-token\") pod \"e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f\" (UID: \"d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e\") " pod="openshift-ingress/e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f"
Sep 08 07:23:56.644842 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:56.644764    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f"
Sep 08 07:23:56.921005 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:56.920957    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f"]
Sep 08 07:23:56.922715 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:23:56.922682    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1b07f2f_4e5e_4a67_a895_88c1f0c9f21e.slice/crio-3a8f0ce2d33d6fc2206863da34c983ba50dcdc9ba565472e97d7e0a4724b9b61 WatchSource:0}: Error finding container 3a8f0ce2d33d6fc2206863da34c983ba50dcdc9ba565472e97d7e0a4724b9b61: Status 404 returned error can't find the container with id 3a8f0ce2d33d6fc2206863da34c983ba50dcdc9ba565472e97d7e0a4724b9b61
Sep 08 07:23:56.924854 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:56.924817    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 07:23:56.924912 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:56.924886    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 07:23:56.924953 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:56.924916    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 07:23:57.545395 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:57.545358    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f" event={"ID":"d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e","Type":"ContainerStarted","Data":"34bd0fc8d58d6bc9140e8b2e22e88be4ebefc2cdf76acd97fca464154623ff38"}
Sep 08 07:23:57.545797 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:57.545418    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f" event={"ID":"d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e","Type":"ContainerStarted","Data":"3a8f0ce2d33d6fc2206863da34c983ba50dcdc9ba565472e97d7e0a4724b9b61"}
Sep 08 07:23:57.565045 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:57.564959    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f" podStartSLOduration=1.564940218 podStartE2EDuration="1.564940218s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:23:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:23:57.563904044 +0000 UTC m=+1185.544943384" watchObservedRunningTime="2026-09-08 07:23:57.564940218 +0000 UTC m=+1185.545979585"
Sep 08 07:23:57.576146 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:57.576050    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-37abc6-5c848b8ff-7zlg2"]
Sep 08 07:23:57.580323 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:57.580303    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-37abc6-5c848b8ff-7zlg2"
Sep 08 07:23:57.586945 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:57.586712    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-37abc6-serving-cert\""
Sep 08 07:23:57.592210 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:57.591946    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-37abc6-5c848b8ff-7zlg2"]
Sep 08 07:23:57.645370 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:57.645328    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f"
Sep 08 07:23:57.646818 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:57.646793    2564 patch_prober.go:28] interesting pod/e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Sep 08 07:23:57.647052 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:57.647023    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f" podUID="d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Sep 08 07:23:57.668534 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:57.668502    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa179a28-3241-4355-a099-e65a72fdea00-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-37abc6-5c848b8ff-7zlg2\" (UID: \"fa179a28-3241-4355-a099-e65a72fdea00\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-37abc6-5c848b8ff-7zlg2"
Sep 08 07:23:57.668652 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:57.668634    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa179a28-3241-4355-a099-e65a72fdea00-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-37abc6-5c848b8ff-7zlg2\" (UID: \"fa179a28-3241-4355-a099-e65a72fdea00\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-37abc6-5c848b8ff-7zlg2"
Sep 08 07:23:57.668717 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:57.668669    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa179a28-3241-4355-a099-e65a72fdea00-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-37abc6-5c848b8ff-7zlg2\" (UID: \"fa179a28-3241-4355-a099-e65a72fdea00\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-37abc6-5c848b8ff-7zlg2"
Sep 08 07:23:57.668717 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:57.668694    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dc7jh\" (UniqueName: \"kubernetes.io/projected/fa179a28-3241-4355-a099-e65a72fdea00-kube-api-access-dc7jh\") pod \"maas-api-e2e-shared-a-w2-37abc6-5c848b8ff-7zlg2\" (UID: \"fa179a28-3241-4355-a099-e65a72fdea00\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-37abc6-5c848b8ff-7zlg2"
Sep 08 07:23:57.770240 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:57.770196    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa179a28-3241-4355-a099-e65a72fdea00-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-37abc6-5c848b8ff-7zlg2\" (UID: \"fa179a28-3241-4355-a099-e65a72fdea00\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-37abc6-5c848b8ff-7zlg2"
Sep 08 07:23:57.770408 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:57.770249    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa179a28-3241-4355-a099-e65a72fdea00-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-37abc6-5c848b8ff-7zlg2\" (UID: \"fa179a28-3241-4355-a099-e65a72fdea00\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-37abc6-5c848b8ff-7zlg2"
Sep 08 07:23:57.770408 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:57.770274    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa179a28-3241-4355-a099-e65a72fdea00-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-37abc6-5c848b8ff-7zlg2\" (UID: \"fa179a28-3241-4355-a099-e65a72fdea00\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-37abc6-5c848b8ff-7zlg2"
Sep 08 07:23:57.770408 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:57.770294    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dc7jh\" (UniqueName: \"kubernetes.io/projected/fa179a28-3241-4355-a099-e65a72fdea00-kube-api-access-dc7jh\") pod \"maas-api-e2e-shared-a-w2-37abc6-5c848b8ff-7zlg2\" (UID: \"fa179a28-3241-4355-a099-e65a72fdea00\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-37abc6-5c848b8ff-7zlg2"
Sep 08 07:23:57.770569 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:23:57.770421    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-37abc6-serving-cert: secret "maas-api-e2e-shared-a-w2-37abc6-serving-cert" not found
Sep 08 07:23:57.770569 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:23:57.770502    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa179a28-3241-4355-a099-e65a72fdea00-maas-api-tls podName:fa179a28-3241-4355-a099-e65a72fdea00 nodeName:}" failed. No retries permitted until 2026-09-08 07:23:58.270480473 +0000 UTC m=+1186.251519761 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/fa179a28-3241-4355-a099-e65a72fdea00-maas-api-tls") pod "maas-api-e2e-shared-a-w2-37abc6-5c848b8ff-7zlg2" (UID: "fa179a28-3241-4355-a099-e65a72fdea00") : secret "maas-api-e2e-shared-a-w2-37abc6-serving-cert" not found
Sep 08 07:23:57.771005 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:57.770983    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa179a28-3241-4355-a099-e65a72fdea00-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-37abc6-5c848b8ff-7zlg2\" (UID: \"fa179a28-3241-4355-a099-e65a72fdea00\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-37abc6-5c848b8ff-7zlg2"
Sep 08 07:23:57.772823 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:57.772794    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa179a28-3241-4355-a099-e65a72fdea00-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-37abc6-5c848b8ff-7zlg2\" (UID: \"fa179a28-3241-4355-a099-e65a72fdea00\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-37abc6-5c848b8ff-7zlg2"
Sep 08 07:23:57.778021 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:57.777996    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dc7jh\" (UniqueName: \"kubernetes.io/projected/fa179a28-3241-4355-a099-e65a72fdea00-kube-api-access-dc7jh\") pod \"maas-api-e2e-shared-a-w2-37abc6-5c848b8ff-7zlg2\" (UID: \"fa179a28-3241-4355-a099-e65a72fdea00\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-37abc6-5c848b8ff-7zlg2"
Sep 08 07:23:58.276765 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:58.276726    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa179a28-3241-4355-a099-e65a72fdea00-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-37abc6-5c848b8ff-7zlg2\" (UID: \"fa179a28-3241-4355-a099-e65a72fdea00\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-37abc6-5c848b8ff-7zlg2"
Sep 08 07:23:58.279052 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:58.279030    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa179a28-3241-4355-a099-e65a72fdea00-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-37abc6-5c848b8ff-7zlg2\" (UID: \"fa179a28-3241-4355-a099-e65a72fdea00\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-37abc6-5c848b8ff-7zlg2"
Sep 08 07:23:58.509656 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:58.509620    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-37abc6-5c848b8ff-7zlg2"
Sep 08 07:23:58.648948 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:58.648916    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f"
Sep 08 07:23:58.789726 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:58.789694    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-37abc6-5c848b8ff-7zlg2"]
Sep 08 07:23:58.795773 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:58.795741    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 07:23:59.558264 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:59.558220    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-37abc6-5c848b8ff-7zlg2" event={"ID":"fa179a28-3241-4355-a099-e65a72fdea00","Type":"ContainerStarted","Data":"eae4be1949782791be064b42a24b15469cb44ce9a24ce1e2dee6881d2b36b183"}
Sep 08 07:23:59.558445 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:59.558429    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-37abc6-5c848b8ff-7zlg2"
Sep 08 07:23:59.558504 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:59.558460    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-37abc6-5c848b8ff-7zlg2" event={"ID":"fa179a28-3241-4355-a099-e65a72fdea00","Type":"ContainerStarted","Data":"c35e4904b7dedadb7c5d84f7acef4fc46db6f18e32496536ecd8242a7368ca46"}
Sep 08 07:23:59.558504 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:59.558479    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f"
Sep 08 07:23:59.559422 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:59.559403    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f"
Sep 08 07:23:59.578837 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:23:59.578790    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-37abc6-5c848b8ff-7zlg2" podStartSLOduration=2.11926815 podStartE2EDuration="2.578774819s" totalImagesPullingTime="459.506669ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:23:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:23:59.57689056 +0000 UTC m=+1187.557929889" watchObservedRunningTime="2026-09-08 07:23:59.578774819 +0000 UTC m=+1187.559814125"
Sep 08 07:24:00.561783 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:00.561004    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-fb59c2-86f4b8db49-lccl7"]
Sep 08 07:24:00.565576 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:00.565552    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-fb59c2-86f4b8db49-lccl7"
Sep 08 07:24:00.567536 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:00.567511    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w3-fb59c2-serving-cert\""
Sep 08 07:24:00.576047 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:00.576027    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-fb59c2-86f4b8db49-lccl7"]
Sep 08 07:24:00.712304 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:00.712259    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmhv8\" (UniqueName: \"kubernetes.io/projected/fff106e5-8dd2-430b-ae60-1c2341eebe6a-kube-api-access-gmhv8\") pod \"maas-api-e2e-shared-a-w3-fb59c2-86f4b8db49-lccl7\" (UID: \"fff106e5-8dd2-430b-ae60-1c2341eebe6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-fb59c2-86f4b8db49-lccl7"
Sep 08 07:24:00.712456 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:00.712363    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fff106e5-8dd2-430b-ae60-1c2341eebe6a-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-fb59c2-86f4b8db49-lccl7\" (UID: \"fff106e5-8dd2-430b-ae60-1c2341eebe6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-fb59c2-86f4b8db49-lccl7"
Sep 08 07:24:00.712456 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:00.712446    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fff106e5-8dd2-430b-ae60-1c2341eebe6a-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-fb59c2-86f4b8db49-lccl7\" (UID: \"fff106e5-8dd2-430b-ae60-1c2341eebe6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-fb59c2-86f4b8db49-lccl7"
Sep 08 07:24:00.712853 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:00.712805    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fff106e5-8dd2-430b-ae60-1c2341eebe6a-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-fb59c2-86f4b8db49-lccl7\" (UID: \"fff106e5-8dd2-430b-ae60-1c2341eebe6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-fb59c2-86f4b8db49-lccl7"
Sep 08 07:24:00.814370 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:00.814278    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fff106e5-8dd2-430b-ae60-1c2341eebe6a-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-fb59c2-86f4b8db49-lccl7\" (UID: \"fff106e5-8dd2-430b-ae60-1c2341eebe6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-fb59c2-86f4b8db49-lccl7"
Sep 08 07:24:00.814532 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:00.814384    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmhv8\" (UniqueName: \"kubernetes.io/projected/fff106e5-8dd2-430b-ae60-1c2341eebe6a-kube-api-access-gmhv8\") pod \"maas-api-e2e-shared-a-w3-fb59c2-86f4b8db49-lccl7\" (UID: \"fff106e5-8dd2-430b-ae60-1c2341eebe6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-fb59c2-86f4b8db49-lccl7"
Sep 08 07:24:00.814532 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:00.814427    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fff106e5-8dd2-430b-ae60-1c2341eebe6a-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-fb59c2-86f4b8db49-lccl7\" (UID: \"fff106e5-8dd2-430b-ae60-1c2341eebe6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-fb59c2-86f4b8db49-lccl7"
Sep 08 07:24:00.814532 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:00.814471    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fff106e5-8dd2-430b-ae60-1c2341eebe6a-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-fb59c2-86f4b8db49-lccl7\" (UID: \"fff106e5-8dd2-430b-ae60-1c2341eebe6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-fb59c2-86f4b8db49-lccl7"
Sep 08 07:24:00.815321 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:00.815293    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fff106e5-8dd2-430b-ae60-1c2341eebe6a-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-fb59c2-86f4b8db49-lccl7\" (UID: \"fff106e5-8dd2-430b-ae60-1c2341eebe6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-fb59c2-86f4b8db49-lccl7"
Sep 08 07:24:00.817393 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:00.817314    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fff106e5-8dd2-430b-ae60-1c2341eebe6a-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-fb59c2-86f4b8db49-lccl7\" (UID: \"fff106e5-8dd2-430b-ae60-1c2341eebe6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-fb59c2-86f4b8db49-lccl7"
Sep 08 07:24:00.817497 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:00.817393    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fff106e5-8dd2-430b-ae60-1c2341eebe6a-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-fb59c2-86f4b8db49-lccl7\" (UID: \"fff106e5-8dd2-430b-ae60-1c2341eebe6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-fb59c2-86f4b8db49-lccl7"
Sep 08 07:24:00.822094 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:00.822071    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmhv8\" (UniqueName: \"kubernetes.io/projected/fff106e5-8dd2-430b-ae60-1c2341eebe6a-kube-api-access-gmhv8\") pod \"maas-api-e2e-shared-a-w3-fb59c2-86f4b8db49-lccl7\" (UID: \"fff106e5-8dd2-430b-ae60-1c2341eebe6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-fb59c2-86f4b8db49-lccl7"
Sep 08 07:24:00.879741 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:00.879707    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-fb59c2-86f4b8db49-lccl7"
Sep 08 07:24:01.156626 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:01.156504    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-fb59c2-86f4b8db49-lccl7"]
Sep 08 07:24:01.159117 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:24:01.159090    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfff106e5_8dd2_430b_ae60_1c2341eebe6a.slice/crio-5b21ad50622dafd5305e097ac268af65542953fc542fa9ee901be75ab96511c8 WatchSource:0}: Error finding container 5b21ad50622dafd5305e097ac268af65542953fc542fa9ee901be75ab96511c8: Status 404 returned error can't find the container with id 5b21ad50622dafd5305e097ac268af65542953fc542fa9ee901be75ab96511c8
Sep 08 07:24:01.573043 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:01.572951    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-fb59c2-86f4b8db49-lccl7" event={"ID":"fff106e5-8dd2-430b-ae60-1c2341eebe6a","Type":"ContainerStarted","Data":"5b21ad50622dafd5305e097ac268af65542953fc542fa9ee901be75ab96511c8"}
Sep 08 07:24:02.579752 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:02.579713    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-fb59c2-86f4b8db49-lccl7" event={"ID":"fff106e5-8dd2-430b-ae60-1c2341eebe6a","Type":"ContainerStarted","Data":"fe76bf3b9e24c16894a4c7b33b40ae5df22a14f5e83613cfb8ee7d7931d16d87"}
Sep 08 07:24:02.580159 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:02.579784    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-fb59c2-86f4b8db49-lccl7"
Sep 08 07:24:02.596483 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:02.596427    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-fb59c2-86f4b8db49-lccl7" podStartSLOduration=2.249457064 podStartE2EDuration="2.59640852s" totalImagesPullingTime="346.951456ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:24:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:24:02.595228463 +0000 UTC m=+1190.576267787" watchObservedRunningTime="2026-09-08 07:24:02.59640852 +0000 UTC m=+1190.577447836"
Sep 08 07:24:02.645516 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:02.645479    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:24:05.572549 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:05.572515    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-37abc6-5c848b8ff-7zlg2"
Sep 08 07:24:08.598283 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:08.598246    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-fb59c2-86f4b8db49-lccl7"
Sep 08 07:24:11.578121 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:11.578080    2564 patch_prober.go:28] interesting pod/e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 08 07:24:11.578574 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:11.578176    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c" podUID="256362b2-f2b0-457a-beb7-12752bc16b41" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 08 07:24:12.562230 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:12.562192    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-8d4lx_5cf68f79-8fda-42e2-92c1-05a5a601f505/console-operator/1.log"
Sep 08 07:24:12.562498 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:12.562471    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-8d4lx_5cf68f79-8fda-42e2-92c1-05a5a601f505/console-operator/1.log"
Sep 08 07:24:13.660591 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:13.660557    2564 generic.go:356] "Generic (PLEG): container finished" podID="256362b2-f2b0-457a-beb7-12752bc16b41" containerID="a7248397509d4192b32dcca099c05d8fd9f6c65c6276c04f579af8145cf83bd7" exitCode=0
Sep 08 07:24:13.661031 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:13.660589    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c" event={"ID":"256362b2-f2b0-457a-beb7-12752bc16b41","Type":"ContainerDied","Data":"a7248397509d4192b32dcca099c05d8fd9f6c65c6276c04f579af8145cf83bd7"}
Sep 08 07:24:13.661246 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:13.661226    2564 scope.go:117] "RemoveContainer" containerID="a7248397509d4192b32dcca099c05d8fd9f6c65c6276c04f579af8145cf83bd7"
Sep 08 07:24:13.662359 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:13.662333    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 07:24:13.662420 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:13.662395    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 07:24:13.662459 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:13.662430    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 07:24:14.560251 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:14.560219    2564 patch_prober.go:28] interesting pod/e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Sep 08 07:24:14.560488 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:14.560276    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f" podUID="d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Sep 08 07:24:14.667812 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:14.667775    2564 generic.go:356] "Generic (PLEG): container finished" podID="d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e" containerID="34bd0fc8d58d6bc9140e8b2e22e88be4ebefc2cdf76acd97fca464154623ff38" exitCode=0
Sep 08 07:24:14.668275 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:14.667838    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f" event={"ID":"d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e","Type":"ContainerDied","Data":"34bd0fc8d58d6bc9140e8b2e22e88be4ebefc2cdf76acd97fca464154623ff38"}
Sep 08 07:24:14.668399 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:14.668382    2564 scope.go:117] "RemoveContainer" containerID="34bd0fc8d58d6bc9140e8b2e22e88be4ebefc2cdf76acd97fca464154623ff38"
Sep 08 07:24:14.669597 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:14.669562    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 07:24:14.669723 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:14.669659    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 07:24:14.669723 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:14.669707    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 07:24:14.670045 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:14.670019    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c" event={"ID":"256362b2-f2b0-457a-beb7-12752bc16b41","Type":"ContainerStarted","Data":"43847637875f736084fe5c8755c44750180dd7f063774872ec1d60f95ba89618"}
Sep 08 07:24:15.171608 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:15.171576    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c"
Sep 08 07:24:15.171786 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:15.171620    2564 patch_prober.go:28] interesting pod/e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 08 07:24:15.171786 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:15.171667    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c" podUID="256362b2-f2b0-457a-beb7-12752bc16b41" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 08 07:24:15.677229 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:15.677196    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f" event={"ID":"d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e","Type":"ContainerStarted","Data":"1edd89d9fa359e2268c11d27d35830f401b0ea53d43ee22e58d80b6d8f09440b"}
Sep 08 07:24:16.172121 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:16.172077    2564 patch_prober.go:28] interesting pod/e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 08 07:24:16.172289 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:16.172136    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c" podUID="256362b2-f2b0-457a-beb7-12752bc16b41" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 08 07:24:16.645620 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:16.645578    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f"
Sep 08 07:24:16.645997 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:16.645947    2564 patch_prober.go:28] interesting pod/e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Sep 08 07:24:16.646102 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:16.646049    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f" podUID="d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Sep 08 07:24:17.171636 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:17.171596    2564 patch_prober.go:28] interesting pod/e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 08 07:24:17.172065 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:17.171676    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c" podUID="256362b2-f2b0-457a-beb7-12752bc16b41" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 08 07:24:17.645881 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:17.645840    2564 patch_prober.go:28] interesting pod/e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Sep 08 07:24:17.646111 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:17.645897    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f" podUID="d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Sep 08 07:24:18.171426 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:18.171377    2564 patch_prober.go:28] interesting pod/e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 08 07:24:18.171597 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:18.171448    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c" podUID="256362b2-f2b0-457a-beb7-12752bc16b41" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 08 07:24:18.645533 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:18.645494    2564 patch_prober.go:28] interesting pod/e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Sep 08 07:24:18.645919 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:18.645548    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f" podUID="d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Sep 08 07:24:19.171594 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:19.171550    2564 patch_prober.go:28] interesting pod/e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 08 07:24:19.171809 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:19.171615    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c" podUID="256362b2-f2b0-457a-beb7-12752bc16b41" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 08 07:24:19.645302 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:19.645266    2564 patch_prober.go:28] interesting pod/e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Sep 08 07:24:19.645500 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:19.645323    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f" podUID="d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Sep 08 07:24:20.175324 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:20.175289    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c"
Sep 08 07:24:20.175733 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:20.175552    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c"
Sep 08 07:24:20.176267 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:20.176251    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c"
Sep 08 07:24:20.646234 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:20.646197    2564 patch_prober.go:28] interesting pod/e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Sep 08 07:24:20.646404 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:20.646265    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f" podUID="d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Sep 08 07:24:21.648926 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:21.648890    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f"
Sep 08 07:24:21.649347 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:21.649268    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f"
Sep 08 07:24:21.649905 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:21.649887    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f"
Sep 08 07:24:24.926390 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:24.926349    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj"]
Sep 08 07:24:24.931997 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:24.931950    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj"
Sep 08 07:24:24.934071 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:24.934048    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-217bc2-openshift-default-dockercfg-vhpg6\""
Sep 08 07:24:24.941509 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:24.941478    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj"]
Sep 08 07:24:25.063443 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:25.063391    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba-istio-envoy\") pod \"e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj\" (UID: \"4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba\") " pod="openshift-ingress/e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj"
Sep 08 07:24:25.063641 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:25.063458    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba-workload-certs\") pod \"e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj\" (UID: \"4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba\") " pod="openshift-ingress/e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj"
Sep 08 07:24:25.063641 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:25.063525    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba-istio-podinfo\") pod \"e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj\" (UID: \"4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba\") " pod="openshift-ingress/e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj"
Sep 08 07:24:25.063641 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:25.063550    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrv5d\" (UniqueName: \"kubernetes.io/projected/4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba-kube-api-access-wrv5d\") pod \"e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj\" (UID: \"4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba\") " pod="openshift-ingress/e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj"
Sep 08 07:24:25.063641 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:25.063582    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba-workload-socket\") pod \"e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj\" (UID: \"4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba\") " pod="openshift-ingress/e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj"
Sep 08 07:24:25.063641 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:25.063611    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba-istio-data\") pod \"e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj\" (UID: \"4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba\") " pod="openshift-ingress/e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj"
Sep 08 07:24:25.063887 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:25.063658    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba-istio-token\") pod \"e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj\" (UID: \"4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba\") " pod="openshift-ingress/e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj"
Sep 08 07:24:25.063887 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:25.063693    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba-istiod-ca-cert\") pod \"e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj\" (UID: \"4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba\") " pod="openshift-ingress/e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj"
Sep 08 07:24:25.063887 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:25.063746    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba-credential-socket\") pod \"e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj\" (UID: \"4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba\") " pod="openshift-ingress/e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj"
Sep 08 07:24:25.165078 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:25.165038    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba-istio-podinfo\") pod \"e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj\" (UID: \"4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba\") " pod="openshift-ingress/e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj"
Sep 08 07:24:25.165078 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:25.165080    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrv5d\" (UniqueName: \"kubernetes.io/projected/4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba-kube-api-access-wrv5d\") pod \"e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj\" (UID: \"4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba\") " pod="openshift-ingress/e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj"
Sep 08 07:24:25.165352 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:25.165102    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba-workload-socket\") pod \"e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj\" (UID: \"4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba\") " pod="openshift-ingress/e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj"
Sep 08 07:24:25.165352 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:25.165132    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba-istio-data\") pod \"e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj\" (UID: \"4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba\") " pod="openshift-ingress/e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj"
Sep 08 07:24:25.165352 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:25.165163    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba-istio-token\") pod \"e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj\" (UID: \"4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba\") " pod="openshift-ingress/e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj"
Sep 08 07:24:25.165352 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:25.165190    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba-istiod-ca-cert\") pod \"e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj\" (UID: \"4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba\") " pod="openshift-ingress/e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj"
Sep 08 07:24:25.165352 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:25.165229    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba-credential-socket\") pod \"e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj\" (UID: \"4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba\") " pod="openshift-ingress/e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj"
Sep 08 07:24:25.165352 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:25.165284    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba-istio-envoy\") pod \"e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj\" (UID: \"4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba\") " pod="openshift-ingress/e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj"
Sep 08 07:24:25.165352 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:25.165334    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba-workload-certs\") pod \"e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj\" (UID: \"4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba\") " pod="openshift-ingress/e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj"
Sep 08 07:24:25.165684 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:25.165563    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba-workload-socket\") pod \"e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj\" (UID: \"4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba\") " pod="openshift-ingress/e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj"
Sep 08 07:24:25.165684 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:25.165589    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba-istio-data\") pod \"e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj\" (UID: \"4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba\") " pod="openshift-ingress/e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj"
Sep 08 07:24:25.165684 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:25.165650    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba-credential-socket\") pod \"e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj\" (UID: \"4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba\") " pod="openshift-ingress/e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj"
Sep 08 07:24:25.165786 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:25.165697    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba-workload-certs\") pod \"e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj\" (UID: \"4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba\") " pod="openshift-ingress/e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj"
Sep 08 07:24:25.166174 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:25.166152    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba-istiod-ca-cert\") pod \"e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj\" (UID: \"4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba\") " pod="openshift-ingress/e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj"
Sep 08 07:24:25.167551 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:25.167533    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba-istio-envoy\") pod \"e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj\" (UID: \"4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba\") " pod="openshift-ingress/e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj"
Sep 08 07:24:25.168049 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:25.168027    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba-istio-podinfo\") pod \"e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj\" (UID: \"4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba\") " pod="openshift-ingress/e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj"
Sep 08 07:24:25.172340 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:25.172313    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrv5d\" (UniqueName: \"kubernetes.io/projected/4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba-kube-api-access-wrv5d\") pod \"e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj\" (UID: \"4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba\") " pod="openshift-ingress/e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj"
Sep 08 07:24:25.172726 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:25.172706    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba-istio-token\") pod \"e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj\" (UID: \"4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba\") " pod="openshift-ingress/e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj"
Sep 08 07:24:25.245419 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:25.245334    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj"
Sep 08 07:24:25.527417 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:25.527382    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj"]
Sep 08 07:24:25.528525 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:24:25.528501    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a383f7a_c5c9_4f84_b1fc_35b1bcfb32ba.slice/crio-4ca7bf54d47906b317583f4349016144b8458395dc3f292be488aa0d1c27a0df WatchSource:0}: Error finding container 4ca7bf54d47906b317583f4349016144b8458395dc3f292be488aa0d1c27a0df: Status 404 returned error can't find the container with id 4ca7bf54d47906b317583f4349016144b8458395dc3f292be488aa0d1c27a0df
Sep 08 07:24:25.530909 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:25.530879    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 07:24:25.530987 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:25.530956    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 07:24:25.531031 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:25.531004    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 07:24:25.749121 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:25.749081    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj" event={"ID":"4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba","Type":"ContainerStarted","Data":"54baf852f305aba9bb6ee842f78360ba579b6c6d014d60f388984be7cd242ef4"}
Sep 08 07:24:25.749294 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:25.749157    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj" event={"ID":"4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba","Type":"ContainerStarted","Data":"4ca7bf54d47906b317583f4349016144b8458395dc3f292be488aa0d1c27a0df"}
Sep 08 07:24:25.768669 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:25.768614    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj" podStartSLOduration=1.76859821 podStartE2EDuration="1.76859821s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:24:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:24:25.766712171 +0000 UTC m=+1213.747751495" watchObservedRunningTime="2026-09-08 07:24:25.76859821 +0000 UTC m=+1213.749637563"
Sep 08 07:24:26.135271 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:26.135222    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-0ca807-6785f9cb5f-tr8c4"]
Sep 08 07:24:26.139564 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:26.139540    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-0ca807-6785f9cb5f-tr8c4"
Sep 08 07:24:26.141507 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:26.141479    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-0ca807-serving-cert\""
Sep 08 07:24:26.150044 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:26.146990    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-0ca807-6785f9cb5f-tr8c4"]
Sep 08 07:24:26.246178 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:26.246139    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj"
Sep 08 07:24:26.247665 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:26.247637    2564 patch_prober.go:28] interesting pod/e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 08 07:24:26.247786 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:26.247694    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj" podUID="4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 08 07:24:26.275170 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:26.275139    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9b2xz\" (UniqueName: \"kubernetes.io/projected/7a190a8c-54b7-404a-8437-6b29e11c549d-kube-api-access-9b2xz\") pod \"maas-api-e2e-shared-b-w2-0ca807-6785f9cb5f-tr8c4\" (UID: \"7a190a8c-54b7-404a-8437-6b29e11c549d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-0ca807-6785f9cb5f-tr8c4"
Sep 08 07:24:26.275349 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:26.275186    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a190a8c-54b7-404a-8437-6b29e11c549d-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-0ca807-6785f9cb5f-tr8c4\" (UID: \"7a190a8c-54b7-404a-8437-6b29e11c549d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-0ca807-6785f9cb5f-tr8c4"
Sep 08 07:24:26.275349 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:26.275241    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a190a8c-54b7-404a-8437-6b29e11c549d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-0ca807-6785f9cb5f-tr8c4\" (UID: \"7a190a8c-54b7-404a-8437-6b29e11c549d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-0ca807-6785f9cb5f-tr8c4"
Sep 08 07:24:26.275349 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:26.275292    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a190a8c-54b7-404a-8437-6b29e11c549d-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-0ca807-6785f9cb5f-tr8c4\" (UID: \"7a190a8c-54b7-404a-8437-6b29e11c549d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-0ca807-6785f9cb5f-tr8c4"
Sep 08 07:24:26.375910 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:26.375870    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9b2xz\" (UniqueName: \"kubernetes.io/projected/7a190a8c-54b7-404a-8437-6b29e11c549d-kube-api-access-9b2xz\") pod \"maas-api-e2e-shared-b-w2-0ca807-6785f9cb5f-tr8c4\" (UID: \"7a190a8c-54b7-404a-8437-6b29e11c549d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-0ca807-6785f9cb5f-tr8c4"
Sep 08 07:24:26.375910 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:26.375916    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a190a8c-54b7-404a-8437-6b29e11c549d-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-0ca807-6785f9cb5f-tr8c4\" (UID: \"7a190a8c-54b7-404a-8437-6b29e11c549d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-0ca807-6785f9cb5f-tr8c4"
Sep 08 07:24:26.376183 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:26.375948    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a190a8c-54b7-404a-8437-6b29e11c549d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-0ca807-6785f9cb5f-tr8c4\" (UID: \"7a190a8c-54b7-404a-8437-6b29e11c549d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-0ca807-6785f9cb5f-tr8c4"
Sep 08 07:24:26.376183 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:26.376020    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a190a8c-54b7-404a-8437-6b29e11c549d-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-0ca807-6785f9cb5f-tr8c4\" (UID: \"7a190a8c-54b7-404a-8437-6b29e11c549d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-0ca807-6785f9cb5f-tr8c4"
Sep 08 07:24:26.376183 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:24:26.376142    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-0ca807-serving-cert: secret "maas-api-e2e-shared-b-w2-0ca807-serving-cert" not found
Sep 08 07:24:26.376353 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:24:26.376214    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a190a8c-54b7-404a-8437-6b29e11c549d-maas-api-tls podName:7a190a8c-54b7-404a-8437-6b29e11c549d nodeName:}" failed. No retries permitted until 2026-09-08 07:24:26.876193444 +0000 UTC m=+1214.857232742 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7a190a8c-54b7-404a-8437-6b29e11c549d-maas-api-tls") pod "maas-api-e2e-shared-b-w2-0ca807-6785f9cb5f-tr8c4" (UID: "7a190a8c-54b7-404a-8437-6b29e11c549d") : secret "maas-api-e2e-shared-b-w2-0ca807-serving-cert" not found
Sep 08 07:24:26.376810 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:26.376786    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a190a8c-54b7-404a-8437-6b29e11c549d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-0ca807-6785f9cb5f-tr8c4\" (UID: \"7a190a8c-54b7-404a-8437-6b29e11c549d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-0ca807-6785f9cb5f-tr8c4"
Sep 08 07:24:26.378353 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:26.378330    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a190a8c-54b7-404a-8437-6b29e11c549d-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-0ca807-6785f9cb5f-tr8c4\" (UID: \"7a190a8c-54b7-404a-8437-6b29e11c549d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-0ca807-6785f9cb5f-tr8c4"
Sep 08 07:24:26.383819 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:26.383799    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9b2xz\" (UniqueName: \"kubernetes.io/projected/7a190a8c-54b7-404a-8437-6b29e11c549d-kube-api-access-9b2xz\") pod \"maas-api-e2e-shared-b-w2-0ca807-6785f9cb5f-tr8c4\" (UID: \"7a190a8c-54b7-404a-8437-6b29e11c549d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-0ca807-6785f9cb5f-tr8c4"
Sep 08 07:24:26.880998 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:26.880945    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a190a8c-54b7-404a-8437-6b29e11c549d-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-0ca807-6785f9cb5f-tr8c4\" (UID: \"7a190a8c-54b7-404a-8437-6b29e11c549d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-0ca807-6785f9cb5f-tr8c4"
Sep 08 07:24:26.883743 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:26.883717    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a190a8c-54b7-404a-8437-6b29e11c549d-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-0ca807-6785f9cb5f-tr8c4\" (UID: \"7a190a8c-54b7-404a-8437-6b29e11c549d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-0ca807-6785f9cb5f-tr8c4"
Sep 08 07:24:27.055211 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:27.055172    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-0ca807-6785f9cb5f-tr8c4"
Sep 08 07:24:27.249894 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:27.249818    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj"
Sep 08 07:24:27.329859 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:27.329836    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-0ca807-6785f9cb5f-tr8c4"]
Sep 08 07:24:27.331730 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:24:27.331700    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a190a8c_54b7_404a_8437_6b29e11c549d.slice/crio-4e79b2cc8baf320e7c29ad1402bb31d8877318a6fd1a463bfc741f79802087ec WatchSource:0}: Error finding container 4e79b2cc8baf320e7c29ad1402bb31d8877318a6fd1a463bfc741f79802087ec: Status 404 returned error can't find the container with id 4e79b2cc8baf320e7c29ad1402bb31d8877318a6fd1a463bfc741f79802087ec
Sep 08 07:24:27.760706 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:27.760670    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-0ca807-6785f9cb5f-tr8c4" event={"ID":"7a190a8c-54b7-404a-8437-6b29e11c549d","Type":"ContainerStarted","Data":"6e52a63d3039334f52fc277f280f51fb39ff3addcdc222cad14b34d8f3aa7ba3"}
Sep 08 07:24:27.760891 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:27.760727    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-0ca807-6785f9cb5f-tr8c4" event={"ID":"7a190a8c-54b7-404a-8437-6b29e11c549d","Type":"ContainerStarted","Data":"4e79b2cc8baf320e7c29ad1402bb31d8877318a6fd1a463bfc741f79802087ec"}
Sep 08 07:24:27.760954 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:27.760894    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj"
Sep 08 07:24:27.761044 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:27.760961    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-0ca807-6785f9cb5f-tr8c4"
Sep 08 07:24:27.761946 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:27.761928    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj"
Sep 08 07:24:27.780555 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:27.780507    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-0ca807-6785f9cb5f-tr8c4" podStartSLOduration=1.449237602 podStartE2EDuration="1.780492677s" totalImagesPullingTime="331.255075ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:24:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:24:27.779535996 +0000 UTC m=+1215.760575359" watchObservedRunningTime="2026-09-08 07:24:27.780492677 +0000 UTC m=+1215.761531983"
Sep 08 07:24:28.763869 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:28.763840    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-217bc2-f689fc7bd-hbp9c"]
Sep 08 07:24:28.768149 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:28.768128    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-217bc2-f689fc7bd-hbp9c"
Sep 08 07:24:28.770292 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:28.770272    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w3-217bc2-serving-cert\""
Sep 08 07:24:28.776562 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:28.776534    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-217bc2-f689fc7bd-hbp9c"]
Sep 08 07:24:28.901536 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:28.901493    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lb79p\" (UniqueName: \"kubernetes.io/projected/e21ccfc3-35e5-4d1d-b394-8094a8ebbbe1-kube-api-access-lb79p\") pod \"maas-api-e2e-shared-b-w3-217bc2-f689fc7bd-hbp9c\" (UID: \"e21ccfc3-35e5-4d1d-b394-8094a8ebbbe1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-217bc2-f689fc7bd-hbp9c"
Sep 08 07:24:28.901689 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:28.901582    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e21ccfc3-35e5-4d1d-b394-8094a8ebbbe1-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-217bc2-f689fc7bd-hbp9c\" (UID: \"e21ccfc3-35e5-4d1d-b394-8094a8ebbbe1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-217bc2-f689fc7bd-hbp9c"
Sep 08 07:24:28.901753 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:28.901738    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e21ccfc3-35e5-4d1d-b394-8094a8ebbbe1-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-217bc2-f689fc7bd-hbp9c\" (UID: \"e21ccfc3-35e5-4d1d-b394-8094a8ebbbe1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-217bc2-f689fc7bd-hbp9c"
Sep 08 07:24:28.901813 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:28.901773    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e21ccfc3-35e5-4d1d-b394-8094a8ebbbe1-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-217bc2-f689fc7bd-hbp9c\" (UID: \"e21ccfc3-35e5-4d1d-b394-8094a8ebbbe1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-217bc2-f689fc7bd-hbp9c"
Sep 08 07:24:29.003332 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:29.003297    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e21ccfc3-35e5-4d1d-b394-8094a8ebbbe1-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-217bc2-f689fc7bd-hbp9c\" (UID: \"e21ccfc3-35e5-4d1d-b394-8094a8ebbbe1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-217bc2-f689fc7bd-hbp9c"
Sep 08 07:24:29.003332 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:29.003339    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e21ccfc3-35e5-4d1d-b394-8094a8ebbbe1-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-217bc2-f689fc7bd-hbp9c\" (UID: \"e21ccfc3-35e5-4d1d-b394-8094a8ebbbe1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-217bc2-f689fc7bd-hbp9c"
Sep 08 07:24:29.003594 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:29.003452    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lb79p\" (UniqueName: \"kubernetes.io/projected/e21ccfc3-35e5-4d1d-b394-8094a8ebbbe1-kube-api-access-lb79p\") pod \"maas-api-e2e-shared-b-w3-217bc2-f689fc7bd-hbp9c\" (UID: \"e21ccfc3-35e5-4d1d-b394-8094a8ebbbe1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-217bc2-f689fc7bd-hbp9c"
Sep 08 07:24:29.003594 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:29.003497    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e21ccfc3-35e5-4d1d-b394-8094a8ebbbe1-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-217bc2-f689fc7bd-hbp9c\" (UID: \"e21ccfc3-35e5-4d1d-b394-8094a8ebbbe1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-217bc2-f689fc7bd-hbp9c"
Sep 08 07:24:29.004355 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:29.004331    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e21ccfc3-35e5-4d1d-b394-8094a8ebbbe1-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-217bc2-f689fc7bd-hbp9c\" (UID: \"e21ccfc3-35e5-4d1d-b394-8094a8ebbbe1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-217bc2-f689fc7bd-hbp9c"
Sep 08 07:24:29.005821 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:29.005801    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e21ccfc3-35e5-4d1d-b394-8094a8ebbbe1-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-217bc2-f689fc7bd-hbp9c\" (UID: \"e21ccfc3-35e5-4d1d-b394-8094a8ebbbe1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-217bc2-f689fc7bd-hbp9c"
Sep 08 07:24:29.005912 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:29.005878    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e21ccfc3-35e5-4d1d-b394-8094a8ebbbe1-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-217bc2-f689fc7bd-hbp9c\" (UID: \"e21ccfc3-35e5-4d1d-b394-8094a8ebbbe1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-217bc2-f689fc7bd-hbp9c"
Sep 08 07:24:29.011301 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:29.011269    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lb79p\" (UniqueName: \"kubernetes.io/projected/e21ccfc3-35e5-4d1d-b394-8094a8ebbbe1-kube-api-access-lb79p\") pod \"maas-api-e2e-shared-b-w3-217bc2-f689fc7bd-hbp9c\" (UID: \"e21ccfc3-35e5-4d1d-b394-8094a8ebbbe1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-217bc2-f689fc7bd-hbp9c"
Sep 08 07:24:29.082351 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:29.082271    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-217bc2-f689fc7bd-hbp9c"
Sep 08 07:24:29.372102 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:29.372016    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-217bc2-f689fc7bd-hbp9c"]
Sep 08 07:24:29.374619 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:24:29.374589    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode21ccfc3_35e5_4d1d_b394_8094a8ebbbe1.slice/crio-f215b2372a9154023d4ba357b0d26df703279ad4b437d5bdcf8bf9e39d3a96a5 WatchSource:0}: Error finding container f215b2372a9154023d4ba357b0d26df703279ad4b437d5bdcf8bf9e39d3a96a5: Status 404 returned error can't find the container with id f215b2372a9154023d4ba357b0d26df703279ad4b437d5bdcf8bf9e39d3a96a5
Sep 08 07:24:29.775067 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:29.775020    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-217bc2-f689fc7bd-hbp9c" event={"ID":"e21ccfc3-35e5-4d1d-b394-8094a8ebbbe1","Type":"ContainerStarted","Data":"f215b2372a9154023d4ba357b0d26df703279ad4b437d5bdcf8bf9e39d3a96a5"}
Sep 08 07:24:30.782669 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:30.782634    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-217bc2-f689fc7bd-hbp9c" event={"ID":"e21ccfc3-35e5-4d1d-b394-8094a8ebbbe1","Type":"ContainerStarted","Data":"0a65cc6733abc7e5093571afeed77903e07fd8c2912354f5e6a4421ae461dec9"}
Sep 08 07:24:30.783079 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:30.782701    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-217bc2-f689fc7bd-hbp9c"
Sep 08 07:24:30.798413 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:30.798361    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-217bc2-f689fc7bd-hbp9c" podStartSLOduration=2.396956507 podStartE2EDuration="2.798343808s" totalImagesPullingTime="401.387301ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:24:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:24:30.797513476 +0000 UTC m=+1218.778552799" watchObservedRunningTime="2026-09-08 07:24:30.798343808 +0000 UTC m=+1218.779383114"
Sep 08 07:24:33.774425 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:33.774396    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-0ca807-6785f9cb5f-tr8c4"
Sep 08 07:24:33.944804 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:33.944773    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:24:36.803418 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:36.803378    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-217bc2-f689fc7bd-hbp9c"
Sep 08 07:24:43.333687 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:43.332037    2564 patch_prober.go:28] interesting pod/e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": read tcp 10.132.0.2:60304->10.132.0.67:15021: read: connection reset by peer" start-of-body=
Sep 08 07:24:43.333687 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:43.332106    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj" podUID="4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": read tcp 10.132.0.2:60304->10.132.0.67:15021: read: connection reset by peer"
Sep 08 07:24:43.861009 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:43.860960    2564 generic.go:356] "Generic (PLEG): container finished" podID="4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba" containerID="54baf852f305aba9bb6ee842f78360ba579b6c6d014d60f388984be7cd242ef4" exitCode=0
Sep 08 07:24:43.861178 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:43.861034    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj" event={"ID":"4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba","Type":"ContainerDied","Data":"54baf852f305aba9bb6ee842f78360ba579b6c6d014d60f388984be7cd242ef4"}
Sep 08 07:24:43.861523 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:43.861506    2564 scope.go:117] "RemoveContainer" containerID="54baf852f305aba9bb6ee842f78360ba579b6c6d014d60f388984be7cd242ef4"
Sep 08 07:24:43.862551 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:43.862520    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 07:24:43.862644 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:43.862588    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 07:24:43.862644 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:43.862621    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 07:24:44.868083 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:44.868048    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj" event={"ID":"4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba","Type":"ContainerStarted","Data":"c431281ea7b2bed6454cc0aee4e533ab4f238b230b26fee7da48a2fa86dbe76a"}
Sep 08 07:24:45.245553 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:45.245463    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj"
Sep 08 07:24:45.245701 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:45.245679    2564 patch_prober.go:28] interesting pod/e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 08 07:24:45.245749 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:45.245723    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj" podUID="4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 08 07:24:46.246034 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:46.246002    2564 patch_prober.go:28] interesting pod/e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 08 07:24:46.246435 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:46.246060    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj" podUID="4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 08 07:24:47.246243 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:47.246204    2564 patch_prober.go:28] interesting pod/e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 08 07:24:47.246716 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:47.246265    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj" podUID="4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 08 07:24:48.246458 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:48.246419    2564 patch_prober.go:28] interesting pod/e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 08 07:24:48.246836 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:48.246472    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj" podUID="4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 08 07:24:49.246579 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:49.246539    2564 patch_prober.go:28] interesting pod/e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 08 07:24:49.247011 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:49.246609    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj" podUID="4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 08 07:24:50.249257 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:50.249222    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj"
Sep 08 07:24:50.249718 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:50.249605    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj"
Sep 08 07:24:50.250321 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:24:50.250301    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj"
Sep 08 07:25:11.439898 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:25:11.439806    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-15977b5c-6b7bd479cd-tc4t7"]
Sep 08 07:25:11.445713 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:25:11.445687    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-15977b5c-6b7bd479cd-tc4t7"
Sep 08 07:25:11.450185 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:25:11.450158    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-15977b5c-serving-cert\""
Sep 08 07:25:11.452054 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:25:11.452028    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-15977b5c-6b7bd479cd-tc4t7"]
Sep 08 07:25:11.616424 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:25:11.616384    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/da02db53-66d7-43c0-adf0-1d4e608df7aa-openshift-service-ca\") pod \"maas-api-e2e-mt-15977b5c-6b7bd479cd-tc4t7\" (UID: \"da02db53-66d7-43c0-adf0-1d4e608df7aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-15977b5c-6b7bd479cd-tc4t7"
Sep 08 07:25:11.616617 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:25:11.616450    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da02db53-66d7-43c0-adf0-1d4e608df7aa-metrics-certs\") pod \"maas-api-e2e-mt-15977b5c-6b7bd479cd-tc4t7\" (UID: \"da02db53-66d7-43c0-adf0-1d4e608df7aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-15977b5c-6b7bd479cd-tc4t7"
Sep 08 07:25:11.616617 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:25:11.616473    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hk5hd\" (UniqueName: \"kubernetes.io/projected/da02db53-66d7-43c0-adf0-1d4e608df7aa-kube-api-access-hk5hd\") pod \"maas-api-e2e-mt-15977b5c-6b7bd479cd-tc4t7\" (UID: \"da02db53-66d7-43c0-adf0-1d4e608df7aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-15977b5c-6b7bd479cd-tc4t7"
Sep 08 07:25:11.616746 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:25:11.616608    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da02db53-66d7-43c0-adf0-1d4e608df7aa-maas-api-tls\") pod \"maas-api-e2e-mt-15977b5c-6b7bd479cd-tc4t7\" (UID: \"da02db53-66d7-43c0-adf0-1d4e608df7aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-15977b5c-6b7bd479cd-tc4t7"
Sep 08 07:25:11.717783 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:25:11.717695    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/da02db53-66d7-43c0-adf0-1d4e608df7aa-openshift-service-ca\") pod \"maas-api-e2e-mt-15977b5c-6b7bd479cd-tc4t7\" (UID: \"da02db53-66d7-43c0-adf0-1d4e608df7aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-15977b5c-6b7bd479cd-tc4t7"
Sep 08 07:25:11.717783 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:25:11.717750    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da02db53-66d7-43c0-adf0-1d4e608df7aa-metrics-certs\") pod \"maas-api-e2e-mt-15977b5c-6b7bd479cd-tc4t7\" (UID: \"da02db53-66d7-43c0-adf0-1d4e608df7aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-15977b5c-6b7bd479cd-tc4t7"
Sep 08 07:25:11.717783 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:25:11.717766    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hk5hd\" (UniqueName: \"kubernetes.io/projected/da02db53-66d7-43c0-adf0-1d4e608df7aa-kube-api-access-hk5hd\") pod \"maas-api-e2e-mt-15977b5c-6b7bd479cd-tc4t7\" (UID: \"da02db53-66d7-43c0-adf0-1d4e608df7aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-15977b5c-6b7bd479cd-tc4t7"
Sep 08 07:25:11.718119 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:25:11.717812    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da02db53-66d7-43c0-adf0-1d4e608df7aa-maas-api-tls\") pod \"maas-api-e2e-mt-15977b5c-6b7bd479cd-tc4t7\" (UID: \"da02db53-66d7-43c0-adf0-1d4e608df7aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-15977b5c-6b7bd479cd-tc4t7"
Sep 08 07:25:11.718486 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:25:11.718463    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/da02db53-66d7-43c0-adf0-1d4e608df7aa-openshift-service-ca\") pod \"maas-api-e2e-mt-15977b5c-6b7bd479cd-tc4t7\" (UID: \"da02db53-66d7-43c0-adf0-1d4e608df7aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-15977b5c-6b7bd479cd-tc4t7"
Sep 08 07:25:11.720313 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:25:11.720285    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da02db53-66d7-43c0-adf0-1d4e608df7aa-maas-api-tls\") pod \"maas-api-e2e-mt-15977b5c-6b7bd479cd-tc4t7\" (UID: \"da02db53-66d7-43c0-adf0-1d4e608df7aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-15977b5c-6b7bd479cd-tc4t7"
Sep 08 07:25:11.720405 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:25:11.720331    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da02db53-66d7-43c0-adf0-1d4e608df7aa-metrics-certs\") pod \"maas-api-e2e-mt-15977b5c-6b7bd479cd-tc4t7\" (UID: \"da02db53-66d7-43c0-adf0-1d4e608df7aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-15977b5c-6b7bd479cd-tc4t7"
Sep 08 07:25:11.728627 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:25:11.728600    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hk5hd\" (UniqueName: \"kubernetes.io/projected/da02db53-66d7-43c0-adf0-1d4e608df7aa-kube-api-access-hk5hd\") pod \"maas-api-e2e-mt-15977b5c-6b7bd479cd-tc4t7\" (UID: \"da02db53-66d7-43c0-adf0-1d4e608df7aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-15977b5c-6b7bd479cd-tc4t7"
Sep 08 07:25:11.760738 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:25:11.760710    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-15977b5c-6b7bd479cd-tc4t7"
Sep 08 07:25:12.034150 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:25:12.034111    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-15977b5c-6b7bd479cd-tc4t7"]
Sep 08 07:25:12.036533 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:25:12.036508    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda02db53_66d7_43c0_adf0_1d4e608df7aa.slice/crio-1679bbf84cbadfdf06fd63bd1c487cfc6a23e0cd79cd881584fa5b69fae3f39e WatchSource:0}: Error finding container 1679bbf84cbadfdf06fd63bd1c487cfc6a23e0cd79cd881584fa5b69fae3f39e: Status 404 returned error can't find the container with id 1679bbf84cbadfdf06fd63bd1c487cfc6a23e0cd79cd881584fa5b69fae3f39e
Sep 08 07:25:12.697632 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:25:12.697595    2564 scope.go:117] "RemoveContainer" containerID="ffee58c769caff2a64c5a9b0c639d9d8f89887f7c18d04bb6cde06fe8b7af21b"
Sep 08 07:25:13.022792 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:25:13.022758    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-15977b5c-6b7bd479cd-tc4t7" event={"ID":"da02db53-66d7-43c0-adf0-1d4e608df7aa","Type":"ContainerStarted","Data":"eabcb7bd68cb8c9e26c725f82960c1f9ca549e3ebcab5cdfd5c0dc6a7c4f673d"}
Sep 08 07:25:13.022964 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:25:13.022808    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-15977b5c-6b7bd479cd-tc4t7" event={"ID":"da02db53-66d7-43c0-adf0-1d4e608df7aa","Type":"ContainerStarted","Data":"1679bbf84cbadfdf06fd63bd1c487cfc6a23e0cd79cd881584fa5b69fae3f39e"}
Sep 08 07:25:13.022964 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:25:13.022850    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-15977b5c-6b7bd479cd-tc4t7"
Sep 08 07:25:13.040053 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:25:13.040006    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-15977b5c-6b7bd479cd-tc4t7" podStartSLOduration=1.601120367 podStartE2EDuration="2.039991639s" totalImagesPullingTime="438.871272ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:25:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:25:13.037426194 +0000 UTC m=+1261.018465733" watchObservedRunningTime="2026-09-08 07:25:13.039991639 +0000 UTC m=+1261.021030939"
Sep 08 07:25:18.650504 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:25:18.650466    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:25:19.033964 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:25:19.033932    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-15977b5c-6b7bd479cd-tc4t7"
Sep 08 07:25:52.446109 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:25:52.446064    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:26:06.239564 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:26:06.239522    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:26:22.437076 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:26:22.437044    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:26:39.442560 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:26:39.442478    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:26:45.335538 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:26:45.335497    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-15977b5c-6b7bd479cd-tc4t7"]
Sep 08 07:26:45.337819 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:26:45.337034    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-15977b5c-6b7bd479cd-tc4t7" podUID="da02db53-66d7-43c0-adf0-1d4e608df7aa" containerName="maas-api" containerID="cri-o://eabcb7bd68cb8c9e26c725f82960c1f9ca549e3ebcab5cdfd5c0dc6a7c4f673d" gracePeriod=30
Sep 08 07:26:45.551673 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:26:45.551633    2564 generic.go:356] "Generic (PLEG): container finished" podID="da02db53-66d7-43c0-adf0-1d4e608df7aa" containerID="eabcb7bd68cb8c9e26c725f82960c1f9ca549e3ebcab5cdfd5c0dc6a7c4f673d" exitCode=0
Sep 08 07:26:45.551826 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:26:45.551694    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-15977b5c-6b7bd479cd-tc4t7" event={"ID":"da02db53-66d7-43c0-adf0-1d4e608df7aa","Type":"ContainerDied","Data":"eabcb7bd68cb8c9e26c725f82960c1f9ca549e3ebcab5cdfd5c0dc6a7c4f673d"}
Sep 08 07:26:45.604367 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:26:45.604338    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-15977b5c-6b7bd479cd-tc4t7"
Sep 08 07:26:45.631566 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:26:45.631537    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da02db53-66d7-43c0-adf0-1d4e608df7aa-metrics-certs\") pod \"da02db53-66d7-43c0-adf0-1d4e608df7aa\" (UID: \"da02db53-66d7-43c0-adf0-1d4e608df7aa\") "
Sep 08 07:26:45.631739 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:26:45.631582    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/da02db53-66d7-43c0-adf0-1d4e608df7aa-openshift-service-ca\") pod \"da02db53-66d7-43c0-adf0-1d4e608df7aa\" (UID: \"da02db53-66d7-43c0-adf0-1d4e608df7aa\") "
Sep 08 07:26:45.631739 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:26:45.631694    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da02db53-66d7-43c0-adf0-1d4e608df7aa-maas-api-tls\") pod \"da02db53-66d7-43c0-adf0-1d4e608df7aa\" (UID: \"da02db53-66d7-43c0-adf0-1d4e608df7aa\") "
Sep 08 07:26:45.631739 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:26:45.631735    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hk5hd\" (UniqueName: \"kubernetes.io/projected/da02db53-66d7-43c0-adf0-1d4e608df7aa-kube-api-access-hk5hd\") pod \"da02db53-66d7-43c0-adf0-1d4e608df7aa\" (UID: \"da02db53-66d7-43c0-adf0-1d4e608df7aa\") "
Sep 08 07:26:45.631947 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:26:45.631916    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da02db53-66d7-43c0-adf0-1d4e608df7aa-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "da02db53-66d7-43c0-adf0-1d4e608df7aa" (UID: "da02db53-66d7-43c0-adf0-1d4e608df7aa"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 07:26:45.632108 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:26:45.632089    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/da02db53-66d7-43c0-adf0-1d4e608df7aa-openshift-service-ca\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:26:45.634096 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:26:45.634057    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da02db53-66d7-43c0-adf0-1d4e608df7aa-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "da02db53-66d7-43c0-adf0-1d4e608df7aa" (UID: "da02db53-66d7-43c0-adf0-1d4e608df7aa"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 07:26:45.634511 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:26:45.634485    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da02db53-66d7-43c0-adf0-1d4e608df7aa-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "da02db53-66d7-43c0-adf0-1d4e608df7aa" (UID: "da02db53-66d7-43c0-adf0-1d4e608df7aa"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 07:26:45.634733 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:26:45.634712    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da02db53-66d7-43c0-adf0-1d4e608df7aa-kube-api-access-hk5hd" (OuterVolumeSpecName: "kube-api-access-hk5hd") pod "da02db53-66d7-43c0-adf0-1d4e608df7aa" (UID: "da02db53-66d7-43c0-adf0-1d4e608df7aa"). InnerVolumeSpecName "kube-api-access-hk5hd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 07:26:45.732876 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:26:45.732841    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da02db53-66d7-43c0-adf0-1d4e608df7aa-maas-api-tls\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:26:45.732876 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:26:45.732874    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hk5hd\" (UniqueName: \"kubernetes.io/projected/da02db53-66d7-43c0-adf0-1d4e608df7aa-kube-api-access-hk5hd\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:26:45.733093 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:26:45.732888    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da02db53-66d7-43c0-adf0-1d4e608df7aa-metrics-certs\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:26:46.558166 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:26:46.558138    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-15977b5c-6b7bd479cd-tc4t7"
Sep 08 07:26:46.558546 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:26:46.558176    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-15977b5c-6b7bd479cd-tc4t7" event={"ID":"da02db53-66d7-43c0-adf0-1d4e608df7aa","Type":"ContainerDied","Data":"1679bbf84cbadfdf06fd63bd1c487cfc6a23e0cd79cd881584fa5b69fae3f39e"}
Sep 08 07:26:46.558546 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:26:46.558237    2564 scope.go:117] "RemoveContainer" containerID="eabcb7bd68cb8c9e26c725f82960c1f9ca549e3ebcab5cdfd5c0dc6a7c4f673d"
Sep 08 07:26:46.576224 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:26:46.576195    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-15977b5c-6b7bd479cd-tc4t7"]
Sep 08 07:26:46.582189 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:26:46.582165    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-15977b5c-6b7bd479cd-tc4t7"]
Sep 08 07:26:48.510150 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:26:48.510106    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da02db53-66d7-43c0-adf0-1d4e608df7aa" path="/var/lib/kubelet/pods/da02db53-66d7-43c0-adf0-1d4e608df7aa/volumes"
Sep 08 07:26:57.235871 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:26:57.235830    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:27:12.036418 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:27:12.036380    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:27:28.934696 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:27:28.934661    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:27:45.242764 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:27:45.242726    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:27:57.038503 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:27:57.038467    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:28:22.044577 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:28:22.044483    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:28:35.852085 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:28:35.852050    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-7e01ea-6ffd4dfc57-4gqx9"]
Sep 08 07:28:35.852786 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:28:35.852766    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da02db53-66d7-43c0-adf0-1d4e608df7aa" containerName="maas-api"
Sep 08 07:28:35.852834 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:28:35.852791    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="da02db53-66d7-43c0-adf0-1d4e608df7aa" containerName="maas-api"
Sep 08 07:28:35.852919 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:28:35.852908    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="da02db53-66d7-43c0-adf0-1d4e608df7aa" containerName="maas-api"
Sep 08 07:28:35.857189 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:28:35.857163    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7e01ea-6ffd4dfc57-4gqx9"
Sep 08 07:28:35.859285 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:28:35.859257    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-7e01ea-serving-cert\""
Sep 08 07:28:35.868688 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:28:35.868663    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-7e01ea-6ffd4dfc57-4gqx9"]
Sep 08 07:28:36.009566 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:28:36.009533    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2636358e-6725-40c2-8827-e8a7df071677-metrics-certs\") pod \"maas-api-e2e-api-a-7e01ea-6ffd4dfc57-4gqx9\" (UID: \"2636358e-6725-40c2-8827-e8a7df071677\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7e01ea-6ffd4dfc57-4gqx9"
Sep 08 07:28:36.009772 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:28:36.009598    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2636358e-6725-40c2-8827-e8a7df071677-openshift-service-ca\") pod \"maas-api-e2e-api-a-7e01ea-6ffd4dfc57-4gqx9\" (UID: \"2636358e-6725-40c2-8827-e8a7df071677\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7e01ea-6ffd4dfc57-4gqx9"
Sep 08 07:28:36.009772 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:28:36.009673    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2636358e-6725-40c2-8827-e8a7df071677-maas-api-tls\") pod \"maas-api-e2e-api-a-7e01ea-6ffd4dfc57-4gqx9\" (UID: \"2636358e-6725-40c2-8827-e8a7df071677\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7e01ea-6ffd4dfc57-4gqx9"
Sep 08 07:28:36.009772 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:28:36.009715    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-js4nb\" (UniqueName: \"kubernetes.io/projected/2636358e-6725-40c2-8827-e8a7df071677-kube-api-access-js4nb\") pod \"maas-api-e2e-api-a-7e01ea-6ffd4dfc57-4gqx9\" (UID: \"2636358e-6725-40c2-8827-e8a7df071677\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7e01ea-6ffd4dfc57-4gqx9"
Sep 08 07:28:36.110927 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:28:36.110835    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2636358e-6725-40c2-8827-e8a7df071677-metrics-certs\") pod \"maas-api-e2e-api-a-7e01ea-6ffd4dfc57-4gqx9\" (UID: \"2636358e-6725-40c2-8827-e8a7df071677\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7e01ea-6ffd4dfc57-4gqx9"
Sep 08 07:28:36.110927 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:28:36.110901    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2636358e-6725-40c2-8827-e8a7df071677-openshift-service-ca\") pod \"maas-api-e2e-api-a-7e01ea-6ffd4dfc57-4gqx9\" (UID: \"2636358e-6725-40c2-8827-e8a7df071677\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7e01ea-6ffd4dfc57-4gqx9"
Sep 08 07:28:36.110927 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:28:36.110920    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2636358e-6725-40c2-8827-e8a7df071677-maas-api-tls\") pod \"maas-api-e2e-api-a-7e01ea-6ffd4dfc57-4gqx9\" (UID: \"2636358e-6725-40c2-8827-e8a7df071677\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7e01ea-6ffd4dfc57-4gqx9"
Sep 08 07:28:36.111254 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:28:36.110939    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-js4nb\" (UniqueName: \"kubernetes.io/projected/2636358e-6725-40c2-8827-e8a7df071677-kube-api-access-js4nb\") pod \"maas-api-e2e-api-a-7e01ea-6ffd4dfc57-4gqx9\" (UID: \"2636358e-6725-40c2-8827-e8a7df071677\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7e01ea-6ffd4dfc57-4gqx9"
Sep 08 07:28:36.111254 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:28:36.111079    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-7e01ea-serving-cert: secret "maas-api-e2e-api-a-7e01ea-serving-cert" not found
Sep 08 07:28:36.111254 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:28:36.111150    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2636358e-6725-40c2-8827-e8a7df071677-maas-api-tls podName:2636358e-6725-40c2-8827-e8a7df071677 nodeName:}" failed. No retries permitted until 2026-09-08 07:28:36.611129947 +0000 UTC m=+1464.592169251 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2636358e-6725-40c2-8827-e8a7df071677-maas-api-tls") pod "maas-api-e2e-api-a-7e01ea-6ffd4dfc57-4gqx9" (UID: "2636358e-6725-40c2-8827-e8a7df071677") : secret "maas-api-e2e-api-a-7e01ea-serving-cert" not found
Sep 08 07:28:36.111757 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:28:36.111724    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2636358e-6725-40c2-8827-e8a7df071677-openshift-service-ca\") pod \"maas-api-e2e-api-a-7e01ea-6ffd4dfc57-4gqx9\" (UID: \"2636358e-6725-40c2-8827-e8a7df071677\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7e01ea-6ffd4dfc57-4gqx9"
Sep 08 07:28:36.113345 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:28:36.113321    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2636358e-6725-40c2-8827-e8a7df071677-metrics-certs\") pod \"maas-api-e2e-api-a-7e01ea-6ffd4dfc57-4gqx9\" (UID: \"2636358e-6725-40c2-8827-e8a7df071677\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7e01ea-6ffd4dfc57-4gqx9"
Sep 08 07:28:36.125748 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:28:36.125721    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-js4nb\" (UniqueName: \"kubernetes.io/projected/2636358e-6725-40c2-8827-e8a7df071677-kube-api-access-js4nb\") pod \"maas-api-e2e-api-a-7e01ea-6ffd4dfc57-4gqx9\" (UID: \"2636358e-6725-40c2-8827-e8a7df071677\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7e01ea-6ffd4dfc57-4gqx9"
Sep 08 07:28:36.616347 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:28:36.616314    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2636358e-6725-40c2-8827-e8a7df071677-maas-api-tls\") pod \"maas-api-e2e-api-a-7e01ea-6ffd4dfc57-4gqx9\" (UID: \"2636358e-6725-40c2-8827-e8a7df071677\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7e01ea-6ffd4dfc57-4gqx9"
Sep 08 07:28:36.618680 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:28:36.618654    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2636358e-6725-40c2-8827-e8a7df071677-maas-api-tls\") pod \"maas-api-e2e-api-a-7e01ea-6ffd4dfc57-4gqx9\" (UID: \"2636358e-6725-40c2-8827-e8a7df071677\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7e01ea-6ffd4dfc57-4gqx9"
Sep 08 07:28:36.770222 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:28:36.770185    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7e01ea-6ffd4dfc57-4gqx9"
Sep 08 07:28:37.045782 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:28:37.045751    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-7e01ea-6ffd4dfc57-4gqx9"]
Sep 08 07:28:37.047828 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:28:37.047800    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2636358e_6725_40c2_8827_e8a7df071677.slice/crio-d1ceba224a5a99a45952f73929a9152807e10131f7128aaf7f6e2f7ecd8108ba WatchSource:0}: Error finding container d1ceba224a5a99a45952f73929a9152807e10131f7128aaf7f6e2f7ecd8108ba: Status 404 returned error can't find the container with id d1ceba224a5a99a45952f73929a9152807e10131f7128aaf7f6e2f7ecd8108ba
Sep 08 07:28:37.152022 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:28:37.151987    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7e01ea-6ffd4dfc57-4gqx9" event={"ID":"2636358e-6725-40c2-8827-e8a7df071677","Type":"ContainerStarted","Data":"d1ceba224a5a99a45952f73929a9152807e10131f7128aaf7f6e2f7ecd8108ba"}
Sep 08 07:28:38.158637 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:28:38.158603    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7e01ea-6ffd4dfc57-4gqx9" event={"ID":"2636358e-6725-40c2-8827-e8a7df071677","Type":"ContainerStarted","Data":"80f963f64b686ba26ffcd19474d773f842bbf2d7450e67249fba2186e41a2712"}
Sep 08 07:28:38.159077 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:28:38.158740    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7e01ea-6ffd4dfc57-4gqx9"
Sep 08 07:28:38.176727 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:28:38.176682    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7e01ea-6ffd4dfc57-4gqx9" podStartSLOduration=2.80761094 podStartE2EDuration="3.176664486s" totalImagesPullingTime="369.053546ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:28:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:28:38.175253899 +0000 UTC m=+1466.156293225" watchObservedRunningTime="2026-09-08 07:28:38.176664486 +0000 UTC m=+1466.157703792"
Sep 08 07:28:42.338099 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:28:42.338064    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:28:44.169364 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:28:44.169326    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7e01ea-6ffd4dfc57-4gqx9"
Sep 08 07:28:55.340863 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:28:55.340828    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:29:04.840236 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:29:04.840201    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-f0e0d8-5b59bd6c94-rpws9"]
Sep 08 07:29:04.845275 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:29:04.845250    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f0e0d8-5b59bd6c94-rpws9"
Sep 08 07:29:04.847182 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:29:04.847159    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-f0e0d8-serving-cert\""
Sep 08 07:29:04.854431 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:29:04.854407    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-f0e0d8-5b59bd6c94-rpws9"]
Sep 08 07:29:04.986217 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:29:04.986175    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9skvs\" (UniqueName: \"kubernetes.io/projected/45649e8f-c326-4749-a2cc-eacdcb539583-kube-api-access-9skvs\") pod \"maas-api-e2e-api-b-f0e0d8-5b59bd6c94-rpws9\" (UID: \"45649e8f-c326-4749-a2cc-eacdcb539583\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f0e0d8-5b59bd6c94-rpws9"
Sep 08 07:29:04.986405 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:29:04.986245    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/45649e8f-c326-4749-a2cc-eacdcb539583-maas-api-tls\") pod \"maas-api-e2e-api-b-f0e0d8-5b59bd6c94-rpws9\" (UID: \"45649e8f-c326-4749-a2cc-eacdcb539583\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f0e0d8-5b59bd6c94-rpws9"
Sep 08 07:29:04.986405 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:29:04.986325    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45649e8f-c326-4749-a2cc-eacdcb539583-metrics-certs\") pod \"maas-api-e2e-api-b-f0e0d8-5b59bd6c94-rpws9\" (UID: \"45649e8f-c326-4749-a2cc-eacdcb539583\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f0e0d8-5b59bd6c94-rpws9"
Sep 08 07:29:04.986405 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:29:04.986384    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/45649e8f-c326-4749-a2cc-eacdcb539583-openshift-service-ca\") pod \"maas-api-e2e-api-b-f0e0d8-5b59bd6c94-rpws9\" (UID: \"45649e8f-c326-4749-a2cc-eacdcb539583\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f0e0d8-5b59bd6c94-rpws9"
Sep 08 07:29:05.087157 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:29:05.087122    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/45649e8f-c326-4749-a2cc-eacdcb539583-openshift-service-ca\") pod \"maas-api-e2e-api-b-f0e0d8-5b59bd6c94-rpws9\" (UID: \"45649e8f-c326-4749-a2cc-eacdcb539583\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f0e0d8-5b59bd6c94-rpws9"
Sep 08 07:29:05.087351 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:29:05.087196    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9skvs\" (UniqueName: \"kubernetes.io/projected/45649e8f-c326-4749-a2cc-eacdcb539583-kube-api-access-9skvs\") pod \"maas-api-e2e-api-b-f0e0d8-5b59bd6c94-rpws9\" (UID: \"45649e8f-c326-4749-a2cc-eacdcb539583\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f0e0d8-5b59bd6c94-rpws9"
Sep 08 07:29:05.087351 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:29:05.087235    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/45649e8f-c326-4749-a2cc-eacdcb539583-maas-api-tls\") pod \"maas-api-e2e-api-b-f0e0d8-5b59bd6c94-rpws9\" (UID: \"45649e8f-c326-4749-a2cc-eacdcb539583\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f0e0d8-5b59bd6c94-rpws9"
Sep 08 07:29:05.087351 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:29:05.087309    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45649e8f-c326-4749-a2cc-eacdcb539583-metrics-certs\") pod \"maas-api-e2e-api-b-f0e0d8-5b59bd6c94-rpws9\" (UID: \"45649e8f-c326-4749-a2cc-eacdcb539583\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f0e0d8-5b59bd6c94-rpws9"
Sep 08 07:29:05.087546 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:29:05.087426    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-f0e0d8-serving-cert: secret "maas-api-e2e-api-b-f0e0d8-serving-cert" not found
Sep 08 07:29:05.087546 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:29:05.087501    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45649e8f-c326-4749-a2cc-eacdcb539583-maas-api-tls podName:45649e8f-c326-4749-a2cc-eacdcb539583 nodeName:}" failed. No retries permitted until 2026-09-08 07:29:05.58748017 +0000 UTC m=+1493.568519471 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/45649e8f-c326-4749-a2cc-eacdcb539583-maas-api-tls") pod "maas-api-e2e-api-b-f0e0d8-5b59bd6c94-rpws9" (UID: "45649e8f-c326-4749-a2cc-eacdcb539583") : secret "maas-api-e2e-api-b-f0e0d8-serving-cert" not found
Sep 08 07:29:05.087953 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:29:05.087927    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/45649e8f-c326-4749-a2cc-eacdcb539583-openshift-service-ca\") pod \"maas-api-e2e-api-b-f0e0d8-5b59bd6c94-rpws9\" (UID: \"45649e8f-c326-4749-a2cc-eacdcb539583\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f0e0d8-5b59bd6c94-rpws9"
Sep 08 07:29:05.090030 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:29:05.090011    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45649e8f-c326-4749-a2cc-eacdcb539583-metrics-certs\") pod \"maas-api-e2e-api-b-f0e0d8-5b59bd6c94-rpws9\" (UID: \"45649e8f-c326-4749-a2cc-eacdcb539583\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f0e0d8-5b59bd6c94-rpws9"
Sep 08 07:29:05.098658 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:29:05.098587    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9skvs\" (UniqueName: \"kubernetes.io/projected/45649e8f-c326-4749-a2cc-eacdcb539583-kube-api-access-9skvs\") pod \"maas-api-e2e-api-b-f0e0d8-5b59bd6c94-rpws9\" (UID: \"45649e8f-c326-4749-a2cc-eacdcb539583\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f0e0d8-5b59bd6c94-rpws9"
Sep 08 07:29:05.592991 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:29:05.592929    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/45649e8f-c326-4749-a2cc-eacdcb539583-maas-api-tls\") pod \"maas-api-e2e-api-b-f0e0d8-5b59bd6c94-rpws9\" (UID: \"45649e8f-c326-4749-a2cc-eacdcb539583\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f0e0d8-5b59bd6c94-rpws9"
Sep 08 07:29:05.595653 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:29:05.595623    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/45649e8f-c326-4749-a2cc-eacdcb539583-maas-api-tls\") pod \"maas-api-e2e-api-b-f0e0d8-5b59bd6c94-rpws9\" (UID: \"45649e8f-c326-4749-a2cc-eacdcb539583\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f0e0d8-5b59bd6c94-rpws9"
Sep 08 07:29:05.759863 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:29:05.759824    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f0e0d8-5b59bd6c94-rpws9"
Sep 08 07:29:06.038197 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:29:06.038168    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-f0e0d8-5b59bd6c94-rpws9"]
Sep 08 07:29:06.040400 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:29:06.040371    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45649e8f_c326_4749_a2cc_eacdcb539583.slice/crio-fcd668b42bed8f4787cc1d78e415c6f879562e04aa4f93263673d30828a2a3f4 WatchSource:0}: Error finding container fcd668b42bed8f4787cc1d78e415c6f879562e04aa4f93263673d30828a2a3f4: Status 404 returned error can't find the container with id fcd668b42bed8f4787cc1d78e415c6f879562e04aa4f93263673d30828a2a3f4
Sep 08 07:29:06.042002 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:29:06.041957    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 07:29:06.319075 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:29:06.318997    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f0e0d8-5b59bd6c94-rpws9" event={"ID":"45649e8f-c326-4749-a2cc-eacdcb539583","Type":"ContainerStarted","Data":"fcd668b42bed8f4787cc1d78e415c6f879562e04aa4f93263673d30828a2a3f4"}
Sep 08 07:29:07.325640 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:29:07.325608    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f0e0d8-5b59bd6c94-rpws9" event={"ID":"45649e8f-c326-4749-a2cc-eacdcb539583","Type":"ContainerStarted","Data":"4d5795af32d16a193fd2267dca241702688876dd5e27b49f411e3315f6c4677a"}
Sep 08 07:29:07.326088 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:29:07.325697    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f0e0d8-5b59bd6c94-rpws9"
Sep 08 07:29:07.343084 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:29:07.343040    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f0e0d8-5b59bd6c94-rpws9" podStartSLOduration=2.938309463 podStartE2EDuration="3.343022488s" totalImagesPullingTime="404.713025ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:29:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:29:07.34189491 +0000 UTC m=+1495.322934228" watchObservedRunningTime="2026-09-08 07:29:07.343022488 +0000 UTC m=+1495.324061794"
Sep 08 07:29:12.598434 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:29:12.598406    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-8d4lx_5cf68f79-8fda-42e2-92c1-05a5a601f505/console-operator/1.log"
Sep 08 07:29:12.599852 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:29:12.599830    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-8d4lx_5cf68f79-8fda-42e2-92c1-05a5a601f505/console-operator/1.log"
Sep 08 07:29:13.337994 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:29:13.337940    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f0e0d8-5b59bd6c94-rpws9"
Sep 08 07:29:13.952456 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:29:13.952420    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:29:29.844499 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:29:29.844466    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:29:46.276651 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:29:46.276614    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/mt-curl-7888-5ff6ee"]
Sep 08 07:29:46.280181 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:29:46.280163    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7888-5ff6ee"
Sep 08 07:29:46.282243 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:29:46.282216    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-lxxzx\""
Sep 08 07:29:46.286084 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:29:46.286058    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7888-5ff6ee"]
Sep 08 07:29:46.387770 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:29:46.387722    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqq5h\" (UniqueName: \"kubernetes.io/projected/ed2125f1-ba4e-45dc-b3d8-cacd4418a6d1-kube-api-access-lqq5h\") pod \"mt-curl-7888-5ff6ee\" (UID: \"ed2125f1-ba4e-45dc-b3d8-cacd4418a6d1\") " pod="opendatahub/mt-curl-7888-5ff6ee"
Sep 08 07:29:46.488745 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:29:46.488708    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqq5h\" (UniqueName: \"kubernetes.io/projected/ed2125f1-ba4e-45dc-b3d8-cacd4418a6d1-kube-api-access-lqq5h\") pod \"mt-curl-7888-5ff6ee\" (UID: \"ed2125f1-ba4e-45dc-b3d8-cacd4418a6d1\") " pod="opendatahub/mt-curl-7888-5ff6ee"
Sep 08 07:29:46.496728 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:29:46.496701    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqq5h\" (UniqueName: \"kubernetes.io/projected/ed2125f1-ba4e-45dc-b3d8-cacd4418a6d1-kube-api-access-lqq5h\") pod \"mt-curl-7888-5ff6ee\" (UID: \"ed2125f1-ba4e-45dc-b3d8-cacd4418a6d1\") " pod="opendatahub/mt-curl-7888-5ff6ee"
Sep 08 07:29:46.594524 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:29:46.594428    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7888-5ff6ee"
Sep 08 07:29:46.797826 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:29:46.797788    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-7e01ea-6ffd4dfc57-4gqx9"]
Sep 08 07:29:46.798389 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:29:46.798089    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7e01ea-6ffd4dfc57-4gqx9" podUID="2636358e-6725-40c2-8827-e8a7df071677" containerName="maas-api" containerID="cri-o://80f963f64b686ba26ffcd19474d773f842bbf2d7450e67249fba2186e41a2712" gracePeriod=30
Sep 08 07:29:46.869020 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:29:46.868927    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7888-5ff6ee"]
Sep 08 07:29:46.876861 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:29:46.876821    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poded2125f1_ba4e_45dc_b3d8_cacd4418a6d1.slice/crio-1f48d80dd2d5fdb76b90f47a09251b93b88922bbe04ac80b09a0934673f3d8c4 WatchSource:0}: Error finding container 1f48d80dd2d5fdb76b90f47a09251b93b88922bbe04ac80b09a0934673f3d8c4: Status 404 returned error can't find the container with id 1f48d80dd2d5fdb76b90f47a09251b93b88922bbe04ac80b09a0934673f3d8c4
Sep 08 07:29:46.946111 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:29:46.946080    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:29:47.042056 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:29:47.042030    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7e01ea-6ffd4dfc57-4gqx9"
Sep 08 07:29:47.099281 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:29:47.099248    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2636358e-6725-40c2-8827-e8a7df071677-maas-api-tls\") pod \"2636358e-6725-40c2-8827-e8a7df071677\" (UID: \"2636358e-6725-40c2-8827-e8a7df071677\") "
Sep 08 07:29:47.099483 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:29:47.099307    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2636358e-6725-40c2-8827-e8a7df071677-metrics-certs\") pod \"2636358e-6725-40c2-8827-e8a7df071677\" (UID: \"2636358e-6725-40c2-8827-e8a7df071677\") "
Sep 08 07:29:47.099483 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:29:47.099399    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2636358e-6725-40c2-8827-e8a7df071677-openshift-service-ca\") pod \"2636358e-6725-40c2-8827-e8a7df071677\" (UID: \"2636358e-6725-40c2-8827-e8a7df071677\") "
Sep 08 07:29:47.099483 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:29:47.099449    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-js4nb\" (UniqueName: \"kubernetes.io/projected/2636358e-6725-40c2-8827-e8a7df071677-kube-api-access-js4nb\") pod \"2636358e-6725-40c2-8827-e8a7df071677\" (UID: \"2636358e-6725-40c2-8827-e8a7df071677\") "
Sep 08 07:29:47.099819 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:29:47.099775    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2636358e-6725-40c2-8827-e8a7df071677-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2636358e-6725-40c2-8827-e8a7df071677" (UID: "2636358e-6725-40c2-8827-e8a7df071677"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 07:29:47.101364 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:29:47.101342    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2636358e-6725-40c2-8827-e8a7df071677-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2636358e-6725-40c2-8827-e8a7df071677" (UID: "2636358e-6725-40c2-8827-e8a7df071677"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 07:29:47.101467 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:29:47.101418    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2636358e-6725-40c2-8827-e8a7df071677-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "2636358e-6725-40c2-8827-e8a7df071677" (UID: "2636358e-6725-40c2-8827-e8a7df071677"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 07:29:47.101873 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:29:47.101848    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2636358e-6725-40c2-8827-e8a7df071677-kube-api-access-js4nb" (OuterVolumeSpecName: "kube-api-access-js4nb") pod "2636358e-6725-40c2-8827-e8a7df071677" (UID: "2636358e-6725-40c2-8827-e8a7df071677"). InnerVolumeSpecName "kube-api-access-js4nb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 07:29:47.201125 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:29:47.201034    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2636358e-6725-40c2-8827-e8a7df071677-maas-api-tls\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:29:47.201125 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:29:47.201072    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2636358e-6725-40c2-8827-e8a7df071677-metrics-certs\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:29:47.201125 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:29:47.201086    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2636358e-6725-40c2-8827-e8a7df071677-openshift-service-ca\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:29:47.201125 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:29:47.201099    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-js4nb\" (UniqueName: \"kubernetes.io/projected/2636358e-6725-40c2-8827-e8a7df071677-kube-api-access-js4nb\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:29:47.550332 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:29:47.550293    2564 generic.go:356] "Generic (PLEG): container finished" podID="2636358e-6725-40c2-8827-e8a7df071677" containerID="80f963f64b686ba26ffcd19474d773f842bbf2d7450e67249fba2186e41a2712" exitCode=0
Sep 08 07:29:47.550806 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:29:47.550343    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7e01ea-6ffd4dfc57-4gqx9"
Sep 08 07:29:47.550806 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:29:47.550369    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7e01ea-6ffd4dfc57-4gqx9" event={"ID":"2636358e-6725-40c2-8827-e8a7df071677","Type":"ContainerDied","Data":"80f963f64b686ba26ffcd19474d773f842bbf2d7450e67249fba2186e41a2712"}
Sep 08 07:29:47.550806 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:29:47.550429    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7e01ea-6ffd4dfc57-4gqx9" event={"ID":"2636358e-6725-40c2-8827-e8a7df071677","Type":"ContainerDied","Data":"d1ceba224a5a99a45952f73929a9152807e10131f7128aaf7f6e2f7ecd8108ba"}
Sep 08 07:29:47.550806 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:29:47.550460    2564 scope.go:117] "RemoveContainer" containerID="80f963f64b686ba26ffcd19474d773f842bbf2d7450e67249fba2186e41a2712"
Sep 08 07:29:47.552160 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:29:47.552117    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7888-5ff6ee" event={"ID":"ed2125f1-ba4e-45dc-b3d8-cacd4418a6d1","Type":"ContainerStarted","Data":"1f48d80dd2d5fdb76b90f47a09251b93b88922bbe04ac80b09a0934673f3d8c4"}
Sep 08 07:29:47.573027 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:29:47.573000    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-7e01ea-6ffd4dfc57-4gqx9"]
Sep 08 07:29:47.576674 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:29:47.576640    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-7e01ea-6ffd4dfc57-4gqx9"]
Sep 08 07:29:47.677463 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:29:47.677070    2564 scope.go:117] "RemoveContainer" containerID="80f963f64b686ba26ffcd19474d773f842bbf2d7450e67249fba2186e41a2712"
Sep 08 07:29:47.677589 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:29:47.677555    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80f963f64b686ba26ffcd19474d773f842bbf2d7450e67249fba2186e41a2712\": container with ID starting with 80f963f64b686ba26ffcd19474d773f842bbf2d7450e67249fba2186e41a2712 not found: ID does not exist" containerID="80f963f64b686ba26ffcd19474d773f842bbf2d7450e67249fba2186e41a2712"
Sep 08 07:29:47.677662 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:29:47.677598    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80f963f64b686ba26ffcd19474d773f842bbf2d7450e67249fba2186e41a2712"} err="failed to get container status \"80f963f64b686ba26ffcd19474d773f842bbf2d7450e67249fba2186e41a2712\": rpc error: code = NotFound desc = could not find container \"80f963f64b686ba26ffcd19474d773f842bbf2d7450e67249fba2186e41a2712\": container with ID starting with 80f963f64b686ba26ffcd19474d773f842bbf2d7450e67249fba2186e41a2712 not found: ID does not exist"
Sep 08 07:29:48.511050 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:29:48.511012    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2636358e-6725-40c2-8827-e8a7df071677" path="/var/lib/kubelet/pods/2636358e-6725-40c2-8827-e8a7df071677/volumes"
Sep 08 07:29:48.559431 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:29:48.559390    2564 generic.go:356] "Generic (PLEG): container finished" podID="ed2125f1-ba4e-45dc-b3d8-cacd4418a6d1" containerID="2ac786440e6a68533757ff1388ef5a977106a0ff1280824987f6811e9eab1911" exitCode=0
Sep 08 07:29:48.559785 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:29:48.559439    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7888-5ff6ee" event={"ID":"ed2125f1-ba4e-45dc-b3d8-cacd4418a6d1","Type":"ContainerDied","Data":"2ac786440e6a68533757ff1388ef5a977106a0ff1280824987f6811e9eab1911"}
Sep 08 07:29:49.697372 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:29:49.697348    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7888-5ff6ee"
Sep 08 07:29:49.729112 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:29:49.729087    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_mt-curl-7888-5ff6ee_ed2125f1-ba4e-45dc-b3d8-cacd4418a6d1/mt-curl-7888-5ff6ee/0.log"
Sep 08 07:29:49.749387 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:29:49.749352    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/mt-curl-7888-5ff6ee"]
Sep 08 07:29:49.753531 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:29:49.753499    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/mt-curl-7888-5ff6ee"]
Sep 08 07:29:49.826677 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:29:49.826538    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lqq5h\" (UniqueName: \"kubernetes.io/projected/ed2125f1-ba4e-45dc-b3d8-cacd4418a6d1-kube-api-access-lqq5h\") pod \"ed2125f1-ba4e-45dc-b3d8-cacd4418a6d1\" (UID: \"ed2125f1-ba4e-45dc-b3d8-cacd4418a6d1\") "
Sep 08 07:29:49.828685 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:29:49.828655    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed2125f1-ba4e-45dc-b3d8-cacd4418a6d1-kube-api-access-lqq5h" (OuterVolumeSpecName: "kube-api-access-lqq5h") pod "ed2125f1-ba4e-45dc-b3d8-cacd4418a6d1" (UID: "ed2125f1-ba4e-45dc-b3d8-cacd4418a6d1"). InnerVolumeSpecName "kube-api-access-lqq5h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 07:29:49.928269 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:29:49.928226    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lqq5h\" (UniqueName: \"kubernetes.io/projected/ed2125f1-ba4e-45dc-b3d8-cacd4418a6d1-kube-api-access-lqq5h\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:29:50.510775 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:29:50.510694    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed2125f1-ba4e-45dc-b3d8-cacd4418a6d1" path="/var/lib/kubelet/pods/ed2125f1-ba4e-45dc-b3d8-cacd4418a6d1/volumes"
Sep 08 07:29:50.571604 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:29:50.571576    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7888-5ff6ee"
Sep 08 07:29:50.571783 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:29:50.571629    2564 scope.go:117] "RemoveContainer" containerID="2ac786440e6a68533757ff1388ef5a977106a0ff1280824987f6811e9eab1911"
Sep 08 07:30:04.045742 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:04.045702    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:30:09.451488 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:09.451423    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-f0e0d8-5b59bd6c94-rpws9"]
Sep 08 07:30:09.451908 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:09.451653    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f0e0d8-5b59bd6c94-rpws9" podUID="45649e8f-c326-4749-a2cc-eacdcb539583" containerName="maas-api" containerID="cri-o://4d5795af32d16a193fd2267dca241702688876dd5e27b49f411e3315f6c4677a" gracePeriod=30
Sep 08 07:30:09.683985 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:09.683942    2564 generic.go:356] "Generic (PLEG): container finished" podID="45649e8f-c326-4749-a2cc-eacdcb539583" containerID="4d5795af32d16a193fd2267dca241702688876dd5e27b49f411e3315f6c4677a" exitCode=0
Sep 08 07:30:09.684125 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:09.684025    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f0e0d8-5b59bd6c94-rpws9" event={"ID":"45649e8f-c326-4749-a2cc-eacdcb539583","Type":"ContainerDied","Data":"4d5795af32d16a193fd2267dca241702688876dd5e27b49f411e3315f6c4677a"}
Sep 08 07:30:09.707329 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:09.707278    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f0e0d8-5b59bd6c94-rpws9"
Sep 08 07:30:09.724302 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:09.724279    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/45649e8f-c326-4749-a2cc-eacdcb539583-maas-api-tls\") pod \"45649e8f-c326-4749-a2cc-eacdcb539583\" (UID: \"45649e8f-c326-4749-a2cc-eacdcb539583\") "
Sep 08 07:30:09.724396 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:09.724308    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45649e8f-c326-4749-a2cc-eacdcb539583-metrics-certs\") pod \"45649e8f-c326-4749-a2cc-eacdcb539583\" (UID: \"45649e8f-c326-4749-a2cc-eacdcb539583\") "
Sep 08 07:30:09.724396 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:09.724358    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/45649e8f-c326-4749-a2cc-eacdcb539583-openshift-service-ca\") pod \"45649e8f-c326-4749-a2cc-eacdcb539583\" (UID: \"45649e8f-c326-4749-a2cc-eacdcb539583\") "
Sep 08 07:30:09.724481 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:09.724429    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9skvs\" (UniqueName: \"kubernetes.io/projected/45649e8f-c326-4749-a2cc-eacdcb539583-kube-api-access-9skvs\") pod \"45649e8f-c326-4749-a2cc-eacdcb539583\" (UID: \"45649e8f-c326-4749-a2cc-eacdcb539583\") "
Sep 08 07:30:09.724770 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:09.724742    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45649e8f-c326-4749-a2cc-eacdcb539583-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "45649e8f-c326-4749-a2cc-eacdcb539583" (UID: "45649e8f-c326-4749-a2cc-eacdcb539583"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 07:30:09.726878 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:09.726819    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45649e8f-c326-4749-a2cc-eacdcb539583-kube-api-access-9skvs" (OuterVolumeSpecName: "kube-api-access-9skvs") pod "45649e8f-c326-4749-a2cc-eacdcb539583" (UID: "45649e8f-c326-4749-a2cc-eacdcb539583"). InnerVolumeSpecName "kube-api-access-9skvs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 07:30:09.727538 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:09.727512    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45649e8f-c326-4749-a2cc-eacdcb539583-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "45649e8f-c326-4749-a2cc-eacdcb539583" (UID: "45649e8f-c326-4749-a2cc-eacdcb539583"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 07:30:09.727682 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:09.727654    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45649e8f-c326-4749-a2cc-eacdcb539583-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "45649e8f-c326-4749-a2cc-eacdcb539583" (UID: "45649e8f-c326-4749-a2cc-eacdcb539583"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 07:30:09.825563 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:09.825534    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/45649e8f-c326-4749-a2cc-eacdcb539583-maas-api-tls\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:30:09.825563 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:09.825561    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45649e8f-c326-4749-a2cc-eacdcb539583-metrics-certs\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:30:09.825761 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:09.825570    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/45649e8f-c326-4749-a2cc-eacdcb539583-openshift-service-ca\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:30:09.825761 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:09.825580    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9skvs\" (UniqueName: \"kubernetes.io/projected/45649e8f-c326-4749-a2cc-eacdcb539583-kube-api-access-9skvs\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:30:10.691224 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:10.691193    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f0e0d8-5b59bd6c94-rpws9"
Sep 08 07:30:10.691224 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:10.691219    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f0e0d8-5b59bd6c94-rpws9" event={"ID":"45649e8f-c326-4749-a2cc-eacdcb539583","Type":"ContainerDied","Data":"fcd668b42bed8f4787cc1d78e415c6f879562e04aa4f93263673d30828a2a3f4"}
Sep 08 07:30:10.691754 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:10.691282    2564 scope.go:117] "RemoveContainer" containerID="4d5795af32d16a193fd2267dca241702688876dd5e27b49f411e3315f6c4677a"
Sep 08 07:30:10.709400 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:10.709369    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-f0e0d8-5b59bd6c94-rpws9"]
Sep 08 07:30:10.711276 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:10.711254    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-f0e0d8-5b59bd6c94-rpws9"]
Sep 08 07:30:12.512442 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:12.512408    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45649e8f-c326-4749-a2cc-eacdcb539583" path="/var/lib/kubelet/pods/45649e8f-c326-4749-a2cc-eacdcb539583/volumes"
Sep 08 07:30:16.048734 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:16.048704    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:30:27.457993 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:27.457930    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-37abc6-5c848b8ff-7zlg2"]
Sep 08 07:30:27.458482 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:27.458232    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-37abc6-5c848b8ff-7zlg2" podUID="fa179a28-3241-4355-a099-e65a72fdea00" containerName="maas-api" containerID="cri-o://eae4be1949782791be064b42a24b15469cb44ce9a24ce1e2dee6881d2b36b183" gracePeriod=30
Sep 08 07:30:27.738009 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:27.737955    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-37abc6-5c848b8ff-7zlg2"
Sep 08 07:30:27.787927 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:27.787890    2564 generic.go:356] "Generic (PLEG): container finished" podID="fa179a28-3241-4355-a099-e65a72fdea00" containerID="eae4be1949782791be064b42a24b15469cb44ce9a24ce1e2dee6881d2b36b183" exitCode=0
Sep 08 07:30:27.787927 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:27.787939    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-37abc6-5c848b8ff-7zlg2"
Sep 08 07:30:27.788254 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:27.788010    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-37abc6-5c848b8ff-7zlg2" event={"ID":"fa179a28-3241-4355-a099-e65a72fdea00","Type":"ContainerDied","Data":"eae4be1949782791be064b42a24b15469cb44ce9a24ce1e2dee6881d2b36b183"}
Sep 08 07:30:27.788254 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:27.788054    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-37abc6-5c848b8ff-7zlg2" event={"ID":"fa179a28-3241-4355-a099-e65a72fdea00","Type":"ContainerDied","Data":"c35e4904b7dedadb7c5d84f7acef4fc46db6f18e32496536ecd8242a7368ca46"}
Sep 08 07:30:27.788254 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:27.788082    2564 scope.go:117] "RemoveContainer" containerID="eae4be1949782791be064b42a24b15469cb44ce9a24ce1e2dee6881d2b36b183"
Sep 08 07:30:27.800444 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:27.799383    2564 scope.go:117] "RemoveContainer" containerID="eae4be1949782791be064b42a24b15469cb44ce9a24ce1e2dee6881d2b36b183"
Sep 08 07:30:27.802042 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:30:27.802010    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eae4be1949782791be064b42a24b15469cb44ce9a24ce1e2dee6881d2b36b183\": container with ID starting with eae4be1949782791be064b42a24b15469cb44ce9a24ce1e2dee6881d2b36b183 not found: ID does not exist" containerID="eae4be1949782791be064b42a24b15469cb44ce9a24ce1e2dee6881d2b36b183"
Sep 08 07:30:27.802156 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:27.802053    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eae4be1949782791be064b42a24b15469cb44ce9a24ce1e2dee6881d2b36b183"} err="failed to get container status \"eae4be1949782791be064b42a24b15469cb44ce9a24ce1e2dee6881d2b36b183\": rpc error: code = NotFound desc = could not find container \"eae4be1949782791be064b42a24b15469cb44ce9a24ce1e2dee6881d2b36b183\": container with ID starting with eae4be1949782791be064b42a24b15469cb44ce9a24ce1e2dee6881d2b36b183 not found: ID does not exist"
Sep 08 07:30:27.906387 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:27.906350    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa179a28-3241-4355-a099-e65a72fdea00-metrics-certs\") pod \"fa179a28-3241-4355-a099-e65a72fdea00\" (UID: \"fa179a28-3241-4355-a099-e65a72fdea00\") "
Sep 08 07:30:27.906571 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:27.906414    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa179a28-3241-4355-a099-e65a72fdea00-openshift-service-ca\") pod \"fa179a28-3241-4355-a099-e65a72fdea00\" (UID: \"fa179a28-3241-4355-a099-e65a72fdea00\") "
Sep 08 07:30:27.906571 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:27.906482    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dc7jh\" (UniqueName: \"kubernetes.io/projected/fa179a28-3241-4355-a099-e65a72fdea00-kube-api-access-dc7jh\") pod \"fa179a28-3241-4355-a099-e65a72fdea00\" (UID: \"fa179a28-3241-4355-a099-e65a72fdea00\") "
Sep 08 07:30:27.906690 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:27.906569    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa179a28-3241-4355-a099-e65a72fdea00-maas-api-tls\") pod \"fa179a28-3241-4355-a099-e65a72fdea00\" (UID: \"fa179a28-3241-4355-a099-e65a72fdea00\") "
Sep 08 07:30:27.906958 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:27.906821    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa179a28-3241-4355-a099-e65a72fdea00-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fa179a28-3241-4355-a099-e65a72fdea00" (UID: "fa179a28-3241-4355-a099-e65a72fdea00"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 07:30:27.906958 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:27.906907    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa179a28-3241-4355-a099-e65a72fdea00-openshift-service-ca\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:30:27.908898 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:27.908873    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa179a28-3241-4355-a099-e65a72fdea00-kube-api-access-dc7jh" (OuterVolumeSpecName: "kube-api-access-dc7jh") pod "fa179a28-3241-4355-a099-e65a72fdea00" (UID: "fa179a28-3241-4355-a099-e65a72fdea00"). InnerVolumeSpecName "kube-api-access-dc7jh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 07:30:27.909134 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:27.909115    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa179a28-3241-4355-a099-e65a72fdea00-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "fa179a28-3241-4355-a099-e65a72fdea00" (UID: "fa179a28-3241-4355-a099-e65a72fdea00"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 07:30:27.909315 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:27.909297    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa179a28-3241-4355-a099-e65a72fdea00-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fa179a28-3241-4355-a099-e65a72fdea00" (UID: "fa179a28-3241-4355-a099-e65a72fdea00"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 07:30:28.008106 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:28.008025    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dc7jh\" (UniqueName: \"kubernetes.io/projected/fa179a28-3241-4355-a099-e65a72fdea00-kube-api-access-dc7jh\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:30:28.008106 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:28.008055    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa179a28-3241-4355-a099-e65a72fdea00-maas-api-tls\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:30:28.008106 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:28.008065    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa179a28-3241-4355-a099-e65a72fdea00-metrics-certs\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:30:28.110875 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:28.110847    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-37abc6-5c848b8ff-7zlg2"]
Sep 08 07:30:28.114493 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:28.114470    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-37abc6-5c848b8ff-7zlg2"]
Sep 08 07:30:28.516803 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:28.516760    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa179a28-3241-4355-a099-e65a72fdea00" path="/var/lib/kubelet/pods/fa179a28-3241-4355-a099-e65a72fdea00/volumes"
Sep 08 07:30:31.937184 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:31.937138    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:30:34.320188 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:34.320156    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c"]
Sep 08 07:30:34.320652 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:34.320449    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c" podUID="256362b2-f2b0-457a-beb7-12752bc16b41" containerName="istio-proxy" containerID="cri-o://43847637875f736084fe5c8755c44750180dd7f063774872ec1d60f95ba89618" gracePeriod=30
Sep 08 07:30:35.178204 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:35.178148    2564 patch_prober.go:28] interesting pod/e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 07:30:35.178378 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:35.178231    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c" podUID="256362b2-f2b0-457a-beb7-12752bc16b41" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 07:30:39.583962 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:39.583905    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c"
Sep 08 07:30:39.618773 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:39.618744    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/256362b2-f2b0-457a-beb7-12752bc16b41-workload-socket\") pod \"256362b2-f2b0-457a-beb7-12752bc16b41\" (UID: \"256362b2-f2b0-457a-beb7-12752bc16b41\") "
Sep 08 07:30:39.618922 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:39.618796    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/256362b2-f2b0-457a-beb7-12752bc16b41-istiod-ca-cert\") pod \"256362b2-f2b0-457a-beb7-12752bc16b41\" (UID: \"256362b2-f2b0-457a-beb7-12752bc16b41\") "
Sep 08 07:30:39.618922 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:39.618826    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/256362b2-f2b0-457a-beb7-12752bc16b41-istio-data\") pod \"256362b2-f2b0-457a-beb7-12752bc16b41\" (UID: \"256362b2-f2b0-457a-beb7-12752bc16b41\") "
Sep 08 07:30:39.618922 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:39.618895    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/256362b2-f2b0-457a-beb7-12752bc16b41-istio-envoy\") pod \"256362b2-f2b0-457a-beb7-12752bc16b41\" (UID: \"256362b2-f2b0-457a-beb7-12752bc16b41\") "
Sep 08 07:30:39.619128 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:39.618954    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8cvlh\" (UniqueName: \"kubernetes.io/projected/256362b2-f2b0-457a-beb7-12752bc16b41-kube-api-access-8cvlh\") pod \"256362b2-f2b0-457a-beb7-12752bc16b41\" (UID: \"256362b2-f2b0-457a-beb7-12752bc16b41\") "
Sep 08 07:30:39.619128 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:39.619001    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/256362b2-f2b0-457a-beb7-12752bc16b41-credential-socket\") pod \"256362b2-f2b0-457a-beb7-12752bc16b41\" (UID: \"256362b2-f2b0-457a-beb7-12752bc16b41\") "
Sep 08 07:30:39.619128 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:39.619048    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/256362b2-f2b0-457a-beb7-12752bc16b41-istio-podinfo\") pod \"256362b2-f2b0-457a-beb7-12752bc16b41\" (UID: \"256362b2-f2b0-457a-beb7-12752bc16b41\") "
Sep 08 07:30:39.619128 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:39.619075    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/256362b2-f2b0-457a-beb7-12752bc16b41-workload-certs\") pod \"256362b2-f2b0-457a-beb7-12752bc16b41\" (UID: \"256362b2-f2b0-457a-beb7-12752bc16b41\") "
Sep 08 07:30:39.619128 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:39.619082    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/256362b2-f2b0-457a-beb7-12752bc16b41-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "256362b2-f2b0-457a-beb7-12752bc16b41" (UID: "256362b2-f2b0-457a-beb7-12752bc16b41"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 07:30:39.619128 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:39.619097    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/256362b2-f2b0-457a-beb7-12752bc16b41-istio-token\") pod \"256362b2-f2b0-457a-beb7-12752bc16b41\" (UID: \"256362b2-f2b0-457a-beb7-12752bc16b41\") "
Sep 08 07:30:39.619402 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:39.619155    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/256362b2-f2b0-457a-beb7-12752bc16b41-istio-data" (OuterVolumeSpecName: "istio-data") pod "256362b2-f2b0-457a-beb7-12752bc16b41" (UID: "256362b2-f2b0-457a-beb7-12752bc16b41"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 07:30:39.619477 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:39.619413    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/256362b2-f2b0-457a-beb7-12752bc16b41-istio-data\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:30:39.619477 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:39.619439    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/256362b2-f2b0-457a-beb7-12752bc16b41-workload-socket\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:30:39.619862 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:39.619833    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/256362b2-f2b0-457a-beb7-12752bc16b41-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "256362b2-f2b0-457a-beb7-12752bc16b41" (UID: "256362b2-f2b0-457a-beb7-12752bc16b41"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 07:30:39.620024 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:39.619905    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/256362b2-f2b0-457a-beb7-12752bc16b41-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "256362b2-f2b0-457a-beb7-12752bc16b41" (UID: "256362b2-f2b0-457a-beb7-12752bc16b41"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 07:30:39.620024 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:39.619962    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/256362b2-f2b0-457a-beb7-12752bc16b41-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "256362b2-f2b0-457a-beb7-12752bc16b41" (UID: "256362b2-f2b0-457a-beb7-12752bc16b41"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 07:30:39.621392 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:39.621368    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/256362b2-f2b0-457a-beb7-12752bc16b41-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "256362b2-f2b0-457a-beb7-12752bc16b41" (UID: "256362b2-f2b0-457a-beb7-12752bc16b41"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 07:30:39.621592 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:39.621573    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/256362b2-f2b0-457a-beb7-12752bc16b41-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "256362b2-f2b0-457a-beb7-12752bc16b41" (UID: "256362b2-f2b0-457a-beb7-12752bc16b41"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 07:30:39.621790 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:39.621766    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/256362b2-f2b0-457a-beb7-12752bc16b41-kube-api-access-8cvlh" (OuterVolumeSpecName: "kube-api-access-8cvlh") pod "256362b2-f2b0-457a-beb7-12752bc16b41" (UID: "256362b2-f2b0-457a-beb7-12752bc16b41"). InnerVolumeSpecName "kube-api-access-8cvlh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 07:30:39.621907 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:39.621880    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/256362b2-f2b0-457a-beb7-12752bc16b41-istio-token" (OuterVolumeSpecName: "istio-token") pod "256362b2-f2b0-457a-beb7-12752bc16b41" (UID: "256362b2-f2b0-457a-beb7-12752bc16b41"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 07:30:39.720594 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:39.720549    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/256362b2-f2b0-457a-beb7-12752bc16b41-istio-podinfo\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:30:39.720594 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:39.720589    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/256362b2-f2b0-457a-beb7-12752bc16b41-workload-certs\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:30:39.720594 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:39.720600    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/256362b2-f2b0-457a-beb7-12752bc16b41-istio-token\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:30:39.720837 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:39.720611    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/256362b2-f2b0-457a-beb7-12752bc16b41-istiod-ca-cert\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:30:39.720837 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:39.720622    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/256362b2-f2b0-457a-beb7-12752bc16b41-istio-envoy\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:30:39.720837 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:39.720633    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8cvlh\" (UniqueName: \"kubernetes.io/projected/256362b2-f2b0-457a-beb7-12752bc16b41-kube-api-access-8cvlh\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:30:39.720837 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:39.720645    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/256362b2-f2b0-457a-beb7-12752bc16b41-credential-socket\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:30:39.853715 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:39.853637    2564 generic.go:356] "Generic (PLEG): container finished" podID="256362b2-f2b0-457a-beb7-12752bc16b41" containerID="43847637875f736084fe5c8755c44750180dd7f063774872ec1d60f95ba89618" exitCode=0
Sep 08 07:30:39.853715 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:39.853686    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c"
Sep 08 07:30:39.853886 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:39.853719    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c" event={"ID":"256362b2-f2b0-457a-beb7-12752bc16b41","Type":"ContainerDied","Data":"43847637875f736084fe5c8755c44750180dd7f063774872ec1d60f95ba89618"}
Sep 08 07:30:39.853886 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:39.853777    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c" event={"ID":"256362b2-f2b0-457a-beb7-12752bc16b41","Type":"ContainerDied","Data":"321e5d4699b733bee0db1e1fd2b1773132373a80189f3bc15c758d666826db52"}
Sep 08 07:30:39.853886 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:39.853806    2564 scope.go:117] "RemoveContainer" containerID="43847637875f736084fe5c8755c44750180dd7f063774872ec1d60f95ba89618"
Sep 08 07:30:39.863323 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:39.863304    2564 scope.go:117] "RemoveContainer" containerID="a7248397509d4192b32dcca099c05d8fd9f6c65c6276c04f579af8145cf83bd7"
Sep 08 07:30:39.871530 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:39.871513    2564 scope.go:117] "RemoveContainer" containerID="43847637875f736084fe5c8755c44750180dd7f063774872ec1d60f95ba89618"
Sep 08 07:30:39.871794 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:30:39.871777    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43847637875f736084fe5c8755c44750180dd7f063774872ec1d60f95ba89618\": container with ID starting with 43847637875f736084fe5c8755c44750180dd7f063774872ec1d60f95ba89618 not found: ID does not exist" containerID="43847637875f736084fe5c8755c44750180dd7f063774872ec1d60f95ba89618"
Sep 08 07:30:39.871843 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:39.871802    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43847637875f736084fe5c8755c44750180dd7f063774872ec1d60f95ba89618"} err="failed to get container status \"43847637875f736084fe5c8755c44750180dd7f063774872ec1d60f95ba89618\": rpc error: code = NotFound desc = could not find container \"43847637875f736084fe5c8755c44750180dd7f063774872ec1d60f95ba89618\": container with ID starting with 43847637875f736084fe5c8755c44750180dd7f063774872ec1d60f95ba89618 not found: ID does not exist"
Sep 08 07:30:39.871843 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:39.871819    2564 scope.go:117] "RemoveContainer" containerID="a7248397509d4192b32dcca099c05d8fd9f6c65c6276c04f579af8145cf83bd7"
Sep 08 07:30:39.872102 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:30:39.872069    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7248397509d4192b32dcca099c05d8fd9f6c65c6276c04f579af8145cf83bd7\": container with ID starting with a7248397509d4192b32dcca099c05d8fd9f6c65c6276c04f579af8145cf83bd7 not found: ID does not exist" containerID="a7248397509d4192b32dcca099c05d8fd9f6c65c6276c04f579af8145cf83bd7"
Sep 08 07:30:39.872102 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:39.872090    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7248397509d4192b32dcca099c05d8fd9f6c65c6276c04f579af8145cf83bd7"} err="failed to get container status \"a7248397509d4192b32dcca099c05d8fd9f6c65c6276c04f579af8145cf83bd7\": rpc error: code = NotFound desc = could not find container \"a7248397509d4192b32dcca099c05d8fd9f6c65c6276c04f579af8145cf83bd7\": container with ID starting with a7248397509d4192b32dcca099c05d8fd9f6c65c6276c04f579af8145cf83bd7 not found: ID does not exist"
Sep 08 07:30:39.875065 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:39.875046    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c"]
Sep 08 07:30:39.882669 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:39.882647    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-37abc6-openshift-default-dbcfc774-7zn5c"]
Sep 08 07:30:40.510770 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:40.510735    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="256362b2-f2b0-457a-beb7-12752bc16b41" path="/var/lib/kubelet/pods/256362b2-f2b0-457a-beb7-12752bc16b41/volumes"
Sep 08 07:30:45.048088 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:45.048054    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:30:45.231209 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:45.231170    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-0ca807-6785f9cb5f-tr8c4"]
Sep 08 07:30:45.231433 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:45.231381    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-0ca807-6785f9cb5f-tr8c4" podUID="7a190a8c-54b7-404a-8437-6b29e11c549d" containerName="maas-api" containerID="cri-o://6e52a63d3039334f52fc277f280f51fb39ff3addcdc222cad14b34d8f3aa7ba3" gracePeriod=30
Sep 08 07:30:45.497250 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:45.497225    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-0ca807-6785f9cb5f-tr8c4"
Sep 08 07:30:45.573820 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:45.573788    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a190a8c-54b7-404a-8437-6b29e11c549d-maas-api-tls\") pod \"7a190a8c-54b7-404a-8437-6b29e11c549d\" (UID: \"7a190a8c-54b7-404a-8437-6b29e11c549d\") "
Sep 08 07:30:45.573963 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:45.573871    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9b2xz\" (UniqueName: \"kubernetes.io/projected/7a190a8c-54b7-404a-8437-6b29e11c549d-kube-api-access-9b2xz\") pod \"7a190a8c-54b7-404a-8437-6b29e11c549d\" (UID: \"7a190a8c-54b7-404a-8437-6b29e11c549d\") "
Sep 08 07:30:45.573963 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:45.573906    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a190a8c-54b7-404a-8437-6b29e11c549d-metrics-certs\") pod \"7a190a8c-54b7-404a-8437-6b29e11c549d\" (UID: \"7a190a8c-54b7-404a-8437-6b29e11c549d\") "
Sep 08 07:30:45.573963 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:45.573940    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a190a8c-54b7-404a-8437-6b29e11c549d-openshift-service-ca\") pod \"7a190a8c-54b7-404a-8437-6b29e11c549d\" (UID: \"7a190a8c-54b7-404a-8437-6b29e11c549d\") "
Sep 08 07:30:45.574357 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:45.574326    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a190a8c-54b7-404a-8437-6b29e11c549d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7a190a8c-54b7-404a-8437-6b29e11c549d" (UID: "7a190a8c-54b7-404a-8437-6b29e11c549d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 07:30:45.576133 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:45.576111    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a190a8c-54b7-404a-8437-6b29e11c549d-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "7a190a8c-54b7-404a-8437-6b29e11c549d" (UID: "7a190a8c-54b7-404a-8437-6b29e11c549d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 07:30:45.576225 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:45.576135    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a190a8c-54b7-404a-8437-6b29e11c549d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7a190a8c-54b7-404a-8437-6b29e11c549d" (UID: "7a190a8c-54b7-404a-8437-6b29e11c549d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 07:30:45.576225 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:45.576186    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a190a8c-54b7-404a-8437-6b29e11c549d-kube-api-access-9b2xz" (OuterVolumeSpecName: "kube-api-access-9b2xz") pod "7a190a8c-54b7-404a-8437-6b29e11c549d" (UID: "7a190a8c-54b7-404a-8437-6b29e11c549d"). InnerVolumeSpecName "kube-api-access-9b2xz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 07:30:45.675713 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:45.675629    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9b2xz\" (UniqueName: \"kubernetes.io/projected/7a190a8c-54b7-404a-8437-6b29e11c549d-kube-api-access-9b2xz\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:30:45.675713 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:45.675660    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a190a8c-54b7-404a-8437-6b29e11c549d-metrics-certs\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:30:45.675713 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:45.675669    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a190a8c-54b7-404a-8437-6b29e11c549d-openshift-service-ca\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:30:45.675713 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:45.675678    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a190a8c-54b7-404a-8437-6b29e11c549d-maas-api-tls\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:30:45.889628 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:45.889581    2564 generic.go:356] "Generic (PLEG): container finished" podID="7a190a8c-54b7-404a-8437-6b29e11c549d" containerID="6e52a63d3039334f52fc277f280f51fb39ff3addcdc222cad14b34d8f3aa7ba3" exitCode=0
Sep 08 07:30:45.889628 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:45.889629    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-0ca807-6785f9cb5f-tr8c4" event={"ID":"7a190a8c-54b7-404a-8437-6b29e11c549d","Type":"ContainerDied","Data":"6e52a63d3039334f52fc277f280f51fb39ff3addcdc222cad14b34d8f3aa7ba3"}
Sep 08 07:30:45.889830 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:45.889637    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-0ca807-6785f9cb5f-tr8c4"
Sep 08 07:30:45.889830 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:45.889685    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-0ca807-6785f9cb5f-tr8c4" event={"ID":"7a190a8c-54b7-404a-8437-6b29e11c549d","Type":"ContainerDied","Data":"4e79b2cc8baf320e7c29ad1402bb31d8877318a6fd1a463bfc741f79802087ec"}
Sep 08 07:30:45.889830 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:45.889717    2564 scope.go:117] "RemoveContainer" containerID="6e52a63d3039334f52fc277f280f51fb39ff3addcdc222cad14b34d8f3aa7ba3"
Sep 08 07:30:45.899507 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:45.899487    2564 scope.go:117] "RemoveContainer" containerID="6e52a63d3039334f52fc277f280f51fb39ff3addcdc222cad14b34d8f3aa7ba3"
Sep 08 07:30:45.899811 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:30:45.899791    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e52a63d3039334f52fc277f280f51fb39ff3addcdc222cad14b34d8f3aa7ba3\": container with ID starting with 6e52a63d3039334f52fc277f280f51fb39ff3addcdc222cad14b34d8f3aa7ba3 not found: ID does not exist" containerID="6e52a63d3039334f52fc277f280f51fb39ff3addcdc222cad14b34d8f3aa7ba3"
Sep 08 07:30:45.899865 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:45.899821    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e52a63d3039334f52fc277f280f51fb39ff3addcdc222cad14b34d8f3aa7ba3"} err="failed to get container status \"6e52a63d3039334f52fc277f280f51fb39ff3addcdc222cad14b34d8f3aa7ba3\": rpc error: code = NotFound desc = could not find container \"6e52a63d3039334f52fc277f280f51fb39ff3addcdc222cad14b34d8f3aa7ba3\": container with ID starting with 6e52a63d3039334f52fc277f280f51fb39ff3addcdc222cad14b34d8f3aa7ba3 not found: ID does not exist"
Sep 08 07:30:45.912381 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:45.912352    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-0ca807-6785f9cb5f-tr8c4"]
Sep 08 07:30:45.922737 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:45.922707    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-0ca807-6785f9cb5f-tr8c4"]
Sep 08 07:30:46.511274 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:46.511240    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a190a8c-54b7-404a-8437-6b29e11c549d" path="/var/lib/kubelet/pods/7a190a8c-54b7-404a-8437-6b29e11c549d/volumes"
Sep 08 07:30:55.638641 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:30:55.638602    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:31:07.248123 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:07.248041    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:31:17.359172 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:17.359125    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:31:24.746999 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:24.746939    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg"]
Sep 08 07:31:24.747592 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:24.747572    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a190a8c-54b7-404a-8437-6b29e11c549d" containerName="maas-api"
Sep 08 07:31:24.747683 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:24.747595    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a190a8c-54b7-404a-8437-6b29e11c549d" containerName="maas-api"
Sep 08 07:31:24.747683 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:24.747607    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed2125f1-ba4e-45dc-b3d8-cacd4418a6d1" containerName="mt-curl-7888-5ff6ee"
Sep 08 07:31:24.747683 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:24.747615    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed2125f1-ba4e-45dc-b3d8-cacd4418a6d1" containerName="mt-curl-7888-5ff6ee"
Sep 08 07:31:24.747683 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:24.747629    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2636358e-6725-40c2-8827-e8a7df071677" containerName="maas-api"
Sep 08 07:31:24.747683 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:24.747637    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="2636358e-6725-40c2-8827-e8a7df071677" containerName="maas-api"
Sep 08 07:31:24.747683 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:24.747656    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="256362b2-f2b0-457a-beb7-12752bc16b41" containerName="istio-proxy"
Sep 08 07:31:24.747683 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:24.747664    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="256362b2-f2b0-457a-beb7-12752bc16b41" containerName="istio-proxy"
Sep 08 07:31:24.747683 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:24.747675    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="256362b2-f2b0-457a-beb7-12752bc16b41" containerName="istio-proxy"
Sep 08 07:31:24.747683 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:24.747683    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="256362b2-f2b0-457a-beb7-12752bc16b41" containerName="istio-proxy"
Sep 08 07:31:24.748159 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:24.747708    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa179a28-3241-4355-a099-e65a72fdea00" containerName="maas-api"
Sep 08 07:31:24.748159 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:24.747717    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa179a28-3241-4355-a099-e65a72fdea00" containerName="maas-api"
Sep 08 07:31:24.748159 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:24.747730    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45649e8f-c326-4749-a2cc-eacdcb539583" containerName="maas-api"
Sep 08 07:31:24.748159 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:24.747738    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="45649e8f-c326-4749-a2cc-eacdcb539583" containerName="maas-api"
Sep 08 07:31:24.748159 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:24.747847    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="45649e8f-c326-4749-a2cc-eacdcb539583" containerName="maas-api"
Sep 08 07:31:24.748159 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:24.747858    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed2125f1-ba4e-45dc-b3d8-cacd4418a6d1" containerName="mt-curl-7888-5ff6ee"
Sep 08 07:31:24.748159 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:24.747868    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a190a8c-54b7-404a-8437-6b29e11c549d" containerName="maas-api"
Sep 08 07:31:24.748159 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:24.747879    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="256362b2-f2b0-457a-beb7-12752bc16b41" containerName="istio-proxy"
Sep 08 07:31:24.748159 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:24.747887    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="2636358e-6725-40c2-8827-e8a7df071677" containerName="maas-api"
Sep 08 07:31:24.748159 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:24.747897    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa179a28-3241-4355-a099-e65a72fdea00" containerName="maas-api"
Sep 08 07:31:24.748159 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:24.747907    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="256362b2-f2b0-457a-beb7-12752bc16b41" containerName="istio-proxy"
Sep 08 07:31:24.751416 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:24.751397    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg"
Sep 08 07:31:24.753457 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:24.753438    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-4d980e-openshift-default-dockercfg-dn6m5\""
Sep 08 07:31:24.762482 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:24.762458    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg"]
Sep 08 07:31:24.831477 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:24.831444    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec441f8c-c44a-4968-9eaf-c49a7d1f095f-istio-data\") pod \"e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg\" (UID: \"ec441f8c-c44a-4968-9eaf-c49a7d1f095f\") " pod="openshift-ingress/e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg"
Sep 08 07:31:24.831664 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:24.831508    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec441f8c-c44a-4968-9eaf-c49a7d1f095f-workload-certs\") pod \"e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg\" (UID: \"ec441f8c-c44a-4968-9eaf-c49a7d1f095f\") " pod="openshift-ingress/e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg"
Sep 08 07:31:24.831664 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:24.831534    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dsm2\" (UniqueName: \"kubernetes.io/projected/ec441f8c-c44a-4968-9eaf-c49a7d1f095f-kube-api-access-9dsm2\") pod \"e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg\" (UID: \"ec441f8c-c44a-4968-9eaf-c49a7d1f095f\") " pod="openshift-ingress/e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg"
Sep 08 07:31:24.831664 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:24.831563    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec441f8c-c44a-4968-9eaf-c49a7d1f095f-istio-podinfo\") pod \"e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg\" (UID: \"ec441f8c-c44a-4968-9eaf-c49a7d1f095f\") " pod="openshift-ingress/e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg"
Sep 08 07:31:24.831664 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:24.831598    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec441f8c-c44a-4968-9eaf-c49a7d1f095f-istiod-ca-cert\") pod \"e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg\" (UID: \"ec441f8c-c44a-4968-9eaf-c49a7d1f095f\") " pod="openshift-ingress/e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg"
Sep 08 07:31:24.831886 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:24.831659    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec441f8c-c44a-4968-9eaf-c49a7d1f095f-credential-socket\") pod \"e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg\" (UID: \"ec441f8c-c44a-4968-9eaf-c49a7d1f095f\") " pod="openshift-ingress/e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg"
Sep 08 07:31:24.831886 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:24.831713    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec441f8c-c44a-4968-9eaf-c49a7d1f095f-workload-socket\") pod \"e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg\" (UID: \"ec441f8c-c44a-4968-9eaf-c49a7d1f095f\") " pod="openshift-ingress/e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg"
Sep 08 07:31:24.831886 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:24.831749    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec441f8c-c44a-4968-9eaf-c49a7d1f095f-istio-token\") pod \"e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg\" (UID: \"ec441f8c-c44a-4968-9eaf-c49a7d1f095f\") " pod="openshift-ingress/e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg"
Sep 08 07:31:24.831886 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:24.831791    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec441f8c-c44a-4968-9eaf-c49a7d1f095f-istio-envoy\") pod \"e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg\" (UID: \"ec441f8c-c44a-4968-9eaf-c49a7d1f095f\") " pod="openshift-ingress/e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg"
Sep 08 07:31:24.932274 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:24.932237    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec441f8c-c44a-4968-9eaf-c49a7d1f095f-istio-envoy\") pod \"e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg\" (UID: \"ec441f8c-c44a-4968-9eaf-c49a7d1f095f\") " pod="openshift-ingress/e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg"
Sep 08 07:31:24.932461 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:24.932291    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec441f8c-c44a-4968-9eaf-c49a7d1f095f-istio-data\") pod \"e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg\" (UID: \"ec441f8c-c44a-4968-9eaf-c49a7d1f095f\") " pod="openshift-ingress/e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg"
Sep 08 07:31:24.932461 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:24.932327    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec441f8c-c44a-4968-9eaf-c49a7d1f095f-workload-certs\") pod \"e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg\" (UID: \"ec441f8c-c44a-4968-9eaf-c49a7d1f095f\") " pod="openshift-ingress/e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg"
Sep 08 07:31:24.932461 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:24.932343    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dsm2\" (UniqueName: \"kubernetes.io/projected/ec441f8c-c44a-4968-9eaf-c49a7d1f095f-kube-api-access-9dsm2\") pod \"e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg\" (UID: \"ec441f8c-c44a-4968-9eaf-c49a7d1f095f\") " pod="openshift-ingress/e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg"
Sep 08 07:31:24.932461 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:24.932363    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec441f8c-c44a-4968-9eaf-c49a7d1f095f-istio-podinfo\") pod \"e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg\" (UID: \"ec441f8c-c44a-4968-9eaf-c49a7d1f095f\") " pod="openshift-ingress/e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg"
Sep 08 07:31:24.932461 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:24.932397    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec441f8c-c44a-4968-9eaf-c49a7d1f095f-istiod-ca-cert\") pod \"e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg\" (UID: \"ec441f8c-c44a-4968-9eaf-c49a7d1f095f\") " pod="openshift-ingress/e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg"
Sep 08 07:31:24.932461 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:24.932440    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec441f8c-c44a-4968-9eaf-c49a7d1f095f-credential-socket\") pod \"e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg\" (UID: \"ec441f8c-c44a-4968-9eaf-c49a7d1f095f\") " pod="openshift-ingress/e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg"
Sep 08 07:31:24.932797 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:24.932477    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec441f8c-c44a-4968-9eaf-c49a7d1f095f-workload-socket\") pod \"e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg\" (UID: \"ec441f8c-c44a-4968-9eaf-c49a7d1f095f\") " pod="openshift-ingress/e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg"
Sep 08 07:31:24.932797 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:24.932511    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec441f8c-c44a-4968-9eaf-c49a7d1f095f-istio-token\") pod \"e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg\" (UID: \"ec441f8c-c44a-4968-9eaf-c49a7d1f095f\") " pod="openshift-ingress/e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg"
Sep 08 07:31:24.932797 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:24.932748    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec441f8c-c44a-4968-9eaf-c49a7d1f095f-workload-certs\") pod \"e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg\" (UID: \"ec441f8c-c44a-4968-9eaf-c49a7d1f095f\") " pod="openshift-ingress/e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg"
Sep 08 07:31:24.932797 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:24.932775    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec441f8c-c44a-4968-9eaf-c49a7d1f095f-istio-data\") pod \"e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg\" (UID: \"ec441f8c-c44a-4968-9eaf-c49a7d1f095f\") " pod="openshift-ingress/e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg"
Sep 08 07:31:24.933044 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:24.932951    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec441f8c-c44a-4968-9eaf-c49a7d1f095f-credential-socket\") pod \"e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg\" (UID: \"ec441f8c-c44a-4968-9eaf-c49a7d1f095f\") " pod="openshift-ingress/e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg"
Sep 08 07:31:24.933106 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:24.933050    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec441f8c-c44a-4968-9eaf-c49a7d1f095f-workload-socket\") pod \"e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg\" (UID: \"ec441f8c-c44a-4968-9eaf-c49a7d1f095f\") " pod="openshift-ingress/e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg"
Sep 08 07:31:24.933314 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:24.933296    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec441f8c-c44a-4968-9eaf-c49a7d1f095f-istiod-ca-cert\") pod \"e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg\" (UID: \"ec441f8c-c44a-4968-9eaf-c49a7d1f095f\") " pod="openshift-ingress/e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg"
Sep 08 07:31:24.934495 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:24.934462    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec441f8c-c44a-4968-9eaf-c49a7d1f095f-istio-envoy\") pod \"e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg\" (UID: \"ec441f8c-c44a-4968-9eaf-c49a7d1f095f\") " pod="openshift-ingress/e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg"
Sep 08 07:31:24.935107 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:24.935089    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec441f8c-c44a-4968-9eaf-c49a7d1f095f-istio-podinfo\") pod \"e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg\" (UID: \"ec441f8c-c44a-4968-9eaf-c49a7d1f095f\") " pod="openshift-ingress/e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg"
Sep 08 07:31:24.940373 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:24.940351    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dsm2\" (UniqueName: \"kubernetes.io/projected/ec441f8c-c44a-4968-9eaf-c49a7d1f095f-kube-api-access-9dsm2\") pod \"e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg\" (UID: \"ec441f8c-c44a-4968-9eaf-c49a7d1f095f\") " pod="openshift-ingress/e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg"
Sep 08 07:31:24.940476 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:24.940380    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec441f8c-c44a-4968-9eaf-c49a7d1f095f-istio-token\") pod \"e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg\" (UID: \"ec441f8c-c44a-4968-9eaf-c49a7d1f095f\") " pod="openshift-ingress/e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg"
Sep 08 07:31:25.065252 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:25.065222    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg"
Sep 08 07:31:25.350664 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:25.350634    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg"]
Sep 08 07:31:25.352611 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:31:25.352583    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec441f8c_c44a_4968_9eaf_c49a7d1f095f.slice/crio-416137027e2b5d9d0accb8568fecff8e173edd2712a76e910c3df97a78c12a92 WatchSource:0}: Error finding container 416137027e2b5d9d0accb8568fecff8e173edd2712a76e910c3df97a78c12a92: Status 404 returned error can't find the container with id 416137027e2b5d9d0accb8568fecff8e173edd2712a76e910c3df97a78c12a92
Sep 08 07:31:25.354830 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:25.354790    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 07:31:25.354935 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:25.354865    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 07:31:25.354935 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:25.354914    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 07:31:26.099544 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:26.099507    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg" event={"ID":"ec441f8c-c44a-4968-9eaf-c49a7d1f095f","Type":"ContainerStarted","Data":"ec9d01d6293147946c2b7bbff6d873edc78ed0ccca99bf117950664c9d608a25"}
Sep 08 07:31:26.099994 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:26.099562    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg" event={"ID":"ec441f8c-c44a-4968-9eaf-c49a7d1f095f","Type":"ContainerStarted","Data":"416137027e2b5d9d0accb8568fecff8e173edd2712a76e910c3df97a78c12a92"}
Sep 08 07:31:26.119316 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:26.119267    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg" podStartSLOduration=2.119249677 podStartE2EDuration="2.119249677s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:31:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:31:26.117537967 +0000 UTC m=+1634.098577273" watchObservedRunningTime="2026-09-08 07:31:26.119249677 +0000 UTC m=+1634.100288979"
Sep 08 07:31:27.065544 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:27.065505    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg"
Sep 08 07:31:27.070575 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:27.070550    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg"
Sep 08 07:31:27.104447 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:27.104419    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg"
Sep 08 07:31:27.105258 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:27.105240    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg"
Sep 08 07:31:29.151568 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:29.151526    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-4d980e-5cc68fb947-bdmmm"]
Sep 08 07:31:29.155682 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:29.155657    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-4d980e-5cc68fb947-bdmmm"
Sep 08 07:31:29.157547 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:29.157524    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-4d980e-serving-cert\""
Sep 08 07:31:29.166793 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:29.166768    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d1a40e2-43e5-428f-9536-3e2cae99b505-metrics-certs\") pod \"maas-api-e2e-ipp-a-4d980e-5cc68fb947-bdmmm\" (UID: \"3d1a40e2-43e5-428f-9536-3e2cae99b505\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-4d980e-5cc68fb947-bdmmm"
Sep 08 07:31:29.167035 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:29.167012    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d1a40e2-43e5-428f-9536-3e2cae99b505-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-4d980e-5cc68fb947-bdmmm\" (UID: \"3d1a40e2-43e5-428f-9536-3e2cae99b505\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-4d980e-5cc68fb947-bdmmm"
Sep 08 07:31:29.167278 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:29.167256    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sj8p4\" (UniqueName: \"kubernetes.io/projected/3d1a40e2-43e5-428f-9536-3e2cae99b505-kube-api-access-sj8p4\") pod \"maas-api-e2e-ipp-a-4d980e-5cc68fb947-bdmmm\" (UID: \"3d1a40e2-43e5-428f-9536-3e2cae99b505\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-4d980e-5cc68fb947-bdmmm"
Sep 08 07:31:29.167393 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:29.167371    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3d1a40e2-43e5-428f-9536-3e2cae99b505-maas-api-tls\") pod \"maas-api-e2e-ipp-a-4d980e-5cc68fb947-bdmmm\" (UID: \"3d1a40e2-43e5-428f-9536-3e2cae99b505\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-4d980e-5cc68fb947-bdmmm"
Sep 08 07:31:29.169869 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:29.169847    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-4d980e-5cc68fb947-bdmmm"]
Sep 08 07:31:29.267838 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:29.267804    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sj8p4\" (UniqueName: \"kubernetes.io/projected/3d1a40e2-43e5-428f-9536-3e2cae99b505-kube-api-access-sj8p4\") pod \"maas-api-e2e-ipp-a-4d980e-5cc68fb947-bdmmm\" (UID: \"3d1a40e2-43e5-428f-9536-3e2cae99b505\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-4d980e-5cc68fb947-bdmmm"
Sep 08 07:31:29.268054 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:29.267859    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3d1a40e2-43e5-428f-9536-3e2cae99b505-maas-api-tls\") pod \"maas-api-e2e-ipp-a-4d980e-5cc68fb947-bdmmm\" (UID: \"3d1a40e2-43e5-428f-9536-3e2cae99b505\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-4d980e-5cc68fb947-bdmmm"
Sep 08 07:31:29.268054 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:29.267891    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d1a40e2-43e5-428f-9536-3e2cae99b505-metrics-certs\") pod \"maas-api-e2e-ipp-a-4d980e-5cc68fb947-bdmmm\" (UID: \"3d1a40e2-43e5-428f-9536-3e2cae99b505\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-4d980e-5cc68fb947-bdmmm"
Sep 08 07:31:29.268054 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:29.267917    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d1a40e2-43e5-428f-9536-3e2cae99b505-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-4d980e-5cc68fb947-bdmmm\" (UID: \"3d1a40e2-43e5-428f-9536-3e2cae99b505\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-4d980e-5cc68fb947-bdmmm"
Sep 08 07:31:29.268278 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:31:29.268055    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-4d980e-serving-cert: secret "maas-api-e2e-ipp-a-4d980e-serving-cert" not found
Sep 08 07:31:29.268278 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:31:29.268151    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d1a40e2-43e5-428f-9536-3e2cae99b505-maas-api-tls podName:3d1a40e2-43e5-428f-9536-3e2cae99b505 nodeName:}" failed. No retries permitted until 2026-09-08 07:31:29.768128805 +0000 UTC m=+1637.749168096 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3d1a40e2-43e5-428f-9536-3e2cae99b505-maas-api-tls") pod "maas-api-e2e-ipp-a-4d980e-5cc68fb947-bdmmm" (UID: "3d1a40e2-43e5-428f-9536-3e2cae99b505") : secret "maas-api-e2e-ipp-a-4d980e-serving-cert" not found
Sep 08 07:31:29.268755 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:29.268729    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d1a40e2-43e5-428f-9536-3e2cae99b505-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-4d980e-5cc68fb947-bdmmm\" (UID: \"3d1a40e2-43e5-428f-9536-3e2cae99b505\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-4d980e-5cc68fb947-bdmmm"
Sep 08 07:31:29.270497 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:29.270474    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d1a40e2-43e5-428f-9536-3e2cae99b505-metrics-certs\") pod \"maas-api-e2e-ipp-a-4d980e-5cc68fb947-bdmmm\" (UID: \"3d1a40e2-43e5-428f-9536-3e2cae99b505\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-4d980e-5cc68fb947-bdmmm"
Sep 08 07:31:29.275917 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:29.275895    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sj8p4\" (UniqueName: \"kubernetes.io/projected/3d1a40e2-43e5-428f-9536-3e2cae99b505-kube-api-access-sj8p4\") pod \"maas-api-e2e-ipp-a-4d980e-5cc68fb947-bdmmm\" (UID: \"3d1a40e2-43e5-428f-9536-3e2cae99b505\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-4d980e-5cc68fb947-bdmmm"
Sep 08 07:31:29.773060 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:29.773027    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3d1a40e2-43e5-428f-9536-3e2cae99b505-maas-api-tls\") pod \"maas-api-e2e-ipp-a-4d980e-5cc68fb947-bdmmm\" (UID: \"3d1a40e2-43e5-428f-9536-3e2cae99b505\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-4d980e-5cc68fb947-bdmmm"
Sep 08 07:31:29.773258 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:31:29.773204    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-4d980e-serving-cert: secret "maas-api-e2e-ipp-a-4d980e-serving-cert" not found
Sep 08 07:31:29.773332 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:31:29.773292    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d1a40e2-43e5-428f-9536-3e2cae99b505-maas-api-tls podName:3d1a40e2-43e5-428f-9536-3e2cae99b505 nodeName:}" failed. No retries permitted until 2026-09-08 07:31:30.773271602 +0000 UTC m=+1638.754310900 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3d1a40e2-43e5-428f-9536-3e2cae99b505-maas-api-tls") pod "maas-api-e2e-ipp-a-4d980e-5cc68fb947-bdmmm" (UID: "3d1a40e2-43e5-428f-9536-3e2cae99b505") : secret "maas-api-e2e-ipp-a-4d980e-serving-cert" not found
Sep 08 07:31:30.783928 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:30.783894    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3d1a40e2-43e5-428f-9536-3e2cae99b505-maas-api-tls\") pod \"maas-api-e2e-ipp-a-4d980e-5cc68fb947-bdmmm\" (UID: \"3d1a40e2-43e5-428f-9536-3e2cae99b505\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-4d980e-5cc68fb947-bdmmm"
Sep 08 07:31:30.786396 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:30.786367    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3d1a40e2-43e5-428f-9536-3e2cae99b505-maas-api-tls\") pod \"maas-api-e2e-ipp-a-4d980e-5cc68fb947-bdmmm\" (UID: \"3d1a40e2-43e5-428f-9536-3e2cae99b505\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-4d980e-5cc68fb947-bdmmm"
Sep 08 07:31:30.970576 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:30.970547    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-4d980e-5cc68fb947-bdmmm"
Sep 08 07:31:31.244164 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:31.244107    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-4d980e-5cc68fb947-bdmmm"]
Sep 08 07:31:31.246518 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:31:31.246487    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d1a40e2_43e5_428f_9536_3e2cae99b505.slice/crio-39e11a4c22ad098c5c67748d968e5a1956f8bfce1dd1a4fd61e03a9f989dfab9 WatchSource:0}: Error finding container 39e11a4c22ad098c5c67748d968e5a1956f8bfce1dd1a4fd61e03a9f989dfab9: Status 404 returned error can't find the container with id 39e11a4c22ad098c5c67748d968e5a1956f8bfce1dd1a4fd61e03a9f989dfab9
Sep 08 07:31:32.129205 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:32.129169    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-4d980e-5cc68fb947-bdmmm" event={"ID":"3d1a40e2-43e5-428f-9536-3e2cae99b505","Type":"ContainerStarted","Data":"39e11a4c22ad098c5c67748d968e5a1956f8bfce1dd1a4fd61e03a9f989dfab9"}
Sep 08 07:31:33.135362 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:33.135325    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-4d980e-5cc68fb947-bdmmm" event={"ID":"3d1a40e2-43e5-428f-9536-3e2cae99b505","Type":"ContainerStarted","Data":"9dc8cb3e66939813ac318bdd9b1e8c81f09982683edbc5f465b3a1c5070f1e5e"}
Sep 08 07:31:33.135788 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:33.135460    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-4d980e-5cc68fb947-bdmmm"
Sep 08 07:31:33.155639 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:33.155593    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-4d980e-5cc68fb947-bdmmm" podStartSLOduration=3.016383859 podStartE2EDuration="4.155578228s" totalImagesPullingTime="1.139194369s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:31:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:31:33.154774455 +0000 UTC m=+1641.135813783" watchObservedRunningTime="2026-09-08 07:31:33.155578228 +0000 UTC m=+1641.136617534"
Sep 08 07:31:33.544662 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:33.544622    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:31:39.145760 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:39.145729    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-4d980e-5cc68fb947-bdmmm"
Sep 08 07:31:43.146167 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:43.146119    2564 patch_prober.go:28] interesting pod/e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 08 07:31:43.146605 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:43.146192    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg" podUID="ec441f8c-c44a-4968-9eaf-c49a7d1f095f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 08 07:31:44.194779 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:44.194703    2564 generic.go:356] "Generic (PLEG): container finished" podID="ec441f8c-c44a-4968-9eaf-c49a7d1f095f" containerID="ec9d01d6293147946c2b7bbff6d873edc78ed0ccca99bf117950664c9d608a25" exitCode=0
Sep 08 07:31:44.195205 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:44.194776    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg" event={"ID":"ec441f8c-c44a-4968-9eaf-c49a7d1f095f","Type":"ContainerDied","Data":"ec9d01d6293147946c2b7bbff6d873edc78ed0ccca99bf117950664c9d608a25"}
Sep 08 07:31:44.195286 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:44.195270    2564 scope.go:117] "RemoveContainer" containerID="ec9d01d6293147946c2b7bbff6d873edc78ed0ccca99bf117950664c9d608a25"
Sep 08 07:31:44.196414 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:44.196384    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 07:31:44.196469 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:44.196451    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 07:31:44.196505 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:44.196483    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 07:31:45.206021 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:45.205962    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg" event={"ID":"ec441f8c-c44a-4968-9eaf-c49a7d1f095f","Type":"ContainerStarted","Data":"05adb0670b064a0bc63157c2c8e5ad6b9750d88b2e1bef852cbe45078ca588d6"}
Sep 08 07:31:46.065555 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:46.065515    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg"
Sep 08 07:31:46.065749 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:46.065727    2564 patch_prober.go:28] interesting pod/e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Sep 08 07:31:46.065826 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:46.065785    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg" podUID="ec441f8c-c44a-4968-9eaf-c49a7d1f095f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Sep 08 07:31:47.066448 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:47.066408    2564 patch_prober.go:28] interesting pod/e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Sep 08 07:31:47.066905 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:47.066468    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg" podUID="ec441f8c-c44a-4968-9eaf-c49a7d1f095f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Sep 08 07:31:48.066278 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:48.066244    2564 patch_prober.go:28] interesting pod/e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Sep 08 07:31:48.066453 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:48.066302    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg" podUID="ec441f8c-c44a-4968-9eaf-c49a7d1f095f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Sep 08 07:31:49.066058 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:49.066020    2564 patch_prober.go:28] interesting pod/e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Sep 08 07:31:49.066430 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:49.066076    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg" podUID="ec441f8c-c44a-4968-9eaf-c49a7d1f095f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Sep 08 07:31:50.066178 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:50.066144    2564 patch_prober.go:28] interesting pod/e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Sep 08 07:31:50.066558 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:50.066209    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg" podUID="ec441f8c-c44a-4968-9eaf-c49a7d1f095f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Sep 08 07:31:51.069373 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:51.069340    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg"
Sep 08 07:31:51.069820 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:51.069604    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg"
Sep 08 07:31:51.070381 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:31:51.070364    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg"
Sep 08 07:32:04.740138 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:32:04.740097    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:32:42.544811 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:32:42.544728    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:32:56.751554 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:32:56.751518    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:33:03.334513 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:03.334479    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw"]
Sep 08 07:33:03.338358 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:03.338332    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw"
Sep 08 07:33:03.340527 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:03.340502    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-dd2695-openshift-default-dockercfg-wzq7z\""
Sep 08 07:33:03.352431 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:03.352402    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw"]
Sep 08 07:33:03.362520 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:03.362478    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/edbe59f2-0b00-4b7e-91a9-0435268c2478-workload-socket\") pod \"e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw\" (UID: \"edbe59f2-0b00-4b7e-91a9-0435268c2478\") " pod="openshift-ingress/e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw"
Sep 08 07:33:03.362677 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:03.362534    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/edbe59f2-0b00-4b7e-91a9-0435268c2478-workload-certs\") pod \"e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw\" (UID: \"edbe59f2-0b00-4b7e-91a9-0435268c2478\") " pod="openshift-ingress/e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw"
Sep 08 07:33:03.362677 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:03.362578    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/edbe59f2-0b00-4b7e-91a9-0435268c2478-istio-envoy\") pod \"e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw\" (UID: \"edbe59f2-0b00-4b7e-91a9-0435268c2478\") " pod="openshift-ingress/e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw"
Sep 08 07:33:03.362812 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:03.362709    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/edbe59f2-0b00-4b7e-91a9-0435268c2478-credential-socket\") pod \"e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw\" (UID: \"edbe59f2-0b00-4b7e-91a9-0435268c2478\") " pod="openshift-ingress/e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw"
Sep 08 07:33:03.362812 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:03.362745    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/edbe59f2-0b00-4b7e-91a9-0435268c2478-istio-podinfo\") pod \"e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw\" (UID: \"edbe59f2-0b00-4b7e-91a9-0435268c2478\") " pod="openshift-ingress/e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw"
Sep 08 07:33:03.362812 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:03.362797    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/edbe59f2-0b00-4b7e-91a9-0435268c2478-istiod-ca-cert\") pod \"e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw\" (UID: \"edbe59f2-0b00-4b7e-91a9-0435268c2478\") " pod="openshift-ingress/e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw"
Sep 08 07:33:03.362943 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:03.362846    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/edbe59f2-0b00-4b7e-91a9-0435268c2478-istio-data\") pod \"e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw\" (UID: \"edbe59f2-0b00-4b7e-91a9-0435268c2478\") " pod="openshift-ingress/e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw"
Sep 08 07:33:03.362943 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:03.362886    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdw5p\" (UniqueName: \"kubernetes.io/projected/edbe59f2-0b00-4b7e-91a9-0435268c2478-kube-api-access-fdw5p\") pod \"e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw\" (UID: \"edbe59f2-0b00-4b7e-91a9-0435268c2478\") " pod="openshift-ingress/e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw"
Sep 08 07:33:03.363048 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:03.362949    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/edbe59f2-0b00-4b7e-91a9-0435268c2478-istio-token\") pod \"e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw\" (UID: \"edbe59f2-0b00-4b7e-91a9-0435268c2478\") " pod="openshift-ingress/e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw"
Sep 08 07:33:03.464008 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:03.463959    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/edbe59f2-0b00-4b7e-91a9-0435268c2478-istio-token\") pod \"e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw\" (UID: \"edbe59f2-0b00-4b7e-91a9-0435268c2478\") " pod="openshift-ingress/e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw"
Sep 08 07:33:03.464204 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:03.464019    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/edbe59f2-0b00-4b7e-91a9-0435268c2478-workload-socket\") pod \"e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw\" (UID: \"edbe59f2-0b00-4b7e-91a9-0435268c2478\") " pod="openshift-ingress/e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw"
Sep 08 07:33:03.464204 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:03.464058    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/edbe59f2-0b00-4b7e-91a9-0435268c2478-workload-certs\") pod \"e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw\" (UID: \"edbe59f2-0b00-4b7e-91a9-0435268c2478\") " pod="openshift-ingress/e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw"
Sep 08 07:33:03.464204 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:03.464073    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/edbe59f2-0b00-4b7e-91a9-0435268c2478-istio-envoy\") pod \"e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw\" (UID: \"edbe59f2-0b00-4b7e-91a9-0435268c2478\") " pod="openshift-ingress/e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw"
Sep 08 07:33:03.464204 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:03.464116    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/edbe59f2-0b00-4b7e-91a9-0435268c2478-credential-socket\") pod \"e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw\" (UID: \"edbe59f2-0b00-4b7e-91a9-0435268c2478\") " pod="openshift-ingress/e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw"
Sep 08 07:33:03.464204 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:03.464141    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/edbe59f2-0b00-4b7e-91a9-0435268c2478-istio-podinfo\") pod \"e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw\" (UID: \"edbe59f2-0b00-4b7e-91a9-0435268c2478\") " pod="openshift-ingress/e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw"
Sep 08 07:33:03.464204 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:03.464193    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/edbe59f2-0b00-4b7e-91a9-0435268c2478-istiod-ca-cert\") pod \"e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw\" (UID: \"edbe59f2-0b00-4b7e-91a9-0435268c2478\") " pod="openshift-ingress/e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw"
Sep 08 07:33:03.464542 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:03.464411    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/edbe59f2-0b00-4b7e-91a9-0435268c2478-workload-socket\") pod \"e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw\" (UID: \"edbe59f2-0b00-4b7e-91a9-0435268c2478\") " pod="openshift-ingress/e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw"
Sep 08 07:33:03.464542 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:03.464497    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/edbe59f2-0b00-4b7e-91a9-0435268c2478-workload-certs\") pod \"e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw\" (UID: \"edbe59f2-0b00-4b7e-91a9-0435268c2478\") " pod="openshift-ingress/e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw"
Sep 08 07:33:03.464822 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:03.464791    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/edbe59f2-0b00-4b7e-91a9-0435268c2478-credential-socket\") pod \"e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw\" (UID: \"edbe59f2-0b00-4b7e-91a9-0435268c2478\") " pod="openshift-ingress/e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw"
Sep 08 07:33:03.464925 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:03.464830    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/edbe59f2-0b00-4b7e-91a9-0435268c2478-istio-data\") pod \"e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw\" (UID: \"edbe59f2-0b00-4b7e-91a9-0435268c2478\") " pod="openshift-ingress/e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw"
Sep 08 07:33:03.464925 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:03.464224    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/edbe59f2-0b00-4b7e-91a9-0435268c2478-istio-data\") pod \"e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw\" (UID: \"edbe59f2-0b00-4b7e-91a9-0435268c2478\") " pod="openshift-ingress/e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw"
Sep 08 07:33:03.464925 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:03.464902    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/edbe59f2-0b00-4b7e-91a9-0435268c2478-istiod-ca-cert\") pod \"e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw\" (UID: \"edbe59f2-0b00-4b7e-91a9-0435268c2478\") " pod="openshift-ingress/e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw"
Sep 08 07:33:03.464925 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:03.464905    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdw5p\" (UniqueName: \"kubernetes.io/projected/edbe59f2-0b00-4b7e-91a9-0435268c2478-kube-api-access-fdw5p\") pod \"e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw\" (UID: \"edbe59f2-0b00-4b7e-91a9-0435268c2478\") " pod="openshift-ingress/e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw"
Sep 08 07:33:03.466717 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:03.466693    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/edbe59f2-0b00-4b7e-91a9-0435268c2478-istio-envoy\") pod \"e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw\" (UID: \"edbe59f2-0b00-4b7e-91a9-0435268c2478\") " pod="openshift-ingress/e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw"
Sep 08 07:33:03.466856 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:03.466834    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/edbe59f2-0b00-4b7e-91a9-0435268c2478-istio-podinfo\") pod \"e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw\" (UID: \"edbe59f2-0b00-4b7e-91a9-0435268c2478\") " pod="openshift-ingress/e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw"
Sep 08 07:33:03.472343 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:03.472322    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/edbe59f2-0b00-4b7e-91a9-0435268c2478-istio-token\") pod \"e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw\" (UID: \"edbe59f2-0b00-4b7e-91a9-0435268c2478\") " pod="openshift-ingress/e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw"
Sep 08 07:33:03.472606 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:03.472585    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdw5p\" (UniqueName: \"kubernetes.io/projected/edbe59f2-0b00-4b7e-91a9-0435268c2478-kube-api-access-fdw5p\") pod \"e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw\" (UID: \"edbe59f2-0b00-4b7e-91a9-0435268c2478\") " pod="openshift-ingress/e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw"
Sep 08 07:33:03.651919 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:03.651822    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw"
Sep 08 07:33:03.963771 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:03.963743    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw"]
Sep 08 07:33:03.969666 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:03.969629    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 07:33:03.969792 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:03.969696    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 07:33:03.969792 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:03.969730    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 07:33:04.636792 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:04.636747    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw" event={"ID":"edbe59f2-0b00-4b7e-91a9-0435268c2478","Type":"ContainerStarted","Data":"c8906ad30b2d129136f42f6c35cda5a9b1d1aeab134c07229443a03c6504b27d"}
Sep 08 07:33:04.637213 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:04.636817    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw" event={"ID":"edbe59f2-0b00-4b7e-91a9-0435268c2478","Type":"ContainerStarted","Data":"1e17dc0e888ceef85486c44290346175576e9063d7d5144452a00b2e49128575"}
Sep 08 07:33:04.652894 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:04.652863    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw"
Sep 08 07:33:04.658807 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:04.658760    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw" podStartSLOduration=1.6587447910000002 podStartE2EDuration="1.658744791s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:33:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:33:04.656577157 +0000 UTC m=+1732.637616482" watchObservedRunningTime="2026-09-08 07:33:04.658744791 +0000 UTC m=+1732.639784172"
Sep 08 07:33:05.657222 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:05.657192    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw"
Sep 08 07:33:06.647839 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:06.647806    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw"
Sep 08 07:33:06.648717 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:06.648693    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw"
Sep 08 07:33:16.370157 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:16.370124    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:33:26.762251 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:26.762216    2564 generic.go:356] "Generic (PLEG): container finished" podID="edbe59f2-0b00-4b7e-91a9-0435268c2478" containerID="c8906ad30b2d129136f42f6c35cda5a9b1d1aeab134c07229443a03c6504b27d" exitCode=0
Sep 08 07:33:26.762664 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:26.762288    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw" event={"ID":"edbe59f2-0b00-4b7e-91a9-0435268c2478","Type":"ContainerDied","Data":"c8906ad30b2d129136f42f6c35cda5a9b1d1aeab134c07229443a03c6504b27d"}
Sep 08 07:33:26.762709 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:26.762683    2564 scope.go:117] "RemoveContainer" containerID="c8906ad30b2d129136f42f6c35cda5a9b1d1aeab134c07229443a03c6504b27d"
Sep 08 07:33:26.765815 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:26.764561    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 07:33:26.765815 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:26.764729    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 07:33:26.765815 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:26.764828    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 07:33:27.769861 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:27.769827    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw" event={"ID":"edbe59f2-0b00-4b7e-91a9-0435268c2478","Type":"ContainerStarted","Data":"ddba15225d5cf0fefc468de8d9aaa92e6ae19d98e12117b732138d3abbc740ac"}
Sep 08 07:33:28.652799 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:28.652765    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw"
Sep 08 07:33:28.653004 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:28.652865    2564 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Sep 08 07:33:28.653004 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:28.652908    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw" podUID="edbe59f2-0b00-4b7e-91a9-0435268c2478" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Sep 08 07:33:29.652259 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:29.652222    2564 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Sep 08 07:33:29.652632 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:29.652279    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw" podUID="edbe59f2-0b00-4b7e-91a9-0435268c2478" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Sep 08 07:33:30.652239 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:30.652207    2564 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Sep 08 07:33:30.652405 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:30.652258    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw" podUID="edbe59f2-0b00-4b7e-91a9-0435268c2478" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Sep 08 07:33:31.652417 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:31.652376    2564 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Sep 08 07:33:31.652826 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:31.652436    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw" podUID="edbe59f2-0b00-4b7e-91a9-0435268c2478" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Sep 08 07:33:32.828036 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:32.827996    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw"
Sep 08 07:33:32.828522 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:32.828388    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw"
Sep 08 07:33:32.829276 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:32.829254    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw"
Sep 08 07:33:43.649375 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:43.649338    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:33:45.563855 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:45.563826    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw"]
Sep 08 07:33:45.572064 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:45.572020    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw" podUID="edbe59f2-0b00-4b7e-91a9-0435268c2478" containerName="istio-proxy" containerID="cri-o://ddba15225d5cf0fefc468de8d9aaa92e6ae19d98e12117b732138d3abbc740ac" gracePeriod=30
Sep 08 07:33:47.830450 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:47.830411    2564 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 07:33:47.830921 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:47.830479    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw" podUID="edbe59f2-0b00-4b7e-91a9-0435268c2478" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 07:33:50.827423 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:50.827392    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw"
Sep 08 07:33:50.902405 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:50.902310    2564 generic.go:356] "Generic (PLEG): container finished" podID="edbe59f2-0b00-4b7e-91a9-0435268c2478" containerID="ddba15225d5cf0fefc468de8d9aaa92e6ae19d98e12117b732138d3abbc740ac" exitCode=0
Sep 08 07:33:50.902405 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:50.902362    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw"
Sep 08 07:33:50.902655 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:50.902402    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw" event={"ID":"edbe59f2-0b00-4b7e-91a9-0435268c2478","Type":"ContainerDied","Data":"ddba15225d5cf0fefc468de8d9aaa92e6ae19d98e12117b732138d3abbc740ac"}
Sep 08 07:33:50.902655 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:50.902471    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw" event={"ID":"edbe59f2-0b00-4b7e-91a9-0435268c2478","Type":"ContainerDied","Data":"1e17dc0e888ceef85486c44290346175576e9063d7d5144452a00b2e49128575"}
Sep 08 07:33:50.902655 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:50.902501    2564 scope.go:117] "RemoveContainer" containerID="ddba15225d5cf0fefc468de8d9aaa92e6ae19d98e12117b732138d3abbc740ac"
Sep 08 07:33:50.911471 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:50.911454    2564 scope.go:117] "RemoveContainer" containerID="c8906ad30b2d129136f42f6c35cda5a9b1d1aeab134c07229443a03c6504b27d"
Sep 08 07:33:50.919409 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:50.919393    2564 scope.go:117] "RemoveContainer" containerID="ddba15225d5cf0fefc468de8d9aaa92e6ae19d98e12117b732138d3abbc740ac"
Sep 08 07:33:50.919686 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:33:50.919668    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ddba15225d5cf0fefc468de8d9aaa92e6ae19d98e12117b732138d3abbc740ac\": container with ID starting with ddba15225d5cf0fefc468de8d9aaa92e6ae19d98e12117b732138d3abbc740ac not found: ID does not exist" containerID="ddba15225d5cf0fefc468de8d9aaa92e6ae19d98e12117b732138d3abbc740ac"
Sep 08 07:33:50.919729 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:50.919694    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddba15225d5cf0fefc468de8d9aaa92e6ae19d98e12117b732138d3abbc740ac"} err="failed to get container status \"ddba15225d5cf0fefc468de8d9aaa92e6ae19d98e12117b732138d3abbc740ac\": rpc error: code = NotFound desc = could not find container \"ddba15225d5cf0fefc468de8d9aaa92e6ae19d98e12117b732138d3abbc740ac\": container with ID starting with ddba15225d5cf0fefc468de8d9aaa92e6ae19d98e12117b732138d3abbc740ac not found: ID does not exist"
Sep 08 07:33:50.919729 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:50.919709    2564 scope.go:117] "RemoveContainer" containerID="c8906ad30b2d129136f42f6c35cda5a9b1d1aeab134c07229443a03c6504b27d"
Sep 08 07:33:50.919942 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:33:50.919924    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8906ad30b2d129136f42f6c35cda5a9b1d1aeab134c07229443a03c6504b27d\": container with ID starting with c8906ad30b2d129136f42f6c35cda5a9b1d1aeab134c07229443a03c6504b27d not found: ID does not exist" containerID="c8906ad30b2d129136f42f6c35cda5a9b1d1aeab134c07229443a03c6504b27d"
Sep 08 07:33:50.920032 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:50.919949    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8906ad30b2d129136f42f6c35cda5a9b1d1aeab134c07229443a03c6504b27d"} err="failed to get container status \"c8906ad30b2d129136f42f6c35cda5a9b1d1aeab134c07229443a03c6504b27d\": rpc error: code = NotFound desc = could not find container \"c8906ad30b2d129136f42f6c35cda5a9b1d1aeab134c07229443a03c6504b27d\": container with ID starting with c8906ad30b2d129136f42f6c35cda5a9b1d1aeab134c07229443a03c6504b27d not found: ID does not exist"
Sep 08 07:33:50.931870 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:50.931851    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/edbe59f2-0b00-4b7e-91a9-0435268c2478-credential-socket\") pod \"edbe59f2-0b00-4b7e-91a9-0435268c2478\" (UID: \"edbe59f2-0b00-4b7e-91a9-0435268c2478\") "
Sep 08 07:33:50.931958 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:50.931888    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/edbe59f2-0b00-4b7e-91a9-0435268c2478-istio-data\") pod \"edbe59f2-0b00-4b7e-91a9-0435268c2478\" (UID: \"edbe59f2-0b00-4b7e-91a9-0435268c2478\") "
Sep 08 07:33:50.931958 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:50.931922    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fdw5p\" (UniqueName: \"kubernetes.io/projected/edbe59f2-0b00-4b7e-91a9-0435268c2478-kube-api-access-fdw5p\") pod \"edbe59f2-0b00-4b7e-91a9-0435268c2478\" (UID: \"edbe59f2-0b00-4b7e-91a9-0435268c2478\") "
Sep 08 07:33:50.932112 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:50.931958    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/edbe59f2-0b00-4b7e-91a9-0435268c2478-istio-envoy\") pod \"edbe59f2-0b00-4b7e-91a9-0435268c2478\" (UID: \"edbe59f2-0b00-4b7e-91a9-0435268c2478\") "
Sep 08 07:33:50.932112 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:50.932008    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/edbe59f2-0b00-4b7e-91a9-0435268c2478-workload-socket\") pod \"edbe59f2-0b00-4b7e-91a9-0435268c2478\" (UID: \"edbe59f2-0b00-4b7e-91a9-0435268c2478\") "
Sep 08 07:33:50.932112 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:50.932039    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/edbe59f2-0b00-4b7e-91a9-0435268c2478-istio-token\") pod \"edbe59f2-0b00-4b7e-91a9-0435268c2478\" (UID: \"edbe59f2-0b00-4b7e-91a9-0435268c2478\") "
Sep 08 07:33:50.932112 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:50.932087    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/edbe59f2-0b00-4b7e-91a9-0435268c2478-workload-certs\") pod \"edbe59f2-0b00-4b7e-91a9-0435268c2478\" (UID: \"edbe59f2-0b00-4b7e-91a9-0435268c2478\") "
Sep 08 07:33:50.932112 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:50.932110    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/edbe59f2-0b00-4b7e-91a9-0435268c2478-istiod-ca-cert\") pod \"edbe59f2-0b00-4b7e-91a9-0435268c2478\" (UID: \"edbe59f2-0b00-4b7e-91a9-0435268c2478\") "
Sep 08 07:33:50.932367 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:50.932131    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/edbe59f2-0b00-4b7e-91a9-0435268c2478-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "edbe59f2-0b00-4b7e-91a9-0435268c2478" (UID: "edbe59f2-0b00-4b7e-91a9-0435268c2478"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 07:33:50.932367 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:50.932176    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/edbe59f2-0b00-4b7e-91a9-0435268c2478-istio-podinfo\") pod \"edbe59f2-0b00-4b7e-91a9-0435268c2478\" (UID: \"edbe59f2-0b00-4b7e-91a9-0435268c2478\") "
Sep 08 07:33:50.932367 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:50.932210    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/edbe59f2-0b00-4b7e-91a9-0435268c2478-istio-data" (OuterVolumeSpecName: "istio-data") pod "edbe59f2-0b00-4b7e-91a9-0435268c2478" (UID: "edbe59f2-0b00-4b7e-91a9-0435268c2478"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 07:33:50.932528 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:50.932391    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/edbe59f2-0b00-4b7e-91a9-0435268c2478-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "edbe59f2-0b00-4b7e-91a9-0435268c2478" (UID: "edbe59f2-0b00-4b7e-91a9-0435268c2478"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 07:33:50.932528 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:50.932408    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/edbe59f2-0b00-4b7e-91a9-0435268c2478-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "edbe59f2-0b00-4b7e-91a9-0435268c2478" (UID: "edbe59f2-0b00-4b7e-91a9-0435268c2478"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 07:33:50.932528 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:50.932488    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/edbe59f2-0b00-4b7e-91a9-0435268c2478-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "edbe59f2-0b00-4b7e-91a9-0435268c2478" (UID: "edbe59f2-0b00-4b7e-91a9-0435268c2478"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 07:33:50.932686 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:50.932595    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/edbe59f2-0b00-4b7e-91a9-0435268c2478-workload-socket\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:33:50.932686 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:50.932614    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/edbe59f2-0b00-4b7e-91a9-0435268c2478-workload-certs\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:33:50.932686 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:50.932629    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/edbe59f2-0b00-4b7e-91a9-0435268c2478-istiod-ca-cert\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:33:50.932686 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:50.932641    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/edbe59f2-0b00-4b7e-91a9-0435268c2478-credential-socket\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:33:50.932686 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:50.932654    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/edbe59f2-0b00-4b7e-91a9-0435268c2478-istio-data\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:33:50.934204 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:50.934180    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/edbe59f2-0b00-4b7e-91a9-0435268c2478-kube-api-access-fdw5p" (OuterVolumeSpecName: "kube-api-access-fdw5p") pod "edbe59f2-0b00-4b7e-91a9-0435268c2478" (UID: "edbe59f2-0b00-4b7e-91a9-0435268c2478"). InnerVolumeSpecName "kube-api-access-fdw5p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 07:33:50.934316 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:50.934233    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/edbe59f2-0b00-4b7e-91a9-0435268c2478-istio-token" (OuterVolumeSpecName: "istio-token") pod "edbe59f2-0b00-4b7e-91a9-0435268c2478" (UID: "edbe59f2-0b00-4b7e-91a9-0435268c2478"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 07:33:50.934523 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:50.934508    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/edbe59f2-0b00-4b7e-91a9-0435268c2478-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "edbe59f2-0b00-4b7e-91a9-0435268c2478" (UID: "edbe59f2-0b00-4b7e-91a9-0435268c2478"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 07:33:50.934594 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:50.934532    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/edbe59f2-0b00-4b7e-91a9-0435268c2478-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "edbe59f2-0b00-4b7e-91a9-0435268c2478" (UID: "edbe59f2-0b00-4b7e-91a9-0435268c2478"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 07:33:51.033661 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:51.033628    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/edbe59f2-0b00-4b7e-91a9-0435268c2478-istio-podinfo\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:33:51.033661 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:51.033656    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fdw5p\" (UniqueName: \"kubernetes.io/projected/edbe59f2-0b00-4b7e-91a9-0435268c2478-kube-api-access-fdw5p\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:33:51.033661 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:51.033666    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/edbe59f2-0b00-4b7e-91a9-0435268c2478-istio-envoy\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:33:51.033892 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:51.033674    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/edbe59f2-0b00-4b7e-91a9-0435268c2478-istio-token\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:33:51.225231 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:51.225196    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw"]
Sep 08 07:33:51.229513 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:51.229481    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-dd2695-openshift-default-78b48b995b-495xw"]
Sep 08 07:33:52.510217 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:33:52.510180    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="edbe59f2-0b00-4b7e-91a9-0435268c2478" path="/var/lib/kubelet/pods/edbe59f2-0b00-4b7e-91a9-0435268c2478/volumes"
Sep 08 07:34:04.041947 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:34:04.041910    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:34:04.561013 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:34:04.560979    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-4d980e-5cc68fb947-bdmmm"]
Sep 08 07:34:04.561506 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:34:04.561476    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-4d980e-5cc68fb947-bdmmm" podUID="3d1a40e2-43e5-428f-9536-3e2cae99b505" containerName="maas-api" containerID="cri-o://9dc8cb3e66939813ac318bdd9b1e8c81f09982683edbc5f465b3a1c5070f1e5e" gracePeriod=30
Sep 08 07:34:04.821203 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:34:04.821121    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-4d980e-5cc68fb947-bdmmm"
Sep 08 07:34:04.963610 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:34:04.963577    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sj8p4\" (UniqueName: \"kubernetes.io/projected/3d1a40e2-43e5-428f-9536-3e2cae99b505-kube-api-access-sj8p4\") pod \"3d1a40e2-43e5-428f-9536-3e2cae99b505\" (UID: \"3d1a40e2-43e5-428f-9536-3e2cae99b505\") "
Sep 08 07:34:04.963765 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:34:04.963658    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d1a40e2-43e5-428f-9536-3e2cae99b505-openshift-service-ca\") pod \"3d1a40e2-43e5-428f-9536-3e2cae99b505\" (UID: \"3d1a40e2-43e5-428f-9536-3e2cae99b505\") "
Sep 08 07:34:04.963765 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:34:04.963684    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d1a40e2-43e5-428f-9536-3e2cae99b505-metrics-certs\") pod \"3d1a40e2-43e5-428f-9536-3e2cae99b505\" (UID: \"3d1a40e2-43e5-428f-9536-3e2cae99b505\") "
Sep 08 07:34:04.963765 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:34:04.963704    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3d1a40e2-43e5-428f-9536-3e2cae99b505-maas-api-tls\") pod \"3d1a40e2-43e5-428f-9536-3e2cae99b505\" (UID: \"3d1a40e2-43e5-428f-9536-3e2cae99b505\") "
Sep 08 07:34:04.964071 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:34:04.964045    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d1a40e2-43e5-428f-9536-3e2cae99b505-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3d1a40e2-43e5-428f-9536-3e2cae99b505" (UID: "3d1a40e2-43e5-428f-9536-3e2cae99b505"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 07:34:04.966010 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:34:04.965940    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d1a40e2-43e5-428f-9536-3e2cae99b505-kube-api-access-sj8p4" (OuterVolumeSpecName: "kube-api-access-sj8p4") pod "3d1a40e2-43e5-428f-9536-3e2cae99b505" (UID: "3d1a40e2-43e5-428f-9536-3e2cae99b505"). InnerVolumeSpecName "kube-api-access-sj8p4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 07:34:04.966246 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:34:04.966153    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d1a40e2-43e5-428f-9536-3e2cae99b505-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "3d1a40e2-43e5-428f-9536-3e2cae99b505" (UID: "3d1a40e2-43e5-428f-9536-3e2cae99b505"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 07:34:04.966505 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:34:04.966474    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d1a40e2-43e5-428f-9536-3e2cae99b505-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3d1a40e2-43e5-428f-9536-3e2cae99b505" (UID: "3d1a40e2-43e5-428f-9536-3e2cae99b505"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 07:34:05.000780 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:34:05.000748    2564 generic.go:356] "Generic (PLEG): container finished" podID="3d1a40e2-43e5-428f-9536-3e2cae99b505" containerID="9dc8cb3e66939813ac318bdd9b1e8c81f09982683edbc5f465b3a1c5070f1e5e" exitCode=0
Sep 08 07:34:05.001021 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:34:05.000806    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-4d980e-5cc68fb947-bdmmm" event={"ID":"3d1a40e2-43e5-428f-9536-3e2cae99b505","Type":"ContainerDied","Data":"9dc8cb3e66939813ac318bdd9b1e8c81f09982683edbc5f465b3a1c5070f1e5e"}
Sep 08 07:34:05.001021 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:34:05.000813    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-4d980e-5cc68fb947-bdmmm"
Sep 08 07:34:05.001021 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:34:05.000871    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-4d980e-5cc68fb947-bdmmm" event={"ID":"3d1a40e2-43e5-428f-9536-3e2cae99b505","Type":"ContainerDied","Data":"39e11a4c22ad098c5c67748d968e5a1956f8bfce1dd1a4fd61e03a9f989dfab9"}
Sep 08 07:34:05.001021 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:34:05.000891    2564 scope.go:117] "RemoveContainer" containerID="9dc8cb3e66939813ac318bdd9b1e8c81f09982683edbc5f465b3a1c5070f1e5e"
Sep 08 07:34:05.011790 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:34:05.011750    2564 scope.go:117] "RemoveContainer" containerID="9dc8cb3e66939813ac318bdd9b1e8c81f09982683edbc5f465b3a1c5070f1e5e"
Sep 08 07:34:05.012195 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:34:05.012165    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9dc8cb3e66939813ac318bdd9b1e8c81f09982683edbc5f465b3a1c5070f1e5e\": container with ID starting with 9dc8cb3e66939813ac318bdd9b1e8c81f09982683edbc5f465b3a1c5070f1e5e not found: ID does not exist" containerID="9dc8cb3e66939813ac318bdd9b1e8c81f09982683edbc5f465b3a1c5070f1e5e"
Sep 08 07:34:05.012299 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:34:05.012213    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9dc8cb3e66939813ac318bdd9b1e8c81f09982683edbc5f465b3a1c5070f1e5e"} err="failed to get container status \"9dc8cb3e66939813ac318bdd9b1e8c81f09982683edbc5f465b3a1c5070f1e5e\": rpc error: code = NotFound desc = could not find container \"9dc8cb3e66939813ac318bdd9b1e8c81f09982683edbc5f465b3a1c5070f1e5e\": container with ID starting with 9dc8cb3e66939813ac318bdd9b1e8c81f09982683edbc5f465b3a1c5070f1e5e not found: ID does not exist"
Sep 08 07:34:05.031818 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:34:05.031791    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-4d980e-5cc68fb947-bdmmm"]
Sep 08 07:34:05.043699 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:34:05.043674    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-4d980e-5cc68fb947-bdmmm"]
Sep 08 07:34:05.065052 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:34:05.065031    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sj8p4\" (UniqueName: \"kubernetes.io/projected/3d1a40e2-43e5-428f-9536-3e2cae99b505-kube-api-access-sj8p4\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:34:05.065052 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:34:05.065053    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d1a40e2-43e5-428f-9536-3e2cae99b505-openshift-service-ca\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:34:05.065209 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:34:05.065066    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d1a40e2-43e5-428f-9536-3e2cae99b505-metrics-certs\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:34:05.065209 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:34:05.065074    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3d1a40e2-43e5-428f-9536-3e2cae99b505-maas-api-tls\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:34:06.510660 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:34:06.510629    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d1a40e2-43e5-428f-9536-3e2cae99b505" path="/var/lib/kubelet/pods/3d1a40e2-43e5-428f-9536-3e2cae99b505/volumes"
Sep 08 07:34:12.632032 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:34:12.631995    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-8d4lx_5cf68f79-8fda-42e2-92c1-05a5a601f505/console-operator/1.log"
Sep 08 07:34:12.633475 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:34:12.633452    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-8d4lx_5cf68f79-8fda-42e2-92c1-05a5a601f505/console-operator/1.log"
Sep 08 07:34:13.845687 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:34:13.845651    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:34:54.007148 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:34:54.007113    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg"]
Sep 08 07:34:54.007749 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:34:54.007331    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg" podUID="ec441f8c-c44a-4968-9eaf-c49a7d1f095f" containerName="istio-proxy" containerID="cri-o://05adb0670b064a0bc63157c2c8e5ad6b9750d88b2e1bef852cbe45078ca588d6" gracePeriod=30
Sep 08 07:34:59.267019 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:34:59.266994    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg"
Sep 08 07:34:59.288167 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:34:59.288070    2564 generic.go:356] "Generic (PLEG): container finished" podID="ec441f8c-c44a-4968-9eaf-c49a7d1f095f" containerID="05adb0670b064a0bc63157c2c8e5ad6b9750d88b2e1bef852cbe45078ca588d6" exitCode=0
Sep 08 07:34:59.288167 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:34:59.288127    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg"
Sep 08 07:34:59.288167 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:34:59.288153    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg" event={"ID":"ec441f8c-c44a-4968-9eaf-c49a7d1f095f","Type":"ContainerDied","Data":"05adb0670b064a0bc63157c2c8e5ad6b9750d88b2e1bef852cbe45078ca588d6"}
Sep 08 07:34:59.288414 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:34:59.288201    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg" event={"ID":"ec441f8c-c44a-4968-9eaf-c49a7d1f095f","Type":"ContainerDied","Data":"416137027e2b5d9d0accb8568fecff8e173edd2712a76e910c3df97a78c12a92"}
Sep 08 07:34:59.288414 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:34:59.288222    2564 scope.go:117] "RemoveContainer" containerID="05adb0670b064a0bc63157c2c8e5ad6b9750d88b2e1bef852cbe45078ca588d6"
Sep 08 07:34:59.300064 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:34:59.300036    2564 scope.go:117] "RemoveContainer" containerID="ec9d01d6293147946c2b7bbff6d873edc78ed0ccca99bf117950664c9d608a25"
Sep 08 07:34:59.308182 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:34:59.308162    2564 scope.go:117] "RemoveContainer" containerID="05adb0670b064a0bc63157c2c8e5ad6b9750d88b2e1bef852cbe45078ca588d6"
Sep 08 07:34:59.308472 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:34:59.308441    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05adb0670b064a0bc63157c2c8e5ad6b9750d88b2e1bef852cbe45078ca588d6\": container with ID starting with 05adb0670b064a0bc63157c2c8e5ad6b9750d88b2e1bef852cbe45078ca588d6 not found: ID does not exist" containerID="05adb0670b064a0bc63157c2c8e5ad6b9750d88b2e1bef852cbe45078ca588d6"
Sep 08 07:34:59.308552 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:34:59.308484    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05adb0670b064a0bc63157c2c8e5ad6b9750d88b2e1bef852cbe45078ca588d6"} err="failed to get container status \"05adb0670b064a0bc63157c2c8e5ad6b9750d88b2e1bef852cbe45078ca588d6\": rpc error: code = NotFound desc = could not find container \"05adb0670b064a0bc63157c2c8e5ad6b9750d88b2e1bef852cbe45078ca588d6\": container with ID starting with 05adb0670b064a0bc63157c2c8e5ad6b9750d88b2e1bef852cbe45078ca588d6 not found: ID does not exist"
Sep 08 07:34:59.308552 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:34:59.308510    2564 scope.go:117] "RemoveContainer" containerID="ec9d01d6293147946c2b7bbff6d873edc78ed0ccca99bf117950664c9d608a25"
Sep 08 07:34:59.308846 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:34:59.308825    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec9d01d6293147946c2b7bbff6d873edc78ed0ccca99bf117950664c9d608a25\": container with ID starting with ec9d01d6293147946c2b7bbff6d873edc78ed0ccca99bf117950664c9d608a25 not found: ID does not exist" containerID="ec9d01d6293147946c2b7bbff6d873edc78ed0ccca99bf117950664c9d608a25"
Sep 08 07:34:59.308911 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:34:59.308864    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec9d01d6293147946c2b7bbff6d873edc78ed0ccca99bf117950664c9d608a25"} err="failed to get container status \"ec9d01d6293147946c2b7bbff6d873edc78ed0ccca99bf117950664c9d608a25\": rpc error: code = NotFound desc = could not find container \"ec9d01d6293147946c2b7bbff6d873edc78ed0ccca99bf117950664c9d608a25\": container with ID starting with ec9d01d6293147946c2b7bbff6d873edc78ed0ccca99bf117950664c9d608a25 not found: ID does not exist"
Sep 08 07:34:59.358473 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:34:59.358441    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec441f8c-c44a-4968-9eaf-c49a7d1f095f-credential-socket\") pod \"ec441f8c-c44a-4968-9eaf-c49a7d1f095f\" (UID: \"ec441f8c-c44a-4968-9eaf-c49a7d1f095f\") "
Sep 08 07:34:59.358629 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:34:59.358487    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec441f8c-c44a-4968-9eaf-c49a7d1f095f-workload-certs\") pod \"ec441f8c-c44a-4968-9eaf-c49a7d1f095f\" (UID: \"ec441f8c-c44a-4968-9eaf-c49a7d1f095f\") "
Sep 08 07:34:59.358629 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:34:59.358510    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9dsm2\" (UniqueName: \"kubernetes.io/projected/ec441f8c-c44a-4968-9eaf-c49a7d1f095f-kube-api-access-9dsm2\") pod \"ec441f8c-c44a-4968-9eaf-c49a7d1f095f\" (UID: \"ec441f8c-c44a-4968-9eaf-c49a7d1f095f\") "
Sep 08 07:34:59.358629 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:34:59.358555    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec441f8c-c44a-4968-9eaf-c49a7d1f095f-istiod-ca-cert\") pod \"ec441f8c-c44a-4968-9eaf-c49a7d1f095f\" (UID: \"ec441f8c-c44a-4968-9eaf-c49a7d1f095f\") "
Sep 08 07:34:59.358629 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:34:59.358603    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec441f8c-c44a-4968-9eaf-c49a7d1f095f-istio-data\") pod \"ec441f8c-c44a-4968-9eaf-c49a7d1f095f\" (UID: \"ec441f8c-c44a-4968-9eaf-c49a7d1f095f\") "
Sep 08 07:34:59.358629 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:34:59.358625    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec441f8c-c44a-4968-9eaf-c49a7d1f095f-workload-socket\") pod \"ec441f8c-c44a-4968-9eaf-c49a7d1f095f\" (UID: \"ec441f8c-c44a-4968-9eaf-c49a7d1f095f\") "
Sep 08 07:34:59.358910 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:34:59.358647    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec441f8c-c44a-4968-9eaf-c49a7d1f095f-istio-token\") pod \"ec441f8c-c44a-4968-9eaf-c49a7d1f095f\" (UID: \"ec441f8c-c44a-4968-9eaf-c49a7d1f095f\") "
Sep 08 07:34:59.358910 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:34:59.358729    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec441f8c-c44a-4968-9eaf-c49a7d1f095f-istio-podinfo\") pod \"ec441f8c-c44a-4968-9eaf-c49a7d1f095f\" (UID: \"ec441f8c-c44a-4968-9eaf-c49a7d1f095f\") "
Sep 08 07:34:59.358910 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:34:59.358717    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec441f8c-c44a-4968-9eaf-c49a7d1f095f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ec441f8c-c44a-4968-9eaf-c49a7d1f095f" (UID: "ec441f8c-c44a-4968-9eaf-c49a7d1f095f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 07:34:59.358910 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:34:59.358756    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec441f8c-c44a-4968-9eaf-c49a7d1f095f-istio-envoy\") pod \"ec441f8c-c44a-4968-9eaf-c49a7d1f095f\" (UID: \"ec441f8c-c44a-4968-9eaf-c49a7d1f095f\") "
Sep 08 07:34:59.358910 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:34:59.358799    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec441f8c-c44a-4968-9eaf-c49a7d1f095f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ec441f8c-c44a-4968-9eaf-c49a7d1f095f" (UID: "ec441f8c-c44a-4968-9eaf-c49a7d1f095f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 07:34:59.359387 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:34:59.359009    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec441f8c-c44a-4968-9eaf-c49a7d1f095f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ec441f8c-c44a-4968-9eaf-c49a7d1f095f" (UID: "ec441f8c-c44a-4968-9eaf-c49a7d1f095f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 07:34:59.359387 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:34:59.359039    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec441f8c-c44a-4968-9eaf-c49a7d1f095f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ec441f8c-c44a-4968-9eaf-c49a7d1f095f" (UID: "ec441f8c-c44a-4968-9eaf-c49a7d1f095f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 07:34:59.359387 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:34:59.359159    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec441f8c-c44a-4968-9eaf-c49a7d1f095f-credential-socket\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:34:59.359387 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:34:59.359177    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec441f8c-c44a-4968-9eaf-c49a7d1f095f-workload-certs\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:34:59.359387 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:34:59.359191    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec441f8c-c44a-4968-9eaf-c49a7d1f095f-istiod-ca-cert\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:34:59.359387 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:34:59.359203    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec441f8c-c44a-4968-9eaf-c49a7d1f095f-workload-socket\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:34:59.359387 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:34:59.359307    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec441f8c-c44a-4968-9eaf-c49a7d1f095f-istio-data" (OuterVolumeSpecName: "istio-data") pod "ec441f8c-c44a-4968-9eaf-c49a7d1f095f" (UID: "ec441f8c-c44a-4968-9eaf-c49a7d1f095f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 07:34:59.361068 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:34:59.361022    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec441f8c-c44a-4968-9eaf-c49a7d1f095f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ec441f8c-c44a-4968-9eaf-c49a7d1f095f" (UID: "ec441f8c-c44a-4968-9eaf-c49a7d1f095f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 07:34:59.361273 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:34:59.361217    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec441f8c-c44a-4968-9eaf-c49a7d1f095f-kube-api-access-9dsm2" (OuterVolumeSpecName: "kube-api-access-9dsm2") pod "ec441f8c-c44a-4968-9eaf-c49a7d1f095f" (UID: "ec441f8c-c44a-4968-9eaf-c49a7d1f095f"). InnerVolumeSpecName "kube-api-access-9dsm2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 07:34:59.361273 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:34:59.361250    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec441f8c-c44a-4968-9eaf-c49a7d1f095f-istio-token" (OuterVolumeSpecName: "istio-token") pod "ec441f8c-c44a-4968-9eaf-c49a7d1f095f" (UID: "ec441f8c-c44a-4968-9eaf-c49a7d1f095f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 07:34:59.361273 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:34:59.361252    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ec441f8c-c44a-4968-9eaf-c49a7d1f095f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ec441f8c-c44a-4968-9eaf-c49a7d1f095f" (UID: "ec441f8c-c44a-4968-9eaf-c49a7d1f095f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 07:34:59.460118 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:34:59.460089    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec441f8c-c44a-4968-9eaf-c49a7d1f095f-istio-podinfo\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:34:59.460118 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:34:59.460113    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec441f8c-c44a-4968-9eaf-c49a7d1f095f-istio-envoy\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:34:59.460118 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:34:59.460125    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9dsm2\" (UniqueName: \"kubernetes.io/projected/ec441f8c-c44a-4968-9eaf-c49a7d1f095f-kube-api-access-9dsm2\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:34:59.460323 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:34:59.460134    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec441f8c-c44a-4968-9eaf-c49a7d1f095f-istio-data\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:34:59.460323 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:34:59.460144    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec441f8c-c44a-4968-9eaf-c49a7d1f095f-istio-token\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:34:59.621133 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:34:59.621098    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg"]
Sep 08 07:34:59.624284 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:34:59.624258    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-4d980e-openshift-default-6d45c868b6-k7btg"]
Sep 08 07:35:00.512126 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:00.512089    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec441f8c-c44a-4968-9eaf-c49a7d1f095f" path="/var/lib/kubelet/pods/ec441f8c-c44a-4968-9eaf-c49a7d1f095f/volumes"
Sep 08 07:35:09.150546 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:09.150509    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:35:23.311541 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:23.311504    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-fb59c2-86f4b8db49-lccl7"]
Sep 08 07:35:23.312074 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:23.311703    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-fb59c2-86f4b8db49-lccl7" podUID="fff106e5-8dd2-430b-ae60-1c2341eebe6a" containerName="maas-api" containerID="cri-o://fe76bf3b9e24c16894a4c7b33b40ae5df22a14f5e83613cfb8ee7d7931d16d87" gracePeriod=30
Sep 08 07:35:23.567604 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:23.567539    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-fb59c2-86f4b8db49-lccl7"
Sep 08 07:35:23.686524 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:23.686488    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fff106e5-8dd2-430b-ae60-1c2341eebe6a-maas-api-tls\") pod \"fff106e5-8dd2-430b-ae60-1c2341eebe6a\" (UID: \"fff106e5-8dd2-430b-ae60-1c2341eebe6a\") "
Sep 08 07:35:23.686717 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:23.686564    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gmhv8\" (UniqueName: \"kubernetes.io/projected/fff106e5-8dd2-430b-ae60-1c2341eebe6a-kube-api-access-gmhv8\") pod \"fff106e5-8dd2-430b-ae60-1c2341eebe6a\" (UID: \"fff106e5-8dd2-430b-ae60-1c2341eebe6a\") "
Sep 08 07:35:23.686717 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:23.686637    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fff106e5-8dd2-430b-ae60-1c2341eebe6a-openshift-service-ca\") pod \"fff106e5-8dd2-430b-ae60-1c2341eebe6a\" (UID: \"fff106e5-8dd2-430b-ae60-1c2341eebe6a\") "
Sep 08 07:35:23.686717 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:23.686677    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fff106e5-8dd2-430b-ae60-1c2341eebe6a-metrics-certs\") pod \"fff106e5-8dd2-430b-ae60-1c2341eebe6a\" (UID: \"fff106e5-8dd2-430b-ae60-1c2341eebe6a\") "
Sep 08 07:35:23.687288 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:23.687223    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fff106e5-8dd2-430b-ae60-1c2341eebe6a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fff106e5-8dd2-430b-ae60-1c2341eebe6a" (UID: "fff106e5-8dd2-430b-ae60-1c2341eebe6a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 07:35:23.689551 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:23.689518    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fff106e5-8dd2-430b-ae60-1c2341eebe6a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fff106e5-8dd2-430b-ae60-1c2341eebe6a" (UID: "fff106e5-8dd2-430b-ae60-1c2341eebe6a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 07:35:23.689663 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:23.689591    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fff106e5-8dd2-430b-ae60-1c2341eebe6a-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "fff106e5-8dd2-430b-ae60-1c2341eebe6a" (UID: "fff106e5-8dd2-430b-ae60-1c2341eebe6a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 07:35:23.689746 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:23.689670    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fff106e5-8dd2-430b-ae60-1c2341eebe6a-kube-api-access-gmhv8" (OuterVolumeSpecName: "kube-api-access-gmhv8") pod "fff106e5-8dd2-430b-ae60-1c2341eebe6a" (UID: "fff106e5-8dd2-430b-ae60-1c2341eebe6a"). InnerVolumeSpecName "kube-api-access-gmhv8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 07:35:23.787785 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:23.787748    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gmhv8\" (UniqueName: \"kubernetes.io/projected/fff106e5-8dd2-430b-ae60-1c2341eebe6a-kube-api-access-gmhv8\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:35:23.787785 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:23.787781    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fff106e5-8dd2-430b-ae60-1c2341eebe6a-openshift-service-ca\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:35:23.787785 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:23.787792    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fff106e5-8dd2-430b-ae60-1c2341eebe6a-metrics-certs\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:35:23.788057 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:23.787800    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fff106e5-8dd2-430b-ae60-1c2341eebe6a-maas-api-tls\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:35:24.424294 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:24.424255    2564 generic.go:356] "Generic (PLEG): container finished" podID="fff106e5-8dd2-430b-ae60-1c2341eebe6a" containerID="fe76bf3b9e24c16894a4c7b33b40ae5df22a14f5e83613cfb8ee7d7931d16d87" exitCode=0
Sep 08 07:35:24.424910 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:24.424327    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-fb59c2-86f4b8db49-lccl7"
Sep 08 07:35:24.424910 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:24.424342    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-fb59c2-86f4b8db49-lccl7" event={"ID":"fff106e5-8dd2-430b-ae60-1c2341eebe6a","Type":"ContainerDied","Data":"fe76bf3b9e24c16894a4c7b33b40ae5df22a14f5e83613cfb8ee7d7931d16d87"}
Sep 08 07:35:24.424910 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:24.424450    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-fb59c2-86f4b8db49-lccl7" event={"ID":"fff106e5-8dd2-430b-ae60-1c2341eebe6a","Type":"ContainerDied","Data":"5b21ad50622dafd5305e097ac268af65542953fc542fa9ee901be75ab96511c8"}
Sep 08 07:35:24.424910 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:24.424485    2564 scope.go:117] "RemoveContainer" containerID="fe76bf3b9e24c16894a4c7b33b40ae5df22a14f5e83613cfb8ee7d7931d16d87"
Sep 08 07:35:24.434734 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:24.434716    2564 scope.go:117] "RemoveContainer" containerID="fe76bf3b9e24c16894a4c7b33b40ae5df22a14f5e83613cfb8ee7d7931d16d87"
Sep 08 07:35:24.435066 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:35:24.435029    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe76bf3b9e24c16894a4c7b33b40ae5df22a14f5e83613cfb8ee7d7931d16d87\": container with ID starting with fe76bf3b9e24c16894a4c7b33b40ae5df22a14f5e83613cfb8ee7d7931d16d87 not found: ID does not exist" containerID="fe76bf3b9e24c16894a4c7b33b40ae5df22a14f5e83613cfb8ee7d7931d16d87"
Sep 08 07:35:24.435166 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:24.435077    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe76bf3b9e24c16894a4c7b33b40ae5df22a14f5e83613cfb8ee7d7931d16d87"} err="failed to get container status \"fe76bf3b9e24c16894a4c7b33b40ae5df22a14f5e83613cfb8ee7d7931d16d87\": rpc error: code = NotFound desc = could not find container \"fe76bf3b9e24c16894a4c7b33b40ae5df22a14f5e83613cfb8ee7d7931d16d87\": container with ID starting with fe76bf3b9e24c16894a4c7b33b40ae5df22a14f5e83613cfb8ee7d7931d16d87 not found: ID does not exist"
Sep 08 07:35:24.455789 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:24.455764    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-fb59c2-86f4b8db49-lccl7"]
Sep 08 07:35:24.468505 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:24.468481    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-fb59c2-86f4b8db49-lccl7"]
Sep 08 07:35:24.510744 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:24.510713    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fff106e5-8dd2-430b-ae60-1c2341eebe6a" path="/var/lib/kubelet/pods/fff106e5-8dd2-430b-ae60-1c2341eebe6a/volumes"
Sep 08 07:35:26.251417 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:26.251380    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:35:31.762017 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:31.761958    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f"]
Sep 08 07:35:31.762470 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:31.762193    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f" podUID="d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e" containerName="istio-proxy" containerID="cri-o://1edd89d9fa359e2268c11d27d35830f401b0ea53d43ee22e58d80b6d8f09440b" gracePeriod=30
Sep 08 07:35:36.652306 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:36.652216    2564 patch_prober.go:28] interesting pod/e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 07:35:36.652306 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:36.652286    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f" podUID="d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 07:35:37.009899 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:37.009870    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f"
Sep 08 07:35:37.105218 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:37.105178    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e-istiod-ca-cert\") pod \"d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e\" (UID: \"d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e\") "
Sep 08 07:35:37.105414 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:37.105238    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-twcnw\" (UniqueName: \"kubernetes.io/projected/d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e-kube-api-access-twcnw\") pod \"d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e\" (UID: \"d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e\") "
Sep 08 07:35:37.105414 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:37.105265    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e-credential-socket\") pod \"d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e\" (UID: \"d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e\") "
Sep 08 07:35:37.105414 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:37.105293    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e-workload-certs\") pod \"d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e\" (UID: \"d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e\") "
Sep 08 07:35:37.105414 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:37.105372    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e-istio-envoy\") pod \"d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e\" (UID: \"d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e\") "
Sep 08 07:35:37.105636 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:37.105424    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e-workload-socket\") pod \"d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e\" (UID: \"d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e\") "
Sep 08 07:35:37.105636 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:37.105449    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e-istio-token\") pod \"d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e\" (UID: \"d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e\") "
Sep 08 07:35:37.105636 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:37.105496    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e-istio-podinfo\") pod \"d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e\" (UID: \"d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e\") "
Sep 08 07:35:37.105636 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:37.105524    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e-istio-data\") pod \"d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e\" (UID: \"d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e\") "
Sep 08 07:35:37.105845 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:37.105632    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e" (UID: "d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 07:35:37.105845 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:37.105740    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e" (UID: "d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 07:35:37.105962 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:37.105855    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e" (UID: "d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 07:35:37.105962 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:37.105864    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e-istio-data" (OuterVolumeSpecName: "istio-data") pod "d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e" (UID: "d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 07:35:37.105962 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:37.105935    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e-credential-socket\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:35:37.105962 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:37.105955    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e-workload-socket\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:35:37.106178 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:37.106154    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e" (UID: "d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 07:35:37.108193 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:37.108153    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e" (UID: "d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 07:35:37.108193 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:37.108170    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e-istio-token" (OuterVolumeSpecName: "istio-token") pod "d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e" (UID: "d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 07:35:37.108351 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:37.108231    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e-kube-api-access-twcnw" (OuterVolumeSpecName: "kube-api-access-twcnw") pod "d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e" (UID: "d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e"). InnerVolumeSpecName "kube-api-access-twcnw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 07:35:37.108351 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:37.108230    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e" (UID: "d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 07:35:37.207115 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:37.207023    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e-istio-envoy\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:35:37.207115 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:37.207054    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e-istio-token\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:35:37.207115 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:37.207063    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e-istio-podinfo\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:35:37.207115 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:37.207070    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e-istio-data\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:35:37.207115 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:37.207079    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e-istiod-ca-cert\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:35:37.207115 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:37.207086    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-twcnw\" (UniqueName: \"kubernetes.io/projected/d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e-kube-api-access-twcnw\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:35:37.207115 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:37.207096    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e-workload-certs\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:35:37.500177 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:37.500063    2564 generic.go:356] "Generic (PLEG): container finished" podID="d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e" containerID="1edd89d9fa359e2268c11d27d35830f401b0ea53d43ee22e58d80b6d8f09440b" exitCode=0
Sep 08 07:35:37.500177 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:37.500137    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f"
Sep 08 07:35:37.500177 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:37.500153    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f" event={"ID":"d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e","Type":"ContainerDied","Data":"1edd89d9fa359e2268c11d27d35830f401b0ea53d43ee22e58d80b6d8f09440b"}
Sep 08 07:35:37.500471 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:37.500228    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f" event={"ID":"d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e","Type":"ContainerDied","Data":"3a8f0ce2d33d6fc2206863da34c983ba50dcdc9ba565472e97d7e0a4724b9b61"}
Sep 08 07:35:37.500471 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:37.500252    2564 scope.go:117] "RemoveContainer" containerID="1edd89d9fa359e2268c11d27d35830f401b0ea53d43ee22e58d80b6d8f09440b"
Sep 08 07:35:37.510003 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:37.509987    2564 scope.go:117] "RemoveContainer" containerID="34bd0fc8d58d6bc9140e8b2e22e88be4ebefc2cdf76acd97fca464154623ff38"
Sep 08 07:35:37.517889 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:37.517865    2564 scope.go:117] "RemoveContainer" containerID="1edd89d9fa359e2268c11d27d35830f401b0ea53d43ee22e58d80b6d8f09440b"
Sep 08 07:35:37.518187 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:35:37.518165    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1edd89d9fa359e2268c11d27d35830f401b0ea53d43ee22e58d80b6d8f09440b\": container with ID starting with 1edd89d9fa359e2268c11d27d35830f401b0ea53d43ee22e58d80b6d8f09440b not found: ID does not exist" containerID="1edd89d9fa359e2268c11d27d35830f401b0ea53d43ee22e58d80b6d8f09440b"
Sep 08 07:35:37.518240 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:37.518196    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1edd89d9fa359e2268c11d27d35830f401b0ea53d43ee22e58d80b6d8f09440b"} err="failed to get container status \"1edd89d9fa359e2268c11d27d35830f401b0ea53d43ee22e58d80b6d8f09440b\": rpc error: code = NotFound desc = could not find container \"1edd89d9fa359e2268c11d27d35830f401b0ea53d43ee22e58d80b6d8f09440b\": container with ID starting with 1edd89d9fa359e2268c11d27d35830f401b0ea53d43ee22e58d80b6d8f09440b not found: ID does not exist"
Sep 08 07:35:37.518240 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:37.518213    2564 scope.go:117] "RemoveContainer" containerID="34bd0fc8d58d6bc9140e8b2e22e88be4ebefc2cdf76acd97fca464154623ff38"
Sep 08 07:35:37.518451 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:35:37.518436    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34bd0fc8d58d6bc9140e8b2e22e88be4ebefc2cdf76acd97fca464154623ff38\": container with ID starting with 34bd0fc8d58d6bc9140e8b2e22e88be4ebefc2cdf76acd97fca464154623ff38 not found: ID does not exist" containerID="34bd0fc8d58d6bc9140e8b2e22e88be4ebefc2cdf76acd97fca464154623ff38"
Sep 08 07:35:37.518491 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:37.518457    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34bd0fc8d58d6bc9140e8b2e22e88be4ebefc2cdf76acd97fca464154623ff38"} err="failed to get container status \"34bd0fc8d58d6bc9140e8b2e22e88be4ebefc2cdf76acd97fca464154623ff38\": rpc error: code = NotFound desc = could not find container \"34bd0fc8d58d6bc9140e8b2e22e88be4ebefc2cdf76acd97fca464154623ff38\": container with ID starting with 34bd0fc8d58d6bc9140e8b2e22e88be4ebefc2cdf76acd97fca464154623ff38 not found: ID does not exist"
Sep 08 07:35:37.522944 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:37.522921    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f"]
Sep 08 07:35:37.536855 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:37.536832    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-fb59c2-openshift-default-96cc4f9c8-5jn9f"]
Sep 08 07:35:38.510824 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:38.510790    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e" path="/var/lib/kubelet/pods/d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e/volumes"
Sep 08 07:35:42.789904 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:42.789874    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-217bc2-f689fc7bd-hbp9c"]
Sep 08 07:35:42.790407 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:42.790123    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-217bc2-f689fc7bd-hbp9c" podUID="e21ccfc3-35e5-4d1d-b394-8094a8ebbbe1" containerName="maas-api" containerID="cri-o://0a65cc6733abc7e5093571afeed77903e07fd8c2912354f5e6a4421ae461dec9" gracePeriod=30
Sep 08 07:35:43.041091 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:43.041018    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-217bc2-f689fc7bd-hbp9c"
Sep 08 07:35:43.161827 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:43.161797    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lb79p\" (UniqueName: \"kubernetes.io/projected/e21ccfc3-35e5-4d1d-b394-8094a8ebbbe1-kube-api-access-lb79p\") pod \"e21ccfc3-35e5-4d1d-b394-8094a8ebbbe1\" (UID: \"e21ccfc3-35e5-4d1d-b394-8094a8ebbbe1\") "
Sep 08 07:35:43.162067 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:43.161837    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e21ccfc3-35e5-4d1d-b394-8094a8ebbbe1-openshift-service-ca\") pod \"e21ccfc3-35e5-4d1d-b394-8094a8ebbbe1\" (UID: \"e21ccfc3-35e5-4d1d-b394-8094a8ebbbe1\") "
Sep 08 07:35:43.162067 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:43.161916    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e21ccfc3-35e5-4d1d-b394-8094a8ebbbe1-maas-api-tls\") pod \"e21ccfc3-35e5-4d1d-b394-8094a8ebbbe1\" (UID: \"e21ccfc3-35e5-4d1d-b394-8094a8ebbbe1\") "
Sep 08 07:35:43.162067 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:43.161953    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e21ccfc3-35e5-4d1d-b394-8094a8ebbbe1-metrics-certs\") pod \"e21ccfc3-35e5-4d1d-b394-8094a8ebbbe1\" (UID: \"e21ccfc3-35e5-4d1d-b394-8094a8ebbbe1\") "
Sep 08 07:35:43.162334 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:43.162306    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e21ccfc3-35e5-4d1d-b394-8094a8ebbbe1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e21ccfc3-35e5-4d1d-b394-8094a8ebbbe1" (UID: "e21ccfc3-35e5-4d1d-b394-8094a8ebbbe1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 07:35:43.163866 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:43.163838    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e21ccfc3-35e5-4d1d-b394-8094a8ebbbe1-kube-api-access-lb79p" (OuterVolumeSpecName: "kube-api-access-lb79p") pod "e21ccfc3-35e5-4d1d-b394-8094a8ebbbe1" (UID: "e21ccfc3-35e5-4d1d-b394-8094a8ebbbe1"). InnerVolumeSpecName "kube-api-access-lb79p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 07:35:43.164004 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:43.163912    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e21ccfc3-35e5-4d1d-b394-8094a8ebbbe1-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "e21ccfc3-35e5-4d1d-b394-8094a8ebbbe1" (UID: "e21ccfc3-35e5-4d1d-b394-8094a8ebbbe1"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 07:35:43.164078 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:43.164061    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e21ccfc3-35e5-4d1d-b394-8094a8ebbbe1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e21ccfc3-35e5-4d1d-b394-8094a8ebbbe1" (UID: "e21ccfc3-35e5-4d1d-b394-8094a8ebbbe1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 07:35:43.262978 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:43.262939    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e21ccfc3-35e5-4d1d-b394-8094a8ebbbe1-openshift-service-ca\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:35:43.262978 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:43.262977    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e21ccfc3-35e5-4d1d-b394-8094a8ebbbe1-maas-api-tls\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:35:43.263163 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:43.262990    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e21ccfc3-35e5-4d1d-b394-8094a8ebbbe1-metrics-certs\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:35:43.263163 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:43.263000    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lb79p\" (UniqueName: \"kubernetes.io/projected/e21ccfc3-35e5-4d1d-b394-8094a8ebbbe1-kube-api-access-lb79p\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:35:43.531903 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:43.531869    2564 generic.go:356] "Generic (PLEG): container finished" podID="e21ccfc3-35e5-4d1d-b394-8094a8ebbbe1" containerID="0a65cc6733abc7e5093571afeed77903e07fd8c2912354f5e6a4421ae461dec9" exitCode=0
Sep 08 07:35:43.532102 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:43.531926    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-217bc2-f689fc7bd-hbp9c"
Sep 08 07:35:43.532102 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:43.531950    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-217bc2-f689fc7bd-hbp9c" event={"ID":"e21ccfc3-35e5-4d1d-b394-8094a8ebbbe1","Type":"ContainerDied","Data":"0a65cc6733abc7e5093571afeed77903e07fd8c2912354f5e6a4421ae461dec9"}
Sep 08 07:35:43.532102 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:43.532014    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-217bc2-f689fc7bd-hbp9c" event={"ID":"e21ccfc3-35e5-4d1d-b394-8094a8ebbbe1","Type":"ContainerDied","Data":"f215b2372a9154023d4ba357b0d26df703279ad4b437d5bdcf8bf9e39d3a96a5"}
Sep 08 07:35:43.532102 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:43.532037    2564 scope.go:117] "RemoveContainer" containerID="0a65cc6733abc7e5093571afeed77903e07fd8c2912354f5e6a4421ae461dec9"
Sep 08 07:35:43.541639 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:43.541623    2564 scope.go:117] "RemoveContainer" containerID="0a65cc6733abc7e5093571afeed77903e07fd8c2912354f5e6a4421ae461dec9"
Sep 08 07:35:43.541901 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:35:43.541882    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a65cc6733abc7e5093571afeed77903e07fd8c2912354f5e6a4421ae461dec9\": container with ID starting with 0a65cc6733abc7e5093571afeed77903e07fd8c2912354f5e6a4421ae461dec9 not found: ID does not exist" containerID="0a65cc6733abc7e5093571afeed77903e07fd8c2912354f5e6a4421ae461dec9"
Sep 08 07:35:43.541951 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:43.541908    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a65cc6733abc7e5093571afeed77903e07fd8c2912354f5e6a4421ae461dec9"} err="failed to get container status \"0a65cc6733abc7e5093571afeed77903e07fd8c2912354f5e6a4421ae461dec9\": rpc error: code = NotFound desc = could not find container \"0a65cc6733abc7e5093571afeed77903e07fd8c2912354f5e6a4421ae461dec9\": container with ID starting with 0a65cc6733abc7e5093571afeed77903e07fd8c2912354f5e6a4421ae461dec9 not found: ID does not exist"
Sep 08 07:35:43.560179 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:43.560152    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-217bc2-f689fc7bd-hbp9c"]
Sep 08 07:35:43.565169 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:43.565150    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-217bc2-f689fc7bd-hbp9c"]
Sep 08 07:35:44.511596 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:44.511563    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e21ccfc3-35e5-4d1d-b394-8094a8ebbbe1" path="/var/lib/kubelet/pods/e21ccfc3-35e5-4d1d-b394-8094a8ebbbe1/volumes"
Sep 08 07:35:46.559067 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:46.559028    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:35:51.801321 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:51.801283    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj"]
Sep 08 07:35:51.801755 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:51.801496    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj" podUID="4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba" containerName="istio-proxy" containerID="cri-o://c431281ea7b2bed6454cc0aee4e533ab4f238b230b26fee7da48a2fa86dbe76a" gracePeriod=30
Sep 08 07:35:54.206586 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:54.206550    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-67fbccb46f-4hxv2"]
Sep 08 07:35:54.207104 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:54.206820    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-67fbccb46f-4hxv2" podUID="e41f2ba9-6035-4a6a-9ac1-e730f29a246f" containerName="manager" containerID="cri-o://4aa8f2b33a9a0224cbaeaf58b4170b387193762694f7cb0f253fb70c29038204" gracePeriod=30
Sep 08 07:35:54.457625 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:54.457573    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-67fbccb46f-4hxv2"
Sep 08 07:35:54.570235 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:54.570207    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e41f2ba9-6035-4a6a-9ac1-e730f29a246f-webhook-cert\") pod \"e41f2ba9-6035-4a6a-9ac1-e730f29a246f\" (UID: \"e41f2ba9-6035-4a6a-9ac1-e730f29a246f\") "
Sep 08 07:35:54.570371 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:54.570243    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e41f2ba9-6035-4a6a-9ac1-e730f29a246f-metrics-certs\") pod \"e41f2ba9-6035-4a6a-9ac1-e730f29a246f\" (UID: \"e41f2ba9-6035-4a6a-9ac1-e730f29a246f\") "
Sep 08 07:35:54.570371 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:54.570284    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vfw4b\" (UniqueName: \"kubernetes.io/projected/e41f2ba9-6035-4a6a-9ac1-e730f29a246f-kube-api-access-vfw4b\") pod \"e41f2ba9-6035-4a6a-9ac1-e730f29a246f\" (UID: \"e41f2ba9-6035-4a6a-9ac1-e730f29a246f\") "
Sep 08 07:35:54.572332 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:54.572301    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e41f2ba9-6035-4a6a-9ac1-e730f29a246f-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "e41f2ba9-6035-4a6a-9ac1-e730f29a246f" (UID: "e41f2ba9-6035-4a6a-9ac1-e730f29a246f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 07:35:54.572435 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:54.572332    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e41f2ba9-6035-4a6a-9ac1-e730f29a246f-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "e41f2ba9-6035-4a6a-9ac1-e730f29a246f" (UID: "e41f2ba9-6035-4a6a-9ac1-e730f29a246f"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 07:35:54.572435 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:54.572337    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e41f2ba9-6035-4a6a-9ac1-e730f29a246f-kube-api-access-vfw4b" (OuterVolumeSpecName: "kube-api-access-vfw4b") pod "e41f2ba9-6035-4a6a-9ac1-e730f29a246f" (UID: "e41f2ba9-6035-4a6a-9ac1-e730f29a246f"). InnerVolumeSpecName "kube-api-access-vfw4b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 07:35:54.590598 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:54.590568    2564 generic.go:356] "Generic (PLEG): container finished" podID="e41f2ba9-6035-4a6a-9ac1-e730f29a246f" containerID="4aa8f2b33a9a0224cbaeaf58b4170b387193762694f7cb0f253fb70c29038204" exitCode=0
Sep 08 07:35:54.590735 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:54.590624    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-67fbccb46f-4hxv2"
Sep 08 07:35:54.590735 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:54.590641    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-67fbccb46f-4hxv2" event={"ID":"e41f2ba9-6035-4a6a-9ac1-e730f29a246f","Type":"ContainerDied","Data":"4aa8f2b33a9a0224cbaeaf58b4170b387193762694f7cb0f253fb70c29038204"}
Sep 08 07:35:54.590735 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:54.590695    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-67fbccb46f-4hxv2" event={"ID":"e41f2ba9-6035-4a6a-9ac1-e730f29a246f","Type":"ContainerDied","Data":"30d080401e1ec095ccfc16da40c0ceaadd13eb9dd3f2637b78704f676ac23bde"}
Sep 08 07:35:54.590735 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:54.590725    2564 scope.go:117] "RemoveContainer" containerID="4aa8f2b33a9a0224cbaeaf58b4170b387193762694f7cb0f253fb70c29038204"
Sep 08 07:35:54.600643 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:54.600627    2564 scope.go:117] "RemoveContainer" containerID="4aa8f2b33a9a0224cbaeaf58b4170b387193762694f7cb0f253fb70c29038204"
Sep 08 07:35:54.600938 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:35:54.600914    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4aa8f2b33a9a0224cbaeaf58b4170b387193762694f7cb0f253fb70c29038204\": container with ID starting with 4aa8f2b33a9a0224cbaeaf58b4170b387193762694f7cb0f253fb70c29038204 not found: ID does not exist" containerID="4aa8f2b33a9a0224cbaeaf58b4170b387193762694f7cb0f253fb70c29038204"
Sep 08 07:35:54.601014 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:54.600947    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4aa8f2b33a9a0224cbaeaf58b4170b387193762694f7cb0f253fb70c29038204"} err="failed to get container status \"4aa8f2b33a9a0224cbaeaf58b4170b387193762694f7cb0f253fb70c29038204\": rpc error: code = NotFound desc = could not find container \"4aa8f2b33a9a0224cbaeaf58b4170b387193762694f7cb0f253fb70c29038204\": container with ID starting with 4aa8f2b33a9a0224cbaeaf58b4170b387193762694f7cb0f253fb70c29038204 not found: ID does not exist"
Sep 08 07:35:54.616031 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:54.616007    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-67fbccb46f-4hxv2"]
Sep 08 07:35:54.620867 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:54.620848    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-67fbccb46f-4hxv2"]
Sep 08 07:35:54.672169 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:54.672148    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vfw4b\" (UniqueName: \"kubernetes.io/projected/e41f2ba9-6035-4a6a-9ac1-e730f29a246f-kube-api-access-vfw4b\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:35:54.672169 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:54.672169    2564 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e41f2ba9-6035-4a6a-9ac1-e730f29a246f-webhook-cert\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:35:54.672293 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:54.672181    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e41f2ba9-6035-4a6a-9ac1-e730f29a246f-metrics-certs\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:35:55.949758 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:55.949721    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:35:56.509939 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:56.509907    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e41f2ba9-6035-4a6a-9ac1-e730f29a246f" path="/var/lib/kubelet/pods/e41f2ba9-6035-4a6a-9ac1-e730f29a246f/volumes"
Sep 08 07:35:57.048215 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:57.048191    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj"
Sep 08 07:35:57.195800 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:57.195713    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba-istio-token\") pod \"4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba\" (UID: \"4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba\") "
Sep 08 07:35:57.195800 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:57.195757    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba-workload-certs\") pod \"4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba\" (UID: \"4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba\") "
Sep 08 07:35:57.195800 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:57.195776    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba-istio-podinfo\") pod \"4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba\" (UID: \"4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba\") "
Sep 08 07:35:57.196115 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:57.195814    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba-istio-envoy\") pod \"4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba\" (UID: \"4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba\") "
Sep 08 07:35:57.196115 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:57.195854    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba-credential-socket\") pod \"4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba\" (UID: \"4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba\") "
Sep 08 07:35:57.196115 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:57.195871    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba-istio-data\") pod \"4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba\" (UID: \"4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba\") "
Sep 08 07:35:57.196115 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:57.195906    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba-istiod-ca-cert\") pod \"4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba\" (UID: \"4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba\") "
Sep 08 07:35:57.196115 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:57.195958    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wrv5d\" (UniqueName: \"kubernetes.io/projected/4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba-kube-api-access-wrv5d\") pod \"4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba\" (UID: \"4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba\") "
Sep 08 07:35:57.196115 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:57.196009    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba-workload-socket\") pod \"4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba\" (UID: \"4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba\") "
Sep 08 07:35:57.196115 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:57.196021    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba" (UID: "4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 07:35:57.196483 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:57.196270    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba-workload-certs\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:35:57.196483 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:57.196423    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba" (UID: "4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 07:35:57.196483 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:57.196446    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba" (UID: "4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 07:35:57.196647 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:57.196531    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba-istio-data" (OuterVolumeSpecName: "istio-data") pod "4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba" (UID: "4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 07:35:57.196647 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:57.196594    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba" (UID: "4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 07:35:57.198215 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:57.198180    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba" (UID: "4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 07:35:57.198324 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:57.198257    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba-istio-token" (OuterVolumeSpecName: "istio-token") pod "4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba" (UID: "4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 07:35:57.198394 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:57.198335    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba-kube-api-access-wrv5d" (OuterVolumeSpecName: "kube-api-access-wrv5d") pod "4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba" (UID: "4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba"). InnerVolumeSpecName "kube-api-access-wrv5d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 07:35:57.198453 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:57.198417    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba" (UID: "4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 07:35:57.297260 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:57.297216    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wrv5d\" (UniqueName: \"kubernetes.io/projected/4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba-kube-api-access-wrv5d\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:35:57.297260 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:57.297260    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba-workload-socket\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:35:57.297462 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:57.297276    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba-istio-token\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:35:57.297462 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:57.297289    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba-istio-podinfo\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:35:57.297462 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:57.297304    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba-istio-envoy\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:35:57.297462 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:57.297317    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba-credential-socket\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:35:57.297462 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:57.297329    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba-istio-data\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:35:57.297462 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:57.297341    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba-istiod-ca-cert\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:35:57.608615 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:57.608579    2564 generic.go:356] "Generic (PLEG): container finished" podID="4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba" containerID="c431281ea7b2bed6454cc0aee4e533ab4f238b230b26fee7da48a2fa86dbe76a" exitCode=0
Sep 08 07:35:57.608786 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:57.608632    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj"
Sep 08 07:35:57.608786 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:57.608666    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj" event={"ID":"4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba","Type":"ContainerDied","Data":"c431281ea7b2bed6454cc0aee4e533ab4f238b230b26fee7da48a2fa86dbe76a"}
Sep 08 07:35:57.608786 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:57.608738    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj" event={"ID":"4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba","Type":"ContainerDied","Data":"4ca7bf54d47906b317583f4349016144b8458395dc3f292be488aa0d1c27a0df"}
Sep 08 07:35:57.608786 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:57.608764    2564 scope.go:117] "RemoveContainer" containerID="c431281ea7b2bed6454cc0aee4e533ab4f238b230b26fee7da48a2fa86dbe76a"
Sep 08 07:35:57.619467 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:57.619450    2564 scope.go:117] "RemoveContainer" containerID="54baf852f305aba9bb6ee842f78360ba579b6c6d014d60f388984be7cd242ef4"
Sep 08 07:35:57.627254 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:57.627237    2564 scope.go:117] "RemoveContainer" containerID="c431281ea7b2bed6454cc0aee4e533ab4f238b230b26fee7da48a2fa86dbe76a"
Sep 08 07:35:57.627541 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:35:57.627521    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c431281ea7b2bed6454cc0aee4e533ab4f238b230b26fee7da48a2fa86dbe76a\": container with ID starting with c431281ea7b2bed6454cc0aee4e533ab4f238b230b26fee7da48a2fa86dbe76a not found: ID does not exist" containerID="c431281ea7b2bed6454cc0aee4e533ab4f238b230b26fee7da48a2fa86dbe76a"
Sep 08 07:35:57.627621 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:57.627551    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c431281ea7b2bed6454cc0aee4e533ab4f238b230b26fee7da48a2fa86dbe76a"} err="failed to get container status \"c431281ea7b2bed6454cc0aee4e533ab4f238b230b26fee7da48a2fa86dbe76a\": rpc error: code = NotFound desc = could not find container \"c431281ea7b2bed6454cc0aee4e533ab4f238b230b26fee7da48a2fa86dbe76a\": container with ID starting with c431281ea7b2bed6454cc0aee4e533ab4f238b230b26fee7da48a2fa86dbe76a not found: ID does not exist"
Sep 08 07:35:57.627621 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:57.627574    2564 scope.go:117] "RemoveContainer" containerID="54baf852f305aba9bb6ee842f78360ba579b6c6d014d60f388984be7cd242ef4"
Sep 08 07:35:57.627838 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:35:57.627819    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54baf852f305aba9bb6ee842f78360ba579b6c6d014d60f388984be7cd242ef4\": container with ID starting with 54baf852f305aba9bb6ee842f78360ba579b6c6d014d60f388984be7cd242ef4 not found: ID does not exist" containerID="54baf852f305aba9bb6ee842f78360ba579b6c6d014d60f388984be7cd242ef4"
Sep 08 07:35:57.627874 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:57.627843    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54baf852f305aba9bb6ee842f78360ba579b6c6d014d60f388984be7cd242ef4"} err="failed to get container status \"54baf852f305aba9bb6ee842f78360ba579b6c6d014d60f388984be7cd242ef4\": rpc error: code = NotFound desc = could not find container \"54baf852f305aba9bb6ee842f78360ba579b6c6d014d60f388984be7cd242ef4\": container with ID starting with 54baf852f305aba9bb6ee842f78360ba579b6c6d014d60f388984be7cd242ef4 not found: ID does not exist"
Sep 08 07:35:57.637410 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:57.637385    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj"]
Sep 08 07:35:57.643559 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:57.643538    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-217bc2-openshift-default-5848f8454d-mvhhj"]
Sep 08 07:35:58.509685 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:35:58.509650    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba" path="/var/lib/kubelet/pods/4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba/volumes"
Sep 08 07:36:55.398616 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:36:55.398575    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-67fbccb46f-8gwcj"]
Sep 08 07:36:55.399066 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:36:55.399004    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e21ccfc3-35e5-4d1d-b394-8094a8ebbbe1" containerName="maas-api"
Sep 08 07:36:55.399066 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:36:55.399016    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e21ccfc3-35e5-4d1d-b394-8094a8ebbbe1" containerName="maas-api"
Sep 08 07:36:55.399066 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:36:55.399024    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edbe59f2-0b00-4b7e-91a9-0435268c2478" containerName="istio-proxy"
Sep 08 07:36:55.399066 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:36:55.399029    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="edbe59f2-0b00-4b7e-91a9-0435268c2478" containerName="istio-proxy"
Sep 08 07:36:55.399066 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:36:55.399037    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e" containerName="istio-proxy"
Sep 08 07:36:55.399066 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:36:55.399042    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e" containerName="istio-proxy"
Sep 08 07:36:55.399066 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:36:55.399051    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edbe59f2-0b00-4b7e-91a9-0435268c2478" containerName="istio-proxy"
Sep 08 07:36:55.399066 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:36:55.399057    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="edbe59f2-0b00-4b7e-91a9-0435268c2478" containerName="istio-proxy"
Sep 08 07:36:55.399066 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:36:55.399064    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e" containerName="istio-proxy"
Sep 08 07:36:55.399066 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:36:55.399070    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e" containerName="istio-proxy"
Sep 08 07:36:55.399390 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:36:55.399078    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fff106e5-8dd2-430b-ae60-1c2341eebe6a" containerName="maas-api"
Sep 08 07:36:55.399390 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:36:55.399083    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="fff106e5-8dd2-430b-ae60-1c2341eebe6a" containerName="maas-api"
Sep 08 07:36:55.399390 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:36:55.399091    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d1a40e2-43e5-428f-9536-3e2cae99b505" containerName="maas-api"
Sep 08 07:36:55.399390 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:36:55.399096    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d1a40e2-43e5-428f-9536-3e2cae99b505" containerName="maas-api"
Sep 08 07:36:55.399390 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:36:55.399102    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec441f8c-c44a-4968-9eaf-c49a7d1f095f" containerName="istio-proxy"
Sep 08 07:36:55.399390 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:36:55.399107    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec441f8c-c44a-4968-9eaf-c49a7d1f095f" containerName="istio-proxy"
Sep 08 07:36:55.399390 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:36:55.399114    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e41f2ba9-6035-4a6a-9ac1-e730f29a246f" containerName="manager"
Sep 08 07:36:55.399390 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:36:55.399119    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e41f2ba9-6035-4a6a-9ac1-e730f29a246f" containerName="manager"
Sep 08 07:36:55.399390 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:36:55.399127    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba" containerName="istio-proxy"
Sep 08 07:36:55.399390 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:36:55.399132    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba" containerName="istio-proxy"
Sep 08 07:36:55.399390 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:36:55.399140    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba" containerName="istio-proxy"
Sep 08 07:36:55.399390 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:36:55.399145    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba" containerName="istio-proxy"
Sep 08 07:36:55.399390 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:36:55.399210    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e" containerName="istio-proxy"
Sep 08 07:36:55.399390 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:36:55.399217    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1b07f2f-4e5e-4a67-a895-88c1f0c9f21e" containerName="istio-proxy"
Sep 08 07:36:55.399390 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:36:55.399222    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e41f2ba9-6035-4a6a-9ac1-e730f29a246f" containerName="manager"
Sep 08 07:36:55.399390 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:36:55.399227    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba" containerName="istio-proxy"
Sep 08 07:36:55.399390 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:36:55.399232    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="fff106e5-8dd2-430b-ae60-1c2341eebe6a" containerName="maas-api"
Sep 08 07:36:55.399390 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:36:55.399239    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec441f8c-c44a-4968-9eaf-c49a7d1f095f" containerName="istio-proxy"
Sep 08 07:36:55.399390 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:36:55.399244    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="edbe59f2-0b00-4b7e-91a9-0435268c2478" containerName="istio-proxy"
Sep 08 07:36:55.399390 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:36:55.399248    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="edbe59f2-0b00-4b7e-91a9-0435268c2478" containerName="istio-proxy"
Sep 08 07:36:55.399390 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:36:55.399255    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec441f8c-c44a-4968-9eaf-c49a7d1f095f" containerName="istio-proxy"
Sep 08 07:36:55.399390 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:36:55.399261    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a383f7a-c5c9-4f84-b1fc-35b1bcfb32ba" containerName="istio-proxy"
Sep 08 07:36:55.399390 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:36:55.399266    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e21ccfc3-35e5-4d1d-b394-8094a8ebbbe1" containerName="maas-api"
Sep 08 07:36:55.399390 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:36:55.399272    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d1a40e2-43e5-428f-9536-3e2cae99b505" containerName="maas-api"
Sep 08 07:36:55.402338 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:36:55.402321    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-67fbccb46f-8gwcj"
Sep 08 07:36:55.405054 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:36:55.405028    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 08 07:36:55.405189 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:36:55.405057    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 08 07:36:55.405189 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:36:55.405028    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-w2vnv\""
Sep 08 07:36:55.405189 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:36:55.405062    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 08 07:36:55.413428 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:36:55.413403    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-67fbccb46f-8gwcj"]
Sep 08 07:36:55.512876 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:36:55.512842    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/576ea111-28e1-4fe5-88a4-547a69738d5a-metrics-certs\") pod \"maas-controller-67fbccb46f-8gwcj\" (UID: \"576ea111-28e1-4fe5-88a4-547a69738d5a\") " pod="opendatahub/maas-controller-67fbccb46f-8gwcj"
Sep 08 07:36:55.512876 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:36:55.512888    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sp28\" (UniqueName: \"kubernetes.io/projected/576ea111-28e1-4fe5-88a4-547a69738d5a-kube-api-access-4sp28\") pod \"maas-controller-67fbccb46f-8gwcj\" (UID: \"576ea111-28e1-4fe5-88a4-547a69738d5a\") " pod="opendatahub/maas-controller-67fbccb46f-8gwcj"
Sep 08 07:36:55.513100 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:36:55.512919    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/576ea111-28e1-4fe5-88a4-547a69738d5a-webhook-cert\") pod \"maas-controller-67fbccb46f-8gwcj\" (UID: \"576ea111-28e1-4fe5-88a4-547a69738d5a\") " pod="opendatahub/maas-controller-67fbccb46f-8gwcj"
Sep 08 07:36:55.613810 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:36:55.613760    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4sp28\" (UniqueName: \"kubernetes.io/projected/576ea111-28e1-4fe5-88a4-547a69738d5a-kube-api-access-4sp28\") pod \"maas-controller-67fbccb46f-8gwcj\" (UID: \"576ea111-28e1-4fe5-88a4-547a69738d5a\") " pod="opendatahub/maas-controller-67fbccb46f-8gwcj"
Sep 08 07:36:55.614164 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:36:55.613833    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/576ea111-28e1-4fe5-88a4-547a69738d5a-webhook-cert\") pod \"maas-controller-67fbccb46f-8gwcj\" (UID: \"576ea111-28e1-4fe5-88a4-547a69738d5a\") " pod="opendatahub/maas-controller-67fbccb46f-8gwcj"
Sep 08 07:36:55.614164 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:36:55.613911    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/576ea111-28e1-4fe5-88a4-547a69738d5a-metrics-certs\") pod \"maas-controller-67fbccb46f-8gwcj\" (UID: \"576ea111-28e1-4fe5-88a4-547a69738d5a\") " pod="opendatahub/maas-controller-67fbccb46f-8gwcj"
Sep 08 07:36:55.616454 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:36:55.616428    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/576ea111-28e1-4fe5-88a4-547a69738d5a-metrics-certs\") pod \"maas-controller-67fbccb46f-8gwcj\" (UID: \"576ea111-28e1-4fe5-88a4-547a69738d5a\") " pod="opendatahub/maas-controller-67fbccb46f-8gwcj"
Sep 08 07:36:55.616601 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:36:55.616576    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/576ea111-28e1-4fe5-88a4-547a69738d5a-webhook-cert\") pod \"maas-controller-67fbccb46f-8gwcj\" (UID: \"576ea111-28e1-4fe5-88a4-547a69738d5a\") " pod="opendatahub/maas-controller-67fbccb46f-8gwcj"
Sep 08 07:36:55.621726 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:36:55.621702    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sp28\" (UniqueName: \"kubernetes.io/projected/576ea111-28e1-4fe5-88a4-547a69738d5a-kube-api-access-4sp28\") pod \"maas-controller-67fbccb46f-8gwcj\" (UID: \"576ea111-28e1-4fe5-88a4-547a69738d5a\") " pod="opendatahub/maas-controller-67fbccb46f-8gwcj"
Sep 08 07:36:55.713846 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:36:55.713758    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-67fbccb46f-8gwcj"
Sep 08 07:36:55.988369 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:36:55.988341    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-67fbccb46f-8gwcj"]
Sep 08 07:36:55.990541 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:36:55.990514    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod576ea111_28e1_4fe5_88a4_547a69738d5a.slice/crio-b1d3d8e2c8b65e44dc0e55f25552ee71bf8592443c5db43f7223232e43e5c1a6 WatchSource:0}: Error finding container b1d3d8e2c8b65e44dc0e55f25552ee71bf8592443c5db43f7223232e43e5c1a6: Status 404 returned error can't find the container with id b1d3d8e2c8b65e44dc0e55f25552ee71bf8592443c5db43f7223232e43e5c1a6
Sep 08 07:36:55.992329 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:36:55.992309    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 07:36:56.899142 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:36:56.899103    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-67fbccb46f-8gwcj" event={"ID":"576ea111-28e1-4fe5-88a4-547a69738d5a","Type":"ContainerStarted","Data":"4cdcde819afe451df4e915c8bcb201b7de4300e4bef2f844f2676f77c46293cb"}
Sep 08 07:36:56.899552 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:36:56.899160    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-67fbccb46f-8gwcj" event={"ID":"576ea111-28e1-4fe5-88a4-547a69738d5a","Type":"ContainerStarted","Data":"b1d3d8e2c8b65e44dc0e55f25552ee71bf8592443c5db43f7223232e43e5c1a6"}
Sep 08 07:36:56.899552 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:36:56.899201    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-67fbccb46f-8gwcj"
Sep 08 07:36:56.915293 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:36:56.915243    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-67fbccb46f-8gwcj" podStartSLOduration=1.404601551 podStartE2EDuration="1.915226189s" totalImagesPullingTime="510.624638ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:36:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:36:56.914264636 +0000 UTC m=+1964.895303952" watchObservedRunningTime="2026-09-08 07:36:56.915226189 +0000 UTC m=+1964.896265494"
Sep 08 07:37:07.906916 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:37:07.906833    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-67fbccb46f-8gwcj"
Sep 08 07:37:15.133461 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:37:15.133412    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-67fbccb46f-8gwcj"]
Sep 08 07:37:15.133984 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:37:15.133805    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-67fbccb46f-8gwcj" podUID="576ea111-28e1-4fe5-88a4-547a69738d5a" containerName="manager" containerID="cri-o://4cdcde819afe451df4e915c8bcb201b7de4300e4bef2f844f2676f77c46293cb" gracePeriod=30
Sep 08 07:37:15.373721 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:37:15.373695    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-67fbccb46f-8gwcj"
Sep 08 07:37:15.487167 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:37:15.487072    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4sp28\" (UniqueName: \"kubernetes.io/projected/576ea111-28e1-4fe5-88a4-547a69738d5a-kube-api-access-4sp28\") pod \"576ea111-28e1-4fe5-88a4-547a69738d5a\" (UID: \"576ea111-28e1-4fe5-88a4-547a69738d5a\") "
Sep 08 07:37:15.487167 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:37:15.487146    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/576ea111-28e1-4fe5-88a4-547a69738d5a-metrics-certs\") pod \"576ea111-28e1-4fe5-88a4-547a69738d5a\" (UID: \"576ea111-28e1-4fe5-88a4-547a69738d5a\") "
Sep 08 07:37:15.487423 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:37:15.487245    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/576ea111-28e1-4fe5-88a4-547a69738d5a-webhook-cert\") pod \"576ea111-28e1-4fe5-88a4-547a69738d5a\" (UID: \"576ea111-28e1-4fe5-88a4-547a69738d5a\") "
Sep 08 07:37:15.489273 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:37:15.489238    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/576ea111-28e1-4fe5-88a4-547a69738d5a-kube-api-access-4sp28" (OuterVolumeSpecName: "kube-api-access-4sp28") pod "576ea111-28e1-4fe5-88a4-547a69738d5a" (UID: "576ea111-28e1-4fe5-88a4-547a69738d5a"). InnerVolumeSpecName "kube-api-access-4sp28". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 07:37:15.489550 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:37:15.489515    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/576ea111-28e1-4fe5-88a4-547a69738d5a-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "576ea111-28e1-4fe5-88a4-547a69738d5a" (UID: "576ea111-28e1-4fe5-88a4-547a69738d5a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 07:37:15.489629 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:37:15.489529    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/576ea111-28e1-4fe5-88a4-547a69738d5a-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "576ea111-28e1-4fe5-88a4-547a69738d5a" (UID: "576ea111-28e1-4fe5-88a4-547a69738d5a"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 07:37:15.588623 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:37:15.588548    2564 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/576ea111-28e1-4fe5-88a4-547a69738d5a-webhook-cert\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:37:15.588623 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:37:15.588579    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4sp28\" (UniqueName: \"kubernetes.io/projected/576ea111-28e1-4fe5-88a4-547a69738d5a-kube-api-access-4sp28\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:37:15.588623 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:37:15.588593    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/576ea111-28e1-4fe5-88a4-547a69738d5a-metrics-certs\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:37:15.645114 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:37:15.645086    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:37:15.996890 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:37:15.996856    2564 generic.go:356] "Generic (PLEG): container finished" podID="576ea111-28e1-4fe5-88a4-547a69738d5a" containerID="4cdcde819afe451df4e915c8bcb201b7de4300e4bef2f844f2676f77c46293cb" exitCode=0
Sep 08 07:37:15.997079 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:37:15.996898    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-67fbccb46f-8gwcj"
Sep 08 07:37:15.997079 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:37:15.996943    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-67fbccb46f-8gwcj" event={"ID":"576ea111-28e1-4fe5-88a4-547a69738d5a","Type":"ContainerDied","Data":"4cdcde819afe451df4e915c8bcb201b7de4300e4bef2f844f2676f77c46293cb"}
Sep 08 07:37:15.997079 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:37:15.997016    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-67fbccb46f-8gwcj" event={"ID":"576ea111-28e1-4fe5-88a4-547a69738d5a","Type":"ContainerDied","Data":"b1d3d8e2c8b65e44dc0e55f25552ee71bf8592443c5db43f7223232e43e5c1a6"}
Sep 08 07:37:15.997079 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:37:15.997039    2564 scope.go:117] "RemoveContainer" containerID="4cdcde819afe451df4e915c8bcb201b7de4300e4bef2f844f2676f77c46293cb"
Sep 08 07:37:16.005852 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:37:16.005833    2564 scope.go:117] "RemoveContainer" containerID="4cdcde819afe451df4e915c8bcb201b7de4300e4bef2f844f2676f77c46293cb"
Sep 08 07:37:16.006182 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:37:16.006164    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4cdcde819afe451df4e915c8bcb201b7de4300e4bef2f844f2676f77c46293cb\": container with ID starting with 4cdcde819afe451df4e915c8bcb201b7de4300e4bef2f844f2676f77c46293cb not found: ID does not exist" containerID="4cdcde819afe451df4e915c8bcb201b7de4300e4bef2f844f2676f77c46293cb"
Sep 08 07:37:16.006247 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:37:16.006190    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cdcde819afe451df4e915c8bcb201b7de4300e4bef2f844f2676f77c46293cb"} err="failed to get container status \"4cdcde819afe451df4e915c8bcb201b7de4300e4bef2f844f2676f77c46293cb\": rpc error: code = NotFound desc = could not find container \"4cdcde819afe451df4e915c8bcb201b7de4300e4bef2f844f2676f77c46293cb\": container with ID starting with 4cdcde819afe451df4e915c8bcb201b7de4300e4bef2f844f2676f77c46293cb not found: ID does not exist"
Sep 08 07:37:16.033683 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:37:16.033655    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-67fbccb46f-8gwcj"]
Sep 08 07:37:16.036952 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:37:16.036931    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-67fbccb46f-8gwcj"]
Sep 08 07:37:16.510588 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:37:16.510551    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="576ea111-28e1-4fe5-88a4-547a69738d5a" path="/var/lib/kubelet/pods/576ea111-28e1-4fe5-88a4-547a69738d5a/volumes"
Sep 08 07:37:16.956363 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:37:16.956327    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-67fbccb46f-ms4m4"]
Sep 08 07:37:16.956756 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:37:16.956743    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="576ea111-28e1-4fe5-88a4-547a69738d5a" containerName="manager"
Sep 08 07:37:16.956815 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:37:16.956757    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="576ea111-28e1-4fe5-88a4-547a69738d5a" containerName="manager"
Sep 08 07:37:16.956815 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:37:16.956775    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec441f8c-c44a-4968-9eaf-c49a7d1f095f" containerName="istio-proxy"
Sep 08 07:37:16.956815 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:37:16.956781    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec441f8c-c44a-4968-9eaf-c49a7d1f095f" containerName="istio-proxy"
Sep 08 07:37:16.956912 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:37:16.956840    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="576ea111-28e1-4fe5-88a4-547a69738d5a" containerName="manager"
Sep 08 07:37:16.959798 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:37:16.959784    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-67fbccb46f-ms4m4"
Sep 08 07:37:16.962797 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:37:16.962773    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-w2vnv\""
Sep 08 07:37:16.962937 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:37:16.962806    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 08 07:37:16.962937 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:37:16.962778    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 08 07:37:16.962937 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:37:16.962850    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 08 07:37:16.970783 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:37:16.970762    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-67fbccb46f-ms4m4"]
Sep 08 07:37:17.103128 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:37:17.103094    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3bc808df-3fc3-4ab0-9332-4888a4ff90a2-metrics-certs\") pod \"maas-controller-67fbccb46f-ms4m4\" (UID: \"3bc808df-3fc3-4ab0-9332-4888a4ff90a2\") " pod="opendatahub/maas-controller-67fbccb46f-ms4m4"
Sep 08 07:37:17.103298 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:37:17.103158    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hshg\" (UniqueName: \"kubernetes.io/projected/3bc808df-3fc3-4ab0-9332-4888a4ff90a2-kube-api-access-5hshg\") pod \"maas-controller-67fbccb46f-ms4m4\" (UID: \"3bc808df-3fc3-4ab0-9332-4888a4ff90a2\") " pod="opendatahub/maas-controller-67fbccb46f-ms4m4"
Sep 08 07:37:17.103298 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:37:17.103217    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3bc808df-3fc3-4ab0-9332-4888a4ff90a2-webhook-cert\") pod \"maas-controller-67fbccb46f-ms4m4\" (UID: \"3bc808df-3fc3-4ab0-9332-4888a4ff90a2\") " pod="opendatahub/maas-controller-67fbccb46f-ms4m4"
Sep 08 07:37:17.203928 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:37:17.203899    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hshg\" (UniqueName: \"kubernetes.io/projected/3bc808df-3fc3-4ab0-9332-4888a4ff90a2-kube-api-access-5hshg\") pod \"maas-controller-67fbccb46f-ms4m4\" (UID: \"3bc808df-3fc3-4ab0-9332-4888a4ff90a2\") " pod="opendatahub/maas-controller-67fbccb46f-ms4m4"
Sep 08 07:37:17.204115 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:37:17.203964    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3bc808df-3fc3-4ab0-9332-4888a4ff90a2-webhook-cert\") pod \"maas-controller-67fbccb46f-ms4m4\" (UID: \"3bc808df-3fc3-4ab0-9332-4888a4ff90a2\") " pod="opendatahub/maas-controller-67fbccb46f-ms4m4"
Sep 08 07:37:17.204115 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:37:17.204022    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3bc808df-3fc3-4ab0-9332-4888a4ff90a2-metrics-certs\") pod \"maas-controller-67fbccb46f-ms4m4\" (UID: \"3bc808df-3fc3-4ab0-9332-4888a4ff90a2\") " pod="opendatahub/maas-controller-67fbccb46f-ms4m4"
Sep 08 07:37:17.206497 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:37:17.206440    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3bc808df-3fc3-4ab0-9332-4888a4ff90a2-metrics-certs\") pod \"maas-controller-67fbccb46f-ms4m4\" (UID: \"3bc808df-3fc3-4ab0-9332-4888a4ff90a2\") " pod="opendatahub/maas-controller-67fbccb46f-ms4m4"
Sep 08 07:37:17.206604 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:37:17.206583    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3bc808df-3fc3-4ab0-9332-4888a4ff90a2-webhook-cert\") pod \"maas-controller-67fbccb46f-ms4m4\" (UID: \"3bc808df-3fc3-4ab0-9332-4888a4ff90a2\") " pod="opendatahub/maas-controller-67fbccb46f-ms4m4"
Sep 08 07:37:17.212462 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:37:17.212438    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hshg\" (UniqueName: \"kubernetes.io/projected/3bc808df-3fc3-4ab0-9332-4888a4ff90a2-kube-api-access-5hshg\") pod \"maas-controller-67fbccb46f-ms4m4\" (UID: \"3bc808df-3fc3-4ab0-9332-4888a4ff90a2\") " pod="opendatahub/maas-controller-67fbccb46f-ms4m4"
Sep 08 07:37:17.272073 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:37:17.272038    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-67fbccb46f-ms4m4"
Sep 08 07:37:17.542769 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:37:17.542737    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-67fbccb46f-ms4m4"]
Sep 08 07:37:17.545864 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:37:17.545839    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bc808df_3fc3_4ab0_9332_4888a4ff90a2.slice/crio-dc1e51e9dc0d1df0837580fdbbd58b9a38a81a472ff648c0dee5a4678899ea5c WatchSource:0}: Error finding container dc1e51e9dc0d1df0837580fdbbd58b9a38a81a472ff648c0dee5a4678899ea5c: Status 404 returned error can't find the container with id dc1e51e9dc0d1df0837580fdbbd58b9a38a81a472ff648c0dee5a4678899ea5c
Sep 08 07:37:18.010292 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:37:18.010193    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-67fbccb46f-ms4m4" event={"ID":"3bc808df-3fc3-4ab0-9332-4888a4ff90a2","Type":"ContainerStarted","Data":"dc1e51e9dc0d1df0837580fdbbd58b9a38a81a472ff648c0dee5a4678899ea5c"}
Sep 08 07:37:19.016479 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:37:19.016428    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-67fbccb46f-ms4m4" event={"ID":"3bc808df-3fc3-4ab0-9332-4888a4ff90a2","Type":"ContainerStarted","Data":"100deb6e9da37dfb3498c4514daba8f2bb6a0b5b635cc97f840fb7f01691314f"}
Sep 08 07:37:19.016934 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:37:19.016509    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-67fbccb46f-ms4m4"
Sep 08 07:37:19.039344 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:37:19.039291    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-67fbccb46f-ms4m4" podStartSLOduration=2.361310152 podStartE2EDuration="3.039275484s" totalImagesPullingTime="677.965332ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:37:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:37:19.037841966 +0000 UTC m=+1987.018881287" watchObservedRunningTime="2026-09-08 07:37:19.039275484 +0000 UTC m=+1987.020314819"
Sep 08 07:37:30.024276 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:37:30.024241    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-67fbccb46f-ms4m4"
Sep 08 07:37:39.644858 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:37:39.644826    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:37:46.552546 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:37:46.552508    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:37:54.239817 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:37:54.239779    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:38:12.939687 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:38:12.939647    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:38:19.341635 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:38:19.341604    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:38:22.500049 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:38:22.500001    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-xc7pp"]
Sep 08 07:38:22.500600 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:38:22.500250    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-xc7pp" podUID="cf76376b-e05d-4bd8-b33d-a5dc294102bc" containerName="manager" containerID="cri-o://da482a8efaf5208e33762985b6ed286a9312803147b366a061e3a8653aa26699" gracePeriod=10
Sep 08 07:38:22.949898 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:38:22.949869    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-xc7pp"
Sep 08 07:38:23.002569 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:38:23.002533    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cf76376b-e05d-4bd8-b33d-a5dc294102bc-extensions-socket-volume\") pod \"cf76376b-e05d-4bd8-b33d-a5dc294102bc\" (UID: \"cf76376b-e05d-4bd8-b33d-a5dc294102bc\") "
Sep 08 07:38:23.002753 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:38:23.002589    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rqqkh\" (UniqueName: \"kubernetes.io/projected/cf76376b-e05d-4bd8-b33d-a5dc294102bc-kube-api-access-rqqkh\") pod \"cf76376b-e05d-4bd8-b33d-a5dc294102bc\" (UID: \"cf76376b-e05d-4bd8-b33d-a5dc294102bc\") "
Sep 08 07:38:23.002956 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:38:23.002931    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf76376b-e05d-4bd8-b33d-a5dc294102bc-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "cf76376b-e05d-4bd8-b33d-a5dc294102bc" (UID: "cf76376b-e05d-4bd8-b33d-a5dc294102bc"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 07:38:23.004746 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:38:23.004717    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf76376b-e05d-4bd8-b33d-a5dc294102bc-kube-api-access-rqqkh" (OuterVolumeSpecName: "kube-api-access-rqqkh") pod "cf76376b-e05d-4bd8-b33d-a5dc294102bc" (UID: "cf76376b-e05d-4bd8-b33d-a5dc294102bc"). InnerVolumeSpecName "kube-api-access-rqqkh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 07:38:23.104036 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:38:23.103934    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rqqkh\" (UniqueName: \"kubernetes.io/projected/cf76376b-e05d-4bd8-b33d-a5dc294102bc-kube-api-access-rqqkh\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:38:23.104036 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:38:23.103958    2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cf76376b-e05d-4bd8-b33d-a5dc294102bc-extensions-socket-volume\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:38:23.336202 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:38:23.336167    2564 generic.go:356] "Generic (PLEG): container finished" podID="cf76376b-e05d-4bd8-b33d-a5dc294102bc" containerID="da482a8efaf5208e33762985b6ed286a9312803147b366a061e3a8653aa26699" exitCode=0
Sep 08 07:38:23.336369 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:38:23.336213    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-xc7pp"
Sep 08 07:38:23.336369 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:38:23.336240    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-xc7pp" event={"ID":"cf76376b-e05d-4bd8-b33d-a5dc294102bc","Type":"ContainerDied","Data":"da482a8efaf5208e33762985b6ed286a9312803147b366a061e3a8653aa26699"}
Sep 08 07:38:23.336369 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:38:23.336280    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-xc7pp" event={"ID":"cf76376b-e05d-4bd8-b33d-a5dc294102bc","Type":"ContainerDied","Data":"5ebfd7ffe1834dc697227075d03265bc292973d5cb20a411256366fd79e7b63e"}
Sep 08 07:38:23.336369 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:38:23.336301    2564 scope.go:117] "RemoveContainer" containerID="da482a8efaf5208e33762985b6ed286a9312803147b366a061e3a8653aa26699"
Sep 08 07:38:23.351576 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:38:23.351555    2564 scope.go:117] "RemoveContainer" containerID="da482a8efaf5208e33762985b6ed286a9312803147b366a061e3a8653aa26699"
Sep 08 07:38:23.351894 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:38:23.351873    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da482a8efaf5208e33762985b6ed286a9312803147b366a061e3a8653aa26699\": container with ID starting with da482a8efaf5208e33762985b6ed286a9312803147b366a061e3a8653aa26699 not found: ID does not exist" containerID="da482a8efaf5208e33762985b6ed286a9312803147b366a061e3a8653aa26699"
Sep 08 07:38:23.351960 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:38:23.351903    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da482a8efaf5208e33762985b6ed286a9312803147b366a061e3a8653aa26699"} err="failed to get container status \"da482a8efaf5208e33762985b6ed286a9312803147b366a061e3a8653aa26699\": rpc error: code = NotFound desc = could not find container \"da482a8efaf5208e33762985b6ed286a9312803147b366a061e3a8653aa26699\": container with ID starting with da482a8efaf5208e33762985b6ed286a9312803147b366a061e3a8653aa26699 not found: ID does not exist"
Sep 08 07:38:23.362151 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:38:23.362092    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-xc7pp"]
Sep 08 07:38:23.365440 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:38:23.365419    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-xc7pp"]
Sep 08 07:38:24.509682 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:38:24.509650    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf76376b-e05d-4bd8-b33d-a5dc294102bc" path="/var/lib/kubelet/pods/cf76376b-e05d-4bd8-b33d-a5dc294102bc/volumes"
Sep 08 07:39:12.661636 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:39:12.661604    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-8d4lx_5cf68f79-8fda-42e2-92c1-05a5a601f505/console-operator/1.log"
Sep 08 07:39:12.664190 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:39:12.664170    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-8d4lx_5cf68f79-8fda-42e2-92c1-05a5a601f505/console-operator/1.log"
Sep 08 07:39:23.179462 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:39:23.179426    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-sbj2z"]
Sep 08 07:39:23.179942 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:39:23.179832    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf76376b-e05d-4bd8-b33d-a5dc294102bc" containerName="manager"
Sep 08 07:39:23.179942 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:39:23.179845    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf76376b-e05d-4bd8-b33d-a5dc294102bc" containerName="manager"
Sep 08 07:39:23.179942 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:39:23.179926    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf76376b-e05d-4bd8-b33d-a5dc294102bc" containerName="manager"
Sep 08 07:39:23.182915 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:39:23.182900    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-sbj2z"
Sep 08 07:39:23.185136 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:39:23.185116    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-bnvtt\""
Sep 08 07:39:23.195311 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:39:23.195286    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-sbj2z"]
Sep 08 07:39:23.234080 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:39:23.234054    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4qpq\" (UniqueName: \"kubernetes.io/projected/165b9196-9fd6-4774-b95a-3e0dd6ce86ff-kube-api-access-b4qpq\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-sbj2z\" (UID: \"165b9196-9fd6-4774-b95a-3e0dd6ce86ff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-sbj2z"
Sep 08 07:39:23.234202 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:39:23.234097    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/165b9196-9fd6-4774-b95a-3e0dd6ce86ff-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-sbj2z\" (UID: \"165b9196-9fd6-4774-b95a-3e0dd6ce86ff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-sbj2z"
Sep 08 07:39:23.335456 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:39:23.335426    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4qpq\" (UniqueName: \"kubernetes.io/projected/165b9196-9fd6-4774-b95a-3e0dd6ce86ff-kube-api-access-b4qpq\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-sbj2z\" (UID: \"165b9196-9fd6-4774-b95a-3e0dd6ce86ff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-sbj2z"
Sep 08 07:39:23.335610 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:39:23.335462    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/165b9196-9fd6-4774-b95a-3e0dd6ce86ff-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-sbj2z\" (UID: \"165b9196-9fd6-4774-b95a-3e0dd6ce86ff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-sbj2z"
Sep 08 07:39:23.335776 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:39:23.335760    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/165b9196-9fd6-4774-b95a-3e0dd6ce86ff-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-sbj2z\" (UID: \"165b9196-9fd6-4774-b95a-3e0dd6ce86ff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-sbj2z"
Sep 08 07:39:23.343592 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:39:23.343563    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4qpq\" (UniqueName: \"kubernetes.io/projected/165b9196-9fd6-4774-b95a-3e0dd6ce86ff-kube-api-access-b4qpq\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-sbj2z\" (UID: \"165b9196-9fd6-4774-b95a-3e0dd6ce86ff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-sbj2z"
Sep 08 07:39:23.493116 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:39:23.493039    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-sbj2z"
Sep 08 07:39:23.772401 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:39:23.772377    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-sbj2z"]
Sep 08 07:39:23.774192 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:39:23.774155    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod165b9196_9fd6_4774_b95a_3e0dd6ce86ff.slice/crio-283bb91d97a031fc37e329b134f4f4bbda3236f2445101674b20f9741081fece WatchSource:0}: Error finding container 283bb91d97a031fc37e329b134f4f4bbda3236f2445101674b20f9741081fece: Status 404 returned error can't find the container with id 283bb91d97a031fc37e329b134f4f4bbda3236f2445101674b20f9741081fece
Sep 08 07:39:24.628793 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:39:24.628737    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-sbj2z" event={"ID":"165b9196-9fd6-4774-b95a-3e0dd6ce86ff","Type":"ContainerStarted","Data":"69e90a6b874647ba95a7cf5ab35da198ff533881ed261015e3f33829f8bd37dd"}
Sep 08 07:39:24.629184 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:39:24.628811    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-sbj2z" event={"ID":"165b9196-9fd6-4774-b95a-3e0dd6ce86ff","Type":"ContainerStarted","Data":"283bb91d97a031fc37e329b134f4f4bbda3236f2445101674b20f9741081fece"}
Sep 08 07:39:24.629184 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:39:24.628846    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-sbj2z"
Sep 08 07:39:24.653734 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:39:24.653682    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-sbj2z" podStartSLOduration=1.653664048 podStartE2EDuration="1.653664048s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:39:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:39:24.652451871 +0000 UTC m=+2112.633491210" watchObservedRunningTime="2026-09-08 07:39:24.653664048 +0000 UTC m=+2112.634703356"
Sep 08 07:39:35.642685 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:39:35.642648    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-sbj2z"
Sep 08 07:39:47.053668 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:39:47.053630    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:39:55.037844 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:39:55.037799    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:40:01.651534 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:40:01.651493    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:40:16.546947 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:40:16.546871    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:40:52.636680 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:40:52.636642    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:41:01.245231 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:41:01.245192    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:41:08.740916 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:41:08.740878    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:41:15.140556 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:41:15.140519    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:41:15.359978 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:41:15.359945    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-b546674f9-ttcfp"]
Sep 08 07:41:15.371436 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:41:15.371399    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-b546674f9-ttcfp"
Sep 08 07:41:15.374024 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:41:15.373995    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-b546674f9-ttcfp"]
Sep 08 07:41:15.414999 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:41:15.414897    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e535a872-b0d8-4a93-8f6d-8f87f9becf64-metrics-certs\") pod \"maas-api-b546674f9-ttcfp\" (UID: \"e535a872-b0d8-4a93-8f6d-8f87f9becf64\") " pod="odh-ai-gateway-infra/maas-api-b546674f9-ttcfp"
Sep 08 07:41:15.414999 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:41:15.414930    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e535a872-b0d8-4a93-8f6d-8f87f9becf64-maas-api-tls\") pod \"maas-api-b546674f9-ttcfp\" (UID: \"e535a872-b0d8-4a93-8f6d-8f87f9becf64\") " pod="odh-ai-gateway-infra/maas-api-b546674f9-ttcfp"
Sep 08 07:41:15.414999 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:41:15.414978    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwfvv\" (UniqueName: \"kubernetes.io/projected/e535a872-b0d8-4a93-8f6d-8f87f9becf64-kube-api-access-gwfvv\") pod \"maas-api-b546674f9-ttcfp\" (UID: \"e535a872-b0d8-4a93-8f6d-8f87f9becf64\") " pod="odh-ai-gateway-infra/maas-api-b546674f9-ttcfp"
Sep 08 07:41:15.415229 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:41:15.415054    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e535a872-b0d8-4a93-8f6d-8f87f9becf64-openshift-service-ca\") pod \"maas-api-b546674f9-ttcfp\" (UID: \"e535a872-b0d8-4a93-8f6d-8f87f9becf64\") " pod="odh-ai-gateway-infra/maas-api-b546674f9-ttcfp"
Sep 08 07:41:15.516084 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:41:15.516043    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e535a872-b0d8-4a93-8f6d-8f87f9becf64-metrics-certs\") pod \"maas-api-b546674f9-ttcfp\" (UID: \"e535a872-b0d8-4a93-8f6d-8f87f9becf64\") " pod="odh-ai-gateway-infra/maas-api-b546674f9-ttcfp"
Sep 08 07:41:15.516084 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:41:15.516087    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e535a872-b0d8-4a93-8f6d-8f87f9becf64-maas-api-tls\") pod \"maas-api-b546674f9-ttcfp\" (UID: \"e535a872-b0d8-4a93-8f6d-8f87f9becf64\") " pod="odh-ai-gateway-infra/maas-api-b546674f9-ttcfp"
Sep 08 07:41:15.516340 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:41:15.516125    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwfvv\" (UniqueName: \"kubernetes.io/projected/e535a872-b0d8-4a93-8f6d-8f87f9becf64-kube-api-access-gwfvv\") pod \"maas-api-b546674f9-ttcfp\" (UID: \"e535a872-b0d8-4a93-8f6d-8f87f9becf64\") " pod="odh-ai-gateway-infra/maas-api-b546674f9-ttcfp"
Sep 08 07:41:15.516340 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:41:15.516154    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e535a872-b0d8-4a93-8f6d-8f87f9becf64-openshift-service-ca\") pod \"maas-api-b546674f9-ttcfp\" (UID: \"e535a872-b0d8-4a93-8f6d-8f87f9becf64\") " pod="odh-ai-gateway-infra/maas-api-b546674f9-ttcfp"
Sep 08 07:41:15.516747 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:41:15.516725    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e535a872-b0d8-4a93-8f6d-8f87f9becf64-openshift-service-ca\") pod \"maas-api-b546674f9-ttcfp\" (UID: \"e535a872-b0d8-4a93-8f6d-8f87f9becf64\") " pod="odh-ai-gateway-infra/maas-api-b546674f9-ttcfp"
Sep 08 07:41:15.518632 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:41:15.518607    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e535a872-b0d8-4a93-8f6d-8f87f9becf64-maas-api-tls\") pod \"maas-api-b546674f9-ttcfp\" (UID: \"e535a872-b0d8-4a93-8f6d-8f87f9becf64\") " pod="odh-ai-gateway-infra/maas-api-b546674f9-ttcfp"
Sep 08 07:41:15.518726 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:41:15.518642    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e535a872-b0d8-4a93-8f6d-8f87f9becf64-metrics-certs\") pod \"maas-api-b546674f9-ttcfp\" (UID: \"e535a872-b0d8-4a93-8f6d-8f87f9becf64\") " pod="odh-ai-gateway-infra/maas-api-b546674f9-ttcfp"
Sep 08 07:41:15.523342 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:41:15.523320    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwfvv\" (UniqueName: \"kubernetes.io/projected/e535a872-b0d8-4a93-8f6d-8f87f9becf64-kube-api-access-gwfvv\") pod \"maas-api-b546674f9-ttcfp\" (UID: \"e535a872-b0d8-4a93-8f6d-8f87f9becf64\") " pod="odh-ai-gateway-infra/maas-api-b546674f9-ttcfp"
Sep 08 07:41:15.684023 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:41:15.683906    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-b546674f9-ttcfp"
Sep 08 07:41:15.959357 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:41:15.959284    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-b546674f9-ttcfp"]
Sep 08 07:41:15.962823 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:41:15.962789    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode535a872_b0d8_4a93_8f6d_8f87f9becf64.slice/crio-83bf32670c8f41b440d5f27db76345487a2c13f12e586d3d607fead5530b2c6a WatchSource:0}: Error finding container 83bf32670c8f41b440d5f27db76345487a2c13f12e586d3d607fead5530b2c6a: Status 404 returned error can't find the container with id 83bf32670c8f41b440d5f27db76345487a2c13f12e586d3d607fead5530b2c6a
Sep 08 07:41:16.191811 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:41:16.191775    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-b546674f9-ttcfp" event={"ID":"e535a872-b0d8-4a93-8f6d-8f87f9becf64","Type":"ContainerStarted","Data":"83bf32670c8f41b440d5f27db76345487a2c13f12e586d3d607fead5530b2c6a"}
Sep 08 07:41:17.198452 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:41:17.198415    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-b546674f9-ttcfp" event={"ID":"e535a872-b0d8-4a93-8f6d-8f87f9becf64","Type":"ContainerStarted","Data":"ee879227419257c29756e47402ba5f1bb8b842094312ba8a96c98cd1291d5445"}
Sep 08 07:41:17.198850 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:41:17.198531    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-b546674f9-ttcfp"
Sep 08 07:41:17.214858 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:41:17.214808    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-b546674f9-ttcfp" podStartSLOduration=1.753563456 podStartE2EDuration="2.214791538s" totalImagesPullingTime="461.228082ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:41:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:41:17.212656705 +0000 UTC m=+2225.193696011" watchObservedRunningTime="2026-09-08 07:41:17.214791538 +0000 UTC m=+2225.195830844"
Sep 08 07:41:23.132274 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:41:23.132242    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:41:23.208625 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:41:23.208590    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-b546674f9-ttcfp"
Sep 08 07:41:29.834022 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:41:29.833987    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:41:30.607015 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:41:30.606963    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-55f944c447-7dgdn"]
Sep 08 07:41:30.607245 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:41:30.607221    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-55f944c447-7dgdn" podUID="ab37a706-3074-4de9-9c82-4f003c5ab495" containerName="maas-api" containerID="cri-o://e79d870f672db5375248de931383e41b146528f19ec7ee8784f78b614ba304cb" gracePeriod=30
Sep 08 07:41:31.563067 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:41:31.563029    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-55f944c447-7dgdn" podUID="ab37a706-3074-4de9-9c82-4f003c5ab495" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.43:8443/health\": dial tcp 10.132.0.43:8443: connect: connection refused"
Sep 08 07:41:31.856076 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:41:31.856052    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-55f944c447-7dgdn"
Sep 08 07:41:31.965641 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:41:31.965611    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab37a706-3074-4de9-9c82-4f003c5ab495-metrics-certs\") pod \"ab37a706-3074-4de9-9c82-4f003c5ab495\" (UID: \"ab37a706-3074-4de9-9c82-4f003c5ab495\") "
Sep 08 07:41:31.965842 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:41:31.965660    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t9pjl\" (UniqueName: \"kubernetes.io/projected/ab37a706-3074-4de9-9c82-4f003c5ab495-kube-api-access-t9pjl\") pod \"ab37a706-3074-4de9-9c82-4f003c5ab495\" (UID: \"ab37a706-3074-4de9-9c82-4f003c5ab495\") "
Sep 08 07:41:31.965842 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:41:31.965770    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab37a706-3074-4de9-9c82-4f003c5ab495-maas-api-tls\") pod \"ab37a706-3074-4de9-9c82-4f003c5ab495\" (UID: \"ab37a706-3074-4de9-9c82-4f003c5ab495\") "
Sep 08 07:41:31.965842 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:41:31.965798    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab37a706-3074-4de9-9c82-4f003c5ab495-openshift-service-ca\") pod \"ab37a706-3074-4de9-9c82-4f003c5ab495\" (UID: \"ab37a706-3074-4de9-9c82-4f003c5ab495\") "
Sep 08 07:41:31.966274 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:41:31.966242    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab37a706-3074-4de9-9c82-4f003c5ab495-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ab37a706-3074-4de9-9c82-4f003c5ab495" (UID: "ab37a706-3074-4de9-9c82-4f003c5ab495"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 07:41:31.967731 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:41:31.967706    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab37a706-3074-4de9-9c82-4f003c5ab495-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ab37a706-3074-4de9-9c82-4f003c5ab495" (UID: "ab37a706-3074-4de9-9c82-4f003c5ab495"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 07:41:31.967828 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:41:31.967808    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab37a706-3074-4de9-9c82-4f003c5ab495-kube-api-access-t9pjl" (OuterVolumeSpecName: "kube-api-access-t9pjl") pod "ab37a706-3074-4de9-9c82-4f003c5ab495" (UID: "ab37a706-3074-4de9-9c82-4f003c5ab495"). InnerVolumeSpecName "kube-api-access-t9pjl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 07:41:31.967828 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:41:31.967811    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab37a706-3074-4de9-9c82-4f003c5ab495-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ab37a706-3074-4de9-9c82-4f003c5ab495" (UID: "ab37a706-3074-4de9-9c82-4f003c5ab495"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 07:41:32.067146 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:41:32.067109    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab37a706-3074-4de9-9c82-4f003c5ab495-openshift-service-ca\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:41:32.067146 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:41:32.067139    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab37a706-3074-4de9-9c82-4f003c5ab495-metrics-certs\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:41:32.067146 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:41:32.067149    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t9pjl\" (UniqueName: \"kubernetes.io/projected/ab37a706-3074-4de9-9c82-4f003c5ab495-kube-api-access-t9pjl\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:41:32.067479 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:41:32.067159    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab37a706-3074-4de9-9c82-4f003c5ab495-maas-api-tls\") on node \"ip-10-0-133-164.ec2.internal\" DevicePath \"\""
Sep 08 07:41:32.274672 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:41:32.274633    2564 generic.go:356] "Generic (PLEG): container finished" podID="ab37a706-3074-4de9-9c82-4f003c5ab495" containerID="e79d870f672db5375248de931383e41b146528f19ec7ee8784f78b614ba304cb" exitCode=0
Sep 08 07:41:32.274832 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:41:32.274679    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-55f944c447-7dgdn"
Sep 08 07:41:32.274832 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:41:32.274726    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-55f944c447-7dgdn" event={"ID":"ab37a706-3074-4de9-9c82-4f003c5ab495","Type":"ContainerDied","Data":"e79d870f672db5375248de931383e41b146528f19ec7ee8784f78b614ba304cb"}
Sep 08 07:41:32.274832 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:41:32.274776    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-55f944c447-7dgdn" event={"ID":"ab37a706-3074-4de9-9c82-4f003c5ab495","Type":"ContainerDied","Data":"883c28d433d7f60db5add515dc31226cfff9405025f07e0327fe8e3d8176a743"}
Sep 08 07:41:32.274832 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:41:32.274803    2564 scope.go:117] "RemoveContainer" containerID="e79d870f672db5375248de931383e41b146528f19ec7ee8784f78b614ba304cb"
Sep 08 07:41:32.285210 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:41:32.285184    2564 scope.go:117] "RemoveContainer" containerID="e79d870f672db5375248de931383e41b146528f19ec7ee8784f78b614ba304cb"
Sep 08 07:41:32.285516 ip-10-0-133-164 kubenswrapper[2564]: E0908 07:41:32.285495    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e79d870f672db5375248de931383e41b146528f19ec7ee8784f78b614ba304cb\": container with ID starting with e79d870f672db5375248de931383e41b146528f19ec7ee8784f78b614ba304cb not found: ID does not exist" containerID="e79d870f672db5375248de931383e41b146528f19ec7ee8784f78b614ba304cb"
Sep 08 07:41:32.285603 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:41:32.285528    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e79d870f672db5375248de931383e41b146528f19ec7ee8784f78b614ba304cb"} err="failed to get container status \"e79d870f672db5375248de931383e41b146528f19ec7ee8784f78b614ba304cb\": rpc error: code = NotFound desc = could not find container \"e79d870f672db5375248de931383e41b146528f19ec7ee8784f78b614ba304cb\": container with ID starting with e79d870f672db5375248de931383e41b146528f19ec7ee8784f78b614ba304cb not found: ID does not exist"
Sep 08 07:41:32.302436 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:41:32.302403    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-55f944c447-7dgdn"]
Sep 08 07:41:32.304103 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:41:32.304077    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-55f944c447-7dgdn"]
Sep 08 07:41:32.510414 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:41:32.510382    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab37a706-3074-4de9-9c82-4f003c5ab495" path="/var/lib/kubelet/pods/ab37a706-3074-4de9-9c82-4f003c5ab495/volumes"
Sep 08 07:41:35.849348 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:41:35.849263    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:41:42.538175 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:41:42.538141    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-ksmvr"]
Sep 08 07:41:50.249288 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:41:50.249255    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-hwtbd_1be6fd86-3254-484e-9461-1f55869da9d0/manager/0.log"
Sep 08 07:41:50.361666 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:41:50.361638    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-scw75_8b87b2ce-394b-4faf-9625-d773aa787a23/manager/0.log"
Sep 08 07:41:50.472926 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:41:50.472842    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-67fbccb46f-ms4m4_3bc808df-3fc3-4ab0-9332-4888a4ff90a2/manager/0.log"
Sep 08 07:41:51.050402 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:41:51.050371    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79c9ffb96f-pkcfs_dafa53fa-9e34-4a32-8c19-4a2521033ee1/copy-manifests/0.log"
Sep 08 07:41:51.061937 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:41:51.061911    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79c9ffb96f-pkcfs_dafa53fa-9e34-4a32-8c19-4a2521033ee1/manager/0.log"
Sep 08 07:41:51.490472 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:41:51.490387    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-b546674f9-ttcfp_e535a872-b0d8-4a93-8f6d-8f87f9becf64/maas-api/0.log"
Sep 08 07:41:51.701756 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:41:51.701725    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-jgn8s_64aa2a3a-a4d1-44e3-a7a4-6f7b8ce75432/postgres/0.log"
Sep 08 07:41:52.540416 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:41:52.540380    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-c5mq8_1c13adf1-1366-4264-b7de-734e313d317b/manager/0.log"
Sep 08 07:41:52.646978 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:41:52.646938    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-5985564776-7xlrd_6091876c-9d34-4096-9409-419438e95c61/manager/0.log"
Sep 08 07:41:52.871311 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:41:52.871224    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5b65f94d4c-sbj2z_165b9196-9fd6-4774-b95a-3e0dd6ce86ff/manager/0.log"
Sep 08 07:41:52.976713 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:41:52.976682    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-ksmvr_075d4063-10b1-42f4-a676-edec8c6753eb/limitador/0.log"
Sep 08 07:41:53.653483 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:41:53.653449    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-cd6874cf-892rs_fb8d2989-9fe9-4852-869d-0befcdebecf2/kube-auth-proxy/0.log"
Sep 08 07:41:54.206532 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:41:54.206499    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7cbf7f84b-54255_7e5d6ef0-7b12-4602-a841-195b0c593f58/router/0.log"
Sep 08 07:41:54.636872 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:41:54.636841    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-hcz2v_02fa3eb4-e4dd-4a72-bb16-2c1fef583226/main/0.log"
Sep 08 07:42:00.136784 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:00.136748    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jg2tn/must-gather-4fhsb"]
Sep 08 07:42:00.137200 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:00.137185    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab37a706-3074-4de9-9c82-4f003c5ab495" containerName="maas-api"
Sep 08 07:42:00.137251 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:00.137202    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab37a706-3074-4de9-9c82-4f003c5ab495" containerName="maas-api"
Sep 08 07:42:00.137283 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:00.137265    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab37a706-3074-4de9-9c82-4f003c5ab495" containerName="maas-api"
Sep 08 07:42:00.140547 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:00.140526    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jg2tn/must-gather-4fhsb"
Sep 08 07:42:00.142845 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:00.142824    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jg2tn\"/\"kube-root-ca.crt\""
Sep 08 07:42:00.143410 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:00.143393    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-jg2tn\"/\"default-dockercfg-jjph5\""
Sep 08 07:42:00.143488 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:00.143393    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jg2tn\"/\"openshift-service-ca.crt\""
Sep 08 07:42:00.146803 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:00.146776    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jg2tn/must-gather-4fhsb"]
Sep 08 07:42:00.229151 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:00.229110    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9bfd4474-a6d1-4ba9-bbe7-ede37303ee9b-must-gather-output\") pod \"must-gather-4fhsb\" (UID: \"9bfd4474-a6d1-4ba9-bbe7-ede37303ee9b\") " pod="openshift-must-gather-jg2tn/must-gather-4fhsb"
Sep 08 07:42:00.229333 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:00.229201    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8h5wl\" (UniqueName: \"kubernetes.io/projected/9bfd4474-a6d1-4ba9-bbe7-ede37303ee9b-kube-api-access-8h5wl\") pod \"must-gather-4fhsb\" (UID: \"9bfd4474-a6d1-4ba9-bbe7-ede37303ee9b\") " pod="openshift-must-gather-jg2tn/must-gather-4fhsb"
Sep 08 07:42:00.329827 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:00.329786    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9bfd4474-a6d1-4ba9-bbe7-ede37303ee9b-must-gather-output\") pod \"must-gather-4fhsb\" (UID: \"9bfd4474-a6d1-4ba9-bbe7-ede37303ee9b\") " pod="openshift-must-gather-jg2tn/must-gather-4fhsb"
Sep 08 07:42:00.330070 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:00.329838    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8h5wl\" (UniqueName: \"kubernetes.io/projected/9bfd4474-a6d1-4ba9-bbe7-ede37303ee9b-kube-api-access-8h5wl\") pod \"must-gather-4fhsb\" (UID: \"9bfd4474-a6d1-4ba9-bbe7-ede37303ee9b\") " pod="openshift-must-gather-jg2tn/must-gather-4fhsb"
Sep 08 07:42:00.330177 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:00.330155    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9bfd4474-a6d1-4ba9-bbe7-ede37303ee9b-must-gather-output\") pod \"must-gather-4fhsb\" (UID: \"9bfd4474-a6d1-4ba9-bbe7-ede37303ee9b\") " pod="openshift-must-gather-jg2tn/must-gather-4fhsb"
Sep 08 07:42:00.339676 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:00.339651    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8h5wl\" (UniqueName: \"kubernetes.io/projected/9bfd4474-a6d1-4ba9-bbe7-ede37303ee9b-kube-api-access-8h5wl\") pod \"must-gather-4fhsb\" (UID: \"9bfd4474-a6d1-4ba9-bbe7-ede37303ee9b\") " pod="openshift-must-gather-jg2tn/must-gather-4fhsb"
Sep 08 07:42:00.450702 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:00.450617    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jg2tn/must-gather-4fhsb"
Sep 08 07:42:00.720988 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:00.720937    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jg2tn/must-gather-4fhsb"]
Sep 08 07:42:00.723171 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:42:00.723149    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9bfd4474_a6d1_4ba9_bbe7_ede37303ee9b.slice/crio-4acb8a13065c644b53570e8146e90c54d132713875304847ba1dfc96771a309d WatchSource:0}: Error finding container 4acb8a13065c644b53570e8146e90c54d132713875304847ba1dfc96771a309d: Status 404 returned error can't find the container with id 4acb8a13065c644b53570e8146e90c54d132713875304847ba1dfc96771a309d
Sep 08 07:42:00.725071 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:00.725055    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 07:42:01.422946 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:01.422910    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jg2tn/must-gather-4fhsb" event={"ID":"9bfd4474-a6d1-4ba9-bbe7-ede37303ee9b","Type":"ContainerStarted","Data":"4acb8a13065c644b53570e8146e90c54d132713875304847ba1dfc96771a309d"}
Sep 08 07:42:03.437631 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:03.437587    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jg2tn/must-gather-4fhsb" event={"ID":"9bfd4474-a6d1-4ba9-bbe7-ede37303ee9b","Type":"ContainerStarted","Data":"32e3457b785fb1ff91ff917a076c3521173b85ef9cfa4c45f5e50a1be5626954"}
Sep 08 07:42:03.437631 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:03.437632    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jg2tn/must-gather-4fhsb" event={"ID":"9bfd4474-a6d1-4ba9-bbe7-ede37303ee9b","Type":"ContainerStarted","Data":"096afe41847be757f74bbd27b6f2649b53565661059953703eb288da902036fd"}
Sep 08 07:42:03.452702 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:03.452634    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jg2tn/must-gather-4fhsb" podStartSLOduration=1.25453753 podStartE2EDuration="3.452607766s" totalImagesPullingTime="2.198070236s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:42:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:42:03.45161385 +0000 UTC m=+2271.432653168" watchObservedRunningTime="2026-09-08 07:42:03.452607766 +0000 UTC m=+2271.433647074"
Sep 08 07:42:04.530912 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:04.530883    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-8lgmv_5ddb3084-72df-467e-9cb5-0cf05725de6f/global-pull-secret-syncer/0.log"
Sep 08 07:42:04.680402 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:04.680368    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-ddrdv_2ddc39aa-5d19-45db-9990-5c0b33f0fa81/konnectivity-agent/0.log"
Sep 08 07:42:04.730933 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:04.730898    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-164.ec2.internal_31090b38892b0b01dc7d44dd99f13608/haproxy/0.log"
Sep 08 07:42:09.129757 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:09.129717    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-c5mq8_1c13adf1-1366-4264-b7de-734e313d317b/manager/0.log"
Sep 08 07:42:09.153363 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:09.153318    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-5985564776-7xlrd_6091876c-9d34-4096-9409-419438e95c61/manager/0.log"
Sep 08 07:42:09.223408 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:09.223357    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5b65f94d4c-sbj2z_165b9196-9fd6-4774-b95a-3e0dd6ce86ff/manager/0.log"
Sep 08 07:42:09.242641 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:09.242609    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-ksmvr_075d4063-10b1-42f4-a676-edec8c6753eb/limitador/0.log"
Sep 08 07:42:10.952159 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:10.952122    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cdcc96965-glxch_291459fa-c8c6-49c7-ace3-4c0f500d94b5/cluster-monitoring-operator/0.log"
Sep 08 07:42:11.124737 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:11.124709    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-b2dlx_55969acc-4171-499e-8864-4b910a5d43c8/node-exporter/0.log"
Sep 08 07:42:11.148045 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:11.148011    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-b2dlx_55969acc-4171-499e-8864-4b910a5d43c8/kube-rbac-proxy/0.log"
Sep 08 07:42:11.176778 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:11.176748    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-b2dlx_55969acc-4171-499e-8864-4b910a5d43c8/init-textfile/0.log"
Sep 08 07:42:11.737192 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:11.737156    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-78f599db79-v46z6_a941ceab-0941-4da6-9674-43f74522535f/prometheus-operator-admission-webhook/0.log"
Sep 08 07:42:13.474168 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:13.474132    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-79977f9844-7l54g_7416321a-6800-4360-9b3d-0434aff598ea/networking-console-plugin/0.log"
Sep 08 07:42:14.094690 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:14.094655    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-8d4lx_5cf68f79-8fda-42e2-92c1-05a5a601f505/console-operator/1.log"
Sep 08 07:42:14.101395 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:14.101359    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-8d4lx_5cf68f79-8fda-42e2-92c1-05a5a601f505/console-operator/2.log"
Sep 08 07:42:14.690848 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:14.690794    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-85d98c998f-drsvw_cfe945ce-eef8-4eb9-8d5e-601b45b39514/download-server/0.log"
Sep 08 07:42:14.779865 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:14.778946    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jg2tn/perf-node-gather-daemonset-lhcj2"]
Sep 08 07:42:14.800988 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:14.797152    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jg2tn/perf-node-gather-daemonset-lhcj2"]
Sep 08 07:42:14.800988 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:14.797284    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jg2tn/perf-node-gather-daemonset-lhcj2"
Sep 08 07:42:14.882571 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:14.882535    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/badc3ee1-42df-463a-a09c-1bd72bd82ff7-podres\") pod \"perf-node-gather-daemonset-lhcj2\" (UID: \"badc3ee1-42df-463a-a09c-1bd72bd82ff7\") " pod="openshift-must-gather-jg2tn/perf-node-gather-daemonset-lhcj2"
Sep 08 07:42:14.882782 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:14.882582    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/badc3ee1-42df-463a-a09c-1bd72bd82ff7-proc\") pod \"perf-node-gather-daemonset-lhcj2\" (UID: \"badc3ee1-42df-463a-a09c-1bd72bd82ff7\") " pod="openshift-must-gather-jg2tn/perf-node-gather-daemonset-lhcj2"
Sep 08 07:42:14.882782 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:14.882706    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7859p\" (UniqueName: \"kubernetes.io/projected/badc3ee1-42df-463a-a09c-1bd72bd82ff7-kube-api-access-7859p\") pod \"perf-node-gather-daemonset-lhcj2\" (UID: \"badc3ee1-42df-463a-a09c-1bd72bd82ff7\") " pod="openshift-must-gather-jg2tn/perf-node-gather-daemonset-lhcj2"
Sep 08 07:42:14.882782 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:14.882755    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/badc3ee1-42df-463a-a09c-1bd72bd82ff7-sys\") pod \"perf-node-gather-daemonset-lhcj2\" (UID: \"badc3ee1-42df-463a-a09c-1bd72bd82ff7\") " pod="openshift-must-gather-jg2tn/perf-node-gather-daemonset-lhcj2"
Sep 08 07:42:14.882947 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:14.882791    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/badc3ee1-42df-463a-a09c-1bd72bd82ff7-lib-modules\") pod \"perf-node-gather-daemonset-lhcj2\" (UID: \"badc3ee1-42df-463a-a09c-1bd72bd82ff7\") " pod="openshift-must-gather-jg2tn/perf-node-gather-daemonset-lhcj2"
Sep 08 07:42:14.983579 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:14.983474    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/badc3ee1-42df-463a-a09c-1bd72bd82ff7-podres\") pod \"perf-node-gather-daemonset-lhcj2\" (UID: \"badc3ee1-42df-463a-a09c-1bd72bd82ff7\") " pod="openshift-must-gather-jg2tn/perf-node-gather-daemonset-lhcj2"
Sep 08 07:42:14.983579 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:14.983550    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/badc3ee1-42df-463a-a09c-1bd72bd82ff7-proc\") pod \"perf-node-gather-daemonset-lhcj2\" (UID: \"badc3ee1-42df-463a-a09c-1bd72bd82ff7\") " pod="openshift-must-gather-jg2tn/perf-node-gather-daemonset-lhcj2"
Sep 08 07:42:14.983812 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:14.983590    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7859p\" (UniqueName: \"kubernetes.io/projected/badc3ee1-42df-463a-a09c-1bd72bd82ff7-kube-api-access-7859p\") pod \"perf-node-gather-daemonset-lhcj2\" (UID: \"badc3ee1-42df-463a-a09c-1bd72bd82ff7\") " pod="openshift-must-gather-jg2tn/perf-node-gather-daemonset-lhcj2"
Sep 08 07:42:14.983812 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:14.983647    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/badc3ee1-42df-463a-a09c-1bd72bd82ff7-podres\") pod \"perf-node-gather-daemonset-lhcj2\" (UID: \"badc3ee1-42df-463a-a09c-1bd72bd82ff7\") " pod="openshift-must-gather-jg2tn/perf-node-gather-daemonset-lhcj2"
Sep 08 07:42:14.983812 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:14.983664    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/badc3ee1-42df-463a-a09c-1bd72bd82ff7-proc\") pod \"perf-node-gather-daemonset-lhcj2\" (UID: \"badc3ee1-42df-463a-a09c-1bd72bd82ff7\") " pod="openshift-must-gather-jg2tn/perf-node-gather-daemonset-lhcj2"
Sep 08 07:42:14.983812 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:14.983715    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/badc3ee1-42df-463a-a09c-1bd72bd82ff7-sys\") pod \"perf-node-gather-daemonset-lhcj2\" (UID: \"badc3ee1-42df-463a-a09c-1bd72bd82ff7\") " pod="openshift-must-gather-jg2tn/perf-node-gather-daemonset-lhcj2"
Sep 08 07:42:14.983812 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:14.983749    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/badc3ee1-42df-463a-a09c-1bd72bd82ff7-lib-modules\") pod \"perf-node-gather-daemonset-lhcj2\" (UID: \"badc3ee1-42df-463a-a09c-1bd72bd82ff7\") " pod="openshift-must-gather-jg2tn/perf-node-gather-daemonset-lhcj2"
Sep 08 07:42:14.983812 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:14.983812    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/badc3ee1-42df-463a-a09c-1bd72bd82ff7-sys\") pod \"perf-node-gather-daemonset-lhcj2\" (UID: \"badc3ee1-42df-463a-a09c-1bd72bd82ff7\") " pod="openshift-must-gather-jg2tn/perf-node-gather-daemonset-lhcj2"
Sep 08 07:42:14.984220 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:14.983898    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/badc3ee1-42df-463a-a09c-1bd72bd82ff7-lib-modules\") pod \"perf-node-gather-daemonset-lhcj2\" (UID: \"badc3ee1-42df-463a-a09c-1bd72bd82ff7\") " pod="openshift-must-gather-jg2tn/perf-node-gather-daemonset-lhcj2"
Sep 08 07:42:14.992027 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:14.991992    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7859p\" (UniqueName: \"kubernetes.io/projected/badc3ee1-42df-463a-a09c-1bd72bd82ff7-kube-api-access-7859p\") pod \"perf-node-gather-daemonset-lhcj2\" (UID: \"badc3ee1-42df-463a-a09c-1bd72bd82ff7\") " pod="openshift-must-gather-jg2tn/perf-node-gather-daemonset-lhcj2"
Sep 08 07:42:15.117225 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:15.117191    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jg2tn/perf-node-gather-daemonset-lhcj2"
Sep 08 07:42:15.411213 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:15.411177    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jg2tn/perf-node-gather-daemonset-lhcj2"]
Sep 08 07:42:15.413049 ip-10-0-133-164 kubenswrapper[2564]: W0908 07:42:15.413000    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podbadc3ee1_42df_463a_a09c_1bd72bd82ff7.slice/crio-a37a545a7eea3dcf4e85b7da10f5fe616a5df6e7def1f59dd906393dd3bed5fa WatchSource:0}: Error finding container a37a545a7eea3dcf4e85b7da10f5fe616a5df6e7def1f59dd906393dd3bed5fa: Status 404 returned error can't find the container with id a37a545a7eea3dcf4e85b7da10f5fe616a5df6e7def1f59dd906393dd3bed5fa
Sep 08 07:42:15.440693 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:15.440673    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-695c895bd6-6glxt_9a60f971-69a4-45c0-9e7c-1cdf55b42770/volume-data-source-validator/0.log"
Sep 08 07:42:15.532356 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:15.532249    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jg2tn/perf-node-gather-daemonset-lhcj2" event={"ID":"badc3ee1-42df-463a-a09c-1bd72bd82ff7","Type":"ContainerStarted","Data":"5c9365e6c75fe3962c60c62232d4ea4a74efab7fc9048c858193aca99215767f"}
Sep 08 07:42:15.532356 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:15.532316    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jg2tn/perf-node-gather-daemonset-lhcj2" event={"ID":"badc3ee1-42df-463a-a09c-1bd72bd82ff7","Type":"ContainerStarted","Data":"a37a545a7eea3dcf4e85b7da10f5fe616a5df6e7def1f59dd906393dd3bed5fa"}
Sep 08 07:42:15.532561 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:15.532530    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-jg2tn/perf-node-gather-daemonset-lhcj2"
Sep 08 07:42:15.550252 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:15.550196    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jg2tn/perf-node-gather-daemonset-lhcj2" podStartSLOduration=1.550175752 podStartE2EDuration="1.550175752s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 07:42:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:42:15.547899478 +0000 UTC m=+2283.528938802" watchObservedRunningTime="2026-09-08 07:42:15.550175752 +0000 UTC m=+2283.531215059"
Sep 08 07:42:16.731096 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:16.731037    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vg6m8_b933ee39-2780-43cb-a34d-1fecfabcae2c/dns/0.log"
Sep 08 07:42:16.750772 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:16.750742    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vg6m8_b933ee39-2780-43cb-a34d-1fecfabcae2c/kube-rbac-proxy/0.log"
Sep 08 07:42:16.771673 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:16.771646    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4cwpb_890fab40-3e97-456c-88ed-01de5ff6c541/dns-node-resolver/0.log"
Sep 08 07:42:17.430390 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:17.430362    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qllkn_5b60264a-f3fc-4640-a51a-d556e505482a/node-ca/0.log"
Sep 08 07:42:18.668705 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:18.668671    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-cd6874cf-892rs_fb8d2989-9fe9-4852-869d-0befcdebecf2/kube-auth-proxy/0.log"
Sep 08 07:42:18.823664 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:18.823634    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7cbf7f84b-54255_7e5d6ef0-7b12-4602-a841-195b0c593f58/router/0.log"
Sep 08 07:42:19.717397 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:19.717367    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hrktk_664c9025-a46b-43de-a40a-bda5e922f99a/serve-healthcheck-canary/0.log"
Sep 08 07:42:20.190432 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:20.190403    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-kh2bx_9bd3d9fb-a0ba-40fe-bb47-060b9265e353/insights-operator/0.log"
Sep 08 07:42:20.190896 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:20.190877    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-kh2bx_9bd3d9fb-a0ba-40fe-bb47-060b9265e353/insights-operator/1.log"
Sep 08 07:42:20.286428 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:20.286401    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-m9vqp_2f7de5be-1aea-40af-ae8e-bcbeb6db29f2/kube-rbac-proxy/0.log"
Sep 08 07:42:20.306443 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:20.306416    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-m9vqp_2f7de5be-1aea-40af-ae8e-bcbeb6db29f2/exporter/0.log"
Sep 08 07:42:20.326669 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:20.326635    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-m9vqp_2f7de5be-1aea-40af-ae8e-bcbeb6db29f2/extractor/0.log"
Sep 08 07:42:21.548687 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:21.548662    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-jg2tn/perf-node-gather-daemonset-lhcj2"
Sep 08 07:42:22.455042 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:22.455007    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-hwtbd_1be6fd86-3254-484e-9461-1f55869da9d0/manager/0.log"
Sep 08 07:42:22.684637 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:22.684604    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-scw75_8b87b2ce-394b-4faf-9625-d773aa787a23/manager/0.log"
Sep 08 07:42:22.738798 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:22.738716    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-67fbccb46f-ms4m4_3bc808df-3fc3-4ab0-9332-4888a4ff90a2/manager/0.log"
Sep 08 07:42:23.027783 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:23.027730    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79c9ffb96f-pkcfs_dafa53fa-9e34-4a32-8c19-4a2521033ee1/manager/0.log"
Sep 08 07:42:23.043162 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:23.043136    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79c9ffb96f-pkcfs_dafa53fa-9e34-4a32-8c19-4a2521033ee1/copy-manifests/0.log"
Sep 08 07:42:25.844151 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:25.844117    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-cd6874cf-892rs_fb8d2989-9fe9-4852-869d-0befcdebecf2/kube-auth-proxy/0.log"
Sep 08 07:42:25.961368 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:25.961331    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7cbf7f84b-54255_7e5d6ef0-7b12-4602-a841-195b0c593f58/router/0.log"
Sep 08 07:42:27.800330 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:27.800295    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-cd6874cf-892rs_fb8d2989-9fe9-4852-869d-0befcdebecf2/kube-auth-proxy/0.log"
Sep 08 07:42:27.925623 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:27.925588    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7cbf7f84b-54255_7e5d6ef0-7b12-4602-a841-195b0c593f58/router/0.log"
Sep 08 07:42:29.835694 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:29.835661    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-v4ts8_1d7a1fa0-5368-4e01-a8e7-6be0b6308090/migrator/0.log"
Sep 08 07:42:29.854902 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:29.854875    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-v4ts8_1d7a1fa0-5368-4e01-a8e7-6be0b6308090/graceful-termination/0.log"
Sep 08 07:42:30.204778 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:30.204698    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-st5mf_90b86d86-d71b-4d36-874a-a2a03190d517/kube-storage-version-migrator-operator/1.log"
Sep 08 07:42:30.205777 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:30.205753    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-st5mf_90b86d86-d71b-4d36-874a-a2a03190d517/kube-storage-version-migrator-operator/0.log"
Sep 08 07:42:31.644707 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:31.644673    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gj5rb_6fc4c1f5-eff0-4e2d-a5f8-0b21b412535b/kube-multus-additional-cni-plugins/0.log"
Sep 08 07:42:31.664662 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:31.664633    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gj5rb_6fc4c1f5-eff0-4e2d-a5f8-0b21b412535b/egress-router-binary-copy/0.log"
Sep 08 07:42:31.686433 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:31.686350    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gj5rb_6fc4c1f5-eff0-4e2d-a5f8-0b21b412535b/cni-plugins/0.log"
Sep 08 07:42:31.705815 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:31.705789    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gj5rb_6fc4c1f5-eff0-4e2d-a5f8-0b21b412535b/bond-cni-plugin/0.log"
Sep 08 07:42:31.725575 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:31.725549    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gj5rb_6fc4c1f5-eff0-4e2d-a5f8-0b21b412535b/routeoverride-cni/0.log"
Sep 08 07:42:31.745007 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:31.744981    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gj5rb_6fc4c1f5-eff0-4e2d-a5f8-0b21b412535b/whereabouts-cni-bincopy/0.log"
Sep 08 07:42:31.765020 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:31.764979    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gj5rb_6fc4c1f5-eff0-4e2d-a5f8-0b21b412535b/whereabouts-cni/0.log"
Sep 08 07:42:31.814198 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:31.814171    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-dnzfq_02e6967e-7fbd-46bb-a192-5adc50bed8fa/kube-multus/0.log"
Sep 08 07:42:31.982362 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:31.982263    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-jhq6t_fb65d52f-d619-46f8-b86a-fc6261a24eb3/network-metrics-daemon/0.log"
Sep 08 07:42:31.999520 ip-10-0-133-164 kubenswrapper[2564]: I0908 07:42:31.999488    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-jhq6t_fb65d52f-d619-46f8-b86a-fc6261a24eb3/kube-rbac-proxy/0.log"