Sep 10 04:39:15.199994 ip-10-0-138-27 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 10 04:39:15.200201 ip-10-0-138-27 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 10 04:39:15.200316 ip-10-0-138-27 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 10 04:39:15.200815 ip-10-0-138-27 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 10 04:39:24.520059 ip-10-0-138-27 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 10 04:39:24.520075 ip-10-0-138-27 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot efcad6c3d2414599b432cefccadb982f --
Sep 10 04:41:00.213122 ip-10-0-138-27 systemd[1]: Starting Kubernetes Kubelet...
Sep 10 04:41:00.658588 ip-10-0-138-27 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 04:41:00.658588 ip-10-0-138-27 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 10 04:41:00.658588 ip-10-0-138-27 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 04:41:00.659139 ip-10-0-138-27 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 10 04:41:00.659139 ip-10-0-138-27 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 04:41:00.660520 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.660386    2560 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 10 04:41:00.664523 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664509    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 04:41:00.664559 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664524    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 04:41:00.664559 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664528    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 04:41:00.664559 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664531    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 04:41:00.664559 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664535    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 04:41:00.664559 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664538    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 04:41:00.664559 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664540    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 04:41:00.664559 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664543    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 04:41:00.664559 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664546    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 04:41:00.664559 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664549    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 04:41:00.664559 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664552    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 04:41:00.664559 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664555    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 04:41:00.664559 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664557    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 04:41:00.664559 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664560    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 04:41:00.664559 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664563    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 04:41:00.664907 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664568    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 04:41:00.664907 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664572    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 04:41:00.664907 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664576    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 04:41:00.664907 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664579    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 04:41:00.664907 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664582    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 04:41:00.664907 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664585    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 04:41:00.664907 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664587    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 04:41:00.664907 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664590    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 04:41:00.664907 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664598    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 04:41:00.664907 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664600    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 04:41:00.664907 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664603    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 04:41:00.664907 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664606    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 04:41:00.664907 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664609    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 04:41:00.664907 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664611    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 04:41:00.664907 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664614    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 04:41:00.664907 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664617    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 04:41:00.664907 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664619    2560 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 04:41:00.664907 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664622    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 04:41:00.664907 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664625    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 04:41:00.664907 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664628    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 04:41:00.665424 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664630    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 04:41:00.665424 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664633    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 04:41:00.665424 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664635    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 04:41:00.665424 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664638    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 04:41:00.665424 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664642    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 04:41:00.665424 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664645    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 04:41:00.665424 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664648    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 04:41:00.665424 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664652    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 04:41:00.665424 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664654    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 04:41:00.665424 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664657    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 04:41:00.665424 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664659    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 04:41:00.665424 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664662    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 04:41:00.665424 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664665    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 04:41:00.665424 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664668    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 04:41:00.665424 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664671    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 04:41:00.665424 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664674    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 04:41:00.665424 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664676    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 04:41:00.665424 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664679    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 04:41:00.665424 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664682    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 04:41:00.665895 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664684    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 04:41:00.665895 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664687    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 04:41:00.665895 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664690    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 04:41:00.665895 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664693    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 04:41:00.665895 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664696    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 04:41:00.665895 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664699    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 04:41:00.665895 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664701    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 04:41:00.665895 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664704    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 04:41:00.665895 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664707    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 04:41:00.665895 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664709    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 04:41:00.665895 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664712    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 04:41:00.665895 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664714    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 04:41:00.665895 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664717    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 04:41:00.665895 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664720    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 04:41:00.665895 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664722    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 04:41:00.665895 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664728    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 04:41:00.665895 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664731    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 04:41:00.665895 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664735    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 04:41:00.665895 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664738    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 04:41:00.666350 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664741    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 04:41:00.666350 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664744    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 04:41:00.666350 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664746    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 04:41:00.666350 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664749    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 04:41:00.666350 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664751    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 04:41:00.666350 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664754    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 04:41:00.666350 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664757    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 04:41:00.666350 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664761    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 04:41:00.666350 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664763    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 04:41:00.666350 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664766    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 04:41:00.666350 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664769    2560 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 04:41:00.666350 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664771    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 04:41:00.666350 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664774    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 04:41:00.666350 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664777    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 04:41:00.666350 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664779    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 04:41:00.666350 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664782    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 04:41:00.666350 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664784    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 04:41:00.666350 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664787    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 04:41:00.666350 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664790    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 04:41:00.666350 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664792    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 04:41:00.666825 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664795    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 04:41:00.666825 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664797    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 04:41:00.666825 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664800    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 04:41:00.666825 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664802    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 04:41:00.666825 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664805    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 04:41:00.666825 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.664808    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 04:41:00.666825 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665494    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 04:41:00.666825 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665500    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 04:41:00.666825 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665503    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 04:41:00.666825 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665505    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 04:41:00.666825 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665508    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 04:41:00.666825 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665511    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 04:41:00.666825 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665514    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 04:41:00.666825 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665517    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 04:41:00.666825 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665519    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 04:41:00.666825 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665522    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 04:41:00.666825 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665525    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 04:41:00.666825 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665528    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 04:41:00.666825 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665531    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 04:41:00.666825 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665533    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 04:41:00.667416 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665536    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 04:41:00.667416 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665539    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 04:41:00.667416 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665541    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 04:41:00.667416 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665544    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 04:41:00.667416 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665547    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 04:41:00.667416 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665550    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 04:41:00.667416 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665552    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 04:41:00.667416 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665555    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 04:41:00.667416 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665557    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 04:41:00.667416 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665560    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 04:41:00.667416 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665563    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 04:41:00.667416 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665565    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 04:41:00.667416 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665568    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 04:41:00.667416 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665570    2560 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 04:41:00.667416 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665573    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 04:41:00.667416 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665576    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 04:41:00.667416 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665579    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 04:41:00.667416 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665581    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 04:41:00.667416 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665584    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 04:41:00.667416 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665587    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 04:41:00.667926 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665590    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 04:41:00.667926 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665593    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 04:41:00.667926 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665596    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 04:41:00.667926 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665598    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 04:41:00.667926 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665601    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 04:41:00.667926 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665604    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 04:41:00.667926 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665606    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 04:41:00.667926 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665609    2560 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 04:41:00.667926 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665612    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 04:41:00.667926 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665614    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 04:41:00.667926 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665617    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 04:41:00.667926 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665619    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 04:41:00.667926 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665622    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 04:41:00.667926 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665624    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 04:41:00.667926 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665627    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 04:41:00.667926 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665636    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 04:41:00.667926 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665639    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 04:41:00.667926 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665642    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 04:41:00.667926 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665645    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 04:41:00.668407 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665649    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 04:41:00.668407 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665652    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 04:41:00.668407 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665655    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 04:41:00.668407 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665658    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 04:41:00.668407 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665661    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 04:41:00.668407 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665663    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 04:41:00.668407 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665666    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 04:41:00.668407 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665669    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 04:41:00.668407 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665671    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 04:41:00.668407 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665674    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 04:41:00.668407 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665676    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 04:41:00.668407 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665679    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 04:41:00.668407 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665682    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 04:41:00.668407 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665685    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 04:41:00.668407 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665688    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 04:41:00.668407 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665690    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 04:41:00.668407 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665695    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 04:41:00.668407 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665699    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 04:41:00.668860 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665703    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 04:41:00.668860 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665706    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 04:41:00.668860 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665709    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 04:41:00.668860 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665712    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 04:41:00.668860 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665714    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 04:41:00.668860 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665717    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 04:41:00.668860 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665720    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 04:41:00.668860 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665723    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 04:41:00.668860 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665725    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 04:41:00.668860 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665728    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 04:41:00.668860 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665730    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 04:41:00.668860 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665733    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 04:41:00.668860 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665736    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 04:41:00.668860 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665740    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 04:41:00.668860 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665743    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 04:41:00.668860 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665745    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 04:41:00.668860 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665748    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 04:41:00.668860 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665751    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 04:41:00.668860 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665753    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 04:41:00.668860 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665756    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 04:41:00.669337 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665759    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 04:41:00.669337 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665761    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 04:41:00.669337 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665764    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 04:41:00.669337 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665767    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 04:41:00.669337 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665771    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 04:41:00.669337 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665776    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 04:41:00.669337 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665779    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 04:41:00.669337 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.665783    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 04:41:00.669337 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667080    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 04:41:00.669337 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667095    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 04:41:00.669337 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667098    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 04:41:00.669337 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667101    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 04:41:00.669337 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667105    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 04:41:00.669337 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667109    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 04:41:00.669337 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667111    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 04:41:00.669337 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667114    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 04:41:00.669337 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667117    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 04:41:00.669337 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667120    2560 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 04:41:00.669337 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667123    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 04:41:00.669337 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667125    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 04:41:00.669858 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667128    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 04:41:00.669858 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667131    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 04:41:00.669858 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667134    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 04:41:00.669858 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667136    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 04:41:00.669858 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667140    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 04:41:00.669858 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667142    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 04:41:00.669858 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667145    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 04:41:00.669858 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667148    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 04:41:00.669858 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667150    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 04:41:00.669858 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667154    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 04:41:00.669858 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667156    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 04:41:00.669858 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667159    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 04:41:00.669858 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667162    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 04:41:00.669858 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667164    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 04:41:00.669858 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667167    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 04:41:00.669858 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667170    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 04:41:00.669858 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667172    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 04:41:00.669858 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667175    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 04:41:00.669858 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667178    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 04:41:00.669858 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667180    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 04:41:00.670343 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667184    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 04:41:00.670343 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667188    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 04:41:00.670343 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667191    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 04:41:00.670343 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667194    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 04:41:00.670343 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667199    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 04:41:00.670343 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667205    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 04:41:00.670343 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667208    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 04:41:00.670343 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667211    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 04:41:00.670343 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667214    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 04:41:00.670343 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667217    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 04:41:00.670343 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667220    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 04:41:00.670343 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667223    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 04:41:00.670343 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667226    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 04:41:00.670343 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667229    2560 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 04:41:00.670343 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667232    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 04:41:00.670343 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667234    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 04:41:00.670343 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667237    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 04:41:00.670343 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667239    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 04:41:00.670343 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667242    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 04:41:00.670839 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667245    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 04:41:00.670839 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667247    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 04:41:00.670839 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667250    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 04:41:00.670839 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667253    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 04:41:00.670839 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667255    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 04:41:00.670839 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667258    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 04:41:00.670839 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667260    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 04:41:00.670839 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667263    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 04:41:00.670839 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667265    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 04:41:00.670839 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667268    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 04:41:00.670839 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667271    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 04:41:00.670839 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667273    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 04:41:00.670839 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667276    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 04:41:00.670839 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667278    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 04:41:00.670839 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667282    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 04:41:00.670839 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667285    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 04:41:00.670839 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667288    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 04:41:00.670839 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667291    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 04:41:00.670839 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667293    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 04:41:00.670839 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667296    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 04:41:00.671343 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667299    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 04:41:00.671343 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667301    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 04:41:00.671343 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667304    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 04:41:00.671343 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667306    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 04:41:00.671343 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667310    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 04:41:00.671343 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667313    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 04:41:00.671343 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667316    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 04:41:00.671343 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667320    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 04:41:00.671343 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667323    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 04:41:00.671343 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667326    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 04:41:00.671343 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667329    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 04:41:00.671343 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667331    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 04:41:00.671343 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667334    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 04:41:00.671343 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667337    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 04:41:00.671343 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667339    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 04:41:00.671343 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667342    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 04:41:00.671343 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667346    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 04:41:00.671343 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667349    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 04:41:00.671343 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667352    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 04:41:00.671808 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667355    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 04:41:00.671808 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667359    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 04:41:00.671808 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667362    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 04:41:00.671808 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667365    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 04:41:00.671808 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667368    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 04:41:00.671808 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667371    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 04:41:00.671808 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667374    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 04:41:00.671808 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667382    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 04:41:00.671808 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.667386    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 04:41:00.671808 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667463    2560 flags.go:64] FLAG: --address="0.0.0.0"
Sep 10 04:41:00.671808 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667498    2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 10 04:41:00.671808 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667505    2560 flags.go:64] FLAG: --anonymous-auth="true"
Sep 10 04:41:00.671808 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667510    2560 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 10 04:41:00.671808 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667514    2560 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 10 04:41:00.671808 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667518    2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 10 04:41:00.671808 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667522    2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 10 04:41:00.671808 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667526    2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 10 04:41:00.671808 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667529    2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 10 04:41:00.671808 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667532    2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 10 04:41:00.671808 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667535    2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 10 04:41:00.671808 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667539    2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 10 04:41:00.672364 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667542    2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 10 04:41:00.672364 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667545    2560 flags.go:64] FLAG: --cgroup-root=""
Sep 10 04:41:00.672364 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667547    2560 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 10 04:41:00.672364 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667550    2560 flags.go:64] FLAG: --client-ca-file=""
Sep 10 04:41:00.672364 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667553    2560 flags.go:64] FLAG: --cloud-provider="external"
Sep 10 04:41:00.672364 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667556    2560 flags.go:64] FLAG: --cluster-dns="[]"
Sep 10 04:41:00.672364 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667560    2560 flags.go:64] FLAG: --cluster-domain=""
Sep 10 04:41:00.672364 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667563    2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 10 04:41:00.672364 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667566    2560 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 10 04:41:00.672364 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667569    2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 10 04:41:00.672364 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667572    2560 flags.go:64] FLAG: --container-log-max-files="5"
Sep 10 04:41:00.672364 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667576    2560 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 10 04:41:00.672364 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667579    2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 10 04:41:00.672364 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667582    2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 10 04:41:00.672364 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667585    2560 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 10 04:41:00.672364 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667588    2560 flags.go:64] FLAG: --contention-profiling="false"
Sep 10 04:41:00.672364 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667591    2560 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 10 04:41:00.672364 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667594    2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 10 04:41:00.672364 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667598    2560 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 10 04:41:00.672364 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667601    2560 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 10 04:41:00.672364 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667606    2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 10 04:41:00.672364 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667609    2560 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 10 04:41:00.672364 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667612    2560 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 10 04:41:00.672364 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667615    2560 flags.go:64] FLAG: --enable-load-reader="false"
Sep 10 04:41:00.672364 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667618    2560 flags.go:64] FLAG: --enable-server="true"
Sep 10 04:41:00.672979 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667621    2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 10 04:41:00.672979 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667627    2560 flags.go:64] FLAG: --event-burst="100"
Sep 10 04:41:00.672979 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667630    2560 flags.go:64] FLAG: --event-qps="50"
Sep 10 04:41:00.672979 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667632    2560 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 10 04:41:00.672979 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667636    2560 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 10 04:41:00.672979 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667639    2560 flags.go:64] FLAG: --eviction-hard=""
Sep 10 04:41:00.672979 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667642    2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 10 04:41:00.672979 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667645    2560 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 10 04:41:00.672979 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667648    2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 10 04:41:00.672979 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667651    2560 flags.go:64] FLAG: --eviction-soft=""
Sep 10 04:41:00.672979 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667654    2560 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 10 04:41:00.672979 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667657    2560 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 10 04:41:00.672979 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667660    2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 10 04:41:00.672979 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667663    2560 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 10 04:41:00.672979 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667666    2560 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 10 04:41:00.672979 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667669    2560 flags.go:64] FLAG: --fail-swap-on="true"
Sep 10 04:41:00.672979 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667672    2560 flags.go:64] FLAG: --feature-gates=""
Sep 10 04:41:00.672979 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667676    2560 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 10 04:41:00.672979 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667679    2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 10 04:41:00.672979 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667682    2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 10 04:41:00.672979 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667685    2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 10 04:41:00.672979 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667688    2560 flags.go:64] FLAG: --healthz-port="10248"
Sep 10 04:41:00.672979 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667691    2560 flags.go:64] FLAG: --help="false"
Sep 10 04:41:00.672979 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667694    2560 flags.go:64] FLAG: --hostname-override="ip-10-0-138-27.ec2.internal"
Sep 10 04:41:00.672979 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667697    2560 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 10 04:41:00.673607 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667700    2560 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 10 04:41:00.673607 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667703    2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 10 04:41:00.673607 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667706    2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 10 04:41:00.673607 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667710    2560 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 10 04:41:00.673607 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667714    2560 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 10 04:41:00.673607 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667717    2560 flags.go:64] FLAG: --image-service-endpoint=""
Sep 10 04:41:00.673607 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667719    2560 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 10 04:41:00.673607 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667722    2560 flags.go:64] FLAG: --kube-api-burst="100"
Sep 10 04:41:00.673607 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667726    2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 10 04:41:00.673607 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667729    2560 flags.go:64] FLAG: --kube-api-qps="50"
Sep 10 04:41:00.673607 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667732    2560 flags.go:64] FLAG: --kube-reserved=""
Sep 10 04:41:00.673607 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667735    2560 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 10 04:41:00.673607 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667738    2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 10 04:41:00.673607 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667741    2560 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 10 04:41:00.673607 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667744    2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 10 04:41:00.673607 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667746    2560 flags.go:64] FLAG: --lock-file=""
Sep 10 04:41:00.673607 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667749    2560 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 10 04:41:00.673607 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667752    2560 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 10 04:41:00.673607 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667755    2560 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 10 04:41:00.673607 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667760    2560 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 10 04:41:00.673607 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667763    2560 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 10 04:41:00.673607 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667766    2560 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 10 04:41:00.673607 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667769    2560 flags.go:64] FLAG: --logging-format="text"
Sep 10 04:41:00.674192 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667775    2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 10 04:41:00.674192 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667778    2560 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 10 04:41:00.674192 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667781    2560 flags.go:64] FLAG: --manifest-url=""
Sep 10 04:41:00.674192 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667784    2560 flags.go:64] FLAG: --manifest-url-header=""
Sep 10 04:41:00.674192 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667789    2560 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 10 04:41:00.674192 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667792    2560 flags.go:64] FLAG: --max-open-files="1000000"
Sep 10 04:41:00.674192 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667796    2560 flags.go:64] FLAG: --max-pods="110"
Sep 10 04:41:00.674192 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667799    2560 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 10 04:41:00.674192 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667802    2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 10 04:41:00.674192 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667805    2560 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 10 04:41:00.674192 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667807    2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 10 04:41:00.674192 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667810    2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 10 04:41:00.674192 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667813    2560 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 10 04:41:00.674192 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667816    2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 10 04:41:00.674192 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667824    2560 flags.go:64] FLAG: --node-status-max-images="50"
Sep 10 04:41:00.674192 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667828    2560 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 10 04:41:00.674192 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667831    2560 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 10 04:41:00.674192 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667834    2560 flags.go:64] FLAG: --pod-cidr=""
Sep 10 04:41:00.674192 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667837    2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 10 04:41:00.674192 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667842    2560 flags.go:64] FLAG: --pod-manifest-path=""
Sep 10 04:41:00.674192 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667845    2560 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 10 04:41:00.674192 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667862    2560 flags.go:64] FLAG: --pods-per-core="0"
Sep 10 04:41:00.674192 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667865    2560 flags.go:64] FLAG: --port="10250"
Sep 10 04:41:00.674192 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667868    2560 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 10 04:41:00.674769 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667871    2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0aca3c5eb7471bd6a"
Sep 10 04:41:00.674769 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667874    2560 flags.go:64] FLAG: --qos-reserved=""
Sep 10 04:41:00.674769 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667877    2560 flags.go:64] FLAG: --read-only-port="10255"
Sep 10 04:41:00.674769 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667880    2560 flags.go:64] FLAG: --register-node="true"
Sep 10 04:41:00.674769 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667883    2560 flags.go:64] FLAG: --register-with-taints=""
Sep 10 04:41:00.674769 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667887    2560 flags.go:64] FLAG: --registry-burst="10"
Sep 10 04:41:00.674769 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667889    2560 flags.go:64] FLAG: --registry-qps="5"
Sep 10 04:41:00.674769 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667892    2560 flags.go:64] FLAG: --reserved-cpus=""
Sep 10 04:41:00.674769 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667897    2560 flags.go:64] FLAG: --reserved-memory=""
Sep 10 04:41:00.674769 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667901    2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 10 04:41:00.674769 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667904    2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 10 04:41:00.674769 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667907    2560 flags.go:64] FLAG: --rotate-certificates="false"
Sep 10 04:41:00.674769 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667910    2560 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 10 04:41:00.674769 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667913    2560 flags.go:64] FLAG: --runonce="false"
Sep 10 04:41:00.674769 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667915    2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 10 04:41:00.674769 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667919    2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 10 04:41:00.674769 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667923    2560 flags.go:64] FLAG: --seccomp-default="false"
Sep 10 04:41:00.674769 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667926    2560 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 10 04:41:00.674769 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667929    2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 10 04:41:00.674769 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667932    2560 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 10 04:41:00.674769 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667936    2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 10 04:41:00.674769 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667939    2560 flags.go:64] FLAG: --storage-driver-password="root"
Sep 10 04:41:00.674769 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667942    2560 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 10 04:41:00.674769 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667945    2560 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 10 04:41:00.674769 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667948    2560 flags.go:64] FLAG: --storage-driver-user="root"
Sep 10 04:41:00.675402 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667951    2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 10 04:41:00.675402 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667954    2560 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 10 04:41:00.675402 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667957    2560 flags.go:64] FLAG: --system-cgroups=""
Sep 10 04:41:00.675402 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667960    2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 10 04:41:00.675402 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667966    2560 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 10 04:41:00.675402 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667969    2560 flags.go:64] FLAG: --tls-cert-file=""
Sep 10 04:41:00.675402 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667972    2560 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 10 04:41:00.675402 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667976    2560 flags.go:64] FLAG: --tls-min-version=""
Sep 10 04:41:00.675402 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667979    2560 flags.go:64] FLAG: --tls-private-key-file=""
Sep 10 04:41:00.675402 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667982    2560 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 10 04:41:00.675402 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667985    2560 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 10 04:41:00.675402 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667988    2560 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 10 04:41:00.675402 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667991    2560 flags.go:64] FLAG: --v="2"
Sep 10 04:41:00.675402 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667996    2560 flags.go:64] FLAG: --version="false"
Sep 10 04:41:00.675402 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.667999    2560 flags.go:64] FLAG: --vmodule=""
Sep 10 04:41:00.675402 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.668005    2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 10 04:41:00.675402 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.668008    2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 10 04:41:00.675402 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668119    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 04:41:00.675402 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668124    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 04:41:00.675402 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668127    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 04:41:00.675402 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668130    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 04:41:00.675402 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668133    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 04:41:00.675402 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668136    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 04:41:00.675402 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668140    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 04:41:00.676028 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668143    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 04:41:00.676028 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668147    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 04:41:00.676028 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668151    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 04:41:00.676028 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668154    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 04:41:00.676028 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668158    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 04:41:00.676028 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668162    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 04:41:00.676028 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668165    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 04:41:00.676028 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668168    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 04:41:00.676028 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668171    2560 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 04:41:00.676028 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668175    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 04:41:00.676028 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668177    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 04:41:00.676028 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668180    2560 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 04:41:00.676028 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668183    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 04:41:00.676028 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668186    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 04:41:00.676028 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668188    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 04:41:00.676028 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668191    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 04:41:00.676028 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668194    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 04:41:00.676028 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668196    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 04:41:00.676028 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668199    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 04:41:00.676496 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668201    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 04:41:00.676496 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668204    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 04:41:00.676496 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668206    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 04:41:00.676496 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668209    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 04:41:00.676496 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668213    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 04:41:00.676496 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668215    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 04:41:00.676496 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668218    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 04:41:00.676496 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668221    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 04:41:00.676496 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668223    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 04:41:00.676496 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668226    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 04:41:00.676496 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668228    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 04:41:00.676496 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668231    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 04:41:00.676496 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668235    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 04:41:00.676496 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668237    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 04:41:00.676496 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668240    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 04:41:00.676496 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668243    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 04:41:00.676496 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668245    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 04:41:00.676496 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668248    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 04:41:00.676496 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668250    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 04:41:00.676496 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668253    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 04:41:00.676998 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668256    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 04:41:00.676998 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668259    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 04:41:00.676998 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668261    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 04:41:00.676998 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668264    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 04:41:00.676998 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668266    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 04:41:00.676998 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668269    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 04:41:00.676998 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668272    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 04:41:00.676998 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668274    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 04:41:00.676998 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668278    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 04:41:00.676998 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668281    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 04:41:00.676998 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668284    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 04:41:00.676998 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668287    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 04:41:00.676998 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668289    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 04:41:00.676998 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668292    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 04:41:00.676998 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668294    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 04:41:00.676998 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668297    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 04:41:00.676998 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668301    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 04:41:00.676998 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668304    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 04:41:00.676998 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668306    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 04:41:00.676998 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668309    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 04:41:00.677490 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668312    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 04:41:00.677490 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668315    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 04:41:00.677490 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668317    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 04:41:00.677490 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668320    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 04:41:00.677490 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668323    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 04:41:00.677490 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668326    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 04:41:00.677490 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668329    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 04:41:00.677490 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668332    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 04:41:00.677490 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668334    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 04:41:00.677490 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668337    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 04:41:00.677490 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668339    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 04:41:00.677490 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668342    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 04:41:00.677490 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668344    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 04:41:00.677490 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668347    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 04:41:00.677490 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668350    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 04:41:00.677490 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668352    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 04:41:00.677490 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668355    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 04:41:00.677490 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668357    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 04:41:00.677490 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668360    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 04:41:00.677490 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668362    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 04:41:00.677992 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668365    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 04:41:00.677992 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668367    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 04:41:00.677992 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668370    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 04:41:00.677992 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668373    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 04:41:00.677992 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668376    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 04:41:00.677992 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668378    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 04:41:00.677992 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668381    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 04:41:00.677992 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668384    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 04:41:00.677992 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668388    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 04:41:00.677992 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668390    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 04:41:00.677992 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668393    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 04:41:00.677992 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668396    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 04:41:00.677992 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.668398    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 04:41:00.677992 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.668999    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 04:41:00.678343 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.676144    2560 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 10 04:41:00.678343 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.676158    2560 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 10 04:41:00.678343 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.676173    2560 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 10 04:41:00.678343 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.676179    2560 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 10 04:41:00.678343 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676229    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 04:41:00.678343 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676234    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 04:41:00.678343 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676237    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 04:41:00.678343 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676240    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 04:41:00.678343 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676244    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 04:41:00.678343 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676246    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 04:41:00.678343 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676250    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 04:41:00.678343 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676252    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 04:41:00.678343 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676255    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 04:41:00.678343 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676258    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 04:41:00.678343 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676262    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 04:41:00.678343 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676266    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 04:41:00.678343 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676269    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 04:41:00.678343 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676272    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 04:41:00.678343 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676275    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 04:41:00.678914 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676278    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 04:41:00.678914 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676281    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 04:41:00.678914 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676284    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 04:41:00.678914 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676287    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 04:41:00.678914 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676290    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 04:41:00.678914 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676293    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 04:41:00.678914 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676296    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 04:41:00.678914 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676298    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 04:41:00.678914 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676301    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 04:41:00.678914 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676304    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 04:41:00.678914 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676306    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 04:41:00.678914 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676309    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 04:41:00.678914 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676311    2560 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 04:41:00.678914 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676314    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 04:41:00.678914 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676317    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 04:41:00.678914 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676320    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 04:41:00.678914 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676324    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 04:41:00.678914 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676326    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 04:41:00.678914 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676332    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 04:41:00.678914 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676335    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 04:41:00.679801 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676338    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 04:41:00.679801 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676340    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 04:41:00.679801 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676343    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 04:41:00.679801 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676346    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 04:41:00.679801 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676349    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 04:41:00.679801 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676351    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 04:41:00.679801 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676354    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 04:41:00.679801 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676356    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 04:41:00.679801 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676359    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 04:41:00.679801 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676361    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 04:41:00.679801 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676364    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 04:41:00.679801 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676367    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 04:41:00.679801 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676371    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 04:41:00.679801 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676374    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 04:41:00.679801 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676377    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 04:41:00.679801 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676380    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 04:41:00.679801 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676383    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 04:41:00.679801 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676385    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 04:41:00.679801 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676388    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 04:41:00.680337 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676390    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 04:41:00.680337 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676393    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 04:41:00.680337 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676397    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 04:41:00.680337 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676401    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 04:41:00.680337 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676403    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 04:41:00.680337 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676406    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 04:41:00.680337 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676409    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 04:41:00.680337 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676411    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 04:41:00.680337 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676414    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 04:41:00.680337 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676416    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 04:41:00.680337 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676419    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 04:41:00.680337 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676421    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 04:41:00.680337 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676424    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 04:41:00.680337 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676427    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 04:41:00.680337 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676429    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 04:41:00.680337 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676432    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 04:41:00.680337 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676434    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 04:41:00.680337 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676437    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 04:41:00.680337 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676439    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 04:41:00.680337 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676442    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 04:41:00.680825 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676445    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 04:41:00.680825 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676447    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 04:41:00.680825 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676450    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 04:41:00.680825 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676452    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 04:41:00.680825 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676455    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 04:41:00.680825 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676457    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 04:41:00.680825 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676460    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 04:41:00.680825 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676463    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 04:41:00.680825 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676465    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 04:41:00.680825 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676468    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 04:41:00.680825 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676471    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 04:41:00.680825 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676473    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 04:41:00.680825 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676476    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 04:41:00.680825 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676479    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 04:41:00.680825 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676481    2560 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 04:41:00.680825 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676484    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 04:41:00.680825 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676487    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 04:41:00.680825 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676489    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 04:41:00.680825 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676492    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 04:41:00.681415 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676495    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 04:41:00.681415 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676497    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 04:41:00.681415 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676500    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 04:41:00.681415 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676503    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 04:41:00.681415 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676506    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 04:41:00.681415 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676509    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 04:41:00.681415 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.676514    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 04:41:00.681415 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676622    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 04:41:00.681415 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676626    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 04:41:00.681415 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676629    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 04:41:00.681415 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676632    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 04:41:00.681415 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676635    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 04:41:00.681415 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676638    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 04:41:00.681415 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676642    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 04:41:00.681782 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676645    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 04:41:00.681782 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676649    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 04:41:00.681782 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676652    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 04:41:00.681782 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676656    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 04:41:00.681782 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676660    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 04:41:00.681782 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676662    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 04:41:00.681782 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676665    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 04:41:00.681782 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676668    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 04:41:00.681782 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676671    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 04:41:00.681782 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676673    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 04:41:00.681782 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676676    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 04:41:00.681782 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676678    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 04:41:00.681782 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676681    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 04:41:00.681782 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676683    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 04:41:00.681782 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676686    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 04:41:00.681782 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676688    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 04:41:00.681782 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676691    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 04:41:00.681782 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676693    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 04:41:00.681782 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676696    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 04:41:00.681782 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676698    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 04:41:00.682307 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676701    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 04:41:00.682307 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676703    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 04:41:00.682307 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676706    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 04:41:00.682307 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676708    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 04:41:00.682307 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676711    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 04:41:00.682307 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676714    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 04:41:00.682307 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676717    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 04:41:00.682307 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676719    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 04:41:00.682307 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676722    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 04:41:00.682307 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676725    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 04:41:00.682307 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676727    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 04:41:00.682307 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676730    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 04:41:00.682307 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676732    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 04:41:00.682307 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676735    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 04:41:00.682307 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676739    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 04:41:00.682307 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676742    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 04:41:00.682307 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676745    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 04:41:00.682307 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676748    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 04:41:00.682307 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676751    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 04:41:00.682307 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676754    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 04:41:00.682810 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676757    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 04:41:00.682810 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676759    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 04:41:00.682810 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676762    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 04:41:00.682810 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676765    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 04:41:00.682810 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676767    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 04:41:00.682810 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676770    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 04:41:00.682810 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676772    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 04:41:00.682810 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676775    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 04:41:00.682810 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676777    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 04:41:00.682810 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676780    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 04:41:00.682810 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676783    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 04:41:00.682810 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676785    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 04:41:00.682810 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676788    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 04:41:00.682810 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676790    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 04:41:00.682810 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676793    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 04:41:00.682810 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676795    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 04:41:00.682810 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676797    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 04:41:00.682810 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676800    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 04:41:00.682810 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676803    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 04:41:00.682810 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676806    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 04:41:00.683466 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676808    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 04:41:00.683466 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676811    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 04:41:00.683466 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676814    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 04:41:00.683466 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676816    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 04:41:00.683466 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676819    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 04:41:00.683466 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676821    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 04:41:00.683466 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676824    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 04:41:00.683466 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676826    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 04:41:00.683466 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676829    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 04:41:00.683466 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676831    2560 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 04:41:00.683466 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676834    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 04:41:00.683466 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676836    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 04:41:00.683466 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676839    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 04:41:00.683466 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676842    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 04:41:00.683466 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676844    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 04:41:00.683466 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676860    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 04:41:00.683466 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676862    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 04:41:00.683466 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676865    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 04:41:00.683466 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676868    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 04:41:00.683940 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676870    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 04:41:00.683940 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676873    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 04:41:00.683940 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676875    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 04:41:00.683940 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676878    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 04:41:00.683940 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676881    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 04:41:00.683940 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676883    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 04:41:00.683940 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676886    2560 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 04:41:00.683940 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676889    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 04:41:00.683940 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676891    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 04:41:00.683940 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676894    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 04:41:00.683940 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676897    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 04:41:00.683940 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676899    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 04:41:00.683940 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:00.676902    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 04:41:00.683940 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.676907    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 04:41:00.683940 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.676995    2560 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 10 04:41:00.684332 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.679625    2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 10 04:41:00.684332 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.681027    2560 server.go:1019] "Starting client certificate rotation"
Sep 10 04:41:00.684332 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.681135    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 10 04:41:00.684332 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.681179    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 10 04:41:00.684332 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.683842    2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 10 04:41:00.688576 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.688559    2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 10 04:41:00.699407 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.699369    2560 log.go:25] "Validated CRI v1 runtime API"
Sep 10 04:41:00.704060 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.704037    2560 log.go:25] "Validated CRI v1 image API"
Sep 10 04:41:00.704821 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.704803    2560 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 10 04:41:00.708166 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.708148    2560 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 af6252c1-0ce8-4584-9958-d03fdaed63ca:/dev/nvme0n1p3 e05cb5a0-ebe9-4d20-abb5-25cad259f81f:/dev/nvme0n1p4]
Sep 10 04:41:00.708223 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.708165    2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 10 04:41:00.713699 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.713683    2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 10 04:41:00.714260 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.714162    2560 manager.go:216] Machine: {Timestamp:2026-09-10 04:41:00.712728973 +0000 UTC m=+0.375186712 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3094971 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2106c138fba06df2098235a455217d SystemUUID:ec2106c1-38fb-a06d-f209-8235a455217d BootID:efcad6c3-d241-4599-b432-cefccadb982f Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:57:a8:2a:7a:49 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:57:a8:2a:7a:49 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:9a:80:2c:96:66:4d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 10 04:41:00.714260 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.714259    2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 10 04:41:00.714355 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.714331    2560 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 10 04:41:00.717964 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.717940    2560 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 10 04:41:00.718133 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.717967    2560 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-27.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 10 04:41:00.718827 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.718817    2560 topology_manager.go:138] "Creating topology manager with none policy"
Sep 10 04:41:00.718871 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.718829    2560 container_manager_linux.go:309] "Creating device plugin manager"
Sep 10 04:41:00.718871 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.718841    2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 10 04:41:00.718871 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.718868    2560 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 10 04:41:00.720112 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.720102    2560 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 10 04:41:00.725614 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.725602    2560 state_mem.go:36] "Initialized new in-memory state store"
Sep 10 04:41:00.725723 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.725714    2560 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 10 04:41:00.725766 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.725757    2560 kubelet.go:486] "Attempting to sync node with API server"
Sep 10 04:41:00.725796 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.725775    2560 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 10 04:41:00.725796 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.725788    2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 10 04:41:00.725869 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.725799    2560 kubelet.go:398] "Adding apiserver pod source"
Sep 10 04:41:00.725869 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.725817    2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 10 04:41:00.726245 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.726232    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 10 04:41:00.726282 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.726256    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 10 04:41:00.728636 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.728618    2560 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 10 04:41:00.732711 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.732693    2560 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 10 04:41:00.732803 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.732740    2560 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 10 04:41:00.734156 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.734140    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 10 04:41:00.734233 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.734161    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 10 04:41:00.734233 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.734172    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 10 04:41:00.734233 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.734180    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 10 04:41:00.734233 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.734192    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 10 04:41:00.734385 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.734230    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 10 04:41:00.734385 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.734275    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 10 04:41:00.734385 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.734288    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 10 04:41:00.734385 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.734303    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 10 04:41:00.734385 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.734317    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 10 04:41:00.734385 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.734338    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 10 04:41:00.734385 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.734353    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 10 04:41:00.735290 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.735279    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 10 04:41:00.735339 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.735331    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 10 04:41:00.738933 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.738913    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-27.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 10 04:41:00.738933 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:00.738926    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 10 04:41:00.739069 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:00.739050    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-27.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 10 04:41:00.739778 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.739764    2560 server.go:1268] "Started kubelet"
Sep 10 04:41:00.739867 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.739830    2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 10 04:41:00.739920 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.739861    2560 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 10 04:41:00.739965 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.739929    2560 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 10 04:41:00.740590 ip-10-0-138-27 systemd[1]: Started Kubernetes Kubelet.
Sep 10 04:41:00.741311 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.741295    2560 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 10 04:41:00.742527 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.742514    2560 server.go:310] "Adding debug handlers to kubelet server"
Sep 10 04:41:00.743795 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:00.743775    2560 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 10 04:41:00.747129 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:00.746066    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-27.ec2.internal.18d3dbe6aa250f3d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-27.ec2.internal,UID:ip-10-0-138-27.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-27.ec2.internal,},FirstTimestamp:2026-09-10 04:41:00.739735357 +0000 UTC m=+0.402193148,LastTimestamp:2026-09-10 04:41:00.739735357 +0000 UTC m=+0.402193148,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-27.ec2.internal,}"
Sep 10 04:41:00.748767 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.748752    2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 10 04:41:00.748767 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.748760    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 10 04:41:00.748917 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:00.748834    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-27.ec2.internal\" not found"
Sep 10 04:41:00.749729 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.749714    2560 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 10 04:41:00.749729 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.749732    2560 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 10 04:41:00.749839 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.749716    2560 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 10 04:41:00.749915 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.749907    2560 reconstruct.go:97] "Volume reconstruction finished"
Sep 10 04:41:00.749958 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.749915    2560 reconciler.go:29] "Reconciler: start to sync state"
Sep 10 04:41:00.750197 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.750180    2560 factory.go:55] Registering systemd factory
Sep 10 04:41:00.750197 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.750197    2560 factory.go:223] Registration of the systemd container factory successfully
Sep 10 04:41:00.750410 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.750390    2560 factory.go:153] Registering CRI-O factory
Sep 10 04:41:00.750473 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.750414    2560 factory.go:223] Registration of the crio container factory successfully
Sep 10 04:41:00.750522 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.750473    2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 10 04:41:00.750522 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.750504    2560 factory.go:103] Registering Raw factory
Sep 10 04:41:00.750522 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.750518    2560 manager.go:1196] Started watching for new ooms in manager
Sep 10 04:41:00.751218 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.751200    2560 manager.go:349] Starting recovery of all containers
Sep 10 04:41:00.753198 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:00.753164    2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-27.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 10 04:41:00.753275 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:00.753227    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 10 04:41:00.761140 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.760925    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wk9vg"
Sep 10 04:41:00.762797 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.762781    2560 manager.go:354] Recovery completed
Sep 10 04:41:00.768912 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.768899    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 04:41:00.771339 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.771316    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-27.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 04:41:00.771428 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.771355    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-27.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 04:41:00.771428 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.771370    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-27.ec2.internal" event="NodeHasSufficientPID"
Sep 10 04:41:00.771683 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.771665    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wk9vg"
Sep 10 04:41:00.771989 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.771973    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 04:41:00.772061 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.771972    2560 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 10 04:41:00.772061 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.772031    2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 10 04:41:00.772061 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.772055    2560 state_mem.go:36] "Initialized new in-memory state store"
Sep 10 04:41:00.772672 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.772659    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-27.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 04:41:00.772723 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.772684    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-27.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 04:41:00.772723 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.772697    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-27.ec2.internal" event="NodeHasSufficientPID"
Sep 10 04:41:00.773172 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:00.773099    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-27.ec2.internal.18d3dbe6ac074493  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-27.ec2.internal,UID:ip-10-0-138-27.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-27.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-27.ec2.internal,},FirstTimestamp:2026-09-10 04:41:00.771337363 +0000 UTC m=+0.433795107,LastTimestamp:2026-09-10 04:41:00.771337363 +0000 UTC m=+0.433795107,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-27.ec2.internal,}"
Sep 10 04:41:00.775062 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.775048    2560 policy_none.go:49] "None policy: Start"
Sep 10 04:41:00.775062 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.775063    2560 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 10 04:41:00.775159 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.775073    2560 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 10 04:41:00.777349 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.777338    2560 policy_none.go:47] "Start"
Sep 10 04:41:00.798393 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.798379    2560 manager.go:337] "Starting Device Plugin manager"
Sep 10 04:41:00.798485 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:00.798410    2560 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 10 04:41:00.798485 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.798421    2560 server.go:87] "Starting device plugin registration server"
Sep 10 04:41:00.798645 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.798633    2560 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 10 04:41:00.798693 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.798648    2560 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 10 04:41:00.798733 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.798719    2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 10 04:41:00.798807 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.798787    2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 10 04:41:00.798807 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.798799    2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 10 04:41:00.799466 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:00.799451    2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 10 04:41:00.799538 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:00.799499    2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-27.ec2.internal\" not found"
Sep 10 04:41:00.817139 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.817114    2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 10 04:41:00.829620 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.818208    2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 10 04:41:00.829620 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.818257    2560 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 10 04:41:00.829620 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.818279    2560 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 10 04:41:00.829620 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:00.818348    2560 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 10 04:41:00.829620 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.820206    2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 04:41:00.899173 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.899159    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 04:41:00.899941 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.899922    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-27.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 04:41:00.900026 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.899949    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-27.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 04:41:00.900026 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.899960    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-27.ec2.internal" event="NodeHasSufficientPID"
Sep 10 04:41:00.900026 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.899979    2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-27.ec2.internal"
Sep 10 04:41:00.909132 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.909091    2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-27.ec2.internal"
Sep 10 04:41:00.909132 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:00.909110    2560 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-27.ec2.internal\": node \"ip-10-0-138-27.ec2.internal\" not found"
Sep 10 04:41:00.918910 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.918879    2560 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-27.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-27.ec2.internal"]
Sep 10 04:41:00.918995 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.918939    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 04:41:00.920376 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.920361    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-27.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 04:41:00.920462 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.920390    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-27.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 04:41:00.920462 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.920404    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-27.ec2.internal" event="NodeHasSufficientPID"
Sep 10 04:41:00.922553 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.922538    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 04:41:00.922671 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.922657    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-27.ec2.internal"
Sep 10 04:41:00.922718 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.922687    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 04:41:00.923206 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.923189    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-27.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 04:41:00.923206 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.923201    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-27.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 04:41:00.923325 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.923219    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-27.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 04:41:00.923325 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.923223    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-27.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 04:41:00.923325 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.923231    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-27.ec2.internal" event="NodeHasSufficientPID"
Sep 10 04:41:00.923325 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.923238    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-27.ec2.internal" event="NodeHasSufficientPID"
Sep 10 04:41:00.925333 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.925318    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-27.ec2.internal"
Sep 10 04:41:00.925375 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.925345    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 04:41:00.925938 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.925926    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-27.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 04:41:00.925987 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.925951    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-27.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 04:41:00.925987 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.925962    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-27.ec2.internal" event="NodeHasSufficientPID"
Sep 10 04:41:00.934885 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:00.934870    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-27.ec2.internal\" not found"
Sep 10 04:41:00.950082 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.950051    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/80e4dc2a5b117e5d41646dac820795d0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-27.ec2.internal\" (UID: \"80e4dc2a5b117e5d41646dac820795d0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-27.ec2.internal"
Sep 10 04:41:00.950082 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.950081    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/80e4dc2a5b117e5d41646dac820795d0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-27.ec2.internal\" (UID: \"80e4dc2a5b117e5d41646dac820795d0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-27.ec2.internal"
Sep 10 04:41:00.950271 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:00.950098    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/08157110d78d292dae4b05db5b9fb1a8-config\") pod \"kube-apiserver-proxy-ip-10-0-138-27.ec2.internal\" (UID: \"08157110d78d292dae4b05db5b9fb1a8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-27.ec2.internal"
Sep 10 04:41:00.951398 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:00.951374    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-27.ec2.internal\" not found" node="ip-10-0-138-27.ec2.internal"
Sep 10 04:41:00.955058 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:00.955043    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-27.ec2.internal\" not found" node="ip-10-0-138-27.ec2.internal"
Sep 10 04:41:01.035712 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:01.035694    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-27.ec2.internal\" not found"
Sep 10 04:41:01.050992 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:01.050966    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/80e4dc2a5b117e5d41646dac820795d0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-27.ec2.internal\" (UID: \"80e4dc2a5b117e5d41646dac820795d0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-27.ec2.internal"
Sep 10 04:41:01.051049 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:01.050998    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/80e4dc2a5b117e5d41646dac820795d0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-27.ec2.internal\" (UID: \"80e4dc2a5b117e5d41646dac820795d0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-27.ec2.internal"
Sep 10 04:41:01.051049 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:01.051014    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/08157110d78d292dae4b05db5b9fb1a8-config\") pod \"kube-apiserver-proxy-ip-10-0-138-27.ec2.internal\" (UID: \"08157110d78d292dae4b05db5b9fb1a8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-27.ec2.internal"
Sep 10 04:41:01.051114 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:01.051066    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/80e4dc2a5b117e5d41646dac820795d0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-27.ec2.internal\" (UID: \"80e4dc2a5b117e5d41646dac820795d0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-27.ec2.internal"
Sep 10 04:41:01.051114 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:01.051066    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/80e4dc2a5b117e5d41646dac820795d0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-27.ec2.internal\" (UID: \"80e4dc2a5b117e5d41646dac820795d0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-27.ec2.internal"
Sep 10 04:41:01.051114 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:01.051094    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/08157110d78d292dae4b05db5b9fb1a8-config\") pod \"kube-apiserver-proxy-ip-10-0-138-27.ec2.internal\" (UID: \"08157110d78d292dae4b05db5b9fb1a8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-27.ec2.internal"
Sep 10 04:41:01.136126 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:01.136107    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-27.ec2.internal\" not found"
Sep 10 04:41:01.236840 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:01.236791    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-27.ec2.internal\" not found"
Sep 10 04:41:01.254227 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:01.254211    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-27.ec2.internal"
Sep 10 04:41:01.259602 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:01.259424    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-27.ec2.internal"
Sep 10 04:41:01.337043 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:01.337019    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-27.ec2.internal\" not found"
Sep 10 04:41:01.437634 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:01.437525    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-27.ec2.internal\" not found"
Sep 10 04:41:01.537840 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:01.537775    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-27.ec2.internal\" not found"
Sep 10 04:41:01.639443 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:01.639403    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-27.ec2.internal\" not found"
Sep 10 04:41:01.680659 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:01.680627    2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 10 04:41:01.681284 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:01.680761    2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 10 04:41:01.739610 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:01.739589    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-27.ec2.internal\" not found"
Sep 10 04:41:01.777151 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:01.777115    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-09 04:36:00 +0000 UTC" deadline="2028-03-26 07:09:27.25386076 +0000 UTC"
Sep 10 04:41:01.777151 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:01.777145    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13514h28m25.476718969s"
Sep 10 04:41:01.819098 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:01.819002    2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 04:41:01.824498 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:01.824478    2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 04:41:01.840122 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:01.840100    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-27.ec2.internal\" not found"
Sep 10 04:41:01.940730 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:01.940697    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-27.ec2.internal\" not found"
Sep 10 04:41:01.992151 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:01.992115    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80e4dc2a5b117e5d41646dac820795d0.slice/crio-2016a7ceba2c0728f54ef5286bbd5c7b9f9c86118acba003dd605e40dec00641 WatchSource:0}: Error finding container 2016a7ceba2c0728f54ef5286bbd5c7b9f9c86118acba003dd605e40dec00641: Status 404 returned error can't find the container with id 2016a7ceba2c0728f54ef5286bbd5c7b9f9c86118acba003dd605e40dec00641
Sep 10 04:41:01.999309 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:01.999292    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 04:41:02.001496 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:02.001478    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08157110d78d292dae4b05db5b9fb1a8.slice/crio-435df94b020a507db2211a2c97f51cf8faa3056b043214262fb9708511d8f26c WatchSource:0}: Error finding container 435df94b020a507db2211a2c97f51cf8faa3056b043214262fb9708511d8f26c: Status 404 returned error can't find the container with id 435df94b020a507db2211a2c97f51cf8faa3056b043214262fb9708511d8f26c
Sep 10 04:41:02.040992 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:02.040971    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-27.ec2.internal\" not found"
Sep 10 04:41:02.142801 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:02.142723    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-27.ec2.internal\" not found"
Sep 10 04:41:02.211975 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.211953    2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 04:41:02.249388 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.249368    2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-27.ec2.internal"
Sep 10 04:41:02.262096 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.262078    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 10 04:41:02.263264 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.263252    2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-27.ec2.internal"
Sep 10 04:41:02.269019 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.269006    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 10 04:41:02.726845 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.726816    2560 apiserver.go:52] "Watching apiserver"
Sep 10 04:41:02.736575 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.736550    2560 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 10 04:41:02.737686 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.737664    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-27.ec2.internal","openshift-multus/multus-ctktw","openshift-network-diagnostics/network-check-target-kq4qp","openshift-network-operator/iptables-alerter-snsz7","kube-system/konnectivity-agent-jrddm","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hwrf7","openshift-cluster-node-tuning-operator/tuned-wptnl","openshift-multus/multus-additional-cni-plugins-vhzvh","openshift-multus/network-metrics-daemon-n2sr7","openshift-ovn-kubernetes/ovnkube-node-z79rt","kube-system/global-pull-secret-syncer-77cd4","kube-system/kube-apiserver-proxy-ip-10-0-138-27.ec2.internal","openshift-dns/node-resolver-6c6hs","openshift-image-registry/node-ca-h7swz"]
Sep 10 04:41:02.740341 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.740323    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vhzvh"
Sep 10 04:41:02.742740 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.742723    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 10 04:41:02.742836 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.742724    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 10 04:41:02.743054 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.743031    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 10 04:41:02.743054 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.743048    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-z79rt"
Sep 10 04:41:02.743327 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.743214    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-s677c\""
Sep 10 04:41:02.743327 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.743301    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 10 04:41:02.743457 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.743347    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 10 04:41:02.745235 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.745219    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-snsz7"
Sep 10 04:41:02.746596 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.746313    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 10 04:41:02.746596 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.746328    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 10 04:41:02.746596 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.746400    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 10 04:41:02.746596 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.746414    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 10 04:41:02.746596 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.746497    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 10 04:41:02.746596 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.746515    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 10 04:41:02.746843 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.746713    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-j4jxp\""
Sep 10 04:41:02.747131 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.747115    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 10 04:41:02.747172 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.747154    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 10 04:41:02.747783 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.747766    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 10 04:41:02.747927 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.747910    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-hwcjp\""
Sep 10 04:41:02.748798 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.748782    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jrddm"
Sep 10 04:41:02.749442 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.749426    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 10 04:41:02.750457 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.750440    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 10 04:41:02.750560 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.750491    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 10 04:41:02.750791 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.750777    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-vhk75\""
Sep 10 04:41:02.751229 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.751212    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hwrf7"
Sep 10 04:41:02.752862 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.752835    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 10 04:41:02.753075 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.753061    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 10 04:41:02.753281 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.753199    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-cqf2m\""
Sep 10 04:41:02.753281 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.753224    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 10 04:41:02.753446 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.753428    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wptnl"
Sep 10 04:41:02.755277 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.755260    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 10 04:41:02.755656 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.755636    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7k27c\""
Sep 10 04:41:02.755656 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.755654    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 10 04:41:02.756240 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.756219    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kq4qp"
Sep 10 04:41:02.756340 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:02.756287    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kq4qp" podUID="d9c2d9dc-e666-442f-b8f4-98b917db1a7f"
Sep 10 04:41:02.758620 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.758579    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n2sr7"
Sep 10 04:41:02.758770 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:02.758653    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n2sr7" podUID="13570f73-c21d-4771-8349-f30c25ab27fb"
Sep 10 04:41:02.758899 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.758879    2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 10 04:41:02.759579 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.759563    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdmsd\" (UniqueName: \"kubernetes.io/projected/c29c7fa4-b497-47b3-83b6-3711449979c9-kube-api-access-mdmsd\") pod \"ovnkube-node-z79rt\" (UID: \"c29c7fa4-b497-47b3-83b6-3711449979c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-z79rt"
Sep 10 04:41:02.759663 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.759583    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/02552f59-e9e1-419f-b684-95357447d121-system-cni-dir\") pod \"multus-additional-cni-plugins-vhzvh\" (UID: \"02552f59-e9e1-419f-b684-95357447d121\") " pod="openshift-multus/multus-additional-cni-plugins-vhzvh"
Sep 10 04:41:02.759663 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.759609    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c29c7fa4-b497-47b3-83b6-3711449979c9-host-cni-netd\") pod \"ovnkube-node-z79rt\" (UID: \"c29c7fa4-b497-47b3-83b6-3711449979c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-z79rt"
Sep 10 04:41:02.759663 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.759630    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c29c7fa4-b497-47b3-83b6-3711449979c9-ovn-node-metrics-cert\") pod \"ovnkube-node-z79rt\" (UID: \"c29c7fa4-b497-47b3-83b6-3711449979c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-z79rt"
Sep 10 04:41:02.759663 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.759653    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/87caacb7-22ae-4c04-b8bf-4f72072b6372-iptables-alerter-script\") pod \"iptables-alerter-snsz7\" (UID: \"87caacb7-22ae-4c04-b8bf-4f72072b6372\") " pod="openshift-network-operator/iptables-alerter-snsz7"
Sep 10 04:41:02.759897 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.759674    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8381d071-dc2a-4c80-888a-0fa7411a98fe-etc-selinux\") pod \"aws-ebs-csi-driver-node-hwrf7\" (UID: \"8381d071-dc2a-4c80-888a-0fa7411a98fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hwrf7"
Sep 10 04:41:02.759897 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.759706    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8381d071-dc2a-4c80-888a-0fa7411a98fe-sys-fs\") pod \"aws-ebs-csi-driver-node-hwrf7\" (UID: \"8381d071-dc2a-4c80-888a-0fa7411a98fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hwrf7"
Sep 10 04:41:02.759897 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.759744    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c29c7fa4-b497-47b3-83b6-3711449979c9-host-kubelet\") pod \"ovnkube-node-z79rt\" (UID: \"c29c7fa4-b497-47b3-83b6-3711449979c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-z79rt"
Sep 10 04:41:02.759897 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.759768    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/02552f59-e9e1-419f-b684-95357447d121-cnibin\") pod \"multus-additional-cni-plugins-vhzvh\" (UID: \"02552f59-e9e1-419f-b684-95357447d121\") " pod="openshift-multus/multus-additional-cni-plugins-vhzvh"
Sep 10 04:41:02.759897 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.759791    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/02552f59-e9e1-419f-b684-95357447d121-cni-binary-copy\") pod \"multus-additional-cni-plugins-vhzvh\" (UID: \"02552f59-e9e1-419f-b684-95357447d121\") " pod="openshift-multus/multus-additional-cni-plugins-vhzvh"
Sep 10 04:41:02.759897 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.759817    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c29c7fa4-b497-47b3-83b6-3711449979c9-var-lib-openvswitch\") pod \"ovnkube-node-z79rt\" (UID: \"c29c7fa4-b497-47b3-83b6-3711449979c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-z79rt"
Sep 10 04:41:02.759897 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.759835    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c29c7fa4-b497-47b3-83b6-3711449979c9-etc-openvswitch\") pod \"ovnkube-node-z79rt\" (UID: \"c29c7fa4-b497-47b3-83b6-3711449979c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-z79rt"
Sep 10 04:41:02.759897 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.759878    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/87caacb7-22ae-4c04-b8bf-4f72072b6372-host-slash\") pod \"iptables-alerter-snsz7\" (UID: \"87caacb7-22ae-4c04-b8bf-4f72072b6372\") " pod="openshift-network-operator/iptables-alerter-snsz7"
Sep 10 04:41:02.760428 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.759918    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c29c7fa4-b497-47b3-83b6-3711449979c9-host-cni-bin\") pod \"ovnkube-node-z79rt\" (UID: \"c29c7fa4-b497-47b3-83b6-3711449979c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-z79rt"
Sep 10 04:41:02.760428 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.759942    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c29c7fa4-b497-47b3-83b6-3711449979c9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z79rt\" (UID: \"c29c7fa4-b497-47b3-83b6-3711449979c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-z79rt"
Sep 10 04:41:02.760428 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.759967    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c29c7fa4-b497-47b3-83b6-3711449979c9-env-overrides\") pod \"ovnkube-node-z79rt\" (UID: \"c29c7fa4-b497-47b3-83b6-3711449979c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-z79rt"
Sep 10 04:41:02.760428 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.759990    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e547a905-b80c-4247-b45b-71da7aeaf4e1-agent-certs\") pod \"konnectivity-agent-jrddm\" (UID: \"e547a905-b80c-4247-b45b-71da7aeaf4e1\") " pod="kube-system/konnectivity-agent-jrddm"
Sep 10 04:41:02.760428 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.760026    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8381d071-dc2a-4c80-888a-0fa7411a98fe-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hwrf7\" (UID: \"8381d071-dc2a-4c80-888a-0fa7411a98fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hwrf7"
Sep 10 04:41:02.760428 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.760050    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c29c7fa4-b497-47b3-83b6-3711449979c9-systemd-units\") pod \"ovnkube-node-z79rt\" (UID: \"c29c7fa4-b497-47b3-83b6-3711449979c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-z79rt"
Sep 10 04:41:02.760428 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.760074    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bckbd\" (UniqueName: \"kubernetes.io/projected/02552f59-e9e1-419f-b684-95357447d121-kube-api-access-bckbd\") pod \"multus-additional-cni-plugins-vhzvh\" (UID: \"02552f59-e9e1-419f-b684-95357447d121\") " pod="openshift-multus/multus-additional-cni-plugins-vhzvh"
Sep 10 04:41:02.760428 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.760100    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e547a905-b80c-4247-b45b-71da7aeaf4e1-konnectivity-ca\") pod \"konnectivity-agent-jrddm\" (UID: \"e547a905-b80c-4247-b45b-71da7aeaf4e1\") " pod="kube-system/konnectivity-agent-jrddm"
Sep 10 04:41:02.760428 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.760121    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8381d071-dc2a-4c80-888a-0fa7411a98fe-socket-dir\") pod \"aws-ebs-csi-driver-node-hwrf7\" (UID: \"8381d071-dc2a-4c80-888a-0fa7411a98fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hwrf7"
Sep 10 04:41:02.760428 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.760143    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8381d071-dc2a-4c80-888a-0fa7411a98fe-device-dir\") pod \"aws-ebs-csi-driver-node-hwrf7\" (UID: \"8381d071-dc2a-4c80-888a-0fa7411a98fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hwrf7"
Sep 10 04:41:02.760428 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.760165    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qlrs\" (UniqueName: \"kubernetes.io/projected/8381d071-dc2a-4c80-888a-0fa7411a98fe-kube-api-access-4qlrs\") pod \"aws-ebs-csi-driver-node-hwrf7\" (UID: \"8381d071-dc2a-4c80-888a-0fa7411a98fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hwrf7"
Sep 10 04:41:02.760428 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.760188    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/02552f59-e9e1-419f-b684-95357447d121-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vhzvh\" (UID: \"02552f59-e9e1-419f-b684-95357447d121\") " pod="openshift-multus/multus-additional-cni-plugins-vhzvh"
Sep 10 04:41:02.760428 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.760227    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c29c7fa4-b497-47b3-83b6-3711449979c9-run-systemd\") pod \"ovnkube-node-z79rt\" (UID: \"c29c7fa4-b497-47b3-83b6-3711449979c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-z79rt"
Sep 10 04:41:02.760428 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.760251    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c29c7fa4-b497-47b3-83b6-3711449979c9-log-socket\") pod \"ovnkube-node-z79rt\" (UID: \"c29c7fa4-b497-47b3-83b6-3711449979c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-z79rt"
Sep 10 04:41:02.760428 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.760273    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c29c7fa4-b497-47b3-83b6-3711449979c9-host-run-ovn-kubernetes\") pod \"ovnkube-node-z79rt\" (UID: \"c29c7fa4-b497-47b3-83b6-3711449979c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-z79rt"
Sep 10 04:41:02.760428 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.760328    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8381d071-dc2a-4c80-888a-0fa7411a98fe-registration-dir\") pod \"aws-ebs-csi-driver-node-hwrf7\" (UID: \"8381d071-dc2a-4c80-888a-0fa7411a98fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hwrf7"
Sep 10 04:41:02.761373 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.760376    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c29c7fa4-b497-47b3-83b6-3711449979c9-run-ovn\") pod \"ovnkube-node-z79rt\" (UID: \"c29c7fa4-b497-47b3-83b6-3711449979c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-z79rt"
Sep 10 04:41:02.761373 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.760400    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c29c7fa4-b497-47b3-83b6-3711449979c9-node-log\") pod \"ovnkube-node-z79rt\" (UID: \"c29c7fa4-b497-47b3-83b6-3711449979c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-z79rt"
Sep 10 04:41:02.761373 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.760452    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c29c7fa4-b497-47b3-83b6-3711449979c9-ovnkube-config\") pod \"ovnkube-node-z79rt\" (UID: \"c29c7fa4-b497-47b3-83b6-3711449979c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-z79rt"
Sep 10 04:41:02.761373 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.760516    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8qvz\" (UniqueName: \"kubernetes.io/projected/87caacb7-22ae-4c04-b8bf-4f72072b6372-kube-api-access-c8qvz\") pod \"iptables-alerter-snsz7\" (UID: \"87caacb7-22ae-4c04-b8bf-4f72072b6372\") " pod="openshift-network-operator/iptables-alerter-snsz7"
Sep 10 04:41:02.761373 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.760542    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c29c7fa4-b497-47b3-83b6-3711449979c9-run-openvswitch\") pod \"ovnkube-node-z79rt\" (UID: \"c29c7fa4-b497-47b3-83b6-3711449979c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-z79rt"
Sep 10 04:41:02.761373 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.760564    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c29c7fa4-b497-47b3-83b6-3711449979c9-host-slash\") pod \"ovnkube-node-z79rt\" (UID: \"c29c7fa4-b497-47b3-83b6-3711449979c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-z79rt"
Sep 10 04:41:02.761373 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.760588    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c29c7fa4-b497-47b3-83b6-3711449979c9-host-run-netns\") pod \"ovnkube-node-z79rt\" (UID: \"c29c7fa4-b497-47b3-83b6-3711449979c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-z79rt"
Sep 10 04:41:02.761373 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.760633    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/02552f59-e9e1-419f-b684-95357447d121-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vhzvh\" (UID: \"02552f59-e9e1-419f-b684-95357447d121\") " pod="openshift-multus/multus-additional-cni-plugins-vhzvh"
Sep 10 04:41:02.761373 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.760658    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/02552f59-e9e1-419f-b684-95357447d121-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vhzvh\" (UID: \"02552f59-e9e1-419f-b684-95357447d121\") " pod="openshift-multus/multus-additional-cni-plugins-vhzvh"
Sep 10 04:41:02.761373 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.760684    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c29c7fa4-b497-47b3-83b6-3711449979c9-ovnkube-script-lib\") pod \"ovnkube-node-z79rt\" (UID: \"c29c7fa4-b497-47b3-83b6-3711449979c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-z79rt"
Sep 10 04:41:02.762052 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.762037    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ctktw"
Sep 10 04:41:02.764136 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.764115    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 10 04:41:02.764229 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.764172    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-mdnb2\""
Sep 10 04:41:02.764908 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.764490    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-77cd4"
Sep 10 04:41:02.764908 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:02.764560    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-77cd4" podUID="5e472a47-9b1d-4f3e-be2f-36ac4b0ebc7f"
Sep 10 04:41:02.766973 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.766954    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6c6hs"
Sep 10 04:41:02.770758 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.770737    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-h7swz"
Sep 10 04:41:02.770896 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.770868    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-m66hn\""
Sep 10 04:41:02.771344 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.771323    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 10 04:41:02.771432 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.771403    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 10 04:41:02.772887 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.772714    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 10 04:41:02.773389 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.773066    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 10 04:41:02.773389 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.773214    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7c7zc\""
Sep 10 04:41:02.773389 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.773237    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 10 04:41:02.785232 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.785212    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-rk8r4"
Sep 10 04:41:02.792930 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.792908    2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 04:41:02.795055 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.795034    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-rk8r4"
Sep 10 04:41:02.823712 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.823661    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-27.ec2.internal" event={"ID":"08157110d78d292dae4b05db5b9fb1a8","Type":"ContainerStarted","Data":"435df94b020a507db2211a2c97f51cf8faa3056b043214262fb9708511d8f26c"}
Sep 10 04:41:02.826434 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.826406    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-27.ec2.internal" event={"ID":"80e4dc2a5b117e5d41646dac820795d0","Type":"ContainerStarted","Data":"2016a7ceba2c0728f54ef5286bbd5c7b9f9c86118acba003dd605e40dec00641"}
Sep 10 04:41:02.851775 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.851691    2560 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 10 04:41:02.860964 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.860934    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c29c7fa4-b497-47b3-83b6-3711449979c9-host-slash\") pod \"ovnkube-node-z79rt\" (UID: \"c29c7fa4-b497-47b3-83b6-3711449979c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-z79rt"
Sep 10 04:41:02.861082 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.860979    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/02552f59-e9e1-419f-b684-95357447d121-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vhzvh\" (UID: \"02552f59-e9e1-419f-b684-95357447d121\") " pod="openshift-multus/multus-additional-cni-plugins-vhzvh"
Sep 10 04:41:02.861082 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.861005    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c29c7fa4-b497-47b3-83b6-3711449979c9-ovnkube-script-lib\") pod \"ovnkube-node-z79rt\" (UID: \"c29c7fa4-b497-47b3-83b6-3711449979c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-z79rt"
Sep 10 04:41:02.861082 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.861028    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdmsd\" (UniqueName: \"kubernetes.io/projected/c29c7fa4-b497-47b3-83b6-3711449979c9-kube-api-access-mdmsd\") pod \"ovnkube-node-z79rt\" (UID: \"c29c7fa4-b497-47b3-83b6-3711449979c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-z79rt"
Sep 10 04:41:02.861082 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.861057    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/046c184b-74c1-435f-aa43-942470639bdd-hostroot\") pod \"multus-ctktw\" (UID: \"046c184b-74c1-435f-aa43-942470639bdd\") " pod="openshift-multus/multus-ctktw"
Sep 10 04:41:02.861285 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.861083    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c29c7fa4-b497-47b3-83b6-3711449979c9-ovn-node-metrics-cert\") pod \"ovnkube-node-z79rt\" (UID: \"c29c7fa4-b497-47b3-83b6-3711449979c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-z79rt"
Sep 10 04:41:02.861285 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.861106    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/87caacb7-22ae-4c04-b8bf-4f72072b6372-iptables-alerter-script\") pod \"iptables-alerter-snsz7\" (UID: \"87caacb7-22ae-4c04-b8bf-4f72072b6372\") " pod="openshift-network-operator/iptables-alerter-snsz7"
Sep 10 04:41:02.861285 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.861131    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8381d071-dc2a-4c80-888a-0fa7411a98fe-sys-fs\") pod \"aws-ebs-csi-driver-node-hwrf7\" (UID: \"8381d071-dc2a-4c80-888a-0fa7411a98fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hwrf7"
Sep 10 04:41:02.861285 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.861169    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/046c184b-74c1-435f-aa43-942470639bdd-multus-cni-dir\") pod \"multus-ctktw\" (UID: \"046c184b-74c1-435f-aa43-942470639bdd\") " pod="openshift-multus/multus-ctktw"
Sep 10 04:41:02.861285 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.861192    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/70619315-7b0a-40c0-82cf-a3f283ada09f-hosts-file\") pod \"node-resolver-6c6hs\" (UID: \"70619315-7b0a-40c0-82cf-a3f283ada09f\") " pod="openshift-dns/node-resolver-6c6hs"
Sep 10 04:41:02.861285 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.861215    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/02552f59-e9e1-419f-b684-95357447d121-cnibin\") pod \"multus-additional-cni-plugins-vhzvh\" (UID: \"02552f59-e9e1-419f-b684-95357447d121\") " pod="openshift-multus/multus-additional-cni-plugins-vhzvh"
Sep 10 04:41:02.861285 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.861241    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/02552f59-e9e1-419f-b684-95357447d121-cni-binary-copy\") pod \"multus-additional-cni-plugins-vhzvh\" (UID: \"02552f59-e9e1-419f-b684-95357447d121\") " pod="openshift-multus/multus-additional-cni-plugins-vhzvh"
Sep 10 04:41:02.861285 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.861285    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c29c7fa4-b497-47b3-83b6-3711449979c9-var-lib-openvswitch\") pod \"ovnkube-node-z79rt\" (UID: \"c29c7fa4-b497-47b3-83b6-3711449979c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-z79rt"
Sep 10 04:41:02.861643 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.861314    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c29c7fa4-b497-47b3-83b6-3711449979c9-etc-openvswitch\") pod \"ovnkube-node-z79rt\" (UID: \"c29c7fa4-b497-47b3-83b6-3711449979c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-z79rt"
Sep 10 04:41:02.861643 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.861337    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/87caacb7-22ae-4c04-b8bf-4f72072b6372-host-slash\") pod \"iptables-alerter-snsz7\" (UID: \"87caacb7-22ae-4c04-b8bf-4f72072b6372\") " pod="openshift-network-operator/iptables-alerter-snsz7"
Sep 10 04:41:02.861643 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.861360    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0d079061-d48c-4738-b43e-d489966ea9e6-etc-kubernetes\") pod \"tuned-wptnl\" (UID: \"0d079061-d48c-4738-b43e-d489966ea9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wptnl"
Sep 10 04:41:02.861643 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.861382    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0d079061-d48c-4738-b43e-d489966ea9e6-lib-modules\") pod \"tuned-wptnl\" (UID: \"0d079061-d48c-4738-b43e-d489966ea9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wptnl"
Sep 10 04:41:02.861643 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.861407    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e547a905-b80c-4247-b45b-71da7aeaf4e1-agent-certs\") pod \"konnectivity-agent-jrddm\" (UID: \"e547a905-b80c-4247-b45b-71da7aeaf4e1\") " pod="kube-system/konnectivity-agent-jrddm"
Sep 10 04:41:02.861643 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.861445    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8381d071-dc2a-4c80-888a-0fa7411a98fe-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hwrf7\" (UID: \"8381d071-dc2a-4c80-888a-0fa7411a98fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hwrf7"
Sep 10 04:41:02.861643 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.861469    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/046c184b-74c1-435f-aa43-942470639bdd-host-var-lib-kubelet\") pod \"multus-ctktw\" (UID: \"046c184b-74c1-435f-aa43-942470639bdd\") " pod="openshift-multus/multus-ctktw"
Sep 10 04:41:02.861643 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.861478    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8381d071-dc2a-4c80-888a-0fa7411a98fe-sys-fs\") pod \"aws-ebs-csi-driver-node-hwrf7\" (UID: \"8381d071-dc2a-4c80-888a-0fa7411a98fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hwrf7"
Sep 10 04:41:02.861643 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.861488    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5e472a47-9b1d-4f3e-be2f-36ac4b0ebc7f-original-pull-secret\") pod \"global-pull-secret-syncer-77cd4\" (UID: \"5e472a47-9b1d-4f3e-be2f-36ac4b0ebc7f\") " pod="kube-system/global-pull-secret-syncer-77cd4"
Sep 10 04:41:02.861643 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.861505    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c29c7fa4-b497-47b3-83b6-3711449979c9-systemd-units\") pod \"ovnkube-node-z79rt\" (UID: \"c29c7fa4-b497-47b3-83b6-3711449979c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-z79rt"
Sep 10 04:41:02.861643 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.861533    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c29c7fa4-b497-47b3-83b6-3711449979c9-host-slash\") pod \"ovnkube-node-z79rt\" (UID: \"c29c7fa4-b497-47b3-83b6-3711449979c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-z79rt"
Sep 10 04:41:02.861643 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.861552    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bckbd\" (UniqueName: \"kubernetes.io/projected/02552f59-e9e1-419f-b684-95357447d121-kube-api-access-bckbd\") pod \"multus-additional-cni-plugins-vhzvh\" (UID: \"02552f59-e9e1-419f-b684-95357447d121\") " pod="openshift-multus/multus-additional-cni-plugins-vhzvh"
Sep 10 04:41:02.861643 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.861570    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e547a905-b80c-4247-b45b-71da7aeaf4e1-konnectivity-ca\") pod \"konnectivity-agent-jrddm\" (UID: \"e547a905-b80c-4247-b45b-71da7aeaf4e1\") " pod="kube-system/konnectivity-agent-jrddm"
Sep 10 04:41:02.861643 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.861568    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/87caacb7-22ae-4c04-b8bf-4f72072b6372-host-slash\") pod \"iptables-alerter-snsz7\" (UID: \"87caacb7-22ae-4c04-b8bf-4f72072b6372\") " pod="openshift-network-operator/iptables-alerter-snsz7"
Sep 10 04:41:02.861643 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.861585    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8381d071-dc2a-4c80-888a-0fa7411a98fe-device-dir\") pod \"aws-ebs-csi-driver-node-hwrf7\" (UID: \"8381d071-dc2a-4c80-888a-0fa7411a98fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hwrf7"
Sep 10 04:41:02.862374 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.861650    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0d079061-d48c-4738-b43e-d489966ea9e6-etc-sysconfig\") pod \"tuned-wptnl\" (UID: \"0d079061-d48c-4738-b43e-d489966ea9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wptnl"
Sep 10 04:41:02.862374 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.861660    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8381d071-dc2a-4c80-888a-0fa7411a98fe-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hwrf7\" (UID: \"8381d071-dc2a-4c80-888a-0fa7411a98fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hwrf7"
Sep 10 04:41:02.862374 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.861669    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/046c184b-74c1-435f-aa43-942470639bdd-system-cni-dir\") pod \"multus-ctktw\" (UID: \"046c184b-74c1-435f-aa43-942470639bdd\") " pod="openshift-multus/multus-ctktw"
Sep 10 04:41:02.862374 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.861700    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/02552f59-e9e1-419f-b684-95357447d121-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vhzvh\" (UID: \"02552f59-e9e1-419f-b684-95357447d121\") " pod="openshift-multus/multus-additional-cni-plugins-vhzvh"
Sep 10 04:41:02.862374 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.861713    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/046c184b-74c1-435f-aa43-942470639bdd-host-var-lib-cni-bin\") pod \"multus-ctktw\" (UID: \"046c184b-74c1-435f-aa43-942470639bdd\") " pod="openshift-multus/multus-ctktw"
Sep 10 04:41:02.862374 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.861724    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c29c7fa4-b497-47b3-83b6-3711449979c9-var-lib-openvswitch\") pod \"ovnkube-node-z79rt\" (UID: \"c29c7fa4-b497-47b3-83b6-3711449979c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-z79rt"
Sep 10 04:41:02.862374 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.861751    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0d079061-d48c-4738-b43e-d489966ea9e6-etc-modprobe-d\") pod \"tuned-wptnl\" (UID: \"0d079061-d48c-4738-b43e-d489966ea9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wptnl"
Sep 10 04:41:02.862374 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.861772    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0d079061-d48c-4738-b43e-d489966ea9e6-etc-sysctl-conf\") pod \"tuned-wptnl\" (UID: \"0d079061-d48c-4738-b43e-d489966ea9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wptnl"
Sep 10 04:41:02.862374 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.861787    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0d079061-d48c-4738-b43e-d489966ea9e6-var-lib-kubelet\") pod \"tuned-wptnl\" (UID: \"0d079061-d48c-4738-b43e-d489966ea9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wptnl"
Sep 10 04:41:02.862374 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.861801    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0d079061-d48c-4738-b43e-d489966ea9e6-tmp\") pod \"tuned-wptnl\" (UID: \"0d079061-d48c-4738-b43e-d489966ea9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wptnl"
Sep 10 04:41:02.862374 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.861816    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/046c184b-74c1-435f-aa43-942470639bdd-host-var-lib-cni-multus\") pod \"multus-ctktw\" (UID: \"046c184b-74c1-435f-aa43-942470639bdd\") " pod="openshift-multus/multus-ctktw"
Sep 10 04:41:02.862374 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.861830    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5e472a47-9b1d-4f3e-be2f-36ac4b0ebc7f-kubelet-config\") pod \"global-pull-secret-syncer-77cd4\" (UID: \"5e472a47-9b1d-4f3e-be2f-36ac4b0ebc7f\") " pod="kube-system/global-pull-secret-syncer-77cd4"
Sep 10 04:41:02.862374 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.861870    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1e129b32-2387-4f9c-91b8-940841cb77cc-serviceca\") pod \"node-ca-h7swz\" (UID: \"1e129b32-2387-4f9c-91b8-940841cb77cc\") " pod="openshift-image-registry/node-ca-h7swz"
Sep 10 04:41:02.862374 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.861885    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jl5lf\" (UniqueName: \"kubernetes.io/projected/70619315-7b0a-40c0-82cf-a3f283ada09f-kube-api-access-jl5lf\") pod \"node-resolver-6c6hs\" (UID: \"70619315-7b0a-40c0-82cf-a3f283ada09f\") " pod="openshift-dns/node-resolver-6c6hs"
Sep 10 04:41:02.862374 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.861902    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/02552f59-e9e1-419f-b684-95357447d121-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vhzvh\" (UID: \"02552f59-e9e1-419f-b684-95357447d121\") " pod="openshift-multus/multus-additional-cni-plugins-vhzvh"
Sep 10 04:41:02.862374 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.861972    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0d079061-d48c-4738-b43e-d489966ea9e6-etc-sysctl-d\") pod \"tuned-wptnl\" (UID: \"0d079061-d48c-4738-b43e-d489966ea9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wptnl"
Sep 10 04:41:02.862374 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.862004    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/02552f59-e9e1-419f-b684-95357447d121-cnibin\") pod \"multus-additional-cni-plugins-vhzvh\" (UID: \"02552f59-e9e1-419f-b684-95357447d121\") " pod="openshift-multus/multus-additional-cni-plugins-vhzvh"
Sep 10 04:41:02.863173 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.862029    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c29c7fa4-b497-47b3-83b6-3711449979c9-etc-openvswitch\") pod \"ovnkube-node-z79rt\" (UID: \"c29c7fa4-b497-47b3-83b6-3711449979c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-z79rt"
Sep 10 04:41:02.863173 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.862039    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8381d071-dc2a-4c80-888a-0fa7411a98fe-device-dir\") pod \"aws-ebs-csi-driver-node-hwrf7\" (UID: \"8381d071-dc2a-4c80-888a-0fa7411a98fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hwrf7"
Sep 10 04:41:02.863173 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.862061    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c29c7fa4-b497-47b3-83b6-3711449979c9-systemd-units\") pod \"ovnkube-node-z79rt\" (UID: \"c29c7fa4-b497-47b3-83b6-3711449979c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-z79rt"
Sep 10 04:41:02.863173 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.862212    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e547a905-b80c-4247-b45b-71da7aeaf4e1-konnectivity-ca\") pod \"konnectivity-agent-jrddm\" (UID: \"e547a905-b80c-4247-b45b-71da7aeaf4e1\") " pod="kube-system/konnectivity-agent-jrddm"
Sep 10 04:41:02.863173 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.862229    2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 10 04:41:02.863173 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.862483    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/87caacb7-22ae-4c04-b8bf-4f72072b6372-iptables-alerter-script\") pod \"iptables-alerter-snsz7\" (UID: \"87caacb7-22ae-4c04-b8bf-4f72072b6372\") " pod="openshift-network-operator/iptables-alerter-snsz7"
Sep 10 04:41:02.863173 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.862623    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c29c7fa4-b497-47b3-83b6-3711449979c9-ovnkube-script-lib\") pod \"ovnkube-node-z79rt\" (UID: \"c29c7fa4-b497-47b3-83b6-3711449979c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-z79rt"
Sep 10 04:41:02.863173 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.862604    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/02552f59-e9e1-419f-b684-95357447d121-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vhzvh\" (UID: \"02552f59-e9e1-419f-b684-95357447d121\") " pod="openshift-multus/multus-additional-cni-plugins-vhzvh"
Sep 10 04:41:02.863173 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.862712    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/046c184b-74c1-435f-aa43-942470639bdd-multus-conf-dir\") pod \"multus-ctktw\" (UID: \"046c184b-74c1-435f-aa43-942470639bdd\") " pod="openshift-multus/multus-ctktw"
Sep 10 04:41:02.863173 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.862887    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c29c7fa4-b497-47b3-83b6-3711449979c9-run-ovn\") pod \"ovnkube-node-z79rt\" (UID: \"c29c7fa4-b497-47b3-83b6-3711449979c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-z79rt"
Sep 10 04:41:02.863173 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.862929    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c29c7fa4-b497-47b3-83b6-3711449979c9-ovnkube-config\") pod \"ovnkube-node-z79rt\" (UID: \"c29c7fa4-b497-47b3-83b6-3711449979c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-z79rt"
Sep 10 04:41:02.863173 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.862973    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8qvz\" (UniqueName: \"kubernetes.io/projected/87caacb7-22ae-4c04-b8bf-4f72072b6372-kube-api-access-c8qvz\") pod \"iptables-alerter-snsz7\" (UID: \"87caacb7-22ae-4c04-b8bf-4f72072b6372\") " pod="openshift-network-operator/iptables-alerter-snsz7"
Sep 10 04:41:02.863173 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.862991    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/02552f59-e9e1-419f-b684-95357447d121-cni-binary-copy\") pod \"multus-additional-cni-plugins-vhzvh\" (UID: \"02552f59-e9e1-419f-b684-95357447d121\") " pod="openshift-multus/multus-additional-cni-plugins-vhzvh"
Sep 10 04:41:02.863173 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.862994    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5e472a47-9b1d-4f3e-be2f-36ac4b0ebc7f-dbus\") pod \"global-pull-secret-syncer-77cd4\" (UID: \"5e472a47-9b1d-4f3e-be2f-36ac4b0ebc7f\") " pod="kube-system/global-pull-secret-syncer-77cd4"
Sep 10 04:41:02.863173 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.863080    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvxw2\" (UniqueName: \"kubernetes.io/projected/13570f73-c21d-4771-8349-f30c25ab27fb-kube-api-access-xvxw2\") pod \"network-metrics-daemon-n2sr7\" (UID: \"13570f73-c21d-4771-8349-f30c25ab27fb\") " pod="openshift-multus/network-metrics-daemon-n2sr7"
Sep 10 04:41:02.863173 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.863127    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c29c7fa4-b497-47b3-83b6-3711449979c9-run-openvswitch\") pod \"ovnkube-node-z79rt\" (UID: \"c29c7fa4-b497-47b3-83b6-3711449979c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-z79rt"
Sep 10 04:41:02.863173 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.863161    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c29c7fa4-b497-47b3-83b6-3711449979c9-host-run-netns\") pod \"ovnkube-node-z79rt\" (UID: \"c29c7fa4-b497-47b3-83b6-3711449979c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-z79rt"
Sep 10 04:41:02.863999 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.863208    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c29c7fa4-b497-47b3-83b6-3711449979c9-run-ovn\") pod \"ovnkube-node-z79rt\" (UID: \"c29c7fa4-b497-47b3-83b6-3711449979c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-z79rt"
Sep 10 04:41:02.863999 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.863353    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c29c7fa4-b497-47b3-83b6-3711449979c9-run-openvswitch\") pod \"ovnkube-node-z79rt\" (UID: \"c29c7fa4-b497-47b3-83b6-3711449979c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-z79rt"
Sep 10 04:41:02.863999 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.863367    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c29c7fa4-b497-47b3-83b6-3711449979c9-ovnkube-config\") pod \"ovnkube-node-z79rt\" (UID: \"c29c7fa4-b497-47b3-83b6-3711449979c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-z79rt"
Sep 10 04:41:02.863999 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.863417    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c29c7fa4-b497-47b3-83b6-3711449979c9-host-run-netns\") pod \"ovnkube-node-z79rt\" (UID: \"c29c7fa4-b497-47b3-83b6-3711449979c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-z79rt"
Sep 10 04:41:02.863999 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.863416    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/02552f59-e9e1-419f-b684-95357447d121-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vhzvh\" (UID: \"02552f59-e9e1-419f-b684-95357447d121\") " pod="openshift-multus/multus-additional-cni-plugins-vhzvh"
Sep 10 04:41:02.863999 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.863451    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0d079061-d48c-4738-b43e-d489966ea9e6-etc-systemd\") pod \"tuned-wptnl\" (UID: \"0d079061-d48c-4738-b43e-d489966ea9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wptnl"
Sep 10 04:41:02.863999 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.863494    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/02552f59-e9e1-419f-b684-95357447d121-system-cni-dir\") pod \"multus-additional-cni-plugins-vhzvh\" (UID: \"02552f59-e9e1-419f-b684-95357447d121\") " pod="openshift-multus/multus-additional-cni-plugins-vhzvh"
Sep 10 04:41:02.863999 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.863533    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/02552f59-e9e1-419f-b684-95357447d121-system-cni-dir\") pod \"multus-additional-cni-plugins-vhzvh\" (UID: \"02552f59-e9e1-419f-b684-95357447d121\") " pod="openshift-multus/multus-additional-cni-plugins-vhzvh"
Sep 10 04:41:02.863999 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.863563    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c29c7fa4-b497-47b3-83b6-3711449979c9-host-cni-netd\") pod \"ovnkube-node-z79rt\" (UID: \"c29c7fa4-b497-47b3-83b6-3711449979c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-z79rt"
Sep 10 04:41:02.863999 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.863620    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8381d071-dc2a-4c80-888a-0fa7411a98fe-etc-selinux\") pod \"aws-ebs-csi-driver-node-hwrf7\" (UID: \"8381d071-dc2a-4c80-888a-0fa7411a98fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hwrf7"
Sep 10 04:41:02.863999 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.863654    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0d079061-d48c-4738-b43e-d489966ea9e6-run\") pod \"tuned-wptnl\" (UID: \"0d079061-d48c-4738-b43e-d489966ea9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wptnl"
Sep 10 04:41:02.863999 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.863691    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c29c7fa4-b497-47b3-83b6-3711449979c9-host-kubelet\") pod \"ovnkube-node-z79rt\" (UID: \"c29c7fa4-b497-47b3-83b6-3711449979c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-z79rt"
Sep 10 04:41:02.863999 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.863719    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/046c184b-74c1-435f-aa43-942470639bdd-cni-binary-copy\") pod \"multus-ctktw\" (UID: \"046c184b-74c1-435f-aa43-942470639bdd\") " pod="openshift-multus/multus-ctktw"
Sep 10 04:41:02.863999 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.863753    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/046c184b-74c1-435f-aa43-942470639bdd-host-run-netns\") pod \"multus-ctktw\" (UID: \"046c184b-74c1-435f-aa43-942470639bdd\") " pod="openshift-multus/multus-ctktw"
Sep 10 04:41:02.863999 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.863777    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/046c184b-74c1-435f-aa43-942470639bdd-multus-daemon-config\") pod \"multus-ctktw\" (UID: \"046c184b-74c1-435f-aa43-942470639bdd\") " pod="openshift-multus/multus-ctktw"
Sep 10 04:41:02.863999 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.863817    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c29c7fa4-b497-47b3-83b6-3711449979c9-host-cni-bin\") pod \"ovnkube-node-z79rt\" (UID: \"c29c7fa4-b497-47b3-83b6-3711449979c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-z79rt"
Sep 10 04:41:02.863999 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.863834    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c29c7fa4-b497-47b3-83b6-3711449979c9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z79rt\" (UID: \"c29c7fa4-b497-47b3-83b6-3711449979c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-z79rt"
Sep 10 04:41:02.864818 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.863868    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c29c7fa4-b497-47b3-83b6-3711449979c9-env-overrides\") pod \"ovnkube-node-z79rt\" (UID: \"c29c7fa4-b497-47b3-83b6-3711449979c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-z79rt"
Sep 10 04:41:02.864818 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.863882    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/02552f59-e9e1-419f-b684-95357447d121-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vhzvh\" (UID: \"02552f59-e9e1-419f-b684-95357447d121\") " pod="openshift-multus/multus-additional-cni-plugins-vhzvh"
Sep 10 04:41:02.864818 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.863893    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8p9h4\" (UniqueName: \"kubernetes.io/projected/0d079061-d48c-4738-b43e-d489966ea9e6-kube-api-access-8p9h4\") pod \"tuned-wptnl\" (UID: \"0d079061-d48c-4738-b43e-d489966ea9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wptnl"
Sep 10 04:41:02.864818 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.863913    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8381d071-dc2a-4c80-888a-0fa7411a98fe-socket-dir\") pod \"aws-ebs-csi-driver-node-hwrf7\" (UID: \"8381d071-dc2a-4c80-888a-0fa7411a98fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hwrf7"
Sep 10 04:41:02.864818 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.863951    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c29c7fa4-b497-47b3-83b6-3711449979c9-host-cni-netd\") pod \"ovnkube-node-z79rt\" (UID: \"c29c7fa4-b497-47b3-83b6-3711449979c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-z79rt"
Sep 10 04:41:02.864818 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.863980    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qlrs\" (UniqueName: \"kubernetes.io/projected/8381d071-dc2a-4c80-888a-0fa7411a98fe-kube-api-access-4qlrs\") pod \"aws-ebs-csi-driver-node-hwrf7\" (UID: \"8381d071-dc2a-4c80-888a-0fa7411a98fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hwrf7"
Sep 10 04:41:02.864818 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.864013    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/046c184b-74c1-435f-aa43-942470639bdd-host-run-k8s-cni-cncf-io\") pod \"multus-ctktw\" (UID: \"046c184b-74c1-435f-aa43-942470639bdd\") " pod="openshift-multus/multus-ctktw"
Sep 10 04:41:02.864818 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.864032    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8381d071-dc2a-4c80-888a-0fa7411a98fe-socket-dir\") pod \"aws-ebs-csi-driver-node-hwrf7\" (UID: \"8381d071-dc2a-4c80-888a-0fa7411a98fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hwrf7"
Sep 10 04:41:02.864818 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.864058    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13570f73-c21d-4771-8349-f30c25ab27fb-metrics-certs\") pod \"network-metrics-daemon-n2sr7\" (UID: \"13570f73-c21d-4771-8349-f30c25ab27fb\") " pod="openshift-multus/network-metrics-daemon-n2sr7"
Sep 10 04:41:02.864818 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.864083    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0d079061-d48c-4738-b43e-d489966ea9e6-sys\") pod \"tuned-wptnl\" (UID: \"0d079061-d48c-4738-b43e-d489966ea9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wptnl"
Sep 10 04:41:02.864818 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.864109    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0d079061-d48c-4738-b43e-d489966ea9e6-host\") pod \"tuned-wptnl\" (UID: \"0d079061-d48c-4738-b43e-d489966ea9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wptnl"
Sep 10 04:41:02.864818 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.864133    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/046c184b-74c1-435f-aa43-942470639bdd-host-run-multus-certs\") pod \"multus-ctktw\" (UID: \"046c184b-74c1-435f-aa43-942470639bdd\") " pod="openshift-multus/multus-ctktw"
Sep 10 04:41:02.864818 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.864163    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c29c7fa4-b497-47b3-83b6-3711449979c9-run-systemd\") pod \"ovnkube-node-z79rt\" (UID: \"c29c7fa4-b497-47b3-83b6-3711449979c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-z79rt"
Sep 10 04:41:02.864818 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.864189    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c29c7fa4-b497-47b3-83b6-3711449979c9-log-socket\") pod \"ovnkube-node-z79rt\" (UID: \"c29c7fa4-b497-47b3-83b6-3711449979c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-z79rt"
Sep 10 04:41:02.864818 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.864084    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c29c7fa4-b497-47b3-83b6-3711449979c9-host-cni-bin\") pod \"ovnkube-node-z79rt\" (UID: \"c29c7fa4-b497-47b3-83b6-3711449979c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-z79rt"
Sep 10 04:41:02.864818 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.864248    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c29c7fa4-b497-47b3-83b6-3711449979c9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z79rt\" (UID: \"c29c7fa4-b497-47b3-83b6-3711449979c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-z79rt"
Sep 10 04:41:02.864818 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.864300    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c29c7fa4-b497-47b3-83b6-3711449979c9-host-run-ovn-kubernetes\") pod \"ovnkube-node-z79rt\" (UID: \"c29c7fa4-b497-47b3-83b6-3711449979c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-z79rt"
Sep 10 04:41:02.865620 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.864328    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8381d071-dc2a-4c80-888a-0fa7411a98fe-registration-dir\") pod \"aws-ebs-csi-driver-node-hwrf7\" (UID: \"8381d071-dc2a-4c80-888a-0fa7411a98fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hwrf7"
Sep 10 04:41:02.865620 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.864354    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0d079061-d48c-4738-b43e-d489966ea9e6-etc-tuned\") pod \"tuned-wptnl\" (UID: \"0d079061-d48c-4738-b43e-d489966ea9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wptnl"
Sep 10 04:41:02.865620 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.864378    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/046c184b-74c1-435f-aa43-942470639bdd-etc-kubernetes\") pod \"multus-ctktw\" (UID: \"046c184b-74c1-435f-aa43-942470639bdd\") " pod="openshift-multus/multus-ctktw"
Sep 10 04:41:02.865620 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.864404    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqtc6\" (UniqueName: \"kubernetes.io/projected/046c184b-74c1-435f-aa43-942470639bdd-kube-api-access-pqtc6\") pod \"multus-ctktw\" (UID: \"046c184b-74c1-435f-aa43-942470639bdd\") " pod="openshift-multus/multus-ctktw"
Sep 10 04:41:02.865620 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.864428    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rns82\" (UniqueName: \"kubernetes.io/projected/1e129b32-2387-4f9c-91b8-940841cb77cc-kube-api-access-rns82\") pod \"node-ca-h7swz\" (UID: \"1e129b32-2387-4f9c-91b8-940841cb77cc\") " pod="openshift-image-registry/node-ca-h7swz"
Sep 10 04:41:02.865620 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.864456    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c29c7fa4-b497-47b3-83b6-3711449979c9-node-log\") pod \"ovnkube-node-z79rt\" (UID: \"c29c7fa4-b497-47b3-83b6-3711449979c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-z79rt"
Sep 10 04:41:02.865620 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.864482    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zsr7\" (UniqueName: \"kubernetes.io/projected/d9c2d9dc-e666-442f-b8f4-98b917db1a7f-kube-api-access-4zsr7\") pod \"network-check-target-kq4qp\" (UID: \"d9c2d9dc-e666-442f-b8f4-98b917db1a7f\") " pod="openshift-network-diagnostics/network-check-target-kq4qp"
Sep 10 04:41:02.865620 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.864511    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c29c7fa4-b497-47b3-83b6-3711449979c9-env-overrides\") pod \"ovnkube-node-z79rt\" (UID: \"c29c7fa4-b497-47b3-83b6-3711449979c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-z79rt"
Sep 10 04:41:02.865620 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.864543    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/046c184b-74c1-435f-aa43-942470639bdd-cnibin\") pod \"multus-ctktw\" (UID: \"046c184b-74c1-435f-aa43-942470639bdd\") " pod="openshift-multus/multus-ctktw"
Sep 10 04:41:02.865620 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.864564    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c29c7fa4-b497-47b3-83b6-3711449979c9-log-socket\") pod \"ovnkube-node-z79rt\" (UID: \"c29c7fa4-b497-47b3-83b6-3711449979c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-z79rt"
Sep 10 04:41:02.865620 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.864606    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c29c7fa4-b497-47b3-83b6-3711449979c9-node-log\") pod \"ovnkube-node-z79rt\" (UID: \"c29c7fa4-b497-47b3-83b6-3711449979c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-z79rt"
Sep 10 04:41:02.865620 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.864616    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/046c184b-74c1-435f-aa43-942470639bdd-multus-socket-dir-parent\") pod \"multus-ctktw\" (UID: \"046c184b-74c1-435f-aa43-942470639bdd\") " pod="openshift-multus/multus-ctktw"
Sep 10 04:41:02.865620 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.864643    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c29c7fa4-b497-47b3-83b6-3711449979c9-run-systemd\") pod \"ovnkube-node-z79rt\" (UID: \"c29c7fa4-b497-47b3-83b6-3711449979c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-z79rt"
Sep 10 04:41:02.865620 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.864643    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1e129b32-2387-4f9c-91b8-940841cb77cc-host\") pod \"node-ca-h7swz\" (UID: \"1e129b32-2387-4f9c-91b8-940841cb77cc\") " pod="openshift-image-registry/node-ca-h7swz"
Sep 10 04:41:02.865620 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.864681    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70619315-7b0a-40c0-82cf-a3f283ada09f-tmp-dir\") pod \"node-resolver-6c6hs\" (UID: \"70619315-7b0a-40c0-82cf-a3f283ada09f\") " pod="openshift-dns/node-resolver-6c6hs"
Sep 10 04:41:02.865620 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.864697    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8381d071-dc2a-4c80-888a-0fa7411a98fe-registration-dir\") pod \"aws-ebs-csi-driver-node-hwrf7\" (UID: \"8381d071-dc2a-4c80-888a-0fa7411a98fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hwrf7"
Sep 10 04:41:02.865620 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.864732    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c29c7fa4-b497-47b3-83b6-3711449979c9-host-run-ovn-kubernetes\") pod \"ovnkube-node-z79rt\" (UID: \"c29c7fa4-b497-47b3-83b6-3711449979c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-z79rt"
Sep 10 04:41:02.866570 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.864769    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8381d071-dc2a-4c80-888a-0fa7411a98fe-etc-selinux\") pod \"aws-ebs-csi-driver-node-hwrf7\" (UID: \"8381d071-dc2a-4c80-888a-0fa7411a98fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hwrf7"
Sep 10 04:41:02.866570 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.864814    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c29c7fa4-b497-47b3-83b6-3711449979c9-host-kubelet\") pod \"ovnkube-node-z79rt\" (UID: \"c29c7fa4-b497-47b3-83b6-3711449979c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-z79rt"
Sep 10 04:41:02.866570 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.866067    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c29c7fa4-b497-47b3-83b6-3711449979c9-ovn-node-metrics-cert\") pod \"ovnkube-node-z79rt\" (UID: \"c29c7fa4-b497-47b3-83b6-3711449979c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-z79rt"
Sep 10 04:41:02.866570 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.866157    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e547a905-b80c-4247-b45b-71da7aeaf4e1-agent-certs\") pod \"konnectivity-agent-jrddm\" (UID: \"e547a905-b80c-4247-b45b-71da7aeaf4e1\") " pod="kube-system/konnectivity-agent-jrddm"
Sep 10 04:41:02.871242 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.871189    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdmsd\" (UniqueName: \"kubernetes.io/projected/c29c7fa4-b497-47b3-83b6-3711449979c9-kube-api-access-mdmsd\") pod \"ovnkube-node-z79rt\" (UID: \"c29c7fa4-b497-47b3-83b6-3711449979c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-z79rt"
Sep 10 04:41:02.874667 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.874645    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8qvz\" (UniqueName: \"kubernetes.io/projected/87caacb7-22ae-4c04-b8bf-4f72072b6372-kube-api-access-c8qvz\") pod \"iptables-alerter-snsz7\" (UID: \"87caacb7-22ae-4c04-b8bf-4f72072b6372\") " pod="openshift-network-operator/iptables-alerter-snsz7"
Sep 10 04:41:02.876744 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.876720    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qlrs\" (UniqueName: \"kubernetes.io/projected/8381d071-dc2a-4c80-888a-0fa7411a98fe-kube-api-access-4qlrs\") pod \"aws-ebs-csi-driver-node-hwrf7\" (UID: \"8381d071-dc2a-4c80-888a-0fa7411a98fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hwrf7"
Sep 10 04:41:02.877179 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.877158    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bckbd\" (UniqueName: \"kubernetes.io/projected/02552f59-e9e1-419f-b684-95357447d121-kube-api-access-bckbd\") pod \"multus-additional-cni-plugins-vhzvh\" (UID: \"02552f59-e9e1-419f-b684-95357447d121\") " pod="openshift-multus/multus-additional-cni-plugins-vhzvh"
Sep 10 04:41:02.965673 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.965642    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5e472a47-9b1d-4f3e-be2f-36ac4b0ebc7f-dbus\") pod \"global-pull-secret-syncer-77cd4\" (UID: \"5e472a47-9b1d-4f3e-be2f-36ac4b0ebc7f\") " pod="kube-system/global-pull-secret-syncer-77cd4"
Sep 10 04:41:02.965871 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.965684    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvxw2\" (UniqueName: \"kubernetes.io/projected/13570f73-c21d-4771-8349-f30c25ab27fb-kube-api-access-xvxw2\") pod \"network-metrics-daemon-n2sr7\" (UID: \"13570f73-c21d-4771-8349-f30c25ab27fb\") " pod="openshift-multus/network-metrics-daemon-n2sr7"
Sep 10 04:41:02.965871 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.965713    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0d079061-d48c-4738-b43e-d489966ea9e6-etc-systemd\") pod \"tuned-wptnl\" (UID: \"0d079061-d48c-4738-b43e-d489966ea9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wptnl"
Sep 10 04:41:02.965871 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.965738    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0d079061-d48c-4738-b43e-d489966ea9e6-run\") pod \"tuned-wptnl\" (UID: \"0d079061-d48c-4738-b43e-d489966ea9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wptnl"
Sep 10 04:41:02.965871 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.965761    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/046c184b-74c1-435f-aa43-942470639bdd-cni-binary-copy\") pod \"multus-ctktw\" (UID: \"046c184b-74c1-435f-aa43-942470639bdd\") " pod="openshift-multus/multus-ctktw"
Sep 10 04:41:02.965871 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.965784    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/046c184b-74c1-435f-aa43-942470639bdd-host-run-netns\") pod \"multus-ctktw\" (UID: \"046c184b-74c1-435f-aa43-942470639bdd\") " pod="openshift-multus/multus-ctktw"
Sep 10 04:41:02.965871 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.965807    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/046c184b-74c1-435f-aa43-942470639bdd-multus-daemon-config\") pod \"multus-ctktw\" (UID: \"046c184b-74c1-435f-aa43-942470639bdd\") " pod="openshift-multus/multus-ctktw"
Sep 10 04:41:02.965871 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.965833    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8p9h4\" (UniqueName: \"kubernetes.io/projected/0d079061-d48c-4738-b43e-d489966ea9e6-kube-api-access-8p9h4\") pod \"tuned-wptnl\" (UID: \"0d079061-d48c-4738-b43e-d489966ea9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wptnl"
Sep 10 04:41:02.965871 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.965842    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0d079061-d48c-4738-b43e-d489966ea9e6-run\") pod \"tuned-wptnl\" (UID: \"0d079061-d48c-4738-b43e-d489966ea9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wptnl"
Sep 10 04:41:02.965871 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.965873    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/046c184b-74c1-435f-aa43-942470639bdd-host-run-k8s-cni-cncf-io\") pod \"multus-ctktw\" (UID: \"046c184b-74c1-435f-aa43-942470639bdd\") " pod="openshift-multus/multus-ctktw"
Sep 10 04:41:02.966314 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.965897    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13570f73-c21d-4771-8349-f30c25ab27fb-metrics-certs\") pod \"network-metrics-daemon-n2sr7\" (UID: \"13570f73-c21d-4771-8349-f30c25ab27fb\") " pod="openshift-multus/network-metrics-daemon-n2sr7"
Sep 10 04:41:02.966314 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.965918    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0d079061-d48c-4738-b43e-d489966ea9e6-sys\") pod \"tuned-wptnl\" (UID: \"0d079061-d48c-4738-b43e-d489966ea9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wptnl"
Sep 10 04:41:02.966314 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.965924    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0d079061-d48c-4738-b43e-d489966ea9e6-etc-systemd\") pod \"tuned-wptnl\" (UID: \"0d079061-d48c-4738-b43e-d489966ea9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wptnl"
Sep 10 04:41:02.966314 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.965940    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0d079061-d48c-4738-b43e-d489966ea9e6-host\") pod \"tuned-wptnl\" (UID: \"0d079061-d48c-4738-b43e-d489966ea9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wptnl"
Sep 10 04:41:02.966314 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.965962    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/046c184b-74c1-435f-aa43-942470639bdd-host-run-multus-certs\") pod \"multus-ctktw\" (UID: \"046c184b-74c1-435f-aa43-942470639bdd\") " pod="openshift-multus/multus-ctktw"
Sep 10 04:41:02.966314 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.965986    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0d079061-d48c-4738-b43e-d489966ea9e6-etc-tuned\") pod \"tuned-wptnl\" (UID: \"0d079061-d48c-4738-b43e-d489966ea9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wptnl"
Sep 10 04:41:02.966314 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.966008    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/046c184b-74c1-435f-aa43-942470639bdd-etc-kubernetes\") pod \"multus-ctktw\" (UID: \"046c184b-74c1-435f-aa43-942470639bdd\") " pod="openshift-multus/multus-ctktw"
Sep 10 04:41:02.966314 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.966035    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5e472a47-9b1d-4f3e-be2f-36ac4b0ebc7f-dbus\") pod \"global-pull-secret-syncer-77cd4\" (UID: \"5e472a47-9b1d-4f3e-be2f-36ac4b0ebc7f\") " pod="kube-system/global-pull-secret-syncer-77cd4"
Sep 10 04:41:02.966314 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.966103    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqtc6\" (UniqueName: \"kubernetes.io/projected/046c184b-74c1-435f-aa43-942470639bdd-kube-api-access-pqtc6\") pod \"multus-ctktw\" (UID: \"046c184b-74c1-435f-aa43-942470639bdd\") " pod="openshift-multus/multus-ctktw"
Sep 10 04:41:02.966314 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.966107    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0d079061-d48c-4738-b43e-d489966ea9e6-host\") pod \"tuned-wptnl\" (UID: \"0d079061-d48c-4738-b43e-d489966ea9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wptnl"
Sep 10 04:41:02.966314 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.966137    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rns82\" (UniqueName: \"kubernetes.io/projected/1e129b32-2387-4f9c-91b8-940841cb77cc-kube-api-access-rns82\") pod \"node-ca-h7swz\" (UID: \"1e129b32-2387-4f9c-91b8-940841cb77cc\") " pod="openshift-image-registry/node-ca-h7swz"
Sep 10 04:41:02.966314 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.966173    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zsr7\" (UniqueName: \"kubernetes.io/projected/d9c2d9dc-e666-442f-b8f4-98b917db1a7f-kube-api-access-4zsr7\") pod \"network-check-target-kq4qp\" (UID: \"d9c2d9dc-e666-442f-b8f4-98b917db1a7f\") " pod="openshift-network-diagnostics/network-check-target-kq4qp"
Sep 10 04:41:02.966314 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.966198    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/046c184b-74c1-435f-aa43-942470639bdd-cnibin\") pod \"multus-ctktw\" (UID: \"046c184b-74c1-435f-aa43-942470639bdd\") " pod="openshift-multus/multus-ctktw"
Sep 10 04:41:02.966314 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.966220    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/046c184b-74c1-435f-aa43-942470639bdd-multus-socket-dir-parent\") pod \"multus-ctktw\" (UID: \"046c184b-74c1-435f-aa43-942470639bdd\") " pod="openshift-multus/multus-ctktw"
Sep 10 04:41:02.966314 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.966241    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1e129b32-2387-4f9c-91b8-940841cb77cc-host\") pod \"node-ca-h7swz\" (UID: \"1e129b32-2387-4f9c-91b8-940841cb77cc\") " pod="openshift-image-registry/node-ca-h7swz"
Sep 10 04:41:02.966314 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.966264    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70619315-7b0a-40c0-82cf-a3f283ada09f-tmp-dir\") pod \"node-resolver-6c6hs\" (UID: \"70619315-7b0a-40c0-82cf-a3f283ada09f\") " pod="openshift-dns/node-resolver-6c6hs"
Sep 10 04:41:02.966314 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.966289    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/046c184b-74c1-435f-aa43-942470639bdd-hostroot\") pod \"multus-ctktw\" (UID: \"046c184b-74c1-435f-aa43-942470639bdd\") " pod="openshift-multus/multus-ctktw"
Sep 10 04:41:02.966314 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.966313    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/046c184b-74c1-435f-aa43-942470639bdd-multus-cni-dir\") pod \"multus-ctktw\" (UID: \"046c184b-74c1-435f-aa43-942470639bdd\") " pod="openshift-multus/multus-ctktw"
Sep 10 04:41:02.967227 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.966336    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/70619315-7b0a-40c0-82cf-a3f283ada09f-hosts-file\") pod \"node-resolver-6c6hs\" (UID: \"70619315-7b0a-40c0-82cf-a3f283ada09f\") " pod="openshift-dns/node-resolver-6c6hs"
Sep 10 04:41:02.967227 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.966369    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0d079061-d48c-4738-b43e-d489966ea9e6-etc-kubernetes\") pod \"tuned-wptnl\" (UID: \"0d079061-d48c-4738-b43e-d489966ea9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wptnl"
Sep 10 04:41:02.967227 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.966388    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/046c184b-74c1-435f-aa43-942470639bdd-etc-kubernetes\") pod \"multus-ctktw\" (UID: \"046c184b-74c1-435f-aa43-942470639bdd\") " pod="openshift-multus/multus-ctktw"
Sep 10 04:41:02.967227 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.966389    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0d079061-d48c-4738-b43e-d489966ea9e6-lib-modules\") pod \"tuned-wptnl\" (UID: \"0d079061-d48c-4738-b43e-d489966ea9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wptnl"
Sep 10 04:41:02.967227 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.966434    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/046c184b-74c1-435f-aa43-942470639bdd-host-run-multus-certs\") pod \"multus-ctktw\" (UID: \"046c184b-74c1-435f-aa43-942470639bdd\") " pod="openshift-multus/multus-ctktw"
Sep 10 04:41:02.967227 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.966460    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/046c184b-74c1-435f-aa43-942470639bdd-cnibin\") pod \"multus-ctktw\" (UID: \"046c184b-74c1-435f-aa43-942470639bdd\") " pod="openshift-multus/multus-ctktw"
Sep 10 04:41:02.967227 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.966500    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0d079061-d48c-4738-b43e-d489966ea9e6-lib-modules\") pod \"tuned-wptnl\" (UID: \"0d079061-d48c-4738-b43e-d489966ea9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wptnl"
Sep 10 04:41:02.967227 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:02.966532    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 04:41:02.967227 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.966564    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/046c184b-74c1-435f-aa43-942470639bdd-host-var-lib-kubelet\") pod \"multus-ctktw\" (UID: \"046c184b-74c1-435f-aa43-942470639bdd\") " pod="openshift-multus/multus-ctktw"
Sep 10 04:41:02.967227 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:02.966594    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13570f73-c21d-4771-8349-f30c25ab27fb-metrics-certs podName:13570f73-c21d-4771-8349-f30c25ab27fb nodeName:}" failed. No retries permitted until 2026-09-10 04:41:03.466574116 +0000 UTC m=+3.129031856 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/13570f73-c21d-4771-8349-f30c25ab27fb-metrics-certs") pod "network-metrics-daemon-n2sr7" (UID: "13570f73-c21d-4771-8349-f30c25ab27fb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 04:41:02.967227 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.966610    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/046c184b-74c1-435f-aa43-942470639bdd-host-var-lib-kubelet\") pod \"multus-ctktw\" (UID: \"046c184b-74c1-435f-aa43-942470639bdd\") " pod="openshift-multus/multus-ctktw"
Sep 10 04:41:02.967227 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.966644    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/046c184b-74c1-435f-aa43-942470639bdd-cni-binary-copy\") pod \"multus-ctktw\" (UID: \"046c184b-74c1-435f-aa43-942470639bdd\") " pod="openshift-multus/multus-ctktw"
Sep 10 04:41:02.967227 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.966653    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/046c184b-74c1-435f-aa43-942470639bdd-host-run-k8s-cni-cncf-io\") pod \"multus-ctktw\" (UID: \"046c184b-74c1-435f-aa43-942470639bdd\") " pod="openshift-multus/multus-ctktw"
Sep 10 04:41:02.967227 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.966659    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5e472a47-9b1d-4f3e-be2f-36ac4b0ebc7f-original-pull-secret\") pod \"global-pull-secret-syncer-77cd4\" (UID: \"5e472a47-9b1d-4f3e-be2f-36ac4b0ebc7f\") " pod="kube-system/global-pull-secret-syncer-77cd4"
Sep 10 04:41:02.967227 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.966698    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0d079061-d48c-4738-b43e-d489966ea9e6-sys\") pod \"tuned-wptnl\" (UID: \"0d079061-d48c-4738-b43e-d489966ea9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wptnl"
Sep 10 04:41:02.967227 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.966702    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0d079061-d48c-4738-b43e-d489966ea9e6-etc-sysconfig\") pod \"tuned-wptnl\" (UID: \"0d079061-d48c-4738-b43e-d489966ea9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wptnl"
Sep 10 04:41:02.967227 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.966727    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/046c184b-74c1-435f-aa43-942470639bdd-system-cni-dir\") pod \"multus-ctktw\" (UID: \"046c184b-74c1-435f-aa43-942470639bdd\") " pod="openshift-multus/multus-ctktw"
Sep 10 04:41:02.967227 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:02.966744    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 04:41:02.968084 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.966755    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/046c184b-74c1-435f-aa43-942470639bdd-host-var-lib-cni-bin\") pod \"multus-ctktw\" (UID: \"046c184b-74c1-435f-aa43-942470639bdd\") " pod="openshift-multus/multus-ctktw"
Sep 10 04:41:02.968084 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:02.966771    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e472a47-9b1d-4f3e-be2f-36ac4b0ebc7f-original-pull-secret podName:5e472a47-9b1d-4f3e-be2f-36ac4b0ebc7f nodeName:}" failed. No retries permitted until 2026-09-10 04:41:03.466763027 +0000 UTC m=+3.129220752 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5e472a47-9b1d-4f3e-be2f-36ac4b0ebc7f-original-pull-secret") pod "global-pull-secret-syncer-77cd4" (UID: "5e472a47-9b1d-4f3e-be2f-36ac4b0ebc7f") : object "kube-system"/"original-pull-secret" not registered
Sep 10 04:41:02.968084 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.966795    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/046c184b-74c1-435f-aa43-942470639bdd-host-var-lib-cni-bin\") pod \"multus-ctktw\" (UID: \"046c184b-74c1-435f-aa43-942470639bdd\") " pod="openshift-multus/multus-ctktw"
Sep 10 04:41:02.968084 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.966798    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0d079061-d48c-4738-b43e-d489966ea9e6-etc-modprobe-d\") pod \"tuned-wptnl\" (UID: \"0d079061-d48c-4738-b43e-d489966ea9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wptnl"
Sep 10 04:41:02.968084 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.966831    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0d079061-d48c-4738-b43e-d489966ea9e6-etc-sysctl-conf\") pod \"tuned-wptnl\" (UID: \"0d079061-d48c-4738-b43e-d489966ea9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wptnl"
Sep 10 04:41:02.968084 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.966872    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0d079061-d48c-4738-b43e-d489966ea9e6-var-lib-kubelet\") pod \"tuned-wptnl\" (UID: \"0d079061-d48c-4738-b43e-d489966ea9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wptnl"
Sep 10 04:41:02.968084 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.966890    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0d079061-d48c-4738-b43e-d489966ea9e6-etc-modprobe-d\") pod \"tuned-wptnl\" (UID: \"0d079061-d48c-4738-b43e-d489966ea9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wptnl"
Sep 10 04:41:02.968084 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.966889    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0d079061-d48c-4738-b43e-d489966ea9e6-etc-sysconfig\") pod \"tuned-wptnl\" (UID: \"0d079061-d48c-4738-b43e-d489966ea9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wptnl"
Sep 10 04:41:02.968084 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.966896    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0d079061-d48c-4738-b43e-d489966ea9e6-tmp\") pod \"tuned-wptnl\" (UID: \"0d079061-d48c-4738-b43e-d489966ea9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wptnl"
Sep 10 04:41:02.968084 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.966924    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/046c184b-74c1-435f-aa43-942470639bdd-hostroot\") pod \"multus-ctktw\" (UID: \"046c184b-74c1-435f-aa43-942470639bdd\") " pod="openshift-multus/multus-ctktw"
Sep 10 04:41:02.968084 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.966951    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/046c184b-74c1-435f-aa43-942470639bdd-host-var-lib-cni-multus\") pod \"multus-ctktw\" (UID: \"046c184b-74c1-435f-aa43-942470639bdd\") " pod="openshift-multus/multus-ctktw"
Sep 10 04:41:02.968084 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.966957    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/046c184b-74c1-435f-aa43-942470639bdd-multus-socket-dir-parent\") pod \"multus-ctktw\" (UID: \"046c184b-74c1-435f-aa43-942470639bdd\") " pod="openshift-multus/multus-ctktw"
Sep 10 04:41:02.968084 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.966945    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/046c184b-74c1-435f-aa43-942470639bdd-multus-daemon-config\") pod \"multus-ctktw\" (UID: \"046c184b-74c1-435f-aa43-942470639bdd\") " pod="openshift-multus/multus-ctktw"
Sep 10 04:41:02.968084 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.966986    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/70619315-7b0a-40c0-82cf-a3f283ada09f-hosts-file\") pod \"node-resolver-6c6hs\" (UID: \"70619315-7b0a-40c0-82cf-a3f283ada09f\") " pod="openshift-dns/node-resolver-6c6hs"
Sep 10 04:41:02.968084 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.966983    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/046c184b-74c1-435f-aa43-942470639bdd-host-run-netns\") pod \"multus-ctktw\" (UID: \"046c184b-74c1-435f-aa43-942470639bdd\") " pod="openshift-multus/multus-ctktw"
Sep 10 04:41:02.968084 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.967012    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1e129b32-2387-4f9c-91b8-940841cb77cc-host\") pod \"node-ca-h7swz\" (UID: \"1e129b32-2387-4f9c-91b8-940841cb77cc\") " pod="openshift-image-registry/node-ca-h7swz"
Sep 10 04:41:02.968084 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.967031    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/046c184b-74c1-435f-aa43-942470639bdd-multus-cni-dir\") pod \"multus-ctktw\" (UID: \"046c184b-74c1-435f-aa43-942470639bdd\") " pod="openshift-multus/multus-ctktw"
Sep 10 04:41:02.968884 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.967056    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/046c184b-74c1-435f-aa43-942470639bdd-host-var-lib-cni-multus\") pod \"multus-ctktw\" (UID: \"046c184b-74c1-435f-aa43-942470639bdd\") " pod="openshift-multus/multus-ctktw"
Sep 10 04:41:02.968884 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.967062    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5e472a47-9b1d-4f3e-be2f-36ac4b0ebc7f-kubelet-config\") pod \"global-pull-secret-syncer-77cd4\" (UID: \"5e472a47-9b1d-4f3e-be2f-36ac4b0ebc7f\") " pod="kube-system/global-pull-secret-syncer-77cd4"
Sep 10 04:41:02.968884 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.967072    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0d079061-d48c-4738-b43e-d489966ea9e6-etc-kubernetes\") pod \"tuned-wptnl\" (UID: \"0d079061-d48c-4738-b43e-d489966ea9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wptnl"
Sep 10 04:41:02.968884 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.967089    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1e129b32-2387-4f9c-91b8-940841cb77cc-serviceca\") pod \"node-ca-h7swz\" (UID: \"1e129b32-2387-4f9c-91b8-940841cb77cc\") " pod="openshift-image-registry/node-ca-h7swz"
Sep 10 04:41:02.968884 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.967109    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0d079061-d48c-4738-b43e-d489966ea9e6-var-lib-kubelet\") pod \"tuned-wptnl\" (UID: \"0d079061-d48c-4738-b43e-d489966ea9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wptnl"
Sep 10 04:41:02.968884 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.967118    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5e472a47-9b1d-4f3e-be2f-36ac4b0ebc7f-kubelet-config\") pod \"global-pull-secret-syncer-77cd4\" (UID: \"5e472a47-9b1d-4f3e-be2f-36ac4b0ebc7f\") " pod="kube-system/global-pull-secret-syncer-77cd4"
Sep 10 04:41:02.968884 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.967136    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/046c184b-74c1-435f-aa43-942470639bdd-system-cni-dir\") pod \"multus-ctktw\" (UID: \"046c184b-74c1-435f-aa43-942470639bdd\") " pod="openshift-multus/multus-ctktw"
Sep 10 04:41:02.968884 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.967114    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jl5lf\" (UniqueName: \"kubernetes.io/projected/70619315-7b0a-40c0-82cf-a3f283ada09f-kube-api-access-jl5lf\") pod \"node-resolver-6c6hs\" (UID: \"70619315-7b0a-40c0-82cf-a3f283ada09f\") " pod="openshift-dns/node-resolver-6c6hs"
Sep 10 04:41:02.968884 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.967186    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0d079061-d48c-4738-b43e-d489966ea9e6-etc-sysctl-d\") pod \"tuned-wptnl\" (UID: \"0d079061-d48c-4738-b43e-d489966ea9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wptnl"
Sep 10 04:41:02.968884 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.967212    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/046c184b-74c1-435f-aa43-942470639bdd-multus-conf-dir\") pod \"multus-ctktw\" (UID: \"046c184b-74c1-435f-aa43-942470639bdd\") " pod="openshift-multus/multus-ctktw"
Sep 10 04:41:02.968884 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.967273    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/046c184b-74c1-435f-aa43-942470639bdd-multus-conf-dir\") pod \"multus-ctktw\" (UID: \"046c184b-74c1-435f-aa43-942470639bdd\") " pod="openshift-multus/multus-ctktw"
Sep 10 04:41:02.968884 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.967383    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0d079061-d48c-4738-b43e-d489966ea9e6-etc-sysctl-d\") pod \"tuned-wptnl\" (UID: \"0d079061-d48c-4738-b43e-d489966ea9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wptnl"
Sep 10 04:41:02.968884 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.967388    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0d079061-d48c-4738-b43e-d489966ea9e6-etc-sysctl-conf\") pod \"tuned-wptnl\" (UID: \"0d079061-d48c-4738-b43e-d489966ea9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wptnl"
Sep 10 04:41:02.968884 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.967475    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70619315-7b0a-40c0-82cf-a3f283ada09f-tmp-dir\") pod \"node-resolver-6c6hs\" (UID: \"70619315-7b0a-40c0-82cf-a3f283ada09f\") " pod="openshift-dns/node-resolver-6c6hs"
Sep 10 04:41:02.968884 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.967568    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1e129b32-2387-4f9c-91b8-940841cb77cc-serviceca\") pod \"node-ca-h7swz\" (UID: \"1e129b32-2387-4f9c-91b8-940841cb77cc\") " pod="openshift-image-registry/node-ca-h7swz"
Sep 10 04:41:02.969716 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.969671    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0d079061-d48c-4738-b43e-d489966ea9e6-etc-tuned\") pod \"tuned-wptnl\" (UID: \"0d079061-d48c-4738-b43e-d489966ea9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wptnl"
Sep 10 04:41:02.969716 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.969699    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0d079061-d48c-4738-b43e-d489966ea9e6-tmp\") pod \"tuned-wptnl\" (UID: \"0d079061-d48c-4738-b43e-d489966ea9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wptnl"
Sep 10 04:41:02.978540 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:02.978244    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 04:41:02.978540 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:02.978265    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 04:41:02.978540 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:02.978280    2560 projected.go:196] Error preparing data for projected volume kube-api-access-4zsr7 for pod openshift-network-diagnostics/network-check-target-kq4qp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 04:41:02.978540 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:02.978343    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d9c2d9dc-e666-442f-b8f4-98b917db1a7f-kube-api-access-4zsr7 podName:d9c2d9dc-e666-442f-b8f4-98b917db1a7f nodeName:}" failed. No retries permitted until 2026-09-10 04:41:03.478326763 +0000 UTC m=+3.140784493 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-4zsr7" (UniqueName: "kubernetes.io/projected/d9c2d9dc-e666-442f-b8f4-98b917db1a7f-kube-api-access-4zsr7") pod "network-check-target-kq4qp" (UID: "d9c2d9dc-e666-442f-b8f4-98b917db1a7f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 04:41:02.979133 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.979102    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvxw2\" (UniqueName: \"kubernetes.io/projected/13570f73-c21d-4771-8349-f30c25ab27fb-kube-api-access-xvxw2\") pod \"network-metrics-daemon-n2sr7\" (UID: \"13570f73-c21d-4771-8349-f30c25ab27fb\") " pod="openshift-multus/network-metrics-daemon-n2sr7"
Sep 10 04:41:02.979740 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.979709    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqtc6\" (UniqueName: \"kubernetes.io/projected/046c184b-74c1-435f-aa43-942470639bdd-kube-api-access-pqtc6\") pod \"multus-ctktw\" (UID: \"046c184b-74c1-435f-aa43-942470639bdd\") " pod="openshift-multus/multus-ctktw"
Sep 10 04:41:02.980420 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.980393    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8p9h4\" (UniqueName: \"kubernetes.io/projected/0d079061-d48c-4738-b43e-d489966ea9e6-kube-api-access-8p9h4\") pod \"tuned-wptnl\" (UID: \"0d079061-d48c-4738-b43e-d489966ea9e6\") " pod="openshift-cluster-node-tuning-operator/tuned-wptnl"
Sep 10 04:41:02.982023 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.981994    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jl5lf\" (UniqueName: \"kubernetes.io/projected/70619315-7b0a-40c0-82cf-a3f283ada09f-kube-api-access-jl5lf\") pod \"node-resolver-6c6hs\" (UID: \"70619315-7b0a-40c0-82cf-a3f283ada09f\") " pod="openshift-dns/node-resolver-6c6hs"
Sep 10 04:41:02.982114 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:02.981998    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rns82\" (UniqueName: \"kubernetes.io/projected/1e129b32-2387-4f9c-91b8-940841cb77cc-kube-api-access-rns82\") pod \"node-ca-h7swz\" (UID: \"1e129b32-2387-4f9c-91b8-940841cb77cc\") " pod="openshift-image-registry/node-ca-h7swz"
Sep 10 04:41:03.049943 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:03.049914    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vhzvh"
Sep 10 04:41:03.056461 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:03.056437    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-z79rt"
Sep 10 04:41:03.063690 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:03.063655    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02552f59_e9e1_419f_b684_95357447d121.slice/crio-527f69ca0e277249fcd9bc2528fc07f70b1f171f5c1878a3d921bcfe4d995f21 WatchSource:0}: Error finding container 527f69ca0e277249fcd9bc2528fc07f70b1f171f5c1878a3d921bcfe4d995f21: Status 404 returned error can't find the container with id 527f69ca0e277249fcd9bc2528fc07f70b1f171f5c1878a3d921bcfe4d995f21
Sep 10 04:41:03.066225 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:03.066063    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-snsz7"
Sep 10 04:41:03.068370 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:03.068345    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc29c7fa4_b497_47b3_83b6_3711449979c9.slice/crio-dad3190dbfb6e2049e3e84bb7ccbc8f3059af5cea2751b758564235c9ce6abe7 WatchSource:0}: Error finding container dad3190dbfb6e2049e3e84bb7ccbc8f3059af5cea2751b758564235c9ce6abe7: Status 404 returned error can't find the container with id dad3190dbfb6e2049e3e84bb7ccbc8f3059af5cea2751b758564235c9ce6abe7
Sep 10 04:41:03.073086 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:03.073066    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jrddm"
Sep 10 04:41:03.076641 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:03.076620    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87caacb7_22ae_4c04_b8bf_4f72072b6372.slice/crio-edb46aec65106843f7fbc150a1a0055458cc1afe0f7db2ec4b8e6f541310c816 WatchSource:0}: Error finding container edb46aec65106843f7fbc150a1a0055458cc1afe0f7db2ec4b8e6f541310c816: Status 404 returned error can't find the container with id edb46aec65106843f7fbc150a1a0055458cc1afe0f7db2ec4b8e6f541310c816
Sep 10 04:41:03.079208 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:03.079191    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hwrf7"
Sep 10 04:41:03.083151 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:03.083129    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode547a905_b80c_4247_b45b_71da7aeaf4e1.slice/crio-734d2dd0efe68e83208fda07ed420f961652d9d1302a77c7e7da366fd9bf42fe WatchSource:0}: Error finding container 734d2dd0efe68e83208fda07ed420f961652d9d1302a77c7e7da366fd9bf42fe: Status 404 returned error can't find the container with id 734d2dd0efe68e83208fda07ed420f961652d9d1302a77c7e7da366fd9bf42fe
Sep 10 04:41:03.087019 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:03.086998    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wptnl"
Sep 10 04:41:03.089769 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:03.089708    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8381d071_dc2a_4c80_888a_0fa7411a98fe.slice/crio-de5081afddb19d72a64337a016b0833fc540104be0842846f3b9506cde8e18f9 WatchSource:0}: Error finding container de5081afddb19d72a64337a016b0833fc540104be0842846f3b9506cde8e18f9: Status 404 returned error can't find the container with id de5081afddb19d72a64337a016b0833fc540104be0842846f3b9506cde8e18f9
Sep 10 04:41:03.093993 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:03.093975    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ctktw"
Sep 10 04:41:03.098766 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:03.098745    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d079061_d48c_4738_b43e_d489966ea9e6.slice/crio-6ad88caf118ea4d937f780b0236c4cc3e396ed9158d78302cb99c9548220ba07 WatchSource:0}: Error finding container 6ad88caf118ea4d937f780b0236c4cc3e396ed9158d78302cb99c9548220ba07: Status 404 returned error can't find the container with id 6ad88caf118ea4d937f780b0236c4cc3e396ed9158d78302cb99c9548220ba07
Sep 10 04:41:03.103828 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:03.103808    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6c6hs"
Sep 10 04:41:03.104208 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:03.104186    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod046c184b_74c1_435f_aa43_942470639bdd.slice/crio-5e016d02e8190bfc9705e526b5dbe3dc7492f849dc45879f6ab21edbb0b2a6ea WatchSource:0}: Error finding container 5e016d02e8190bfc9705e526b5dbe3dc7492f849dc45879f6ab21edbb0b2a6ea: Status 404 returned error can't find the container with id 5e016d02e8190bfc9705e526b5dbe3dc7492f849dc45879f6ab21edbb0b2a6ea
Sep 10 04:41:03.107502 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:03.107471    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-h7swz"
Sep 10 04:41:03.115946 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:03.115926    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70619315_7b0a_40c0_82cf_a3f283ada09f.slice/crio-a6d2133dcd4813798123896bfb398f577611a8df91eb93fe3dfbb89d124b7a91 WatchSource:0}: Error finding container a6d2133dcd4813798123896bfb398f577611a8df91eb93fe3dfbb89d124b7a91: Status 404 returned error can't find the container with id a6d2133dcd4813798123896bfb398f577611a8df91eb93fe3dfbb89d124b7a91
Sep 10 04:41:03.118829 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:03.118807    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e129b32_2387_4f9c_91b8_940841cb77cc.slice/crio-a39b676534c615ec5c1cb732a52f45cb474ccb451cd4245c4757e0d0b2e03b10 WatchSource:0}: Error finding container a39b676534c615ec5c1cb732a52f45cb474ccb451cd4245c4757e0d0b2e03b10: Status 404 returned error can't find the container with id a39b676534c615ec5c1cb732a52f45cb474ccb451cd4245c4757e0d0b2e03b10
Sep 10 04:41:03.470634 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:03.470560    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13570f73-c21d-4771-8349-f30c25ab27fb-metrics-certs\") pod \"network-metrics-daemon-n2sr7\" (UID: \"13570f73-c21d-4771-8349-f30c25ab27fb\") " pod="openshift-multus/network-metrics-daemon-n2sr7"
Sep 10 04:41:03.470634 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:03.470627    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5e472a47-9b1d-4f3e-be2f-36ac4b0ebc7f-original-pull-secret\") pod \"global-pull-secret-syncer-77cd4\" (UID: \"5e472a47-9b1d-4f3e-be2f-36ac4b0ebc7f\") " pod="kube-system/global-pull-secret-syncer-77cd4"
Sep 10 04:41:03.470818 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:03.470724    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 04:41:03.470818 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:03.470794    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13570f73-c21d-4771-8349-f30c25ab27fb-metrics-certs podName:13570f73-c21d-4771-8349-f30c25ab27fb nodeName:}" failed. No retries permitted until 2026-09-10 04:41:04.470774368 +0000 UTC m=+4.133232105 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/13570f73-c21d-4771-8349-f30c25ab27fb-metrics-certs") pod "network-metrics-daemon-n2sr7" (UID: "13570f73-c21d-4771-8349-f30c25ab27fb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 04:41:03.470939 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:03.470727    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 04:41:03.470939 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:03.470911    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e472a47-9b1d-4f3e-be2f-36ac4b0ebc7f-original-pull-secret podName:5e472a47-9b1d-4f3e-be2f-36ac4b0ebc7f nodeName:}" failed. No retries permitted until 2026-09-10 04:41:04.47088896 +0000 UTC m=+4.133346699 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5e472a47-9b1d-4f3e-be2f-36ac4b0ebc7f-original-pull-secret") pod "global-pull-secret-syncer-77cd4" (UID: "5e472a47-9b1d-4f3e-be2f-36ac4b0ebc7f") : object "kube-system"/"original-pull-secret" not registered
Sep 10 04:41:03.571392 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:03.571358    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zsr7\" (UniqueName: \"kubernetes.io/projected/d9c2d9dc-e666-442f-b8f4-98b917db1a7f-kube-api-access-4zsr7\") pod \"network-check-target-kq4qp\" (UID: \"d9c2d9dc-e666-442f-b8f4-98b917db1a7f\") " pod="openshift-network-diagnostics/network-check-target-kq4qp"
Sep 10 04:41:03.571532 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:03.571506    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 04:41:03.571532 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:03.571525    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 04:41:03.571599 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:03.571534    2560 projected.go:196] Error preparing data for projected volume kube-api-access-4zsr7 for pod openshift-network-diagnostics/network-check-target-kq4qp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 04:41:03.571599 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:03.571581    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d9c2d9dc-e666-442f-b8f4-98b917db1a7f-kube-api-access-4zsr7 podName:d9c2d9dc-e666-442f-b8f4-98b917db1a7f nodeName:}" failed. No retries permitted until 2026-09-10 04:41:04.571566239 +0000 UTC m=+4.234023971 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-4zsr7" (UniqueName: "kubernetes.io/projected/d9c2d9dc-e666-442f-b8f4-98b917db1a7f-kube-api-access-4zsr7") pod "network-check-target-kq4qp" (UID: "d9c2d9dc-e666-442f-b8f4-98b917db1a7f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 04:41:03.800236 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:03.800128    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 04:36:02 +0000 UTC" deadline="2028-06-03 15:22:55.706387658 +0000 UTC"
Sep 10 04:41:03.800236 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:03.800185    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15178h41m51.906209091s"
Sep 10 04:41:03.830312 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:03.830275    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z79rt" event={"ID":"c29c7fa4-b497-47b3-83b6-3711449979c9","Type":"ContainerStarted","Data":"dad3190dbfb6e2049e3e84bb7ccbc8f3059af5cea2751b758564235c9ce6abe7"}
Sep 10 04:41:03.832531 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:03.832497    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6c6hs" event={"ID":"70619315-7b0a-40c0-82cf-a3f283ada09f","Type":"ContainerStarted","Data":"a6d2133dcd4813798123896bfb398f577611a8df91eb93fe3dfbb89d124b7a91"}
Sep 10 04:41:03.834092 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:03.834066    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ctktw" event={"ID":"046c184b-74c1-435f-aa43-942470639bdd","Type":"ContainerStarted","Data":"5e016d02e8190bfc9705e526b5dbe3dc7492f849dc45879f6ab21edbb0b2a6ea"}
Sep 10 04:41:03.835550 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:03.835496    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hwrf7" event={"ID":"8381d071-dc2a-4c80-888a-0fa7411a98fe","Type":"ContainerStarted","Data":"de5081afddb19d72a64337a016b0833fc540104be0842846f3b9506cde8e18f9"}
Sep 10 04:41:03.841290 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:03.841265    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jrddm" event={"ID":"e547a905-b80c-4247-b45b-71da7aeaf4e1","Type":"ContainerStarted","Data":"734d2dd0efe68e83208fda07ed420f961652d9d1302a77c7e7da366fd9bf42fe"}
Sep 10 04:41:03.842775 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:03.842753    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-snsz7" event={"ID":"87caacb7-22ae-4c04-b8bf-4f72072b6372","Type":"ContainerStarted","Data":"edb46aec65106843f7fbc150a1a0055458cc1afe0f7db2ec4b8e6f541310c816"}
Sep 10 04:41:03.846001 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:03.845946    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vhzvh" event={"ID":"02552f59-e9e1-419f-b684-95357447d121","Type":"ContainerStarted","Data":"527f69ca0e277249fcd9bc2528fc07f70b1f171f5c1878a3d921bcfe4d995f21"}
Sep 10 04:41:03.848284 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:03.848235    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-h7swz" event={"ID":"1e129b32-2387-4f9c-91b8-940841cb77cc","Type":"ContainerStarted","Data":"a39b676534c615ec5c1cb732a52f45cb474ccb451cd4245c4757e0d0b2e03b10"}
Sep 10 04:41:03.849802 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:03.849761    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wptnl" event={"ID":"0d079061-d48c-4738-b43e-d489966ea9e6","Type":"ContainerStarted","Data":"6ad88caf118ea4d937f780b0236c4cc3e396ed9158d78302cb99c9548220ba07"}
Sep 10 04:41:04.479390 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:04.478599    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5e472a47-9b1d-4f3e-be2f-36ac4b0ebc7f-original-pull-secret\") pod \"global-pull-secret-syncer-77cd4\" (UID: \"5e472a47-9b1d-4f3e-be2f-36ac4b0ebc7f\") " pod="kube-system/global-pull-secret-syncer-77cd4"
Sep 10 04:41:04.479390 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:04.478679    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13570f73-c21d-4771-8349-f30c25ab27fb-metrics-certs\") pod \"network-metrics-daemon-n2sr7\" (UID: \"13570f73-c21d-4771-8349-f30c25ab27fb\") " pod="openshift-multus/network-metrics-daemon-n2sr7"
Sep 10 04:41:04.479390 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:04.478843    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 04:41:04.479390 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:04.478919    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13570f73-c21d-4771-8349-f30c25ab27fb-metrics-certs podName:13570f73-c21d-4771-8349-f30c25ab27fb nodeName:}" failed. No retries permitted until 2026-09-10 04:41:06.478901347 +0000 UTC m=+6.141359087 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/13570f73-c21d-4771-8349-f30c25ab27fb-metrics-certs") pod "network-metrics-daemon-n2sr7" (UID: "13570f73-c21d-4771-8349-f30c25ab27fb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 04:41:04.479390 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:04.479289    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 04:41:04.479390 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:04.479336    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e472a47-9b1d-4f3e-be2f-36ac4b0ebc7f-original-pull-secret podName:5e472a47-9b1d-4f3e-be2f-36ac4b0ebc7f nodeName:}" failed. No retries permitted until 2026-09-10 04:41:06.479320212 +0000 UTC m=+6.141777943 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5e472a47-9b1d-4f3e-be2f-36ac4b0ebc7f-original-pull-secret") pod "global-pull-secret-syncer-77cd4" (UID: "5e472a47-9b1d-4f3e-be2f-36ac4b0ebc7f") : object "kube-system"/"original-pull-secret" not registered
Sep 10 04:41:04.579932 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:04.579897    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zsr7\" (UniqueName: \"kubernetes.io/projected/d9c2d9dc-e666-442f-b8f4-98b917db1a7f-kube-api-access-4zsr7\") pod \"network-check-target-kq4qp\" (UID: \"d9c2d9dc-e666-442f-b8f4-98b917db1a7f\") " pod="openshift-network-diagnostics/network-check-target-kq4qp"
Sep 10 04:41:04.580172 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:04.580117    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 04:41:04.580172 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:04.580138    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 04:41:04.580172 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:04.580151    2560 projected.go:196] Error preparing data for projected volume kube-api-access-4zsr7 for pod openshift-network-diagnostics/network-check-target-kq4qp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 04:41:04.580349 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:04.580209    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d9c2d9dc-e666-442f-b8f4-98b917db1a7f-kube-api-access-4zsr7 podName:d9c2d9dc-e666-442f-b8f4-98b917db1a7f nodeName:}" failed. No retries permitted until 2026-09-10 04:41:06.580192192 +0000 UTC m=+6.242649923 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-4zsr7" (UniqueName: "kubernetes.io/projected/d9c2d9dc-e666-442f-b8f4-98b917db1a7f-kube-api-access-4zsr7") pod "network-check-target-kq4qp" (UID: "d9c2d9dc-e666-442f-b8f4-98b917db1a7f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 04:41:04.803811 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:04.803727    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 04:36:02 +0000 UTC" deadline="2028-03-24 21:52:49.731890188 +0000 UTC"
Sep 10 04:41:04.803811 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:04.803766    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13481h11m44.928127903s"
Sep 10 04:41:04.821494 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:04.821466    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kq4qp"
Sep 10 04:41:04.821641 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:04.821585    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kq4qp" podUID="d9c2d9dc-e666-442f-b8f4-98b917db1a7f"
Sep 10 04:41:04.821997 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:04.821975    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-77cd4"
Sep 10 04:41:04.822149 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:04.822119    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-77cd4" podUID="5e472a47-9b1d-4f3e-be2f-36ac4b0ebc7f"
Sep 10 04:41:04.822216 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:04.822186    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n2sr7"
Sep 10 04:41:04.822299 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:04.822272    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n2sr7" podUID="13570f73-c21d-4771-8349-f30c25ab27fb"
Sep 10 04:41:05.871683 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:05.871403    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-27.ec2.internal" event={"ID":"08157110d78d292dae4b05db5b9fb1a8","Type":"ContainerStarted","Data":"6488d8a86266c518faed08e435fed5d6e2277398748a6d87d29c97ff88499ffc"}
Sep 10 04:41:05.890960 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:05.890906    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-27.ec2.internal" podStartSLOduration=3.890890692 podStartE2EDuration="3.890890692s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 04:41:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:41:05.890062386 +0000 UTC m=+5.552520135" watchObservedRunningTime="2026-09-10 04:41:05.890890692 +0000 UTC m=+5.553348438"
Sep 10 04:41:06.495547 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:06.495512    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13570f73-c21d-4771-8349-f30c25ab27fb-metrics-certs\") pod \"network-metrics-daemon-n2sr7\" (UID: \"13570f73-c21d-4771-8349-f30c25ab27fb\") " pod="openshift-multus/network-metrics-daemon-n2sr7"
Sep 10 04:41:06.495737 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:06.495597    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5e472a47-9b1d-4f3e-be2f-36ac4b0ebc7f-original-pull-secret\") pod \"global-pull-secret-syncer-77cd4\" (UID: \"5e472a47-9b1d-4f3e-be2f-36ac4b0ebc7f\") " pod="kube-system/global-pull-secret-syncer-77cd4"
Sep 10 04:41:06.495807 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:06.495735    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 04:41:06.495807 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:06.495797    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e472a47-9b1d-4f3e-be2f-36ac4b0ebc7f-original-pull-secret podName:5e472a47-9b1d-4f3e-be2f-36ac4b0ebc7f nodeName:}" failed. No retries permitted until 2026-09-10 04:41:10.495778457 +0000 UTC m=+10.158236184 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5e472a47-9b1d-4f3e-be2f-36ac4b0ebc7f-original-pull-secret") pod "global-pull-secret-syncer-77cd4" (UID: "5e472a47-9b1d-4f3e-be2f-36ac4b0ebc7f") : object "kube-system"/"original-pull-secret" not registered
Sep 10 04:41:06.495978 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:06.495961    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 04:41:06.496042 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:06.496012    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13570f73-c21d-4771-8349-f30c25ab27fb-metrics-certs podName:13570f73-c21d-4771-8349-f30c25ab27fb nodeName:}" failed. No retries permitted until 2026-09-10 04:41:10.495998576 +0000 UTC m=+10.158456304 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/13570f73-c21d-4771-8349-f30c25ab27fb-metrics-certs") pod "network-metrics-daemon-n2sr7" (UID: "13570f73-c21d-4771-8349-f30c25ab27fb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 04:41:06.596819 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:06.596782    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zsr7\" (UniqueName: \"kubernetes.io/projected/d9c2d9dc-e666-442f-b8f4-98b917db1a7f-kube-api-access-4zsr7\") pod \"network-check-target-kq4qp\" (UID: \"d9c2d9dc-e666-442f-b8f4-98b917db1a7f\") " pod="openshift-network-diagnostics/network-check-target-kq4qp"
Sep 10 04:41:06.597006 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:06.596978    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 04:41:06.597006 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:06.596998    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 04:41:06.597122 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:06.597010    2560 projected.go:196] Error preparing data for projected volume kube-api-access-4zsr7 for pod openshift-network-diagnostics/network-check-target-kq4qp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 04:41:06.597122 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:06.597065    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d9c2d9dc-e666-442f-b8f4-98b917db1a7f-kube-api-access-4zsr7 podName:d9c2d9dc-e666-442f-b8f4-98b917db1a7f nodeName:}" failed. No retries permitted until 2026-09-10 04:41:10.597049116 +0000 UTC m=+10.259506854 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-4zsr7" (UniqueName: "kubernetes.io/projected/d9c2d9dc-e666-442f-b8f4-98b917db1a7f-kube-api-access-4zsr7") pod "network-check-target-kq4qp" (UID: "d9c2d9dc-e666-442f-b8f4-98b917db1a7f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 04:41:06.820015 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:06.819948    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kq4qp"
Sep 10 04:41:06.820162 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:06.820063    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kq4qp" podUID="d9c2d9dc-e666-442f-b8f4-98b917db1a7f"
Sep 10 04:41:06.820438 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:06.820422    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-77cd4"
Sep 10 04:41:06.820545 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:06.820511    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-77cd4" podUID="5e472a47-9b1d-4f3e-be2f-36ac4b0ebc7f"
Sep 10 04:41:06.822037 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:06.821997    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n2sr7"
Sep 10 04:41:06.822154 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:06.822104    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n2sr7" podUID="13570f73-c21d-4771-8349-f30c25ab27fb"
Sep 10 04:41:06.878107 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:06.878075    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-27.ec2.internal" event={"ID":"80e4dc2a5b117e5d41646dac820795d0","Type":"ContainerStarted","Data":"5384531adab1f999bd80c8db5d4851826ee2076f8548d1499cd1fde55c80a1e9"}
Sep 10 04:41:08.818909 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:08.818825    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-77cd4"
Sep 10 04:41:08.818909 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:08.818885    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kq4qp"
Sep 10 04:41:08.819400 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:08.818827    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n2sr7"
Sep 10 04:41:08.819400 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:08.819019    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-77cd4" podUID="5e472a47-9b1d-4f3e-be2f-36ac4b0ebc7f"
Sep 10 04:41:08.819400 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:08.819147    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n2sr7" podUID="13570f73-c21d-4771-8349-f30c25ab27fb"
Sep 10 04:41:08.819400 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:08.819224    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kq4qp" podUID="d9c2d9dc-e666-442f-b8f4-98b917db1a7f"
Sep 10 04:41:08.884815 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:08.883975    2560 generic.go:356] "Generic (PLEG): container finished" podID="80e4dc2a5b117e5d41646dac820795d0" containerID="5384531adab1f999bd80c8db5d4851826ee2076f8548d1499cd1fde55c80a1e9" exitCode=0
Sep 10 04:41:08.884815 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:08.884032    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-27.ec2.internal" event={"ID":"80e4dc2a5b117e5d41646dac820795d0","Type":"ContainerDied","Data":"5384531adab1f999bd80c8db5d4851826ee2076f8548d1499cd1fde55c80a1e9"}
Sep 10 04:41:10.529104 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:10.529069    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13570f73-c21d-4771-8349-f30c25ab27fb-metrics-certs\") pod \"network-metrics-daemon-n2sr7\" (UID: \"13570f73-c21d-4771-8349-f30c25ab27fb\") " pod="openshift-multus/network-metrics-daemon-n2sr7"
Sep 10 04:41:10.529649 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:10.529145    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5e472a47-9b1d-4f3e-be2f-36ac4b0ebc7f-original-pull-secret\") pod \"global-pull-secret-syncer-77cd4\" (UID: \"5e472a47-9b1d-4f3e-be2f-36ac4b0ebc7f\") " pod="kube-system/global-pull-secret-syncer-77cd4"
Sep 10 04:41:10.529649 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:10.529250    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 04:41:10.529649 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:10.529311    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e472a47-9b1d-4f3e-be2f-36ac4b0ebc7f-original-pull-secret podName:5e472a47-9b1d-4f3e-be2f-36ac4b0ebc7f nodeName:}" failed. No retries permitted until 2026-09-10 04:41:18.52929312 +0000 UTC m=+18.191750851 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5e472a47-9b1d-4f3e-be2f-36ac4b0ebc7f-original-pull-secret") pod "global-pull-secret-syncer-77cd4" (UID: "5e472a47-9b1d-4f3e-be2f-36ac4b0ebc7f") : object "kube-system"/"original-pull-secret" not registered
Sep 10 04:41:10.529649 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:10.529250    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 04:41:10.529649 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:10.529366    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13570f73-c21d-4771-8349-f30c25ab27fb-metrics-certs podName:13570f73-c21d-4771-8349-f30c25ab27fb nodeName:}" failed. No retries permitted until 2026-09-10 04:41:18.529353349 +0000 UTC m=+18.191811079 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/13570f73-c21d-4771-8349-f30c25ab27fb-metrics-certs") pod "network-metrics-daemon-n2sr7" (UID: "13570f73-c21d-4771-8349-f30c25ab27fb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 04:41:10.629657 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:10.629576    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zsr7\" (UniqueName: \"kubernetes.io/projected/d9c2d9dc-e666-442f-b8f4-98b917db1a7f-kube-api-access-4zsr7\") pod \"network-check-target-kq4qp\" (UID: \"d9c2d9dc-e666-442f-b8f4-98b917db1a7f\") " pod="openshift-network-diagnostics/network-check-target-kq4qp"
Sep 10 04:41:10.629807 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:10.629738    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 04:41:10.629807 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:10.629761    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 04:41:10.629807 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:10.629772    2560 projected.go:196] Error preparing data for projected volume kube-api-access-4zsr7 for pod openshift-network-diagnostics/network-check-target-kq4qp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 04:41:10.629995 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:10.629825    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d9c2d9dc-e666-442f-b8f4-98b917db1a7f-kube-api-access-4zsr7 podName:d9c2d9dc-e666-442f-b8f4-98b917db1a7f nodeName:}" failed. No retries permitted until 2026-09-10 04:41:18.629808444 +0000 UTC m=+18.292266169 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-4zsr7" (UniqueName: "kubernetes.io/projected/d9c2d9dc-e666-442f-b8f4-98b917db1a7f-kube-api-access-4zsr7") pod "network-check-target-kq4qp" (UID: "d9c2d9dc-e666-442f-b8f4-98b917db1a7f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 04:41:10.820261 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:10.820187    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n2sr7"
Sep 10 04:41:10.820942 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:10.820251    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kq4qp"
Sep 10 04:41:10.820942 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:10.820274    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-77cd4"
Sep 10 04:41:10.820942 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:10.820581    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n2sr7" podUID="13570f73-c21d-4771-8349-f30c25ab27fb"
Sep 10 04:41:10.820942 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:10.820655    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-77cd4" podUID="5e472a47-9b1d-4f3e-be2f-36ac4b0ebc7f"
Sep 10 04:41:10.820942 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:10.820736    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kq4qp" podUID="d9c2d9dc-e666-442f-b8f4-98b917db1a7f"
Sep 10 04:41:12.819384 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:12.819340    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kq4qp"
Sep 10 04:41:12.819927 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:12.819351    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n2sr7"
Sep 10 04:41:12.819927 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:12.819473    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kq4qp" podUID="d9c2d9dc-e666-442f-b8f4-98b917db1a7f"
Sep 10 04:41:12.819927 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:12.819591    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n2sr7" podUID="13570f73-c21d-4771-8349-f30c25ab27fb"
Sep 10 04:41:12.819927 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:12.819664    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-77cd4"
Sep 10 04:41:12.819927 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:12.819756    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-77cd4" podUID="5e472a47-9b1d-4f3e-be2f-36ac4b0ebc7f"
Sep 10 04:41:14.818903 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:14.818867    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kq4qp"
Sep 10 04:41:14.818903 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:14.818887    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n2sr7"
Sep 10 04:41:14.819378 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:14.818867    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-77cd4"
Sep 10 04:41:14.819378 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:14.818994    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kq4qp" podUID="d9c2d9dc-e666-442f-b8f4-98b917db1a7f"
Sep 10 04:41:14.819378 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:14.819079    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-77cd4" podUID="5e472a47-9b1d-4f3e-be2f-36ac4b0ebc7f"
Sep 10 04:41:14.819378 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:14.819161    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n2sr7" podUID="13570f73-c21d-4771-8349-f30c25ab27fb"
Sep 10 04:41:16.819206 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:16.819170    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kq4qp"
Sep 10 04:41:16.819626 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:16.819185    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-77cd4"
Sep 10 04:41:16.819626 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:16.819290    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n2sr7"
Sep 10 04:41:16.819626 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:16.819280    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kq4qp" podUID="d9c2d9dc-e666-442f-b8f4-98b917db1a7f"
Sep 10 04:41:16.819626 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:16.819373    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-77cd4" podUID="5e472a47-9b1d-4f3e-be2f-36ac4b0ebc7f"
Sep 10 04:41:16.819626 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:16.819456    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n2sr7" podUID="13570f73-c21d-4771-8349-f30c25ab27fb"
Sep 10 04:41:18.585528 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:18.585493    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13570f73-c21d-4771-8349-f30c25ab27fb-metrics-certs\") pod \"network-metrics-daemon-n2sr7\" (UID: \"13570f73-c21d-4771-8349-f30c25ab27fb\") " pod="openshift-multus/network-metrics-daemon-n2sr7"
Sep 10 04:41:18.586062 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:18.585559    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5e472a47-9b1d-4f3e-be2f-36ac4b0ebc7f-original-pull-secret\") pod \"global-pull-secret-syncer-77cd4\" (UID: \"5e472a47-9b1d-4f3e-be2f-36ac4b0ebc7f\") " pod="kube-system/global-pull-secret-syncer-77cd4"
Sep 10 04:41:18.586062 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:18.585663    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 04:41:18.586062 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:18.585679    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 04:41:18.586062 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:18.585723    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13570f73-c21d-4771-8349-f30c25ab27fb-metrics-certs podName:13570f73-c21d-4771-8349-f30c25ab27fb nodeName:}" failed. No retries permitted until 2026-09-10 04:41:34.585708616 +0000 UTC m=+34.248166346 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/13570f73-c21d-4771-8349-f30c25ab27fb-metrics-certs") pod "network-metrics-daemon-n2sr7" (UID: "13570f73-c21d-4771-8349-f30c25ab27fb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 04:41:18.586062 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:18.585738    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e472a47-9b1d-4f3e-be2f-36ac4b0ebc7f-original-pull-secret podName:5e472a47-9b1d-4f3e-be2f-36ac4b0ebc7f nodeName:}" failed. No retries permitted until 2026-09-10 04:41:34.585731663 +0000 UTC m=+34.248189389 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5e472a47-9b1d-4f3e-be2f-36ac4b0ebc7f-original-pull-secret") pod "global-pull-secret-syncer-77cd4" (UID: "5e472a47-9b1d-4f3e-be2f-36ac4b0ebc7f") : object "kube-system"/"original-pull-secret" not registered
Sep 10 04:41:18.686241 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:18.686207    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zsr7\" (UniqueName: \"kubernetes.io/projected/d9c2d9dc-e666-442f-b8f4-98b917db1a7f-kube-api-access-4zsr7\") pod \"network-check-target-kq4qp\" (UID: \"d9c2d9dc-e666-442f-b8f4-98b917db1a7f\") " pod="openshift-network-diagnostics/network-check-target-kq4qp"
Sep 10 04:41:18.686392 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:18.686350    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 04:41:18.686392 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:18.686367    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 04:41:18.686392 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:18.686377    2560 projected.go:196] Error preparing data for projected volume kube-api-access-4zsr7 for pod openshift-network-diagnostics/network-check-target-kq4qp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 04:41:18.686551 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:18.686429    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d9c2d9dc-e666-442f-b8f4-98b917db1a7f-kube-api-access-4zsr7 podName:d9c2d9dc-e666-442f-b8f4-98b917db1a7f nodeName:}" failed. No retries permitted until 2026-09-10 04:41:34.686411011 +0000 UTC m=+34.348868740 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-4zsr7" (UniqueName: "kubernetes.io/projected/d9c2d9dc-e666-442f-b8f4-98b917db1a7f-kube-api-access-4zsr7") pod "network-check-target-kq4qp" (UID: "d9c2d9dc-e666-442f-b8f4-98b917db1a7f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 04:41:18.818458 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:18.818429    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kq4qp"
Sep 10 04:41:18.818458 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:18.818440    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n2sr7"
Sep 10 04:41:18.818657 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:18.818428    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-77cd4"
Sep 10 04:41:18.818657 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:18.818545    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kq4qp" podUID="d9c2d9dc-e666-442f-b8f4-98b917db1a7f"
Sep 10 04:41:18.818657 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:18.818633    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-77cd4" podUID="5e472a47-9b1d-4f3e-be2f-36ac4b0ebc7f"
Sep 10 04:41:18.818786 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:18.818730    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n2sr7" podUID="13570f73-c21d-4771-8349-f30c25ab27fb"
Sep 10 04:41:20.819106 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:20.819074    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-77cd4"
Sep 10 04:41:20.819536 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:20.819175    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n2sr7"
Sep 10 04:41:20.819536 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:20.819174    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-77cd4" podUID="5e472a47-9b1d-4f3e-be2f-36ac4b0ebc7f"
Sep 10 04:41:20.819536 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:20.819201    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kq4qp"
Sep 10 04:41:20.819536 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:20.819303    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n2sr7" podUID="13570f73-c21d-4771-8349-f30c25ab27fb"
Sep 10 04:41:20.819536 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:20.819386    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kq4qp" podUID="d9c2d9dc-e666-442f-b8f4-98b917db1a7f"
Sep 10 04:41:21.909252 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:21.908817    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jrddm" event={"ID":"e547a905-b80c-4247-b45b-71da7aeaf4e1","Type":"ContainerStarted","Data":"5a0001c5d8f7aa5359212a75a6d9e8c55d46f6103e0c5b8af7f924188890c329"}
Sep 10 04:41:21.910489 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:21.910466    2560 generic.go:356] "Generic (PLEG): container finished" podID="02552f59-e9e1-419f-b684-95357447d121" containerID="4b6c3bae89c95244f1f4304dbf87039ea2bb45ce9b2dbb3e51a0ce311d9dc74d" exitCode=0
Sep 10 04:41:21.910599 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:21.910499    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vhzvh" event={"ID":"02552f59-e9e1-419f-b684-95357447d121","Type":"ContainerDied","Data":"4b6c3bae89c95244f1f4304dbf87039ea2bb45ce9b2dbb3e51a0ce311d9dc74d"}
Sep 10 04:41:21.912343 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:21.912316    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-h7swz" event={"ID":"1e129b32-2387-4f9c-91b8-940841cb77cc","Type":"ContainerStarted","Data":"674d42934fd6676b4fe1487e0f89819e4dcff538f8d88f7d3b25117f98f11e63"}
Sep 10 04:41:21.914351 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:21.914323    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wptnl" event={"ID":"0d079061-d48c-4738-b43e-d489966ea9e6","Type":"ContainerStarted","Data":"92e76609dfe0dca3a386443acaf9fc58f242cfd468d3e8f8240af38cddc1c456"}
Sep 10 04:41:21.917902 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:21.917882    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z79rt" event={"ID":"c29c7fa4-b497-47b3-83b6-3711449979c9","Type":"ContainerStarted","Data":"a3fbf7b0c7221dc84c1cc366aee5862e54ef719af553ac64bafc989bcf073fc1"}
Sep 10 04:41:21.918000 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:21.917954    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z79rt" event={"ID":"c29c7fa4-b497-47b3-83b6-3711449979c9","Type":"ContainerStarted","Data":"bfc13d23e58a8fb6a6547a4c94262946a0d678a3aad2877062b75392f2090b41"}
Sep 10 04:41:21.918068 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:21.918006    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z79rt" event={"ID":"c29c7fa4-b497-47b3-83b6-3711449979c9","Type":"ContainerStarted","Data":"76f345ecde479dcd9c409def295f0e0fff9047712c05793c14855eff1d277d66"}
Sep 10 04:41:21.918068 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:21.918053    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z79rt" event={"ID":"c29c7fa4-b497-47b3-83b6-3711449979c9","Type":"ContainerStarted","Data":"1eed5d70e3db7eadb98bc6a21513f7808dc90a001f7a93e46439e17f440507d3"}
Sep 10 04:41:21.918160 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:21.918099    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z79rt" event={"ID":"c29c7fa4-b497-47b3-83b6-3711449979c9","Type":"ContainerStarted","Data":"5de73e814fe927c72588d54eb9a79dbf21eee55a7b4f367c407b1dae867db7e4"}
Sep 10 04:41:21.918160 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:21.918147    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z79rt" event={"ID":"c29c7fa4-b497-47b3-83b6-3711449979c9","Type":"ContainerStarted","Data":"3fa7e51e253fece8f882c04ca2f2e5df5eee34d754672a9f48ac2e83ea81e6e3"}
Sep 10 04:41:21.919907 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:21.919883    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-27.ec2.internal" event={"ID":"80e4dc2a5b117e5d41646dac820795d0","Type":"ContainerStarted","Data":"72e9b65bab531b12eb206b155275ad81aa85c0c67a8e65a2d501a5d67fb9d84d"}
Sep 10 04:41:21.921378 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:21.921354    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6c6hs" event={"ID":"70619315-7b0a-40c0-82cf-a3f283ada09f","Type":"ContainerStarted","Data":"7ee63e00a023599daf14e959cc42ada2c15a69fcd15eaf8ab52890fdd9889a7f"}
Sep 10 04:41:21.923029 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:21.923005    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ctktw" event={"ID":"046c184b-74c1-435f-aa43-942470639bdd","Type":"ContainerStarted","Data":"9e58f09dfab9fe32ae3a4f62a3bbc978ad030a2a44e2e41e1de743954e5394a6"}
Sep 10 04:41:21.926318 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:21.926294    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hwrf7" event={"ID":"8381d071-dc2a-4c80-888a-0fa7411a98fe","Type":"ContainerStarted","Data":"c36bc9ab058b2baefa53fcd1f4c6bcfd8ccc40541256d4be7e4241ee798bfda3"}
Sep 10 04:41:21.926891 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:21.926830    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-jrddm" podStartSLOduration=7.131982929 podStartE2EDuration="20.926814816s" totalImagesPullingTime="13.794831887s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:41:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:41:21.926368187 +0000 UTC m=+21.588825934" watchObservedRunningTime="2026-09-10 04:41:21.926814816 +0000 UTC m=+21.589272566"
Sep 10 04:41:21.941303 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:21.941250    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-wptnl" podStartSLOduration=3.039632338 podStartE2EDuration="20.941235238s" totalImagesPullingTime="17.9016029s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 04:41:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:41:21.941204365 +0000 UTC m=+21.603662110" watchObservedRunningTime="2026-09-10 04:41:21.941235238 +0000 UTC m=+21.603693015"
Sep 10 04:41:21.958243 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:21.958202    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-ctktw" podStartSLOduration=2.961559653 podStartE2EDuration="20.958193447s" totalImagesPullingTime="17.996633794s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 04:41:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:41:21.957874234 +0000 UTC m=+21.620331976" watchObservedRunningTime="2026-09-10 04:41:21.958193447 +0000 UTC m=+21.620651198"
Sep 10 04:41:22.002561 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:22.002508    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-6c6hs" podStartSLOduration=3.119369074 podStartE2EDuration="21.002493269s" totalImagesPullingTime="17.883124195s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 04:41:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:41:21.984143426 +0000 UTC m=+21.646601169" watchObservedRunningTime="2026-09-10 04:41:22.002493269 +0000 UTC m=+21.664951019"
Sep 10 04:41:22.018945 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:22.017814    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-h7swz" podStartSLOduration=7.258325739 podStartE2EDuration="21.017795666s" totalImagesPullingTime="13.759469927s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 04:41:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:41:22.002634557 +0000 UTC m=+21.665092294" watchObservedRunningTime="2026-09-10 04:41:22.017795666 +0000 UTC m=+21.680253410"
Sep 10 04:41:22.018945 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:22.017991    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-27.ec2.internal" podStartSLOduration=20.017983154 podStartE2EDuration="20.017983154s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 04:41:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:41:22.017475396 +0000 UTC m=+21.679933135" watchObservedRunningTime="2026-09-10 04:41:22.017983154 +0000 UTC m=+21.680440903"
Sep 10 04:41:22.440410 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:22.440334    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-jrddm"
Sep 10 04:41:22.441309 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:22.441287    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-jrddm"
Sep 10 04:41:22.701718 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:22.701697    2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 10 04:41:22.813805 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:22.813719    2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-10T04:41:22.701714583Z","UUID":"81ae08ab-54d7-4ed9-ad16-4ffb4574b04e","Handler":null,"Name":"","Endpoint":""}
Sep 10 04:41:22.815093 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:22.815072    2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 10 04:41:22.815223 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:22.815108    2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 10 04:41:22.819026 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:22.818995    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n2sr7"
Sep 10 04:41:22.819202 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:22.819042    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kq4qp"
Sep 10 04:41:22.819202 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:22.819136    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n2sr7" podUID="13570f73-c21d-4771-8349-f30c25ab27fb"
Sep 10 04:41:22.819202 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:22.819200    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-77cd4"
Sep 10 04:41:22.819388 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:22.819291    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-77cd4" podUID="5e472a47-9b1d-4f3e-be2f-36ac4b0ebc7f"
Sep 10 04:41:22.819441 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:22.819397    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kq4qp" podUID="d9c2d9dc-e666-442f-b8f4-98b917db1a7f"
Sep 10 04:41:22.929445 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:22.929418    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-snsz7" event={"ID":"87caacb7-22ae-4c04-b8bf-4f72072b6372","Type":"ContainerStarted","Data":"0cdf7c7ef30c4062757017a06e7edaa18d47e5c2499ea70b809d655af9e98e49"}
Sep 10 04:41:22.931306 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:22.931280    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hwrf7" event={"ID":"8381d071-dc2a-4c80-888a-0fa7411a98fe","Type":"ContainerStarted","Data":"1f0f99af1cba30d649e0dbcdafcd023479980b5005c8de38a1f75c26e5046f83"}
Sep 10 04:41:22.931570 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:22.931553    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-jrddm"
Sep 10 04:41:22.932008 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:22.931994    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-jrddm"
Sep 10 04:41:22.948498 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:22.948403    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-snsz7" podStartSLOduration=4.043757839 podStartE2EDuration="21.948387696s" totalImagesPullingTime="17.904629857s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 04:41:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:41:22.948032525 +0000 UTC m=+22.610490273" watchObservedRunningTime="2026-09-10 04:41:22.948387696 +0000 UTC m=+22.610845447"
Sep 10 04:41:23.937737 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:23.937698    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z79rt" event={"ID":"c29c7fa4-b497-47b3-83b6-3711449979c9","Type":"ContainerStarted","Data":"095880a866fa811a0ce7e42151e58a9bede49ac236b2653da8ffa6dbd1a9a140"}
Sep 10 04:41:24.818865 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:24.818816    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n2sr7"
Sep 10 04:41:24.818865 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:24.818816    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-77cd4"
Sep 10 04:41:24.819173 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:24.818816    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kq4qp"
Sep 10 04:41:24.819173 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:24.818968    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n2sr7" podUID="13570f73-c21d-4771-8349-f30c25ab27fb"
Sep 10 04:41:24.819277 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:24.819084    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-77cd4" podUID="5e472a47-9b1d-4f3e-be2f-36ac4b0ebc7f"
Sep 10 04:41:24.819277 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:24.819188    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kq4qp" podUID="d9c2d9dc-e666-442f-b8f4-98b917db1a7f"
Sep 10 04:41:24.941943 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:24.941906    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hwrf7" event={"ID":"8381d071-dc2a-4c80-888a-0fa7411a98fe","Type":"ContainerStarted","Data":"1d6ab2bc8998e04bdcb9e0ddf1cec3aa545332b5792a1993b480268fcf2cbac2"}
Sep 10 04:41:24.957648 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:24.957603    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hwrf7" podStartSLOduration=3.526433856 podStartE2EDuration="23.95759118s" totalImagesPullingTime="20.431157324s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 04:41:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:41:24.957281727 +0000 UTC m=+24.619739474" watchObservedRunningTime="2026-09-10 04:41:24.95759118 +0000 UTC m=+24.620048926"
Sep 10 04:41:26.819116 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:26.819088    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n2sr7"
Sep 10 04:41:26.819116 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:26.819100    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kq4qp"
Sep 10 04:41:26.819506 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:26.819185    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n2sr7" podUID="13570f73-c21d-4771-8349-f30c25ab27fb"
Sep 10 04:41:26.819506 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:26.819270    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kq4qp" podUID="d9c2d9dc-e666-442f-b8f4-98b917db1a7f"
Sep 10 04:41:26.819506 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:26.819314    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-77cd4"
Sep 10 04:41:26.819506 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:26.819403    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-77cd4" podUID="5e472a47-9b1d-4f3e-be2f-36ac4b0ebc7f"
Sep 10 04:41:27.953440 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:27.953188    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z79rt" event={"ID":"c29c7fa4-b497-47b3-83b6-3711449979c9","Type":"ContainerStarted","Data":"3f4874e910f691e2d9832859c93ac230cafdd77b3f881ae0bcc4cf1bbaf24291"}
Sep 10 04:41:27.953963 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:27.953522    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-z79rt"
Sep 10 04:41:27.953963 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:27.953576    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-z79rt"
Sep 10 04:41:27.955269 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:27.955246    2560 generic.go:356] "Generic (PLEG): container finished" podID="02552f59-e9e1-419f-b684-95357447d121" containerID="c28f69e79133e734abc86385fb60edc223dd70b79f8eedd7642bc49ec05d4ca1" exitCode=0
Sep 10 04:41:27.955365 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:27.955276    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vhzvh" event={"ID":"02552f59-e9e1-419f-b684-95357447d121","Type":"ContainerDied","Data":"c28f69e79133e734abc86385fb60edc223dd70b79f8eedd7642bc49ec05d4ca1"}
Sep 10 04:41:27.969086 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:27.969066    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-z79rt"
Sep 10 04:41:27.980966 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:27.980912    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-z79rt" podStartSLOduration=10.036463905 podStartE2EDuration="27.980899689s" totalImagesPullingTime="17.944435784s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 04:41:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:41:27.980639565 +0000 UTC m=+27.643097313" watchObservedRunningTime="2026-09-10 04:41:27.980899689 +0000 UTC m=+27.643357436"
Sep 10 04:41:28.818952 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:28.818926    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-77cd4"
Sep 10 04:41:28.818952 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:28.818944    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n2sr7"
Sep 10 04:41:28.819226 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:28.818926    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kq4qp"
Sep 10 04:41:28.819226 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:28.819036    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-77cd4" podUID="5e472a47-9b1d-4f3e-be2f-36ac4b0ebc7f"
Sep 10 04:41:28.819226 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:28.819089    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kq4qp" podUID="d9c2d9dc-e666-442f-b8f4-98b917db1a7f"
Sep 10 04:41:28.819226 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:28.819200    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n2sr7" podUID="13570f73-c21d-4771-8349-f30c25ab27fb"
Sep 10 04:41:28.957310 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:28.957279    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-z79rt"
Sep 10 04:41:28.970972 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:28.970949    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-z79rt"
Sep 10 04:41:28.980776 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:28.980752    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-77cd4"]
Sep 10 04:41:28.980877 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:28.980837    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-77cd4"
Sep 10 04:41:28.980970 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:28.980949    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-77cd4" podUID="5e472a47-9b1d-4f3e-be2f-36ac4b0ebc7f"
Sep 10 04:41:28.983814 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:28.983791    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kq4qp"]
Sep 10 04:41:28.983912 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:28.983872    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kq4qp"
Sep 10 04:41:28.983968 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:28.983945    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kq4qp" podUID="d9c2d9dc-e666-442f-b8f4-98b917db1a7f"
Sep 10 04:41:28.984479 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:28.984458    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-n2sr7"]
Sep 10 04:41:28.984579 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:28.984551    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n2sr7"
Sep 10 04:41:28.984656 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:28.984638    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n2sr7" podUID="13570f73-c21d-4771-8349-f30c25ab27fb"
Sep 10 04:41:29.960702 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:29.960668    2560 generic.go:356] "Generic (PLEG): container finished" podID="02552f59-e9e1-419f-b684-95357447d121" containerID="6bef128d24afc46de938103204df5e2174aa8f253cc119e41c1105aa8e829177" exitCode=0
Sep 10 04:41:29.961225 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:29.960746    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vhzvh" event={"ID":"02552f59-e9e1-419f-b684-95357447d121","Type":"ContainerDied","Data":"6bef128d24afc46de938103204df5e2174aa8f253cc119e41c1105aa8e829177"}
Sep 10 04:41:30.820272 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:30.820245    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-77cd4"
Sep 10 04:41:30.820406 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:30.820321    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n2sr7"
Sep 10 04:41:30.820406 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:30.820331    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-77cd4" podUID="5e472a47-9b1d-4f3e-be2f-36ac4b0ebc7f"
Sep 10 04:41:30.820491 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:30.820442    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n2sr7" podUID="13570f73-c21d-4771-8349-f30c25ab27fb"
Sep 10 04:41:30.820491 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:30.820476    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kq4qp"
Sep 10 04:41:30.820574 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:30.820547    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kq4qp" podUID="d9c2d9dc-e666-442f-b8f4-98b917db1a7f"
Sep 10 04:41:31.967916 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:31.967706    2560 generic.go:356] "Generic (PLEG): container finished" podID="02552f59-e9e1-419f-b684-95357447d121" containerID="9ebb3b50899ff4763f9ab2618f88830620e375ebe1f172ac4fcbba527e6394ea" exitCode=0
Sep 10 04:41:31.968396 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:31.967767    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vhzvh" event={"ID":"02552f59-e9e1-419f-b684-95357447d121","Type":"ContainerDied","Data":"9ebb3b50899ff4763f9ab2618f88830620e375ebe1f172ac4fcbba527e6394ea"}
Sep 10 04:41:32.819177 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:32.819147    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n2sr7"
Sep 10 04:41:32.819344 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:32.819147    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-77cd4"
Sep 10 04:41:32.819344 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:32.819262    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n2sr7" podUID="13570f73-c21d-4771-8349-f30c25ab27fb"
Sep 10 04:41:32.819344 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:32.819301    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kq4qp"
Sep 10 04:41:32.819505 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:32.819371    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-77cd4" podUID="5e472a47-9b1d-4f3e-be2f-36ac4b0ebc7f"
Sep 10 04:41:32.819505 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:32.819448    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kq4qp" podUID="d9c2d9dc-e666-442f-b8f4-98b917db1a7f"
Sep 10 04:41:33.607716 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.607692    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-27.ec2.internal" event="NodeReady"
Sep 10 04:41:33.608083 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.607818    2560 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 10 04:41:33.641368 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.641340    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-77586cf744-p4w2v"]
Sep 10 04:41:33.651655 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.651631    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77586cf744-p4w2v"
Sep 10 04:41:33.653466 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.653447    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6qv7t\""
Sep 10 04:41:33.653729 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.653714    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 10 04:41:33.653893 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.653876    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 10 04:41:33.653980 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.653961    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 10 04:41:33.657357 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.656744    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-x8kmb"]
Sep 10 04:41:33.664374 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.664046    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 10 04:41:33.667886 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.667865    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-6r6cl"]
Sep 10 04:41:33.667994 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.667969    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-x8kmb"
Sep 10 04:41:33.670205 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.670186    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 10 04:41:33.670335 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.670317    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 10 04:41:33.670442 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.670426    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-x7d89\""
Sep 10 04:41:33.670556 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.670542    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 10 04:41:33.670882 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.670764    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 10 04:41:33.676492 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.676448    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-mpw59"]
Sep 10 04:41:33.676589 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.676542    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-6r6cl"
Sep 10 04:41:33.677628 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.677609    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 10 04:41:33.680491 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.680252    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-klmkx\""
Sep 10 04:41:33.680733 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.680715    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 10 04:41:33.680992 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.680974    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 10 04:41:33.690484 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.690453    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-tkl9f"]
Sep 10 04:41:33.691324 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.691308    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-mpw59"
Sep 10 04:41:33.695871 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.694388    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 10 04:41:33.695871 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.694593    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 10 04:41:33.695871 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.694795    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 10 04:41:33.695871 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.695272    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 10 04:41:33.695871 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.695482    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-zc8tq\""
Sep 10 04:41:33.702995 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.702647    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-85b454874b-p5zjp"]
Sep 10 04:41:33.703248 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.703230    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tkl9f"
Sep 10 04:41:33.706296 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.706238    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nj7q4\""
Sep 10 04:41:33.706628 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.706242    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 10 04:41:33.708946 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.706720    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 10 04:41:33.716991 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.716974    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-hkjtg"]
Sep 10 04:41:33.717094 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.717078    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-p5zjp"
Sep 10 04:41:33.719232 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.719208    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 10 04:41:33.719320 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.719217    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 10 04:41:33.719451 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.719436    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 10 04:41:33.719501 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.719437    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-fqdzr\""
Sep 10 04:41:33.719716 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.719696    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 10 04:41:33.724374 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.724358    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 10 04:41:33.729531 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.729516    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-hkjtg"
Sep 10 04:41:33.729531 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.729521    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7bff86c86-9d7sj"]
Sep 10 04:41:33.731461 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.731439    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 10 04:41:33.731573 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.731561    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 10 04:41:33.731746 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.731728    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 10 04:41:33.731845 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.731774    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-x2pz2\""
Sep 10 04:41:33.731845 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.731804    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 10 04:41:33.743723 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.743707    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-tgcbl"]
Sep 10 04:41:33.743839 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.743821    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7bff86c86-9d7sj"
Sep 10 04:41:33.745936 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.745897    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 10 04:41:33.746040 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.746026    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-778q9\""
Sep 10 04:41:33.746311 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.746293    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 10 04:41:33.746423 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.746349    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 10 04:41:33.746502 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.746454    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 10 04:41:33.746579 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.746566    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 10 04:41:33.746749 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.746733    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 10 04:41:33.758329 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.758310    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-77586cf744-p4w2v"]
Sep 10 04:41:33.758422 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.758353    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-x8kmb"]
Sep 10 04:41:33.758422 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.758368    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tkl9f"]
Sep 10 04:41:33.758422 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.758385    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-mpw59"]
Sep 10 04:41:33.758422 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.758398    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-hkjtg"]
Sep 10 04:41:33.758422 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.758408    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-tgcbl"]
Sep 10 04:41:33.758422 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.758420    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-tgcbl"
Sep 10 04:41:33.758743 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.758423    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-hnd48"]
Sep 10 04:41:33.760324 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.760304    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 10 04:41:33.760432 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.760360    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 10 04:41:33.760432 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.760415    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 10 04:41:33.760539 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.760521    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 10 04:41:33.760750 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.760733    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-lllwv\""
Sep 10 04:41:33.772669 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.772650    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-x5xr6"]
Sep 10 04:41:33.772773 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.772759    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-hnd48"
Sep 10 04:41:33.775443 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.775235    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-d7snv\""
Sep 10 04:41:33.775443 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.775288    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 10 04:41:33.775443 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.775272    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 10 04:41:33.785059 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.785041    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-6r6cl"]
Sep 10 04:41:33.785148 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.785075    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-hnd48"]
Sep 10 04:41:33.785148 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.785095    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-p5zjp"]
Sep 10 04:41:33.785148 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.785115    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7bff86c86-9d7sj"]
Sep 10 04:41:33.785148 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.785134    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-x5xr6"]
Sep 10 04:41:33.785295 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.785159    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-x5xr6"
Sep 10 04:41:33.785295 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.785178    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-vjxjf"]
Sep 10 04:41:33.787925 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.787782    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 10 04:41:33.788539 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.788286    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 10 04:41:33.789009 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.788762    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-j9rtp\""
Sep 10 04:41:33.789009 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.788895    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 10 04:41:33.791586 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.791568    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/92e0e646-b15f-45be-8797-fcac67a89fd1-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-mpw59\" (UID: \"92e0e646-b15f-45be-8797-fcac67a89fd1\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-mpw59"
Sep 10 04:41:33.791686 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.791593    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9trmw\" (UniqueName: \"kubernetes.io/projected/345fe3ae-0c3e-4924-af34-bf06acf51ac4-kube-api-access-9trmw\") pod \"dns-default-tkl9f\" (UID: \"345fe3ae-0c3e-4924-af34-bf06acf51ac4\") " pod="openshift-dns/dns-default-tkl9f"
Sep 10 04:41:33.791686 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.791614    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0f33b82-87c0-4c48-a093-a91e3317cf73-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-x8kmb\" (UID: \"b0f33b82-87c0-4c48-a093-a91e3317cf73\") " pod="openshift-insights/insights-operator-76bcd6ccf5-x8kmb"
Sep 10 04:41:33.791686 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.791634    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1529c81a-0935-4a33-a02a-39323d37b580-registry-certificates\") pod \"image-registry-77586cf744-p4w2v\" (UID: \"1529c81a-0935-4a33-a02a-39323d37b580\") " pod="openshift-image-registry/image-registry-77586cf744-p4w2v"
Sep 10 04:41:33.791686 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.791663    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1529c81a-0935-4a33-a02a-39323d37b580-bound-sa-token\") pod \"image-registry-77586cf744-p4w2v\" (UID: \"1529c81a-0935-4a33-a02a-39323d37b580\") " pod="openshift-image-registry/image-registry-77586cf744-p4w2v"
Sep 10 04:41:33.791919 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.791736    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5552ac0d-5458-4244-9cb1-e278a75e0451-serving-cert\") pod \"service-ca-operator-859f94c4b-hkjtg\" (UID: \"5552ac0d-5458-4244-9cb1-e278a75e0451\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-hkjtg"
Sep 10 04:41:33.791919 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.791791    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8b3ec8dc-1508-4537-8dc3-b9de1ff22d03-trusted-ca\") pod \"console-operator-85b454874b-p5zjp\" (UID: \"8b3ec8dc-1508-4537-8dc3-b9de1ff22d03\") " pod="openshift-console-operator/console-operator-85b454874b-p5zjp"
Sep 10 04:41:33.791919 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.791820    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68cp9\" (UniqueName: \"kubernetes.io/projected/5552ac0d-5458-4244-9cb1-e278a75e0451-kube-api-access-68cp9\") pod \"service-ca-operator-859f94c4b-hkjtg\" (UID: \"5552ac0d-5458-4244-9cb1-e278a75e0451\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-hkjtg"
Sep 10 04:41:33.791919 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.791863    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8b3ec8dc-1508-4537-8dc3-b9de1ff22d03-serving-cert\") pod \"console-operator-85b454874b-p5zjp\" (UID: \"8b3ec8dc-1508-4537-8dc3-b9de1ff22d03\") " pod="openshift-console-operator/console-operator-85b454874b-p5zjp"
Sep 10 04:41:33.791919 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.791891    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1529c81a-0935-4a33-a02a-39323d37b580-ca-trust-extracted\") pod \"image-registry-77586cf744-p4w2v\" (UID: \"1529c81a-0935-4a33-a02a-39323d37b580\") " pod="openshift-image-registry/image-registry-77586cf744-p4w2v"
Sep 10 04:41:33.792155 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.791932    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/92e0e646-b15f-45be-8797-fcac67a89fd1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-mpw59\" (UID: \"92e0e646-b15f-45be-8797-fcac67a89fd1\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-mpw59"
Sep 10 04:41:33.792155 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.792001    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0f33b82-87c0-4c48-a093-a91e3317cf73-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-x8kmb\" (UID: \"b0f33b82-87c0-4c48-a093-a91e3317cf73\") " pod="openshift-insights/insights-operator-76bcd6ccf5-x8kmb"
Sep 10 04:41:33.792155 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.792033    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvzqz\" (UniqueName: \"kubernetes.io/projected/8b3ec8dc-1508-4537-8dc3-b9de1ff22d03-kube-api-access-dvzqz\") pod \"console-operator-85b454874b-p5zjp\" (UID: \"8b3ec8dc-1508-4537-8dc3-b9de1ff22d03\") " pod="openshift-console-operator/console-operator-85b454874b-p5zjp"
Sep 10 04:41:33.792155 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.792056    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b0f33b82-87c0-4c48-a093-a91e3317cf73-tmp\") pod \"insights-operator-76bcd6ccf5-x8kmb\" (UID: \"b0f33b82-87c0-4c48-a093-a91e3317cf73\") " pod="openshift-insights/insights-operator-76bcd6ccf5-x8kmb"
Sep 10 04:41:33.792155 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.792107    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/345fe3ae-0c3e-4924-af34-bf06acf51ac4-tmp-dir\") pod \"dns-default-tkl9f\" (UID: \"345fe3ae-0c3e-4924-af34-bf06acf51ac4\") " pod="openshift-dns/dns-default-tkl9f"
Sep 10 04:41:33.792155 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.792133    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1529c81a-0935-4a33-a02a-39323d37b580-installation-pull-secrets\") pod \"image-registry-77586cf744-p4w2v\" (UID: \"1529c81a-0935-4a33-a02a-39323d37b580\") " pod="openshift-image-registry/image-registry-77586cf744-p4w2v"
Sep 10 04:41:33.792440 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.792159    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5552ac0d-5458-4244-9cb1-e278a75e0451-config\") pod \"service-ca-operator-859f94c4b-hkjtg\" (UID: \"5552ac0d-5458-4244-9cb1-e278a75e0451\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-hkjtg"
Sep 10 04:41:33.792440 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.792202    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1529c81a-0935-4a33-a02a-39323d37b580-image-registry-private-configuration\") pod \"image-registry-77586cf744-p4w2v\" (UID: \"1529c81a-0935-4a33-a02a-39323d37b580\") " pod="openshift-image-registry/image-registry-77586cf744-p4w2v"
Sep 10 04:41:33.792440 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.792229    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjlg2\" (UniqueName: \"kubernetes.io/projected/1529c81a-0935-4a33-a02a-39323d37b580-kube-api-access-rjlg2\") pod \"image-registry-77586cf744-p4w2v\" (UID: \"1529c81a-0935-4a33-a02a-39323d37b580\") " pod="openshift-image-registry/image-registry-77586cf744-p4w2v"
Sep 10 04:41:33.792440 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.792254    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhfn5\" (UniqueName: \"kubernetes.io/projected/92e0e646-b15f-45be-8797-fcac67a89fd1-kube-api-access-qhfn5\") pod \"cluster-monitoring-operator-6cdcc96965-mpw59\" (UID: \"92e0e646-b15f-45be-8797-fcac67a89fd1\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-mpw59"
Sep 10 04:41:33.792440 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.792274    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b0f33b82-87c0-4c48-a093-a91e3317cf73-serving-cert\") pod \"insights-operator-76bcd6ccf5-x8kmb\" (UID: \"b0f33b82-87c0-4c48-a093-a91e3317cf73\") " pod="openshift-insights/insights-operator-76bcd6ccf5-x8kmb"
Sep 10 04:41:33.792440 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.792292    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8b3ec8dc-1508-4537-8dc3-b9de1ff22d03-config\") pod \"console-operator-85b454874b-p5zjp\" (UID: \"8b3ec8dc-1508-4537-8dc3-b9de1ff22d03\") " pod="openshift-console-operator/console-operator-85b454874b-p5zjp"
Sep 10 04:41:33.792440 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.792332    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tk2t2\" (UniqueName: \"kubernetes.io/projected/61306ba6-2958-4dfb-84b4-e35336f7ec3d-kube-api-access-tk2t2\") pod \"volume-data-source-validator-695c895bd6-6r6cl\" (UID: \"61306ba6-2958-4dfb-84b4-e35336f7ec3d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-6r6cl"
Sep 10 04:41:33.792440 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.792363    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/345fe3ae-0c3e-4924-af34-bf06acf51ac4-metrics-tls\") pod \"dns-default-tkl9f\" (UID: \"345fe3ae-0c3e-4924-af34-bf06acf51ac4\") " pod="openshift-dns/dns-default-tkl9f"
Sep 10 04:41:33.792440 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.792383    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b0f33b82-87c0-4c48-a093-a91e3317cf73-snapshots\") pod \"insights-operator-76bcd6ccf5-x8kmb\" (UID: \"b0f33b82-87c0-4c48-a093-a91e3317cf73\") " pod="openshift-insights/insights-operator-76bcd6ccf5-x8kmb"
Sep 10 04:41:33.792440 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.792408    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1529c81a-0935-4a33-a02a-39323d37b580-trusted-ca\") pod \"image-registry-77586cf744-p4w2v\" (UID: \"1529c81a-0935-4a33-a02a-39323d37b580\") " pod="openshift-image-registry/image-registry-77586cf744-p4w2v"
Sep 10 04:41:33.792440 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.792422    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rkzp\" (UniqueName: \"kubernetes.io/projected/b0f33b82-87c0-4c48-a093-a91e3317cf73-kube-api-access-5rkzp\") pod \"insights-operator-76bcd6ccf5-x8kmb\" (UID: \"b0f33b82-87c0-4c48-a093-a91e3317cf73\") " pod="openshift-insights/insights-operator-76bcd6ccf5-x8kmb"
Sep 10 04:41:33.792440 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.792437    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/345fe3ae-0c3e-4924-af34-bf06acf51ac4-config-volume\") pod \"dns-default-tkl9f\" (UID: \"345fe3ae-0c3e-4924-af34-bf06acf51ac4\") " pod="openshift-dns/dns-default-tkl9f"
Sep 10 04:41:33.793033 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.792459    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1529c81a-0935-4a33-a02a-39323d37b580-registry-tls\") pod \"image-registry-77586cf744-p4w2v\" (UID: \"1529c81a-0935-4a33-a02a-39323d37b580\") " pod="openshift-image-registry/image-registry-77586cf744-p4w2v"
Sep 10 04:41:33.799365 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.799348    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vjxjf"]
Sep 10 04:41:33.799439 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.799421    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vjxjf"
Sep 10 04:41:33.801390 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.801371    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 10 04:41:33.801506 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.801410    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 10 04:41:33.801506 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.801460    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 10 04:41:33.801674 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.801661    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-d4254\""
Sep 10 04:41:33.893712 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.893685    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68cp9\" (UniqueName: \"kubernetes.io/projected/5552ac0d-5458-4244-9cb1-e278a75e0451-kube-api-access-68cp9\") pod \"service-ca-operator-859f94c4b-hkjtg\" (UID: \"5552ac0d-5458-4244-9cb1-e278a75e0451\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-hkjtg"
Sep 10 04:41:33.893868 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.893719    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/107242dc-160c-4fff-b4d5-ac1b059ff6e1-service-ca-bundle\") pod \"router-default-7bff86c86-9d7sj\" (UID: \"107242dc-160c-4fff-b4d5-ac1b059ff6e1\") " pod="openshift-ingress/router-default-7bff86c86-9d7sj"
Sep 10 04:41:33.893868 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.893746    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8b3ec8dc-1508-4537-8dc3-b9de1ff22d03-serving-cert\") pod \"console-operator-85b454874b-p5zjp\" (UID: \"8b3ec8dc-1508-4537-8dc3-b9de1ff22d03\") " pod="openshift-console-operator/console-operator-85b454874b-p5zjp"
Sep 10 04:41:33.893868 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.893770    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/107242dc-160c-4fff-b4d5-ac1b059ff6e1-metrics-certs\") pod \"router-default-7bff86c86-9d7sj\" (UID: \"107242dc-160c-4fff-b4d5-ac1b059ff6e1\") " pod="openshift-ingress/router-default-7bff86c86-9d7sj"
Sep 10 04:41:33.894012 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.893883    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1529c81a-0935-4a33-a02a-39323d37b580-ca-trust-extracted\") pod \"image-registry-77586cf744-p4w2v\" (UID: \"1529c81a-0935-4a33-a02a-39323d37b580\") " pod="openshift-image-registry/image-registry-77586cf744-p4w2v"
Sep 10 04:41:33.894012 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.893900    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/92e0e646-b15f-45be-8797-fcac67a89fd1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-mpw59\" (UID: \"92e0e646-b15f-45be-8797-fcac67a89fd1\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-mpw59"
Sep 10 04:41:33.894012 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.893919    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0f33b82-87c0-4c48-a093-a91e3317cf73-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-x8kmb\" (UID: \"b0f33b82-87c0-4c48-a093-a91e3317cf73\") " pod="openshift-insights/insights-operator-76bcd6ccf5-x8kmb"
Sep 10 04:41:33.894012 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.893940    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1f30b38a-507b-4294-b1a1-d58d2bc2bfb3-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-x5xr6\" (UID: \"1f30b38a-507b-4294-b1a1-d58d2bc2bfb3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-x5xr6"
Sep 10 04:41:33.894012 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.893968    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvzqz\" (UniqueName: \"kubernetes.io/projected/8b3ec8dc-1508-4537-8dc3-b9de1ff22d03-kube-api-access-dvzqz\") pod \"console-operator-85b454874b-p5zjp\" (UID: \"8b3ec8dc-1508-4537-8dc3-b9de1ff22d03\") " pod="openshift-console-operator/console-operator-85b454874b-p5zjp"
Sep 10 04:41:33.894012 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.893990    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b0f33b82-87c0-4c48-a093-a91e3317cf73-tmp\") pod \"insights-operator-76bcd6ccf5-x8kmb\" (UID: \"b0f33b82-87c0-4c48-a093-a91e3317cf73\") " pod="openshift-insights/insights-operator-76bcd6ccf5-x8kmb"
Sep 10 04:41:33.894268 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:33.894022    2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 10 04:41:33.894268 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.894030    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/107242dc-160c-4fff-b4d5-ac1b059ff6e1-default-certificate\") pod \"router-default-7bff86c86-9d7sj\" (UID: \"107242dc-160c-4fff-b4d5-ac1b059ff6e1\") " pod="openshift-ingress/router-default-7bff86c86-9d7sj"
Sep 10 04:41:33.894268 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.894061    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/345fe3ae-0c3e-4924-af34-bf06acf51ac4-tmp-dir\") pod \"dns-default-tkl9f\" (UID: \"345fe3ae-0c3e-4924-af34-bf06acf51ac4\") " pod="openshift-dns/dns-default-tkl9f"
Sep 10 04:41:33.894268 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:33.894087    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92e0e646-b15f-45be-8797-fcac67a89fd1-cluster-monitoring-operator-tls podName:92e0e646-b15f-45be-8797-fcac67a89fd1 nodeName:}" failed. No retries permitted until 2026-09-10 04:41:34.394069423 +0000 UTC m=+34.056527161 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/92e0e646-b15f-45be-8797-fcac67a89fd1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-mpw59" (UID: "92e0e646-b15f-45be-8797-fcac67a89fd1") : secret "cluster-monitoring-operator-tls" not found
Sep 10 04:41:33.894268 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.894118    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1529c81a-0935-4a33-a02a-39323d37b580-installation-pull-secrets\") pod \"image-registry-77586cf744-p4w2v\" (UID: \"1529c81a-0935-4a33-a02a-39323d37b580\") " pod="openshift-image-registry/image-registry-77586cf744-p4w2v"
Sep 10 04:41:33.894268 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.894148    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5552ac0d-5458-4244-9cb1-e278a75e0451-config\") pod \"service-ca-operator-859f94c4b-hkjtg\" (UID: \"5552ac0d-5458-4244-9cb1-e278a75e0451\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-hkjtg"
Sep 10 04:41:33.894268 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.894175    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ef57e894-f8b4-464e-b814-3ceada543c28-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-tgcbl\" (UID: \"ef57e894-f8b4-464e-b814-3ceada543c28\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-tgcbl"
Sep 10 04:41:33.894268 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.894214    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1529c81a-0935-4a33-a02a-39323d37b580-image-registry-private-configuration\") pod \"image-registry-77586cf744-p4w2v\" (UID: \"1529c81a-0935-4a33-a02a-39323d37b580\") " pod="openshift-image-registry/image-registry-77586cf744-p4w2v"
Sep 10 04:41:33.894268 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.894242    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/107242dc-160c-4fff-b4d5-ac1b059ff6e1-stats-auth\") pod \"router-default-7bff86c86-9d7sj\" (UID: \"107242dc-160c-4fff-b4d5-ac1b059ff6e1\") " pod="openshift-ingress/router-default-7bff86c86-9d7sj"
Sep 10 04:41:33.894268 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.894268    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjlg2\" (UniqueName: \"kubernetes.io/projected/1529c81a-0935-4a33-a02a-39323d37b580-kube-api-access-rjlg2\") pod \"image-registry-77586cf744-p4w2v\" (UID: \"1529c81a-0935-4a33-a02a-39323d37b580\") " pod="openshift-image-registry/image-registry-77586cf744-p4w2v"
Sep 10 04:41:33.894795 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.894292    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/345fe3ae-0c3e-4924-af34-bf06acf51ac4-tmp-dir\") pod \"dns-default-tkl9f\" (UID: \"345fe3ae-0c3e-4924-af34-bf06acf51ac4\") " pod="openshift-dns/dns-default-tkl9f"
Sep 10 04:41:33.894795 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.894303    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhfn5\" (UniqueName: \"kubernetes.io/projected/92e0e646-b15f-45be-8797-fcac67a89fd1-kube-api-access-qhfn5\") pod \"cluster-monitoring-operator-6cdcc96965-mpw59\" (UID: \"92e0e646-b15f-45be-8797-fcac67a89fd1\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-mpw59"
Sep 10 04:41:33.894795 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.894315    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b0f33b82-87c0-4c48-a093-a91e3317cf73-tmp\") pod \"insights-operator-76bcd6ccf5-x8kmb\" (UID: \"b0f33b82-87c0-4c48-a093-a91e3317cf73\") " pod="openshift-insights/insights-operator-76bcd6ccf5-x8kmb"
Sep 10 04:41:33.894795 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.894659    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1529c81a-0935-4a33-a02a-39323d37b580-ca-trust-extracted\") pod \"image-registry-77586cf744-p4w2v\" (UID: \"1529c81a-0935-4a33-a02a-39323d37b580\") " pod="openshift-image-registry/image-registry-77586cf744-p4w2v"
Sep 10 04:41:33.895017 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.894815    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rz8gx\" (UniqueName: \"kubernetes.io/projected/7e644efa-0a6e-412b-b2a9-352dfeeed160-kube-api-access-rz8gx\") pod \"network-check-source-685456655f-hnd48\" (UID: \"7e644efa-0a6e-412b-b2a9-352dfeeed160\") " pod="openshift-network-diagnostics/network-check-source-685456655f-hnd48"
Sep 10 04:41:33.895017 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.894846    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b0f33b82-87c0-4c48-a093-a91e3317cf73-serving-cert\") pod \"insights-operator-76bcd6ccf5-x8kmb\" (UID: \"b0f33b82-87c0-4c48-a093-a91e3317cf73\") " pod="openshift-insights/insights-operator-76bcd6ccf5-x8kmb"
Sep 10 04:41:33.895017 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.894895    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8b3ec8dc-1508-4537-8dc3-b9de1ff22d03-config\") pod \"console-operator-85b454874b-p5zjp\" (UID: \"8b3ec8dc-1508-4537-8dc3-b9de1ff22d03\") " pod="openshift-console-operator/console-operator-85b454874b-p5zjp"
Sep 10 04:41:33.895017 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.894919    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/beaaafd1-47c4-4a3a-a985-bed140f007e6-cert\") pod \"ingress-canary-vjxjf\" (UID: \"beaaafd1-47c4-4a3a-a985-bed140f007e6\") " pod="openshift-ingress-canary/ingress-canary-vjxjf"
Sep 10 04:41:33.895017 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.894944    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tk2t2\" (UniqueName: \"kubernetes.io/projected/61306ba6-2958-4dfb-84b4-e35336f7ec3d-kube-api-access-tk2t2\") pod \"volume-data-source-validator-695c895bd6-6r6cl\" (UID: \"61306ba6-2958-4dfb-84b4-e35336f7ec3d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-6r6cl"
Sep 10 04:41:33.895277 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.895056    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5552ac0d-5458-4244-9cb1-e278a75e0451-config\") pod \"service-ca-operator-859f94c4b-hkjtg\" (UID: \"5552ac0d-5458-4244-9cb1-e278a75e0451\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-hkjtg"
Sep 10 04:41:33.895579 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.895437    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0f33b82-87c0-4c48-a093-a91e3317cf73-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-x8kmb\" (UID: \"b0f33b82-87c0-4c48-a093-a91e3317cf73\") " pod="openshift-insights/insights-operator-76bcd6ccf5-x8kmb"
Sep 10 04:41:33.895579 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.895507    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/345fe3ae-0c3e-4924-af34-bf06acf51ac4-metrics-tls\") pod \"dns-default-tkl9f\" (UID: \"345fe3ae-0c3e-4924-af34-bf06acf51ac4\") " pod="openshift-dns/dns-default-tkl9f"
Sep 10 04:41:33.895579 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.895538    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b0f33b82-87c0-4c48-a093-a91e3317cf73-snapshots\") pod \"insights-operator-76bcd6ccf5-x8kmb\" (UID: \"b0f33b82-87c0-4c48-a093-a91e3317cf73\") " pod="openshift-insights/insights-operator-76bcd6ccf5-x8kmb"
Sep 10 04:41:33.895579 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.895567    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqxnz\" (UniqueName: \"kubernetes.io/projected/1f30b38a-507b-4294-b1a1-d58d2bc2bfb3-kube-api-access-bqxnz\") pod \"cluster-samples-operator-7cdcfcf76c-x5xr6\" (UID: \"1f30b38a-507b-4294-b1a1-d58d2bc2bfb3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-x5xr6"
Sep 10 04:41:33.895809 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.895605    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1529c81a-0935-4a33-a02a-39323d37b580-trusted-ca\") pod \"image-registry-77586cf744-p4w2v\" (UID: \"1529c81a-0935-4a33-a02a-39323d37b580\") " pod="openshift-image-registry/image-registry-77586cf744-p4w2v"
Sep 10 04:41:33.895809 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:33.895608    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 04:41:33.895809 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.895640    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rkzp\" (UniqueName: \"kubernetes.io/projected/b0f33b82-87c0-4c48-a093-a91e3317cf73-kube-api-access-5rkzp\") pod \"insights-operator-76bcd6ccf5-x8kmb\" (UID: \"b0f33b82-87c0-4c48-a093-a91e3317cf73\") " pod="openshift-insights/insights-operator-76bcd6ccf5-x8kmb"
Sep 10 04:41:33.895809 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:33.895667    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/345fe3ae-0c3e-4924-af34-bf06acf51ac4-metrics-tls podName:345fe3ae-0c3e-4924-af34-bf06acf51ac4 nodeName:}" failed. No retries permitted until 2026-09-10 04:41:34.395652713 +0000 UTC m=+34.058110445 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/345fe3ae-0c3e-4924-af34-bf06acf51ac4-metrics-tls") pod "dns-default-tkl9f" (UID: "345fe3ae-0c3e-4924-af34-bf06acf51ac4") : secret "dns-default-metrics-tls" not found
Sep 10 04:41:33.895809 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.895704    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/345fe3ae-0c3e-4924-af34-bf06acf51ac4-config-volume\") pod \"dns-default-tkl9f\" (UID: \"345fe3ae-0c3e-4924-af34-bf06acf51ac4\") " pod="openshift-dns/dns-default-tkl9f"
Sep 10 04:41:33.895809 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.895734    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1529c81a-0935-4a33-a02a-39323d37b580-registry-tls\") pod \"image-registry-77586cf744-p4w2v\" (UID: \"1529c81a-0935-4a33-a02a-39323d37b580\") " pod="openshift-image-registry/image-registry-77586cf744-p4w2v"
Sep 10 04:41:33.895809 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.895768    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/92e0e646-b15f-45be-8797-fcac67a89fd1-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-mpw59\" (UID: \"92e0e646-b15f-45be-8797-fcac67a89fd1\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-mpw59"
Sep 10 04:41:33.895809 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.895775    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8b3ec8dc-1508-4537-8dc3-b9de1ff22d03-config\") pod \"console-operator-85b454874b-p5zjp\" (UID: \"8b3ec8dc-1508-4537-8dc3-b9de1ff22d03\") " pod="openshift-console-operator/console-operator-85b454874b-p5zjp"
Sep 10 04:41:33.895809 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.895794    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9trmw\" (UniqueName: \"kubernetes.io/projected/345fe3ae-0c3e-4924-af34-bf06acf51ac4-kube-api-access-9trmw\") pod \"dns-default-tkl9f\" (UID: \"345fe3ae-0c3e-4924-af34-bf06acf51ac4\") " pod="openshift-dns/dns-default-tkl9f"
Sep 10 04:41:33.902166 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.895828    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0f33b82-87c0-4c48-a093-a91e3317cf73-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-x8kmb\" (UID: \"b0f33b82-87c0-4c48-a093-a91e3317cf73\") " pod="openshift-insights/insights-operator-76bcd6ccf5-x8kmb"
Sep 10 04:41:33.902166 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.895888    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1529c81a-0935-4a33-a02a-39323d37b580-registry-certificates\") pod \"image-registry-77586cf744-p4w2v\" (UID: \"1529c81a-0935-4a33-a02a-39323d37b580\") " pod="openshift-image-registry/image-registry-77586cf744-p4w2v"
Sep 10 04:41:33.902166 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.895921    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjrz9\" (UniqueName: \"kubernetes.io/projected/107242dc-160c-4fff-b4d5-ac1b059ff6e1-kube-api-access-jjrz9\") pod \"router-default-7bff86c86-9d7sj\" (UID: \"107242dc-160c-4fff-b4d5-ac1b059ff6e1\") " pod="openshift-ingress/router-default-7bff86c86-9d7sj"
Sep 10 04:41:33.902166 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.895952    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwndn\" (UniqueName: \"kubernetes.io/projected/beaaafd1-47c4-4a3a-a985-bed140f007e6-kube-api-access-zwndn\") pod \"ingress-canary-vjxjf\" (UID: \"beaaafd1-47c4-4a3a-a985-bed140f007e6\") " pod="openshift-ingress-canary/ingress-canary-vjxjf"
Sep 10 04:41:33.902166 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.895982    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1529c81a-0935-4a33-a02a-39323d37b580-bound-sa-token\") pod \"image-registry-77586cf744-p4w2v\" (UID: \"1529c81a-0935-4a33-a02a-39323d37b580\") " pod="openshift-image-registry/image-registry-77586cf744-p4w2v"
Sep 10 04:41:33.902166 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.896008    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ef57e894-f8b4-464e-b814-3ceada543c28-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-tgcbl\" (UID: \"ef57e894-f8b4-464e-b814-3ceada543c28\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-tgcbl"
Sep 10 04:41:33.902166 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.896034    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5bnp\" (UniqueName: \"kubernetes.io/projected/ef57e894-f8b4-464e-b814-3ceada543c28-kube-api-access-d5bnp\") pod \"kube-storage-version-migrator-operator-8d7dd4675-tgcbl\" (UID: \"ef57e894-f8b4-464e-b814-3ceada543c28\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-tgcbl"
Sep 10 04:41:33.902166 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.896065    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5552ac0d-5458-4244-9cb1-e278a75e0451-serving-cert\") pod \"service-ca-operator-859f94c4b-hkjtg\" (UID: \"5552ac0d-5458-4244-9cb1-e278a75e0451\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-hkjtg"
Sep 10 04:41:33.902166 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.896107    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8b3ec8dc-1508-4537-8dc3-b9de1ff22d03-trusted-ca\") pod \"console-operator-85b454874b-p5zjp\" (UID: \"8b3ec8dc-1508-4537-8dc3-b9de1ff22d03\") " pod="openshift-console-operator/console-operator-85b454874b-p5zjp"
Sep 10 04:41:33.902166 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.896541    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1529c81a-0935-4a33-a02a-39323d37b580-trusted-ca\") pod \"image-registry-77586cf744-p4w2v\" (UID: \"1529c81a-0935-4a33-a02a-39323d37b580\") " pod="openshift-image-registry/image-registry-77586cf744-p4w2v"
Sep 10 04:41:33.902166 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.896921    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8b3ec8dc-1508-4537-8dc3-b9de1ff22d03-trusted-ca\") pod \"console-operator-85b454874b-p5zjp\" (UID: \"8b3ec8dc-1508-4537-8dc3-b9de1ff22d03\") " pod="openshift-console-operator/console-operator-85b454874b-p5zjp"
Sep 10 04:41:33.902166 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.896943    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0f33b82-87c0-4c48-a093-a91e3317cf73-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-x8kmb\" (UID: \"b0f33b82-87c0-4c48-a093-a91e3317cf73\") " pod="openshift-insights/insights-operator-76bcd6ccf5-x8kmb"
Sep 10 04:41:33.902166 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.897103    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b0f33b82-87c0-4c48-a093-a91e3317cf73-snapshots\") pod \"insights-operator-76bcd6ccf5-x8kmb\" (UID: \"b0f33b82-87c0-4c48-a093-a91e3317cf73\") " pod="openshift-insights/insights-operator-76bcd6ccf5-x8kmb"
Sep 10 04:41:33.902166 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.897215    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1529c81a-0935-4a33-a02a-39323d37b580-registry-certificates\") pod \"image-registry-77586cf744-p4w2v\" (UID: \"1529c81a-0935-4a33-a02a-39323d37b580\") " pod="openshift-image-registry/image-registry-77586cf744-p4w2v"
Sep 10 04:41:33.902166 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:33.897288    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 04:41:33.902166 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:33.897301    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77586cf744-p4w2v: secret "image-registry-tls" not found
Sep 10 04:41:33.902713 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:33.897342    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1529c81a-0935-4a33-a02a-39323d37b580-registry-tls podName:1529c81a-0935-4a33-a02a-39323d37b580 nodeName:}" failed. No retries permitted until 2026-09-10 04:41:34.397328711 +0000 UTC m=+34.059786461 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1529c81a-0935-4a33-a02a-39323d37b580-registry-tls") pod "image-registry-77586cf744-p4w2v" (UID: "1529c81a-0935-4a33-a02a-39323d37b580") : secret "image-registry-tls" not found
Sep 10 04:41:33.902713 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.897628    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/345fe3ae-0c3e-4924-af34-bf06acf51ac4-config-volume\") pod \"dns-default-tkl9f\" (UID: \"345fe3ae-0c3e-4924-af34-bf06acf51ac4\") " pod="openshift-dns/dns-default-tkl9f"
Sep 10 04:41:33.902713 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.897959    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/92e0e646-b15f-45be-8797-fcac67a89fd1-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-mpw59\" (UID: \"92e0e646-b15f-45be-8797-fcac67a89fd1\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-mpw59"
Sep 10 04:41:33.902713 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.899080    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8b3ec8dc-1508-4537-8dc3-b9de1ff22d03-serving-cert\") pod \"console-operator-85b454874b-p5zjp\" (UID: \"8b3ec8dc-1508-4537-8dc3-b9de1ff22d03\") " pod="openshift-console-operator/console-operator-85b454874b-p5zjp"
Sep 10 04:41:33.902713 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.899102    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1529c81a-0935-4a33-a02a-39323d37b580-installation-pull-secrets\") pod \"image-registry-77586cf744-p4w2v\" (UID: \"1529c81a-0935-4a33-a02a-39323d37b580\") " pod="openshift-image-registry/image-registry-77586cf744-p4w2v"
Sep 10 04:41:33.902713 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.899113    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1529c81a-0935-4a33-a02a-39323d37b580-image-registry-private-configuration\") pod \"image-registry-77586cf744-p4w2v\" (UID: \"1529c81a-0935-4a33-a02a-39323d37b580\") " pod="openshift-image-registry/image-registry-77586cf744-p4w2v"
Sep 10 04:41:33.902713 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.899505    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5552ac0d-5458-4244-9cb1-e278a75e0451-serving-cert\") pod \"service-ca-operator-859f94c4b-hkjtg\" (UID: \"5552ac0d-5458-4244-9cb1-e278a75e0451\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-hkjtg"
Sep 10 04:41:33.902713 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.899670    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b0f33b82-87c0-4c48-a093-a91e3317cf73-serving-cert\") pod \"insights-operator-76bcd6ccf5-x8kmb\" (UID: \"b0f33b82-87c0-4c48-a093-a91e3317cf73\") " pod="openshift-insights/insights-operator-76bcd6ccf5-x8kmb"
Sep 10 04:41:33.905382 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.905356    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjlg2\" (UniqueName: \"kubernetes.io/projected/1529c81a-0935-4a33-a02a-39323d37b580-kube-api-access-rjlg2\") pod \"image-registry-77586cf744-p4w2v\" (UID: \"1529c81a-0935-4a33-a02a-39323d37b580\") " pod="openshift-image-registry/image-registry-77586cf744-p4w2v"
Sep 10 04:41:33.906101 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.905947    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-68cp9\" (UniqueName: \"kubernetes.io/projected/5552ac0d-5458-4244-9cb1-e278a75e0451-kube-api-access-68cp9\") pod \"service-ca-operator-859f94c4b-hkjtg\" (UID: \"5552ac0d-5458-4244-9cb1-e278a75e0451\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-hkjtg"
Sep 10 04:41:33.906339 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.906317    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhfn5\" (UniqueName: \"kubernetes.io/projected/92e0e646-b15f-45be-8797-fcac67a89fd1-kube-api-access-qhfn5\") pod \"cluster-monitoring-operator-6cdcc96965-mpw59\" (UID: \"92e0e646-b15f-45be-8797-fcac67a89fd1\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-mpw59"
Sep 10 04:41:33.906439 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.906372    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1529c81a-0935-4a33-a02a-39323d37b580-bound-sa-token\") pod \"image-registry-77586cf744-p4w2v\" (UID: \"1529c81a-0935-4a33-a02a-39323d37b580\") " pod="openshift-image-registry/image-registry-77586cf744-p4w2v"
Sep 10 04:41:33.906981 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.906960    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9trmw\" (UniqueName: \"kubernetes.io/projected/345fe3ae-0c3e-4924-af34-bf06acf51ac4-kube-api-access-9trmw\") pod \"dns-default-tkl9f\" (UID: \"345fe3ae-0c3e-4924-af34-bf06acf51ac4\") " pod="openshift-dns/dns-default-tkl9f"
Sep 10 04:41:33.907184 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.907160    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rkzp\" (UniqueName: \"kubernetes.io/projected/b0f33b82-87c0-4c48-a093-a91e3317cf73-kube-api-access-5rkzp\") pod \"insights-operator-76bcd6ccf5-x8kmb\" (UID: \"b0f33b82-87c0-4c48-a093-a91e3317cf73\") " pod="openshift-insights/insights-operator-76bcd6ccf5-x8kmb"
Sep 10 04:41:33.907655 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.907632    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tk2t2\" (UniqueName: \"kubernetes.io/projected/61306ba6-2958-4dfb-84b4-e35336f7ec3d-kube-api-access-tk2t2\") pod \"volume-data-source-validator-695c895bd6-6r6cl\" (UID: \"61306ba6-2958-4dfb-84b4-e35336f7ec3d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-6r6cl"
Sep 10 04:41:33.908716 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.908688    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvzqz\" (UniqueName: \"kubernetes.io/projected/8b3ec8dc-1508-4537-8dc3-b9de1ff22d03-kube-api-access-dvzqz\") pod \"console-operator-85b454874b-p5zjp\" (UID: \"8b3ec8dc-1508-4537-8dc3-b9de1ff22d03\") " pod="openshift-console-operator/console-operator-85b454874b-p5zjp"
Sep 10 04:41:33.982036 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.982014    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-x8kmb"
Sep 10 04:41:33.992098 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.992076    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-6r6cl"
Sep 10 04:41:33.996440 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.996419    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqxnz\" (UniqueName: \"kubernetes.io/projected/1f30b38a-507b-4294-b1a1-d58d2bc2bfb3-kube-api-access-bqxnz\") pod \"cluster-samples-operator-7cdcfcf76c-x5xr6\" (UID: \"1f30b38a-507b-4294-b1a1-d58d2bc2bfb3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-x5xr6"
Sep 10 04:41:33.996557 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.996480    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjrz9\" (UniqueName: \"kubernetes.io/projected/107242dc-160c-4fff-b4d5-ac1b059ff6e1-kube-api-access-jjrz9\") pod \"router-default-7bff86c86-9d7sj\" (UID: \"107242dc-160c-4fff-b4d5-ac1b059ff6e1\") " pod="openshift-ingress/router-default-7bff86c86-9d7sj"
Sep 10 04:41:33.996557 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.996511    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwndn\" (UniqueName: \"kubernetes.io/projected/beaaafd1-47c4-4a3a-a985-bed140f007e6-kube-api-access-zwndn\") pod \"ingress-canary-vjxjf\" (UID: \"beaaafd1-47c4-4a3a-a985-bed140f007e6\") " pod="openshift-ingress-canary/ingress-canary-vjxjf"
Sep 10 04:41:33.996557 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.996537    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ef57e894-f8b4-464e-b814-3ceada543c28-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-tgcbl\" (UID: \"ef57e894-f8b4-464e-b814-3ceada543c28\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-tgcbl"
Sep 10 04:41:33.996898 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.996560    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5bnp\" (UniqueName: \"kubernetes.io/projected/ef57e894-f8b4-464e-b814-3ceada543c28-kube-api-access-d5bnp\") pod \"kube-storage-version-migrator-operator-8d7dd4675-tgcbl\" (UID: \"ef57e894-f8b4-464e-b814-3ceada543c28\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-tgcbl"
Sep 10 04:41:33.996898 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.996754    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/107242dc-160c-4fff-b4d5-ac1b059ff6e1-service-ca-bundle\") pod \"router-default-7bff86c86-9d7sj\" (UID: \"107242dc-160c-4fff-b4d5-ac1b059ff6e1\") " pod="openshift-ingress/router-default-7bff86c86-9d7sj"
Sep 10 04:41:33.996898 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.996795    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/107242dc-160c-4fff-b4d5-ac1b059ff6e1-metrics-certs\") pod \"router-default-7bff86c86-9d7sj\" (UID: \"107242dc-160c-4fff-b4d5-ac1b059ff6e1\") " pod="openshift-ingress/router-default-7bff86c86-9d7sj"
Sep 10 04:41:33.996898 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.996842    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1f30b38a-507b-4294-b1a1-d58d2bc2bfb3-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-x5xr6\" (UID: \"1f30b38a-507b-4294-b1a1-d58d2bc2bfb3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-x5xr6"
Sep 10 04:41:33.997130 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.996892    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/107242dc-160c-4fff-b4d5-ac1b059ff6e1-default-certificate\") pod \"router-default-7bff86c86-9d7sj\" (UID: \"107242dc-160c-4fff-b4d5-ac1b059ff6e1\") " pod="openshift-ingress/router-default-7bff86c86-9d7sj"
Sep 10 04:41:33.997130 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:33.996944    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/107242dc-160c-4fff-b4d5-ac1b059ff6e1-service-ca-bundle podName:107242dc-160c-4fff-b4d5-ac1b059ff6e1 nodeName:}" failed. No retries permitted until 2026-09-10 04:41:34.496927873 +0000 UTC m=+34.159385600 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/107242dc-160c-4fff-b4d5-ac1b059ff6e1-service-ca-bundle") pod "router-default-7bff86c86-9d7sj" (UID: "107242dc-160c-4fff-b4d5-ac1b059ff6e1") : configmap references non-existent config key: service-ca.crt
Sep 10 04:41:33.997130 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.996965    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ef57e894-f8b4-464e-b814-3ceada543c28-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-tgcbl\" (UID: \"ef57e894-f8b4-464e-b814-3ceada543c28\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-tgcbl"
Sep 10 04:41:33.997130 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.997001    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/107242dc-160c-4fff-b4d5-ac1b059ff6e1-stats-auth\") pod \"router-default-7bff86c86-9d7sj\" (UID: \"107242dc-160c-4fff-b4d5-ac1b059ff6e1\") " pod="openshift-ingress/router-default-7bff86c86-9d7sj"
Sep 10 04:41:33.997130 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.997027    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rz8gx\" (UniqueName: \"kubernetes.io/projected/7e644efa-0a6e-412b-b2a9-352dfeeed160-kube-api-access-rz8gx\") pod \"network-check-source-685456655f-hnd48\" (UID: \"7e644efa-0a6e-412b-b2a9-352dfeeed160\") " pod="openshift-network-diagnostics/network-check-source-685456655f-hnd48"
Sep 10 04:41:33.997130 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.997045    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/beaaafd1-47c4-4a3a-a985-bed140f007e6-cert\") pod \"ingress-canary-vjxjf\" (UID: \"beaaafd1-47c4-4a3a-a985-bed140f007e6\") " pod="openshift-ingress-canary/ingress-canary-vjxjf"
Sep 10 04:41:33.997426 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.997174    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ef57e894-f8b4-464e-b814-3ceada543c28-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-tgcbl\" (UID: \"ef57e894-f8b4-464e-b814-3ceada543c28\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-tgcbl"
Sep 10 04:41:33.997426 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:33.997320    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 10 04:41:33.997426 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:33.997372    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/107242dc-160c-4fff-b4d5-ac1b059ff6e1-metrics-certs podName:107242dc-160c-4fff-b4d5-ac1b059ff6e1 nodeName:}" failed. No retries permitted until 2026-09-10 04:41:34.497354137 +0000 UTC m=+34.159811866 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/107242dc-160c-4fff-b4d5-ac1b059ff6e1-metrics-certs") pod "router-default-7bff86c86-9d7sj" (UID: "107242dc-160c-4fff-b4d5-ac1b059ff6e1") : secret "router-metrics-certs-default" not found
Sep 10 04:41:33.997576 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:33.997539    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 10 04:41:33.997625 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:33.997589    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f30b38a-507b-4294-b1a1-d58d2bc2bfb3-samples-operator-tls podName:1f30b38a-507b-4294-b1a1-d58d2bc2bfb3 nodeName:}" failed. No retries permitted until 2026-09-10 04:41:34.497574235 +0000 UTC m=+34.160031966 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1f30b38a-507b-4294-b1a1-d58d2bc2bfb3-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-x5xr6" (UID: "1f30b38a-507b-4294-b1a1-d58d2bc2bfb3") : secret "samples-operator-tls" not found
Sep 10 04:41:33.999609 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.999565    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ef57e894-f8b4-464e-b814-3ceada543c28-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-tgcbl\" (UID: \"ef57e894-f8b4-464e-b814-3ceada543c28\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-tgcbl"
Sep 10 04:41:33.999956 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:33.999935    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/beaaafd1-47c4-4a3a-a985-bed140f007e6-cert\") pod \"ingress-canary-vjxjf\" (UID: \"beaaafd1-47c4-4a3a-a985-bed140f007e6\") " pod="openshift-ingress-canary/ingress-canary-vjxjf"
Sep 10 04:41:34.000221 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:34.000199    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/107242dc-160c-4fff-b4d5-ac1b059ff6e1-stats-auth\") pod \"router-default-7bff86c86-9d7sj\" (UID: \"107242dc-160c-4fff-b4d5-ac1b059ff6e1\") " pod="openshift-ingress/router-default-7bff86c86-9d7sj"
Sep 10 04:41:34.001788 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:34.001747    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/107242dc-160c-4fff-b4d5-ac1b059ff6e1-default-certificate\") pod \"router-default-7bff86c86-9d7sj\" (UID: \"107242dc-160c-4fff-b4d5-ac1b059ff6e1\") " pod="openshift-ingress/router-default-7bff86c86-9d7sj"
Sep 10 04:41:34.006219 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:34.006172    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjrz9\" (UniqueName: \"kubernetes.io/projected/107242dc-160c-4fff-b4d5-ac1b059ff6e1-kube-api-access-jjrz9\") pod \"router-default-7bff86c86-9d7sj\" (UID: \"107242dc-160c-4fff-b4d5-ac1b059ff6e1\") " pod="openshift-ingress/router-default-7bff86c86-9d7sj"
Sep 10 04:41:34.006416 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:34.006392    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rz8gx\" (UniqueName: \"kubernetes.io/projected/7e644efa-0a6e-412b-b2a9-352dfeeed160-kube-api-access-rz8gx\") pod \"network-check-source-685456655f-hnd48\" (UID: \"7e644efa-0a6e-412b-b2a9-352dfeeed160\") " pod="openshift-network-diagnostics/network-check-source-685456655f-hnd48"
Sep 10 04:41:34.007777 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:34.007493    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwndn\" (UniqueName: \"kubernetes.io/projected/beaaafd1-47c4-4a3a-a985-bed140f007e6-kube-api-access-zwndn\") pod \"ingress-canary-vjxjf\" (UID: \"beaaafd1-47c4-4a3a-a985-bed140f007e6\") " pod="openshift-ingress-canary/ingress-canary-vjxjf"
Sep 10 04:41:34.008339 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:34.008296    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5bnp\" (UniqueName: \"kubernetes.io/projected/ef57e894-f8b4-464e-b814-3ceada543c28-kube-api-access-d5bnp\") pod \"kube-storage-version-migrator-operator-8d7dd4675-tgcbl\" (UID: \"ef57e894-f8b4-464e-b814-3ceada543c28\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-tgcbl"
Sep 10 04:41:34.008430 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:34.008412    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqxnz\" (UniqueName: \"kubernetes.io/projected/1f30b38a-507b-4294-b1a1-d58d2bc2bfb3-kube-api-access-bqxnz\") pod \"cluster-samples-operator-7cdcfcf76c-x5xr6\" (UID: \"1f30b38a-507b-4294-b1a1-d58d2bc2bfb3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-x5xr6"
Sep 10 04:41:34.027928 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:34.027902    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-p5zjp"
Sep 10 04:41:34.039140 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:34.039116    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-hkjtg"
Sep 10 04:41:34.068188 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:34.068165    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-tgcbl"
Sep 10 04:41:34.081951 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:34.081920    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-hnd48"
Sep 10 04:41:34.109152 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:34.108710    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vjxjf"
Sep 10 04:41:34.302544 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:34.302507    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-6r6cl"]
Sep 10 04:41:34.303711 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:34.303618    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-x8kmb"]
Sep 10 04:41:34.306191 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:34.306164    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0f33b82_87c0_4c48_a093_a91e3317cf73.slice/crio-70c7d59b2653781df6186f8452459947e3f31d19489c1757d820f50b592183fb WatchSource:0}: Error finding container 70c7d59b2653781df6186f8452459947e3f31d19489c1757d820f50b592183fb: Status 404 returned error can't find the container with id 70c7d59b2653781df6186f8452459947e3f31d19489c1757d820f50b592183fb
Sep 10 04:41:34.306906 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:34.306880    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61306ba6_2958_4dfb_84b4_e35336f7ec3d.slice/crio-0d3dccba7516ba585cecec2c69f905901975a3ba4d4fc3b535c7ff5ff728565a WatchSource:0}: Error finding container 0d3dccba7516ba585cecec2c69f905901975a3ba4d4fc3b535c7ff5ff728565a: Status 404 returned error can't find the container with id 0d3dccba7516ba585cecec2c69f905901975a3ba4d4fc3b535c7ff5ff728565a
Sep 10 04:41:34.343812 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:34.343787    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-p5zjp"]
Sep 10 04:41:34.346669 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:34.346638    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b3ec8dc_1508_4537_8dc3_b9de1ff22d03.slice/crio-5dacfc393bffdb17100befa1e07038f8046d97061204e7df335276c562597178 WatchSource:0}: Error finding container 5dacfc393bffdb17100befa1e07038f8046d97061204e7df335276c562597178: Status 404 returned error can't find the container with id 5dacfc393bffdb17100befa1e07038f8046d97061204e7df335276c562597178
Sep 10 04:41:34.372872 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:34.372826    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-hkjtg"]
Sep 10 04:41:34.375644 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:34.375619    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5552ac0d_5458_4244_9cb1_e278a75e0451.slice/crio-39f07b5e43dc2461609aa63f3716396f7d632337aaa9ad3ab3f362177920298a WatchSource:0}: Error finding container 39f07b5e43dc2461609aa63f3716396f7d632337aaa9ad3ab3f362177920298a: Status 404 returned error can't find the container with id 39f07b5e43dc2461609aa63f3716396f7d632337aaa9ad3ab3f362177920298a
Sep 10 04:41:34.396533 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:34.396479    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-tgcbl"]
Sep 10 04:41:34.398891 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:34.398867    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef57e894_f8b4_464e_b814_3ceada543c28.slice/crio-f25c16a5b56457fc9274345c5304052888179c7599ce55cd408d3045dcfa96ae WatchSource:0}: Error finding container f25c16a5b56457fc9274345c5304052888179c7599ce55cd408d3045dcfa96ae: Status 404 returned error can't find the container with id f25c16a5b56457fc9274345c5304052888179c7599ce55cd408d3045dcfa96ae
Sep 10 04:41:34.401040 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:34.400986    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/345fe3ae-0c3e-4924-af34-bf06acf51ac4-metrics-tls\") pod \"dns-default-tkl9f\" (UID: \"345fe3ae-0c3e-4924-af34-bf06acf51ac4\") " pod="openshift-dns/dns-default-tkl9f"
Sep 10 04:41:34.401100 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:34.401035    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1529c81a-0935-4a33-a02a-39323d37b580-registry-tls\") pod \"image-registry-77586cf744-p4w2v\" (UID: \"1529c81a-0935-4a33-a02a-39323d37b580\") " pod="openshift-image-registry/image-registry-77586cf744-p4w2v"
Sep 10 04:41:34.401155 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:34.401137    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/92e0e646-b15f-45be-8797-fcac67a89fd1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-mpw59\" (UID: \"92e0e646-b15f-45be-8797-fcac67a89fd1\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-mpw59"
Sep 10 04:41:34.401766 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:34.401289    2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 10 04:41:34.401766 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:34.401347    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92e0e646-b15f-45be-8797-fcac67a89fd1-cluster-monitoring-operator-tls podName:92e0e646-b15f-45be-8797-fcac67a89fd1 nodeName:}" failed. No retries permitted until 2026-09-10 04:41:35.40132877 +0000 UTC m=+35.063786499 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/92e0e646-b15f-45be-8797-fcac67a89fd1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-mpw59" (UID: "92e0e646-b15f-45be-8797-fcac67a89fd1") : secret "cluster-monitoring-operator-tls" not found
Sep 10 04:41:34.401766 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:34.401656    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 04:41:34.401766 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:34.401698    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 04:41:34.401766 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:34.401707    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/345fe3ae-0c3e-4924-af34-bf06acf51ac4-metrics-tls podName:345fe3ae-0c3e-4924-af34-bf06acf51ac4 nodeName:}" failed. No retries permitted until 2026-09-10 04:41:35.401689926 +0000 UTC m=+35.064147668 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/345fe3ae-0c3e-4924-af34-bf06acf51ac4-metrics-tls") pod "dns-default-tkl9f" (UID: "345fe3ae-0c3e-4924-af34-bf06acf51ac4") : secret "dns-default-metrics-tls" not found
Sep 10 04:41:34.401766 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:34.401711    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77586cf744-p4w2v: secret "image-registry-tls" not found
Sep 10 04:41:34.401766 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:34.401734    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-hnd48"]
Sep 10 04:41:34.401766 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:34.401760    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1529c81a-0935-4a33-a02a-39323d37b580-registry-tls podName:1529c81a-0935-4a33-a02a-39323d37b580 nodeName:}" failed. No retries permitted until 2026-09-10 04:41:35.40174619 +0000 UTC m=+35.064203921 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1529c81a-0935-4a33-a02a-39323d37b580-registry-tls") pod "image-registry-77586cf744-p4w2v" (UID: "1529c81a-0935-4a33-a02a-39323d37b580") : secret "image-registry-tls" not found
Sep 10 04:41:34.403372 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:34.403350    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e644efa_0a6e_412b_b2a9_352dfeeed160.slice/crio-359fadb15230e4c558477e88b84eda6eee42e666d83ee8c56df65b6a69e593cb WatchSource:0}: Error finding container 359fadb15230e4c558477e88b84eda6eee42e666d83ee8c56df65b6a69e593cb: Status 404 returned error can't find the container with id 359fadb15230e4c558477e88b84eda6eee42e666d83ee8c56df65b6a69e593cb
Sep 10 04:41:34.426521 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:34.426492    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vjxjf"]
Sep 10 04:41:34.430382 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:34.430354    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbeaaafd1_47c4_4a3a_a985_bed140f007e6.slice/crio-20fa29f76268a2f44800deef2e3056889a44b03aff2cb8862e0cb6d77276112d WatchSource:0}: Error finding container 20fa29f76268a2f44800deef2e3056889a44b03aff2cb8862e0cb6d77276112d: Status 404 returned error can't find the container with id 20fa29f76268a2f44800deef2e3056889a44b03aff2cb8862e0cb6d77276112d
Sep 10 04:41:34.502213 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:34.502183    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/107242dc-160c-4fff-b4d5-ac1b059ff6e1-service-ca-bundle\") pod \"router-default-7bff86c86-9d7sj\" (UID: \"107242dc-160c-4fff-b4d5-ac1b059ff6e1\") " pod="openshift-ingress/router-default-7bff86c86-9d7sj"
Sep 10 04:41:34.502363 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:34.502228    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/107242dc-160c-4fff-b4d5-ac1b059ff6e1-metrics-certs\") pod \"router-default-7bff86c86-9d7sj\" (UID: \"107242dc-160c-4fff-b4d5-ac1b059ff6e1\") " pod="openshift-ingress/router-default-7bff86c86-9d7sj"
Sep 10 04:41:34.502363 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:34.502272    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1f30b38a-507b-4294-b1a1-d58d2bc2bfb3-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-x5xr6\" (UID: \"1f30b38a-507b-4294-b1a1-d58d2bc2bfb3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-x5xr6"
Sep 10 04:41:34.502363 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:34.502352    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/107242dc-160c-4fff-b4d5-ac1b059ff6e1-service-ca-bundle podName:107242dc-160c-4fff-b4d5-ac1b059ff6e1 nodeName:}" failed. No retries permitted until 2026-09-10 04:41:35.502330818 +0000 UTC m=+35.164788567 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/107242dc-160c-4fff-b4d5-ac1b059ff6e1-service-ca-bundle") pod "router-default-7bff86c86-9d7sj" (UID: "107242dc-160c-4fff-b4d5-ac1b059ff6e1") : configmap references non-existent config key: service-ca.crt
Sep 10 04:41:34.502546 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:34.502395    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 10 04:41:34.502546 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:34.502396    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 10 04:41:34.502546 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:34.502452    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f30b38a-507b-4294-b1a1-d58d2bc2bfb3-samples-operator-tls podName:1f30b38a-507b-4294-b1a1-d58d2bc2bfb3 nodeName:}" failed. No retries permitted until 2026-09-10 04:41:35.502433272 +0000 UTC m=+35.164891002 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1f30b38a-507b-4294-b1a1-d58d2bc2bfb3-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-x5xr6" (UID: "1f30b38a-507b-4294-b1a1-d58d2bc2bfb3") : secret "samples-operator-tls" not found
Sep 10 04:41:34.502546 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:34.502476    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/107242dc-160c-4fff-b4d5-ac1b059ff6e1-metrics-certs podName:107242dc-160c-4fff-b4d5-ac1b059ff6e1 nodeName:}" failed. No retries permitted until 2026-09-10 04:41:35.502463557 +0000 UTC m=+35.164921302 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/107242dc-160c-4fff-b4d5-ac1b059ff6e1-metrics-certs") pod "router-default-7bff86c86-9d7sj" (UID: "107242dc-160c-4fff-b4d5-ac1b059ff6e1") : secret "router-metrics-certs-default" not found
Sep 10 04:41:34.602907 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:34.602878    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13570f73-c21d-4771-8349-f30c25ab27fb-metrics-certs\") pod \"network-metrics-daemon-n2sr7\" (UID: \"13570f73-c21d-4771-8349-f30c25ab27fb\") " pod="openshift-multus/network-metrics-daemon-n2sr7"
Sep 10 04:41:34.603058 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:34.602920    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5e472a47-9b1d-4f3e-be2f-36ac4b0ebc7f-original-pull-secret\") pod \"global-pull-secret-syncer-77cd4\" (UID: \"5e472a47-9b1d-4f3e-be2f-36ac4b0ebc7f\") " pod="kube-system/global-pull-secret-syncer-77cd4"
Sep 10 04:41:34.603058 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:34.603006    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 04:41:34.603058 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:34.603053    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13570f73-c21d-4771-8349-f30c25ab27fb-metrics-certs podName:13570f73-c21d-4771-8349-f30c25ab27fb nodeName:}" failed. No retries permitted until 2026-09-10 04:42:06.603042258 +0000 UTC m=+66.265499982 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/13570f73-c21d-4771-8349-f30c25ab27fb-metrics-certs") pod "network-metrics-daemon-n2sr7" (UID: "13570f73-c21d-4771-8349-f30c25ab27fb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 04:41:34.603162 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:34.603014    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 04:41:34.603162 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:34.603107    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e472a47-9b1d-4f3e-be2f-36ac4b0ebc7f-original-pull-secret podName:5e472a47-9b1d-4f3e-be2f-36ac4b0ebc7f nodeName:}" failed. No retries permitted until 2026-09-10 04:42:06.603095109 +0000 UTC m=+66.265552849 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5e472a47-9b1d-4f3e-be2f-36ac4b0ebc7f-original-pull-secret") pod "global-pull-secret-syncer-77cd4" (UID: "5e472a47-9b1d-4f3e-be2f-36ac4b0ebc7f") : object "kube-system"/"original-pull-secret" not registered
Sep 10 04:41:34.704215 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:34.704150    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zsr7\" (UniqueName: \"kubernetes.io/projected/d9c2d9dc-e666-442f-b8f4-98b917db1a7f-kube-api-access-4zsr7\") pod \"network-check-target-kq4qp\" (UID: \"d9c2d9dc-e666-442f-b8f4-98b917db1a7f\") " pod="openshift-network-diagnostics/network-check-target-kq4qp"
Sep 10 04:41:34.707810 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:34.707780    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zsr7\" (UniqueName: \"kubernetes.io/projected/d9c2d9dc-e666-442f-b8f4-98b917db1a7f-kube-api-access-4zsr7\") pod \"network-check-target-kq4qp\" (UID: \"d9c2d9dc-e666-442f-b8f4-98b917db1a7f\") " pod="openshift-network-diagnostics/network-check-target-kq4qp"
Sep 10 04:41:34.818965 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:34.818938    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n2sr7"
Sep 10 04:41:34.819175 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:34.819133    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-77cd4"
Sep 10 04:41:34.819248 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:34.819203    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kq4qp"
Sep 10 04:41:34.821988 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:34.821967    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 10 04:41:34.822130 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:34.821997    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gx84n\""
Sep 10 04:41:34.822130 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:34.822005    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jksxr\""
Sep 10 04:41:34.822130 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:34.822082    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 10 04:41:34.835416 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:34.835401    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kq4qp"
Sep 10 04:41:34.977098 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:34.977021    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-p5zjp" event={"ID":"8b3ec8dc-1508-4537-8dc3-b9de1ff22d03","Type":"ContainerStarted","Data":"5dacfc393bffdb17100befa1e07038f8046d97061204e7df335276c562597178"}
Sep 10 04:41:34.978598 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:34.978572    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-x8kmb" event={"ID":"b0f33b82-87c0-4c48-a093-a91e3317cf73","Type":"ContainerStarted","Data":"70c7d59b2653781df6186f8452459947e3f31d19489c1757d820f50b592183fb"}
Sep 10 04:41:34.980133 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:34.980095    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-6r6cl" event={"ID":"61306ba6-2958-4dfb-84b4-e35336f7ec3d","Type":"ContainerStarted","Data":"0d3dccba7516ba585cecec2c69f905901975a3ba4d4fc3b535c7ff5ff728565a"}
Sep 10 04:41:34.981584 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:34.981558    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vjxjf" event={"ID":"beaaafd1-47c4-4a3a-a985-bed140f007e6","Type":"ContainerStarted","Data":"20fa29f76268a2f44800deef2e3056889a44b03aff2cb8862e0cb6d77276112d"}
Sep 10 04:41:34.983107 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:34.983081    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-hnd48" event={"ID":"7e644efa-0a6e-412b-b2a9-352dfeeed160","Type":"ContainerStarted","Data":"359fadb15230e4c558477e88b84eda6eee42e666d83ee8c56df65b6a69e593cb"}
Sep 10 04:41:34.984429 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:34.984365    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-tgcbl" event={"ID":"ef57e894-f8b4-464e-b814-3ceada543c28","Type":"ContainerStarted","Data":"f25c16a5b56457fc9274345c5304052888179c7599ce55cd408d3045dcfa96ae"}
Sep 10 04:41:34.985701 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:34.985656    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-hkjtg" event={"ID":"5552ac0d-5458-4244-9cb1-e278a75e0451","Type":"ContainerStarted","Data":"39f07b5e43dc2461609aa63f3716396f7d632337aaa9ad3ab3f362177920298a"}
Sep 10 04:41:35.130340 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:35.130308    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kq4qp"]
Sep 10 04:41:35.409578 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:35.409545    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/345fe3ae-0c3e-4924-af34-bf06acf51ac4-metrics-tls\") pod \"dns-default-tkl9f\" (UID: \"345fe3ae-0c3e-4924-af34-bf06acf51ac4\") " pod="openshift-dns/dns-default-tkl9f"
Sep 10 04:41:35.409866 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:35.409605    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1529c81a-0935-4a33-a02a-39323d37b580-registry-tls\") pod \"image-registry-77586cf744-p4w2v\" (UID: \"1529c81a-0935-4a33-a02a-39323d37b580\") " pod="openshift-image-registry/image-registry-77586cf744-p4w2v"
Sep 10 04:41:35.409866 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:35.409680    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/92e0e646-b15f-45be-8797-fcac67a89fd1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-mpw59\" (UID: \"92e0e646-b15f-45be-8797-fcac67a89fd1\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-mpw59"
Sep 10 04:41:35.409993 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:35.409934    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 04:41:35.410045 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:35.409998    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/345fe3ae-0c3e-4924-af34-bf06acf51ac4-metrics-tls podName:345fe3ae-0c3e-4924-af34-bf06acf51ac4 nodeName:}" failed. No retries permitted until 2026-09-10 04:41:37.409978573 +0000 UTC m=+37.072436305 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/345fe3ae-0c3e-4924-af34-bf06acf51ac4-metrics-tls") pod "dns-default-tkl9f" (UID: "345fe3ae-0c3e-4924-af34-bf06acf51ac4") : secret "dns-default-metrics-tls" not found
Sep 10 04:41:35.410524 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:35.410392    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 04:41:35.410524 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:35.410409    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77586cf744-p4w2v: secret "image-registry-tls" not found
Sep 10 04:41:35.410524 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:35.410451    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1529c81a-0935-4a33-a02a-39323d37b580-registry-tls podName:1529c81a-0935-4a33-a02a-39323d37b580 nodeName:}" failed. No retries permitted until 2026-09-10 04:41:37.410437077 +0000 UTC m=+37.072894809 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1529c81a-0935-4a33-a02a-39323d37b580-registry-tls") pod "image-registry-77586cf744-p4w2v" (UID: "1529c81a-0935-4a33-a02a-39323d37b580") : secret "image-registry-tls" not found
Sep 10 04:41:35.410524 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:35.409844    2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 10 04:41:35.410524 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:35.410523    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92e0e646-b15f-45be-8797-fcac67a89fd1-cluster-monitoring-operator-tls podName:92e0e646-b15f-45be-8797-fcac67a89fd1 nodeName:}" failed. No retries permitted until 2026-09-10 04:41:37.410508745 +0000 UTC m=+37.072966671 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/92e0e646-b15f-45be-8797-fcac67a89fd1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-mpw59" (UID: "92e0e646-b15f-45be-8797-fcac67a89fd1") : secret "cluster-monitoring-operator-tls" not found
Sep 10 04:41:35.510451 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:35.510419    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/107242dc-160c-4fff-b4d5-ac1b059ff6e1-service-ca-bundle\") pod \"router-default-7bff86c86-9d7sj\" (UID: \"107242dc-160c-4fff-b4d5-ac1b059ff6e1\") " pod="openshift-ingress/router-default-7bff86c86-9d7sj"
Sep 10 04:41:35.510601 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:35.510468    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/107242dc-160c-4fff-b4d5-ac1b059ff6e1-metrics-certs\") pod \"router-default-7bff86c86-9d7sj\" (UID: \"107242dc-160c-4fff-b4d5-ac1b059ff6e1\") " pod="openshift-ingress/router-default-7bff86c86-9d7sj"
Sep 10 04:41:35.510601 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:35.510516    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1f30b38a-507b-4294-b1a1-d58d2bc2bfb3-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-x5xr6\" (UID: \"1f30b38a-507b-4294-b1a1-d58d2bc2bfb3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-x5xr6"
Sep 10 04:41:35.510767 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:35.510728    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 10 04:41:35.510824 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:35.510786    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f30b38a-507b-4294-b1a1-d58d2bc2bfb3-samples-operator-tls podName:1f30b38a-507b-4294-b1a1-d58d2bc2bfb3 nodeName:}" failed. No retries permitted until 2026-09-10 04:41:37.510768567 +0000 UTC m=+37.173226311 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1f30b38a-507b-4294-b1a1-d58d2bc2bfb3-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-x5xr6" (UID: "1f30b38a-507b-4294-b1a1-d58d2bc2bfb3") : secret "samples-operator-tls" not found
Sep 10 04:41:35.511192 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:35.511172    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/107242dc-160c-4fff-b4d5-ac1b059ff6e1-service-ca-bundle podName:107242dc-160c-4fff-b4d5-ac1b059ff6e1 nodeName:}" failed. No retries permitted until 2026-09-10 04:41:37.511156594 +0000 UTC m=+37.173614323 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/107242dc-160c-4fff-b4d5-ac1b059ff6e1-service-ca-bundle") pod "router-default-7bff86c86-9d7sj" (UID: "107242dc-160c-4fff-b4d5-ac1b059ff6e1") : configmap references non-existent config key: service-ca.crt
Sep 10 04:41:35.511287 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:35.511253    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 10 04:41:35.511346 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:35.511288    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/107242dc-160c-4fff-b4d5-ac1b059ff6e1-metrics-certs podName:107242dc-160c-4fff-b4d5-ac1b059ff6e1 nodeName:}" failed. No retries permitted until 2026-09-10 04:41:37.511276688 +0000 UTC m=+37.173734427 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/107242dc-160c-4fff-b4d5-ac1b059ff6e1-metrics-certs") pod "router-default-7bff86c86-9d7sj" (UID: "107242dc-160c-4fff-b4d5-ac1b059ff6e1") : secret "router-metrics-certs-default" not found
Sep 10 04:41:37.178318 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:41:37.178280    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9c2d9dc_e666_442f_b8f4_98b917db1a7f.slice/crio-3dd27d1694e59c1ee15b5bc98dbb4f692708f5e7f1527cebcca7993cdbace7a6 WatchSource:0}: Error finding container 3dd27d1694e59c1ee15b5bc98dbb4f692708f5e7f1527cebcca7993cdbace7a6: Status 404 returned error can't find the container with id 3dd27d1694e59c1ee15b5bc98dbb4f692708f5e7f1527cebcca7993cdbace7a6
Sep 10 04:41:37.429279 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:37.429199    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/345fe3ae-0c3e-4924-af34-bf06acf51ac4-metrics-tls\") pod \"dns-default-tkl9f\" (UID: \"345fe3ae-0c3e-4924-af34-bf06acf51ac4\") " pod="openshift-dns/dns-default-tkl9f"
Sep 10 04:41:37.429279 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:37.429243    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1529c81a-0935-4a33-a02a-39323d37b580-registry-tls\") pod \"image-registry-77586cf744-p4w2v\" (UID: \"1529c81a-0935-4a33-a02a-39323d37b580\") " pod="openshift-image-registry/image-registry-77586cf744-p4w2v"
Sep 10 04:41:37.429492 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:37.429301    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/92e0e646-b15f-45be-8797-fcac67a89fd1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-mpw59\" (UID: \"92e0e646-b15f-45be-8797-fcac67a89fd1\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-mpw59"
Sep 10 04:41:37.429492 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:37.429386    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 04:41:37.429492 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:37.429408    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 04:41:37.429492 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:37.429425    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77586cf744-p4w2v: secret "image-registry-tls" not found
Sep 10 04:41:37.429492 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:37.429437    2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 10 04:41:37.429492 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:37.429464    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/345fe3ae-0c3e-4924-af34-bf06acf51ac4-metrics-tls podName:345fe3ae-0c3e-4924-af34-bf06acf51ac4 nodeName:}" failed. No retries permitted until 2026-09-10 04:41:41.429444063 +0000 UTC m=+41.091901803 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/345fe3ae-0c3e-4924-af34-bf06acf51ac4-metrics-tls") pod "dns-default-tkl9f" (UID: "345fe3ae-0c3e-4924-af34-bf06acf51ac4") : secret "dns-default-metrics-tls" not found
Sep 10 04:41:37.429492 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:37.429496    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1529c81a-0935-4a33-a02a-39323d37b580-registry-tls podName:1529c81a-0935-4a33-a02a-39323d37b580 nodeName:}" failed. No retries permitted until 2026-09-10 04:41:41.42948926 +0000 UTC m=+41.091946985 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1529c81a-0935-4a33-a02a-39323d37b580-registry-tls") pod "image-registry-77586cf744-p4w2v" (UID: "1529c81a-0935-4a33-a02a-39323d37b580") : secret "image-registry-tls" not found
Sep 10 04:41:37.429812 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:37.429510    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92e0e646-b15f-45be-8797-fcac67a89fd1-cluster-monitoring-operator-tls podName:92e0e646-b15f-45be-8797-fcac67a89fd1 nodeName:}" failed. No retries permitted until 2026-09-10 04:41:41.429501477 +0000 UTC m=+41.091959201 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/92e0e646-b15f-45be-8797-fcac67a89fd1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-mpw59" (UID: "92e0e646-b15f-45be-8797-fcac67a89fd1") : secret "cluster-monitoring-operator-tls" not found
Sep 10 04:41:37.530770 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:37.530739    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/107242dc-160c-4fff-b4d5-ac1b059ff6e1-service-ca-bundle\") pod \"router-default-7bff86c86-9d7sj\" (UID: \"107242dc-160c-4fff-b4d5-ac1b059ff6e1\") " pod="openshift-ingress/router-default-7bff86c86-9d7sj"
Sep 10 04:41:37.530980 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:37.530785    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/107242dc-160c-4fff-b4d5-ac1b059ff6e1-metrics-certs\") pod \"router-default-7bff86c86-9d7sj\" (UID: \"107242dc-160c-4fff-b4d5-ac1b059ff6e1\") " pod="openshift-ingress/router-default-7bff86c86-9d7sj"
Sep 10 04:41:37.530980 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:37.530835    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1f30b38a-507b-4294-b1a1-d58d2bc2bfb3-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-x5xr6\" (UID: \"1f30b38a-507b-4294-b1a1-d58d2bc2bfb3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-x5xr6"
Sep 10 04:41:37.530980 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:37.530936    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/107242dc-160c-4fff-b4d5-ac1b059ff6e1-service-ca-bundle podName:107242dc-160c-4fff-b4d5-ac1b059ff6e1 nodeName:}" failed. No retries permitted until 2026-09-10 04:41:41.530906376 +0000 UTC m=+41.193364101 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/107242dc-160c-4fff-b4d5-ac1b059ff6e1-service-ca-bundle") pod "router-default-7bff86c86-9d7sj" (UID: "107242dc-160c-4fff-b4d5-ac1b059ff6e1") : configmap references non-existent config key: service-ca.crt
Sep 10 04:41:37.531167 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:37.531001    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 10 04:41:37.531167 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:37.531016    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 10 04:41:37.531167 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:37.531055    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/107242dc-160c-4fff-b4d5-ac1b059ff6e1-metrics-certs podName:107242dc-160c-4fff-b4d5-ac1b059ff6e1 nodeName:}" failed. No retries permitted until 2026-09-10 04:41:41.531039044 +0000 UTC m=+41.193496787 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/107242dc-160c-4fff-b4d5-ac1b059ff6e1-metrics-certs") pod "router-default-7bff86c86-9d7sj" (UID: "107242dc-160c-4fff-b4d5-ac1b059ff6e1") : secret "router-metrics-certs-default" not found
Sep 10 04:41:37.531167 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:37.531074    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f30b38a-507b-4294-b1a1-d58d2bc2bfb3-samples-operator-tls podName:1f30b38a-507b-4294-b1a1-d58d2bc2bfb3 nodeName:}" failed. No retries permitted until 2026-09-10 04:41:41.531064848 +0000 UTC m=+41.193522578 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1f30b38a-507b-4294-b1a1-d58d2bc2bfb3-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-x5xr6" (UID: "1f30b38a-507b-4294-b1a1-d58d2bc2bfb3") : secret "samples-operator-tls" not found
Sep 10 04:41:37.995472 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:37.995425    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kq4qp" event={"ID":"d9c2d9dc-e666-442f-b8f4-98b917db1a7f","Type":"ContainerStarted","Data":"3dd27d1694e59c1ee15b5bc98dbb4f692708f5e7f1527cebcca7993cdbace7a6"}
Sep 10 04:41:41.473450 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:41.473416    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/345fe3ae-0c3e-4924-af34-bf06acf51ac4-metrics-tls\") pod \"dns-default-tkl9f\" (UID: \"345fe3ae-0c3e-4924-af34-bf06acf51ac4\") " pod="openshift-dns/dns-default-tkl9f"
Sep 10 04:41:41.474024 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:41.473472    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1529c81a-0935-4a33-a02a-39323d37b580-registry-tls\") pod \"image-registry-77586cf744-p4w2v\" (UID: \"1529c81a-0935-4a33-a02a-39323d37b580\") " pod="openshift-image-registry/image-registry-77586cf744-p4w2v"
Sep 10 04:41:41.474024 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:41.473545    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/92e0e646-b15f-45be-8797-fcac67a89fd1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-mpw59\" (UID: \"92e0e646-b15f-45be-8797-fcac67a89fd1\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-mpw59"
Sep 10 04:41:41.474024 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:41.473590    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 04:41:41.474024 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:41.473660    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 04:41:41.474024 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:41.473676    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/345fe3ae-0c3e-4924-af34-bf06acf51ac4-metrics-tls podName:345fe3ae-0c3e-4924-af34-bf06acf51ac4 nodeName:}" failed. No retries permitted until 2026-09-10 04:41:49.473655062 +0000 UTC m=+49.136112812 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/345fe3ae-0c3e-4924-af34-bf06acf51ac4-metrics-tls") pod "dns-default-tkl9f" (UID: "345fe3ae-0c3e-4924-af34-bf06acf51ac4") : secret "dns-default-metrics-tls" not found
Sep 10 04:41:41.474024 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:41.473681    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77586cf744-p4w2v: secret "image-registry-tls" not found
Sep 10 04:41:41.474024 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:41.473695    2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 10 04:41:41.474024 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:41.473740    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1529c81a-0935-4a33-a02a-39323d37b580-registry-tls podName:1529c81a-0935-4a33-a02a-39323d37b580 nodeName:}" failed. No retries permitted until 2026-09-10 04:41:49.473720011 +0000 UTC m=+49.136177753 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1529c81a-0935-4a33-a02a-39323d37b580-registry-tls") pod "image-registry-77586cf744-p4w2v" (UID: "1529c81a-0935-4a33-a02a-39323d37b580") : secret "image-registry-tls" not found
Sep 10 04:41:41.474024 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:41.473755    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92e0e646-b15f-45be-8797-fcac67a89fd1-cluster-monitoring-operator-tls podName:92e0e646-b15f-45be-8797-fcac67a89fd1 nodeName:}" failed. No retries permitted until 2026-09-10 04:41:49.473748574 +0000 UTC m=+49.136206299 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/92e0e646-b15f-45be-8797-fcac67a89fd1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-mpw59" (UID: "92e0e646-b15f-45be-8797-fcac67a89fd1") : secret "cluster-monitoring-operator-tls" not found
Sep 10 04:41:41.575006 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:41.574935    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/107242dc-160c-4fff-b4d5-ac1b059ff6e1-service-ca-bundle\") pod \"router-default-7bff86c86-9d7sj\" (UID: \"107242dc-160c-4fff-b4d5-ac1b059ff6e1\") " pod="openshift-ingress/router-default-7bff86c86-9d7sj"
Sep 10 04:41:41.575006 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:41.574972    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/107242dc-160c-4fff-b4d5-ac1b059ff6e1-metrics-certs\") pod \"router-default-7bff86c86-9d7sj\" (UID: \"107242dc-160c-4fff-b4d5-ac1b059ff6e1\") " pod="openshift-ingress/router-default-7bff86c86-9d7sj"
Sep 10 04:41:41.575227 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:41.575009    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1f30b38a-507b-4294-b1a1-d58d2bc2bfb3-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-x5xr6\" (UID: \"1f30b38a-507b-4294-b1a1-d58d2bc2bfb3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-x5xr6"
Sep 10 04:41:41.575227 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:41.575116    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/107242dc-160c-4fff-b4d5-ac1b059ff6e1-service-ca-bundle podName:107242dc-160c-4fff-b4d5-ac1b059ff6e1 nodeName:}" failed. No retries permitted until 2026-09-10 04:41:49.575097919 +0000 UTC m=+49.237555662 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/107242dc-160c-4fff-b4d5-ac1b059ff6e1-service-ca-bundle") pod "router-default-7bff86c86-9d7sj" (UID: "107242dc-160c-4fff-b4d5-ac1b059ff6e1") : configmap references non-existent config key: service-ca.crt
Sep 10 04:41:41.575227 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:41.575118    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 10 04:41:41.575227 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:41.575117    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 10 04:41:41.575470 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:41.575156    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f30b38a-507b-4294-b1a1-d58d2bc2bfb3-samples-operator-tls podName:1f30b38a-507b-4294-b1a1-d58d2bc2bfb3 nodeName:}" failed. No retries permitted until 2026-09-10 04:41:49.575147562 +0000 UTC m=+49.237605302 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1f30b38a-507b-4294-b1a1-d58d2bc2bfb3-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-x5xr6" (UID: "1f30b38a-507b-4294-b1a1-d58d2bc2bfb3") : secret "samples-operator-tls" not found
Sep 10 04:41:41.575764 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:41.575744    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/107242dc-160c-4fff-b4d5-ac1b059ff6e1-metrics-certs podName:107242dc-160c-4fff-b4d5-ac1b059ff6e1 nodeName:}" failed. No retries permitted until 2026-09-10 04:41:49.575726044 +0000 UTC m=+49.238183769 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/107242dc-160c-4fff-b4d5-ac1b059ff6e1-metrics-certs") pod "router-default-7bff86c86-9d7sj" (UID: "107242dc-160c-4fff-b4d5-ac1b059ff6e1") : secret "router-metrics-certs-default" not found
Sep 10 04:41:44.013317 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:44.013074    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-6r6cl" event={"ID":"61306ba6-2958-4dfb-84b4-e35336f7ec3d","Type":"ContainerStarted","Data":"a67fb09fa755f0bf39a14eba6b63a3f6ef79a8cd17bc36d1b94065fb7518146b"}
Sep 10 04:41:44.015112 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:44.015081    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kq4qp" event={"ID":"d9c2d9dc-e666-442f-b8f4-98b917db1a7f","Type":"ContainerStarted","Data":"3cb246f577c3a1a8819faae720f84121c4da70a6f18c317312baf7de11ed9abf"}
Sep 10 04:41:44.015250 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:44.015166    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-kq4qp"
Sep 10 04:41:44.017019 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:44.016973    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vjxjf" event={"ID":"beaaafd1-47c4-4a3a-a985-bed140f007e6","Type":"ContainerStarted","Data":"844f35826d54fffd11a0bcf1a42e84c74f84efa47265225d52ec08de24a890fd"}
Sep 10 04:41:44.018698 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:44.018670    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-hnd48" event={"ID":"7e644efa-0a6e-412b-b2a9-352dfeeed160","Type":"ContainerStarted","Data":"9c8a33b222872d918b39c7281ad85bc0393844fc70f10a3c1faff95462807537"}
Sep 10 04:41:44.020532 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:44.020509    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-tgcbl" event={"ID":"ef57e894-f8b4-464e-b814-3ceada543c28","Type":"ContainerStarted","Data":"4a5974d399ed1675bf73fb2b8e532953fa3fe730d2b6ee17f598712ec3f7f769"}
Sep 10 04:41:44.023809 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:44.023789    2560 generic.go:356] "Generic (PLEG): container finished" podID="02552f59-e9e1-419f-b684-95357447d121" containerID="22777bf2194f750f67b51571e08f6b0d46690945aada46151f2561bb675396e6" exitCode=0
Sep 10 04:41:44.023925 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:44.023865    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vhzvh" event={"ID":"02552f59-e9e1-419f-b684-95357447d121","Type":"ContainerDied","Data":"22777bf2194f750f67b51571e08f6b0d46690945aada46151f2561bb675396e6"}
Sep 10 04:41:44.025915 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:44.025893    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-hkjtg" event={"ID":"5552ac0d-5458-4244-9cb1-e278a75e0451","Type":"ContainerStarted","Data":"21d46cc1441ee9a70f92a1df524ecddea482a0c9d04c594f6a19106eb1bb259d"}
Sep 10 04:41:44.027802 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:44.027785    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-p5zjp_8b3ec8dc-1508-4537-8dc3-b9de1ff22d03/console-operator/0.log"
Sep 10 04:41:44.027908 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:44.027816    2560 generic.go:356] "Generic (PLEG): container finished" podID="8b3ec8dc-1508-4537-8dc3-b9de1ff22d03" containerID="5501b29551911e109301588e881285f89e9b0566eb2897475d76fc89ca0732f8" exitCode=255
Sep 10 04:41:44.027908 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:44.027873    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-p5zjp" event={"ID":"8b3ec8dc-1508-4537-8dc3-b9de1ff22d03","Type":"ContainerDied","Data":"5501b29551911e109301588e881285f89e9b0566eb2897475d76fc89ca0732f8"}
Sep 10 04:41:44.028119 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:44.028103    2560 scope.go:117] "RemoveContainer" containerID="5501b29551911e109301588e881285f89e9b0566eb2897475d76fc89ca0732f8"
Sep 10 04:41:44.028400 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:44.028108    2560 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85b454874b-p5zjp"
Sep 10 04:41:44.028400 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:44.028332    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-p5zjp"
Sep 10 04:41:44.031074 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:44.031050    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-x8kmb" event={"ID":"b0f33b82-87c0-4c48-a093-a91e3317cf73","Type":"ContainerStarted","Data":"ebd97eb680a6e732a4641ebe8bcf86782d373e95c59654bd7c1f3b6af11f3e35"}
Sep 10 04:41:44.041108 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:44.041053    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-6r6cl" podStartSLOduration=16.326500643 podStartE2EDuration="25.041035782s" totalImagesPullingTime="8.714535139s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:41:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:41:44.033013983 +0000 UTC m=+43.695471731" watchObservedRunningTime="2026-09-10 04:41:44.041035782 +0000 UTC m=+43.703493530"
Sep 10 04:41:44.144985 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:44.144910    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-hkjtg" podStartSLOduration=17.731052765 podStartE2EDuration="25.144870178s" totalImagesPullingTime="7.413817413s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:41:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:41:44.11134949 +0000 UTC m=+43.773807241" watchObservedRunningTime="2026-09-10 04:41:44.144870178 +0000 UTC m=+43.807327916"
Sep 10 04:41:44.145453 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:44.145355    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-tgcbl" podStartSLOduration=16.514081993 podStartE2EDuration="25.145342955s" totalImagesPullingTime="8.631260962s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:41:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:41:44.144566265 +0000 UTC m=+43.807024013" watchObservedRunningTime="2026-09-10 04:41:44.145342955 +0000 UTC m=+43.807800703"
Sep 10 04:41:44.167517 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:44.166404    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-685456655f-hnd48" podStartSLOduration=17.039592449 podStartE2EDuration="25.166386028s" totalImagesPullingTime="8.126793579s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:41:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:41:44.165475318 +0000 UTC m=+43.827933062" watchObservedRunningTime="2026-09-10 04:41:44.166386028 +0000 UTC m=+43.828843778"
Sep 10 04:41:44.191868 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:44.188723    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-vjxjf" podStartSLOduration=2.671711894 podStartE2EDuration="11.188704113s" totalImagesPullingTime="8.516992219s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:41:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:41:44.186331728 +0000 UTC m=+43.848789479" watchObservedRunningTime="2026-09-10 04:41:44.188704113 +0000 UTC m=+43.851161861"
Sep 10 04:41:44.228630 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:44.228432    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-kq4qp" podStartSLOduration=37.38310528 podStartE2EDuration="43.228413294s" totalImagesPullingTime="5.845308014s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:41:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:41:44.22806036 +0000 UTC m=+43.890518109" watchObservedRunningTime="2026-09-10 04:41:44.228413294 +0000 UTC m=+43.890871041"
Sep 10 04:41:44.255897 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:44.255831    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-76bcd6ccf5-x8kmb" podStartSLOduration=16.539953001 podStartE2EDuration="25.255810717s" totalImagesPullingTime="8.715857716s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:41:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:41:44.253081626 +0000 UTC m=+43.915539376" watchObservedRunningTime="2026-09-10 04:41:44.255810717 +0000 UTC m=+43.918268463"
Sep 10 04:41:45.000270 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:45.000236    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6v2kg"]
Sep 10 04:41:45.020536 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:45.020505    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6v2kg"]
Sep 10 04:41:45.021028 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:45.020630    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6v2kg"
Sep 10 04:41:45.023471 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:45.023447    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kf5vp\""
Sep 10 04:41:45.023615 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:45.023446    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 10 04:41:45.023615 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:45.023512    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 10 04:41:45.037843 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:45.037819    2560 generic.go:356] "Generic (PLEG): container finished" podID="02552f59-e9e1-419f-b684-95357447d121" containerID="57fd1e96bc4e0ab6cf0bb4829c7a19243867f4d9fd167d05cb1359fbb6337f1e" exitCode=0
Sep 10 04:41:45.037983 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:45.037880    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vhzvh" event={"ID":"02552f59-e9e1-419f-b684-95357447d121","Type":"ContainerDied","Data":"57fd1e96bc4e0ab6cf0bb4829c7a19243867f4d9fd167d05cb1359fbb6337f1e"}
Sep 10 04:41:45.039575 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:45.039560    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-p5zjp_8b3ec8dc-1508-4537-8dc3-b9de1ff22d03/console-operator/1.log"
Sep 10 04:41:45.040014 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:45.040000    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-p5zjp_8b3ec8dc-1508-4537-8dc3-b9de1ff22d03/console-operator/0.log"
Sep 10 04:41:45.040061 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:45.040031    2560 generic.go:356] "Generic (PLEG): container finished" podID="8b3ec8dc-1508-4537-8dc3-b9de1ff22d03" containerID="43f95fb8c459bc3c4fce943ce9833eb7e9f4fccc6de5ef7acfd7a9d39f929ada" exitCode=255
Sep 10 04:41:45.040100 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:45.040091    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-p5zjp" event={"ID":"8b3ec8dc-1508-4537-8dc3-b9de1ff22d03","Type":"ContainerDied","Data":"43f95fb8c459bc3c4fce943ce9833eb7e9f4fccc6de5ef7acfd7a9d39f929ada"}
Sep 10 04:41:45.040152 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:45.040139    2560 scope.go:117] "RemoveContainer" containerID="5501b29551911e109301588e881285f89e9b0566eb2897475d76fc89ca0732f8"
Sep 10 04:41:45.040339 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:45.040316    2560 scope.go:117] "RemoveContainer" containerID="43f95fb8c459bc3c4fce943ce9833eb7e9f4fccc6de5ef7acfd7a9d39f929ada"
Sep 10 04:41:45.040525 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:45.040503    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-p5zjp_openshift-console-operator(8b3ec8dc-1508-4537-8dc3-b9de1ff22d03)\"" pod="openshift-console-operator/console-operator-85b454874b-p5zjp" podUID="8b3ec8dc-1508-4537-8dc3-b9de1ff22d03"
Sep 10 04:41:45.210749 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:45.210723    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c11fc765-df6d-4277-84d0-8767a3d38372-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6v2kg\" (UID: \"c11fc765-df6d-4277-84d0-8767a3d38372\") " pod="openshift-insights/insights-runtime-extractor-6v2kg"
Sep 10 04:41:45.210878 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:45.210766    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c11fc765-df6d-4277-84d0-8767a3d38372-crio-socket\") pod \"insights-runtime-extractor-6v2kg\" (UID: \"c11fc765-df6d-4277-84d0-8767a3d38372\") " pod="openshift-insights/insights-runtime-extractor-6v2kg"
Sep 10 04:41:45.211097 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:45.211077    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c11fc765-df6d-4277-84d0-8767a3d38372-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6v2kg\" (UID: \"c11fc765-df6d-4277-84d0-8767a3d38372\") " pod="openshift-insights/insights-runtime-extractor-6v2kg"
Sep 10 04:41:45.211265 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:45.211227    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c11fc765-df6d-4277-84d0-8767a3d38372-data-volume\") pod \"insights-runtime-extractor-6v2kg\" (UID: \"c11fc765-df6d-4277-84d0-8767a3d38372\") " pod="openshift-insights/insights-runtime-extractor-6v2kg"
Sep 10 04:41:45.211475 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:45.211454    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqdzk\" (UniqueName: \"kubernetes.io/projected/c11fc765-df6d-4277-84d0-8767a3d38372-kube-api-access-xqdzk\") pod \"insights-runtime-extractor-6v2kg\" (UID: \"c11fc765-df6d-4277-84d0-8767a3d38372\") " pod="openshift-insights/insights-runtime-extractor-6v2kg"
Sep 10 04:41:45.312196 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:45.312141    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqdzk\" (UniqueName: \"kubernetes.io/projected/c11fc765-df6d-4277-84d0-8767a3d38372-kube-api-access-xqdzk\") pod \"insights-runtime-extractor-6v2kg\" (UID: \"c11fc765-df6d-4277-84d0-8767a3d38372\") " pod="openshift-insights/insights-runtime-extractor-6v2kg"
Sep 10 04:41:45.312284 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:45.312194    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c11fc765-df6d-4277-84d0-8767a3d38372-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6v2kg\" (UID: \"c11fc765-df6d-4277-84d0-8767a3d38372\") " pod="openshift-insights/insights-runtime-extractor-6v2kg"
Sep 10 04:41:45.312284 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:45.312222    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c11fc765-df6d-4277-84d0-8767a3d38372-crio-socket\") pod \"insights-runtime-extractor-6v2kg\" (UID: \"c11fc765-df6d-4277-84d0-8767a3d38372\") " pod="openshift-insights/insights-runtime-extractor-6v2kg"
Sep 10 04:41:45.312351 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:45.312299    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c11fc765-df6d-4277-84d0-8767a3d38372-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6v2kg\" (UID: \"c11fc765-df6d-4277-84d0-8767a3d38372\") " pod="openshift-insights/insights-runtime-extractor-6v2kg"
Sep 10 04:41:45.312351 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:45.312335    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c11fc765-df6d-4277-84d0-8767a3d38372-data-volume\") pod \"insights-runtime-extractor-6v2kg\" (UID: \"c11fc765-df6d-4277-84d0-8767a3d38372\") " pod="openshift-insights/insights-runtime-extractor-6v2kg"
Sep 10 04:41:45.312351 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:45.312337    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 04:41:45.312501 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:45.312403    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c11fc765-df6d-4277-84d0-8767a3d38372-insights-runtime-extractor-tls podName:c11fc765-df6d-4277-84d0-8767a3d38372 nodeName:}" failed. No retries permitted until 2026-09-10 04:41:45.812386823 +0000 UTC m=+45.474844562 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c11fc765-df6d-4277-84d0-8767a3d38372-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6v2kg" (UID: "c11fc765-df6d-4277-84d0-8767a3d38372") : secret "insights-runtime-extractor-tls" not found
Sep 10 04:41:45.312501 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:45.312432    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 04:41:45.312501 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:45.312495    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c11fc765-df6d-4277-84d0-8767a3d38372-kube-rbac-proxy-cm podName:c11fc765-df6d-4277-84d0-8767a3d38372 nodeName:}" failed. No retries permitted until 2026-09-10 04:41:45.812475831 +0000 UTC m=+45.474933577 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c11fc765-df6d-4277-84d0-8767a3d38372-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6v2kg" (UID: "c11fc765-df6d-4277-84d0-8767a3d38372") : configmap "kube-rbac-proxy" not found
Sep 10 04:41:45.312629 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:45.312499    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c11fc765-df6d-4277-84d0-8767a3d38372-crio-socket\") pod \"insights-runtime-extractor-6v2kg\" (UID: \"c11fc765-df6d-4277-84d0-8767a3d38372\") " pod="openshift-insights/insights-runtime-extractor-6v2kg"
Sep 10 04:41:45.312629 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:45.312606    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c11fc765-df6d-4277-84d0-8767a3d38372-data-volume\") pod \"insights-runtime-extractor-6v2kg\" (UID: \"c11fc765-df6d-4277-84d0-8767a3d38372\") " pod="openshift-insights/insights-runtime-extractor-6v2kg"
Sep 10 04:41:45.321365 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:45.321348    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqdzk\" (UniqueName: \"kubernetes.io/projected/c11fc765-df6d-4277-84d0-8767a3d38372-kube-api-access-xqdzk\") pod \"insights-runtime-extractor-6v2kg\" (UID: \"c11fc765-df6d-4277-84d0-8767a3d38372\") " pod="openshift-insights/insights-runtime-extractor-6v2kg"
Sep 10 04:41:45.818172 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:45.818136    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c11fc765-df6d-4277-84d0-8767a3d38372-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6v2kg\" (UID: \"c11fc765-df6d-4277-84d0-8767a3d38372\") " pod="openshift-insights/insights-runtime-extractor-6v2kg"
Sep 10 04:41:45.818356 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:45.818229    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c11fc765-df6d-4277-84d0-8767a3d38372-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6v2kg\" (UID: \"c11fc765-df6d-4277-84d0-8767a3d38372\") " pod="openshift-insights/insights-runtime-extractor-6v2kg"
Sep 10 04:41:45.818356 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:45.818272    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 04:41:45.818356 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:45.818347    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 04:41:45.818478 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:45.818357    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c11fc765-df6d-4277-84d0-8767a3d38372-insights-runtime-extractor-tls podName:c11fc765-df6d-4277-84d0-8767a3d38372 nodeName:}" failed. No retries permitted until 2026-09-10 04:41:46.8183393 +0000 UTC m=+46.480797032 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c11fc765-df6d-4277-84d0-8767a3d38372-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6v2kg" (UID: "c11fc765-df6d-4277-84d0-8767a3d38372") : secret "insights-runtime-extractor-tls" not found
Sep 10 04:41:45.818478 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:45.818412    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c11fc765-df6d-4277-84d0-8767a3d38372-kube-rbac-proxy-cm podName:c11fc765-df6d-4277-84d0-8767a3d38372 nodeName:}" failed. No retries permitted until 2026-09-10 04:41:46.818397402 +0000 UTC m=+46.480855143 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c11fc765-df6d-4277-84d0-8767a3d38372-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6v2kg" (UID: "c11fc765-df6d-4277-84d0-8767a3d38372") : configmap "kube-rbac-proxy" not found
Sep 10 04:41:46.047085 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:46.047054    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vhzvh" event={"ID":"02552f59-e9e1-419f-b684-95357447d121","Type":"ContainerStarted","Data":"94b1d202fe595055c01bce4978cd54a9b9907b64003b9ebce8947d05bdc2217a"}
Sep 10 04:41:46.048575 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:46.048558    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-p5zjp_8b3ec8dc-1508-4537-8dc3-b9de1ff22d03/console-operator/1.log"
Sep 10 04:41:46.048835 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:46.048819    2560 scope.go:117] "RemoveContainer" containerID="43f95fb8c459bc3c4fce943ce9833eb7e9f4fccc6de5ef7acfd7a9d39f929ada"
Sep 10 04:41:46.049004 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:46.048985    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-p5zjp_openshift-console-operator(8b3ec8dc-1508-4537-8dc3-b9de1ff22d03)\"" pod="openshift-console-operator/console-operator-85b454874b-p5zjp" podUID="8b3ec8dc-1508-4537-8dc3-b9de1ff22d03"
Sep 10 04:41:46.131489 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:46.131452    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-vhzvh" podStartSLOduration=16.413615385 podStartE2EDuration="46.13144213s" totalImagesPullingTime="29.717826745s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 04:41:00 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:41:46.091834942 +0000 UTC m=+45.754292689" watchObservedRunningTime="2026-09-10 04:41:46.13144213 +0000 UTC m=+45.793899877"
Sep 10 04:41:46.826587 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:46.826560    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c11fc765-df6d-4277-84d0-8767a3d38372-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6v2kg\" (UID: \"c11fc765-df6d-4277-84d0-8767a3d38372\") " pod="openshift-insights/insights-runtime-extractor-6v2kg"
Sep 10 04:41:46.826760 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:46.826651    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c11fc765-df6d-4277-84d0-8767a3d38372-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6v2kg\" (UID: \"c11fc765-df6d-4277-84d0-8767a3d38372\") " pod="openshift-insights/insights-runtime-extractor-6v2kg"
Sep 10 04:41:46.826760 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:46.826672    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 04:41:46.826760 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:46.826757    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c11fc765-df6d-4277-84d0-8767a3d38372-kube-rbac-proxy-cm podName:c11fc765-df6d-4277-84d0-8767a3d38372 nodeName:}" failed. No retries permitted until 2026-09-10 04:41:48.826728942 +0000 UTC m=+48.489186670 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c11fc765-df6d-4277-84d0-8767a3d38372-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6v2kg" (UID: "c11fc765-df6d-4277-84d0-8767a3d38372") : configmap "kube-rbac-proxy" not found
Sep 10 04:41:46.826918 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:46.826759    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 04:41:46.826918 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:46.826797    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c11fc765-df6d-4277-84d0-8767a3d38372-insights-runtime-extractor-tls podName:c11fc765-df6d-4277-84d0-8767a3d38372 nodeName:}" failed. No retries permitted until 2026-09-10 04:41:48.826787764 +0000 UTC m=+48.489245492 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c11fc765-df6d-4277-84d0-8767a3d38372-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6v2kg" (UID: "c11fc765-df6d-4277-84d0-8767a3d38372") : secret "insights-runtime-extractor-tls" not found
Sep 10 04:41:47.347785 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:47.347759    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6c6hs_70619315-7b0a-40c0-82cf-a3f283ada09f/dns-node-resolver/0.log"
Sep 10 04:41:48.342592 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:48.342563    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-h7swz_1e129b32-2387-4f9c-91b8-940841cb77cc/node-ca/0.log"
Sep 10 04:41:48.842306 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:48.842279    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c11fc765-df6d-4277-84d0-8767a3d38372-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6v2kg\" (UID: \"c11fc765-df6d-4277-84d0-8767a3d38372\") " pod="openshift-insights/insights-runtime-extractor-6v2kg"
Sep 10 04:41:48.842622 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:48.842367    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c11fc765-df6d-4277-84d0-8767a3d38372-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6v2kg\" (UID: \"c11fc765-df6d-4277-84d0-8767a3d38372\") " pod="openshift-insights/insights-runtime-extractor-6v2kg"
Sep 10 04:41:48.842622 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:48.842393    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 04:41:48.842622 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:48.842452    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c11fc765-df6d-4277-84d0-8767a3d38372-kube-rbac-proxy-cm podName:c11fc765-df6d-4277-84d0-8767a3d38372 nodeName:}" failed. No retries permitted until 2026-09-10 04:41:52.842436897 +0000 UTC m=+52.504894623 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c11fc765-df6d-4277-84d0-8767a3d38372-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6v2kg" (UID: "c11fc765-df6d-4277-84d0-8767a3d38372") : configmap "kube-rbac-proxy" not found
Sep 10 04:41:48.842622 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:48.842473    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 04:41:48.842622 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:48.842512    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c11fc765-df6d-4277-84d0-8767a3d38372-insights-runtime-extractor-tls podName:c11fc765-df6d-4277-84d0-8767a3d38372 nodeName:}" failed. No retries permitted until 2026-09-10 04:41:52.842501407 +0000 UTC m=+52.504959132 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c11fc765-df6d-4277-84d0-8767a3d38372-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6v2kg" (UID: "c11fc765-df6d-4277-84d0-8767a3d38372") : secret "insights-runtime-extractor-tls" not found
Sep 10 04:41:49.142967 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:49.142941    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vjxjf_beaaafd1-47c4-4a3a-a985-bed140f007e6/serve-healthcheck-canary/0.log"
Sep 10 04:41:49.548268 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:49.548191    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/345fe3ae-0c3e-4924-af34-bf06acf51ac4-metrics-tls\") pod \"dns-default-tkl9f\" (UID: \"345fe3ae-0c3e-4924-af34-bf06acf51ac4\") " pod="openshift-dns/dns-default-tkl9f"
Sep 10 04:41:49.548268 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:49.548231    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1529c81a-0935-4a33-a02a-39323d37b580-registry-tls\") pod \"image-registry-77586cf744-p4w2v\" (UID: \"1529c81a-0935-4a33-a02a-39323d37b580\") " pod="openshift-image-registry/image-registry-77586cf744-p4w2v"
Sep 10 04:41:49.548443 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:49.548279    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/92e0e646-b15f-45be-8797-fcac67a89fd1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-mpw59\" (UID: \"92e0e646-b15f-45be-8797-fcac67a89fd1\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-mpw59"
Sep 10 04:41:49.548443 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:49.548348    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 04:41:49.548443 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:49.548381    2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 10 04:41:49.548443 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:49.548392    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 04:41:49.548443 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:49.548407    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77586cf744-p4w2v: secret "image-registry-tls" not found
Sep 10 04:41:49.548443 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:49.548425    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/345fe3ae-0c3e-4924-af34-bf06acf51ac4-metrics-tls podName:345fe3ae-0c3e-4924-af34-bf06acf51ac4 nodeName:}" failed. No retries permitted until 2026-09-10 04:42:05.548405733 +0000 UTC m=+65.210863462 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/345fe3ae-0c3e-4924-af34-bf06acf51ac4-metrics-tls") pod "dns-default-tkl9f" (UID: "345fe3ae-0c3e-4924-af34-bf06acf51ac4") : secret "dns-default-metrics-tls" not found
Sep 10 04:41:49.548443 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:49.548444    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1529c81a-0935-4a33-a02a-39323d37b580-registry-tls podName:1529c81a-0935-4a33-a02a-39323d37b580 nodeName:}" failed. No retries permitted until 2026-09-10 04:42:05.548432201 +0000 UTC m=+65.210889948 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1529c81a-0935-4a33-a02a-39323d37b580-registry-tls") pod "image-registry-77586cf744-p4w2v" (UID: "1529c81a-0935-4a33-a02a-39323d37b580") : secret "image-registry-tls" not found
Sep 10 04:41:49.548660 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:49.548460    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92e0e646-b15f-45be-8797-fcac67a89fd1-cluster-monitoring-operator-tls podName:92e0e646-b15f-45be-8797-fcac67a89fd1 nodeName:}" failed. No retries permitted until 2026-09-10 04:42:05.548452119 +0000 UTC m=+65.210909844 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/92e0e646-b15f-45be-8797-fcac67a89fd1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-mpw59" (UID: "92e0e646-b15f-45be-8797-fcac67a89fd1") : secret "cluster-monitoring-operator-tls" not found
Sep 10 04:41:49.649277 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:49.649255    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/107242dc-160c-4fff-b4d5-ac1b059ff6e1-metrics-certs\") pod \"router-default-7bff86c86-9d7sj\" (UID: \"107242dc-160c-4fff-b4d5-ac1b059ff6e1\") " pod="openshift-ingress/router-default-7bff86c86-9d7sj"
Sep 10 04:41:49.649393 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:49.649292    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1f30b38a-507b-4294-b1a1-d58d2bc2bfb3-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-x5xr6\" (UID: \"1f30b38a-507b-4294-b1a1-d58d2bc2bfb3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-x5xr6"
Sep 10 04:41:49.649431 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:49.649405    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 10 04:41:49.649431 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:49.649408    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/107242dc-160c-4fff-b4d5-ac1b059ff6e1-service-ca-bundle\") pod \"router-default-7bff86c86-9d7sj\" (UID: \"107242dc-160c-4fff-b4d5-ac1b059ff6e1\") " pod="openshift-ingress/router-default-7bff86c86-9d7sj"
Sep 10 04:41:49.649493 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:49.649440    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f30b38a-507b-4294-b1a1-d58d2bc2bfb3-samples-operator-tls podName:1f30b38a-507b-4294-b1a1-d58d2bc2bfb3 nodeName:}" failed. No retries permitted until 2026-09-10 04:42:05.649429702 +0000 UTC m=+65.311887432 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1f30b38a-507b-4294-b1a1-d58d2bc2bfb3-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-x5xr6" (UID: "1f30b38a-507b-4294-b1a1-d58d2bc2bfb3") : secret "samples-operator-tls" not found
Sep 10 04:41:49.649533 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:49.649496    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 10 04:41:49.649533 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:49.649517    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/107242dc-160c-4fff-b4d5-ac1b059ff6e1-service-ca-bundle podName:107242dc-160c-4fff-b4d5-ac1b059ff6e1 nodeName:}" failed. No retries permitted until 2026-09-10 04:42:05.649503834 +0000 UTC m=+65.311961575 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/107242dc-160c-4fff-b4d5-ac1b059ff6e1-service-ca-bundle") pod "router-default-7bff86c86-9d7sj" (UID: "107242dc-160c-4fff-b4d5-ac1b059ff6e1") : configmap references non-existent config key: service-ca.crt
Sep 10 04:41:49.649594 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:49.649534    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/107242dc-160c-4fff-b4d5-ac1b059ff6e1-metrics-certs podName:107242dc-160c-4fff-b4d5-ac1b059ff6e1 nodeName:}" failed. No retries permitted until 2026-09-10 04:42:05.64952766 +0000 UTC m=+65.311985384 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/107242dc-160c-4fff-b4d5-ac1b059ff6e1-metrics-certs") pod "router-default-7bff86c86-9d7sj" (UID: "107242dc-160c-4fff-b4d5-ac1b059ff6e1") : secret "router-metrics-certs-default" not found
Sep 10 04:41:49.746078 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:49.746057    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-tgcbl_ef57e894-f8b4-464e-b814-3ceada543c28/kube-storage-version-migrator-operator/0.log"
Sep 10 04:41:52.873037 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:52.873004    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c11fc765-df6d-4277-84d0-8767a3d38372-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6v2kg\" (UID: \"c11fc765-df6d-4277-84d0-8767a3d38372\") " pod="openshift-insights/insights-runtime-extractor-6v2kg"
Sep 10 04:41:52.873467 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:52.873170    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c11fc765-df6d-4277-84d0-8767a3d38372-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6v2kg\" (UID: \"c11fc765-df6d-4277-84d0-8767a3d38372\") " pod="openshift-insights/insights-runtime-extractor-6v2kg"
Sep 10 04:41:52.873467 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:52.873312    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 04:41:52.873467 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:52.873370    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c11fc765-df6d-4277-84d0-8767a3d38372-insights-runtime-extractor-tls podName:c11fc765-df6d-4277-84d0-8767a3d38372 nodeName:}" failed. No retries permitted until 2026-09-10 04:42:00.87335639 +0000 UTC m=+60.535814115 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c11fc765-df6d-4277-84d0-8767a3d38372-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6v2kg" (UID: "c11fc765-df6d-4277-84d0-8767a3d38372") : secret "insights-runtime-extractor-tls" not found
Sep 10 04:41:52.873588 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:52.873570    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c11fc765-df6d-4277-84d0-8767a3d38372-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6v2kg\" (UID: \"c11fc765-df6d-4277-84d0-8767a3d38372\") " pod="openshift-insights/insights-runtime-extractor-6v2kg"
Sep 10 04:41:54.028223 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:54.028184    2560 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85b454874b-p5zjp"
Sep 10 04:41:54.028613 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:54.028279    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-p5zjp"
Sep 10 04:41:54.028658 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:41:54.028631    2560 scope.go:117] "RemoveContainer" containerID="43f95fb8c459bc3c4fce943ce9833eb7e9f4fccc6de5ef7acfd7a9d39f929ada"
Sep 10 04:41:54.028882 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:41:54.028830    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-p5zjp_openshift-console-operator(8b3ec8dc-1508-4537-8dc3-b9de1ff22d03)\"" pod="openshift-console-operator/console-operator-85b454874b-p5zjp" podUID="8b3ec8dc-1508-4537-8dc3-b9de1ff22d03"
Sep 10 04:42:00.937497 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:00.937466    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c11fc765-df6d-4277-84d0-8767a3d38372-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6v2kg\" (UID: \"c11fc765-df6d-4277-84d0-8767a3d38372\") " pod="openshift-insights/insights-runtime-extractor-6v2kg"
Sep 10 04:42:00.939544 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:00.939519    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c11fc765-df6d-4277-84d0-8767a3d38372-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6v2kg\" (UID: \"c11fc765-df6d-4277-84d0-8767a3d38372\") " pod="openshift-insights/insights-runtime-extractor-6v2kg"
Sep 10 04:42:00.972940 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:00.972915    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-z79rt"
Sep 10 04:42:01.231739 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:01.231661    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kf5vp\""
Sep 10 04:42:01.240283 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:01.240265    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6v2kg"
Sep 10 04:42:01.514689 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:01.514627    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6v2kg"]
Sep 10 04:42:01.516815 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:42:01.516787    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc11fc765_df6d_4277_84d0_8767a3d38372.slice/crio-0033bc2331b35ffde4f59250e9d7a55160abd2889ed4dc917994c49abdf88826 WatchSource:0}: Error finding container 0033bc2331b35ffde4f59250e9d7a55160abd2889ed4dc917994c49abdf88826: Status 404 returned error can't find the container with id 0033bc2331b35ffde4f59250e9d7a55160abd2889ed4dc917994c49abdf88826
Sep 10 04:42:02.103005 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:02.102970    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6v2kg" event={"ID":"c11fc765-df6d-4277-84d0-8767a3d38372","Type":"ContainerStarted","Data":"1b883a57d6fec778617eeaf07befc848f84b567446fa58e6719d3bff34f5a984"}
Sep 10 04:42:02.103361 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:02.103024    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6v2kg" event={"ID":"c11fc765-df6d-4277-84d0-8767a3d38372","Type":"ContainerStarted","Data":"0033bc2331b35ffde4f59250e9d7a55160abd2889ed4dc917994c49abdf88826"}
Sep 10 04:42:03.107497 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:03.107464    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6v2kg" event={"ID":"c11fc765-df6d-4277-84d0-8767a3d38372","Type":"ContainerStarted","Data":"a46321b8c89cd856da603a3eb8386005973c5eb781f152f230a668c4eb0d9f1b"}
Sep 10 04:42:04.112738 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:04.112703    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6v2kg" event={"ID":"c11fc765-df6d-4277-84d0-8767a3d38372","Type":"ContainerStarted","Data":"4c0bd0117ca3bcf4ee5a98d1d935e8b1c8210abc26ef17c542238391fb8cbdc1"}
Sep 10 04:42:04.132828 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:04.132778    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6v2kg" podStartSLOduration=17.775927672999998 podStartE2EDuration="20.132765351s" totalImagesPullingTime="2.356837678s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 04:41:44 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:42:04.131239871 +0000 UTC m=+63.793697639" watchObservedRunningTime="2026-09-10 04:42:04.132765351 +0000 UTC m=+63.795223097"
Sep 10 04:42:05.580536 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:05.580497    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/92e0e646-b15f-45be-8797-fcac67a89fd1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-mpw59\" (UID: \"92e0e646-b15f-45be-8797-fcac67a89fd1\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-mpw59"
Sep 10 04:42:05.581059 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:05.580573    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/345fe3ae-0c3e-4924-af34-bf06acf51ac4-metrics-tls\") pod \"dns-default-tkl9f\" (UID: \"345fe3ae-0c3e-4924-af34-bf06acf51ac4\") " pod="openshift-dns/dns-default-tkl9f"
Sep 10 04:42:05.581059 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:05.580596    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1529c81a-0935-4a33-a02a-39323d37b580-registry-tls\") pod \"image-registry-77586cf744-p4w2v\" (UID: \"1529c81a-0935-4a33-a02a-39323d37b580\") " pod="openshift-image-registry/image-registry-77586cf744-p4w2v"
Sep 10 04:42:05.583021 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:05.582989    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/345fe3ae-0c3e-4924-af34-bf06acf51ac4-metrics-tls\") pod \"dns-default-tkl9f\" (UID: \"345fe3ae-0c3e-4924-af34-bf06acf51ac4\") " pod="openshift-dns/dns-default-tkl9f"
Sep 10 04:42:05.583149 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:05.583076    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1529c81a-0935-4a33-a02a-39323d37b580-registry-tls\") pod \"image-registry-77586cf744-p4w2v\" (UID: \"1529c81a-0935-4a33-a02a-39323d37b580\") " pod="openshift-image-registry/image-registry-77586cf744-p4w2v"
Sep 10 04:42:05.583149 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:05.583117    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/92e0e646-b15f-45be-8797-fcac67a89fd1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-mpw59\" (UID: \"92e0e646-b15f-45be-8797-fcac67a89fd1\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-mpw59"
Sep 10 04:42:05.681492 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:05.681456    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/107242dc-160c-4fff-b4d5-ac1b059ff6e1-service-ca-bundle\") pod \"router-default-7bff86c86-9d7sj\" (UID: \"107242dc-160c-4fff-b4d5-ac1b059ff6e1\") " pod="openshift-ingress/router-default-7bff86c86-9d7sj"
Sep 10 04:42:05.681492 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:05.681498    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/107242dc-160c-4fff-b4d5-ac1b059ff6e1-metrics-certs\") pod \"router-default-7bff86c86-9d7sj\" (UID: \"107242dc-160c-4fff-b4d5-ac1b059ff6e1\") " pod="openshift-ingress/router-default-7bff86c86-9d7sj"
Sep 10 04:42:05.681650 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:05.681529    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1f30b38a-507b-4294-b1a1-d58d2bc2bfb3-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-x5xr6\" (UID: \"1f30b38a-507b-4294-b1a1-d58d2bc2bfb3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-x5xr6"
Sep 10 04:42:05.682047 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:05.682027    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/107242dc-160c-4fff-b4d5-ac1b059ff6e1-service-ca-bundle\") pod \"router-default-7bff86c86-9d7sj\" (UID: \"107242dc-160c-4fff-b4d5-ac1b059ff6e1\") " pod="openshift-ingress/router-default-7bff86c86-9d7sj"
Sep 10 04:42:05.683635 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:05.683610    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/107242dc-160c-4fff-b4d5-ac1b059ff6e1-metrics-certs\") pod \"router-default-7bff86c86-9d7sj\" (UID: \"107242dc-160c-4fff-b4d5-ac1b059ff6e1\") " pod="openshift-ingress/router-default-7bff86c86-9d7sj"
Sep 10 04:42:05.683746 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:05.683732    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1f30b38a-507b-4294-b1a1-d58d2bc2bfb3-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-x5xr6\" (UID: \"1f30b38a-507b-4294-b1a1-d58d2bc2bfb3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-x5xr6"
Sep 10 04:42:05.768356 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:05.768315    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6qv7t\""
Sep 10 04:42:05.777075 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:05.777057    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77586cf744-p4w2v"
Sep 10 04:42:05.806269 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:05.806251    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-zc8tq\""
Sep 10 04:42:05.815066 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:05.815044    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-mpw59"
Sep 10 04:42:05.816945 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:05.816926    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nj7q4\""
Sep 10 04:42:05.825788 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:05.825695    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tkl9f"
Sep 10 04:42:05.855405 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:05.855379    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-778q9\""
Sep 10 04:42:05.864233 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:05.864199    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7bff86c86-9d7sj"
Sep 10 04:42:05.900215 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:05.900188    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-j9rtp\""
Sep 10 04:42:05.907995 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:05.907970    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-x5xr6"
Sep 10 04:42:06.048230 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:06.048210    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-77586cf744-p4w2v"]
Sep 10 04:42:06.050022 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:42:06.049998    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1529c81a_0935_4a33_a02a_39323d37b580.slice/crio-b6d138a5877cafe62abdae7b3bd1e69cfec8b8163db99343a9ad255dc3b51c98 WatchSource:0}: Error finding container b6d138a5877cafe62abdae7b3bd1e69cfec8b8163db99343a9ad255dc3b51c98: Status 404 returned error can't find the container with id b6d138a5877cafe62abdae7b3bd1e69cfec8b8163db99343a9ad255dc3b51c98
Sep 10 04:42:06.091744 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:06.091726    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-mpw59"]
Sep 10 04:42:06.100839 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:42:06.100818    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92e0e646_b15f_45be_8797_fcac67a89fd1.slice/crio-9c34239857f2ef44522ec6e57dfe40003b8c8c891b6edefdcf39104877990818 WatchSource:0}: Error finding container 9c34239857f2ef44522ec6e57dfe40003b8c8c891b6edefdcf39104877990818: Status 404 returned error can't find the container with id 9c34239857f2ef44522ec6e57dfe40003b8c8c891b6edefdcf39104877990818
Sep 10 04:42:06.106080 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:06.106049    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tkl9f"]
Sep 10 04:42:06.108158 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:42:06.108138    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod345fe3ae_0c3e_4924_af34_bf06acf51ac4.slice/crio-25afd19ab9c3914e14f955cbedbb156ae2ca31ba7f789fbc9402750a9750820d WatchSource:0}: Error finding container 25afd19ab9c3914e14f955cbedbb156ae2ca31ba7f789fbc9402750a9750820d: Status 404 returned error can't find the container with id 25afd19ab9c3914e14f955cbedbb156ae2ca31ba7f789fbc9402750a9750820d
Sep 10 04:42:06.122513 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:06.122489    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-mpw59" event={"ID":"92e0e646-b15f-45be-8797-fcac67a89fd1","Type":"ContainerStarted","Data":"9c34239857f2ef44522ec6e57dfe40003b8c8c891b6edefdcf39104877990818"}
Sep 10 04:42:06.124054 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:06.124034    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tkl9f" event={"ID":"345fe3ae-0c3e-4924-af34-bf06acf51ac4","Type":"ContainerStarted","Data":"25afd19ab9c3914e14f955cbedbb156ae2ca31ba7f789fbc9402750a9750820d"}
Sep 10 04:42:06.125547 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:06.125530    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77586cf744-p4w2v" event={"ID":"1529c81a-0935-4a33-a02a-39323d37b580","Type":"ContainerStarted","Data":"905f7aec54d78b76acedec36241f77db52a6011d4822563c395bc83342ceb5a7"}
Sep 10 04:42:06.125652 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:06.125559    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77586cf744-p4w2v" event={"ID":"1529c81a-0935-4a33-a02a-39323d37b580","Type":"ContainerStarted","Data":"b6d138a5877cafe62abdae7b3bd1e69cfec8b8163db99343a9ad255dc3b51c98"}
Sep 10 04:42:06.125652 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:06.125612    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-77586cf744-p4w2v"
Sep 10 04:42:06.145150 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:06.145111    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-77586cf744-p4w2v" podStartSLOduration=65.145098112 podStartE2EDuration="1m5.145098112s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:41:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:42:06.144822414 +0000 UTC m=+65.807280162" watchObservedRunningTime="2026-09-10 04:42:06.145098112 +0000 UTC m=+65.807555858"
Sep 10 04:42:06.152402 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:06.152381    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7bff86c86-9d7sj"]
Sep 10 04:42:06.154196 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:42:06.154173    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod107242dc_160c_4fff_b4d5_ac1b059ff6e1.slice/crio-87f0238984ab2e8a68fae8a8e6720baf5f8b9ca464caeb2294c0bdd018404162 WatchSource:0}: Error finding container 87f0238984ab2e8a68fae8a8e6720baf5f8b9ca464caeb2294c0bdd018404162: Status 404 returned error can't find the container with id 87f0238984ab2e8a68fae8a8e6720baf5f8b9ca464caeb2294c0bdd018404162
Sep 10 04:42:06.178698 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:06.178674    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-x5xr6"]
Sep 10 04:42:06.690812 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:06.690784    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13570f73-c21d-4771-8349-f30c25ab27fb-metrics-certs\") pod \"network-metrics-daemon-n2sr7\" (UID: \"13570f73-c21d-4771-8349-f30c25ab27fb\") " pod="openshift-multus/network-metrics-daemon-n2sr7"
Sep 10 04:42:06.691226 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:06.690830    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5e472a47-9b1d-4f3e-be2f-36ac4b0ebc7f-original-pull-secret\") pod \"global-pull-secret-syncer-77cd4\" (UID: \"5e472a47-9b1d-4f3e-be2f-36ac4b0ebc7f\") " pod="kube-system/global-pull-secret-syncer-77cd4"
Sep 10 04:42:06.692954 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:06.692932    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 10 04:42:06.693076 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:06.692934    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 10 04:42:06.704373 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:06.704350    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5e472a47-9b1d-4f3e-be2f-36ac4b0ebc7f-original-pull-secret\") pod \"global-pull-secret-syncer-77cd4\" (UID: \"5e472a47-9b1d-4f3e-be2f-36ac4b0ebc7f\") " pod="kube-system/global-pull-secret-syncer-77cd4"
Sep 10 04:42:06.704373 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:06.704363    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13570f73-c21d-4771-8349-f30c25ab27fb-metrics-certs\") pod \"network-metrics-daemon-n2sr7\" (UID: \"13570f73-c21d-4771-8349-f30c25ab27fb\") " pod="openshift-multus/network-metrics-daemon-n2sr7"
Sep 10 04:42:06.933157 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:06.933115    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jksxr\""
Sep 10 04:42:06.941228 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:06.941163    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n2sr7"
Sep 10 04:42:06.941228 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:06.941184    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-77cd4"
Sep 10 04:42:07.134558 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:07.134469    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-x5xr6" event={"ID":"1f30b38a-507b-4294-b1a1-d58d2bc2bfb3","Type":"ContainerStarted","Data":"13308dc69037555d4fb639da5652e635c3539d4d4c1f66413456c17afe5992e2"}
Sep 10 04:42:07.137485 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:07.137031    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7bff86c86-9d7sj" event={"ID":"107242dc-160c-4fff-b4d5-ac1b059ff6e1","Type":"ContainerStarted","Data":"a6646c0c16870ee7f3e2a93b20b09eeeb28c85217ac5a4c0e91c6ef366ef22cd"}
Sep 10 04:42:07.137485 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:07.137083    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7bff86c86-9d7sj" event={"ID":"107242dc-160c-4fff-b4d5-ac1b059ff6e1","Type":"ContainerStarted","Data":"87f0238984ab2e8a68fae8a8e6720baf5f8b9ca464caeb2294c0bdd018404162"}
Sep 10 04:42:07.186113 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:07.186056    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7bff86c86-9d7sj" podStartSLOduration=48.186038059 podStartE2EDuration="48.186038059s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:41:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:42:07.18582566 +0000 UTC m=+66.848283408" watchObservedRunningTime="2026-09-10 04:42:07.186038059 +0000 UTC m=+66.848495808"
Sep 10 04:42:07.246891 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:07.246729    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-n2sr7"]
Sep 10 04:42:07.251071 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:42:07.251033    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13570f73_c21d_4771_8349_f30c25ab27fb.slice/crio-c74d356f861d5a138edcb3a91a4bc8bd51cd9b84fa236d12df30c7c79c2e6a46 WatchSource:0}: Error finding container c74d356f861d5a138edcb3a91a4bc8bd51cd9b84fa236d12df30c7c79c2e6a46: Status 404 returned error can't find the container with id c74d356f861d5a138edcb3a91a4bc8bd51cd9b84fa236d12df30c7c79c2e6a46
Sep 10 04:42:07.278511 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:07.278224    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-77cd4"]
Sep 10 04:42:07.282235 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:42:07.282207    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e472a47_9b1d_4f3e_be2f_36ac4b0ebc7f.slice/crio-9f4f51eb767ae7f7c84054855c9e8380054ac0eed8a38a9b1aefbbbf2dcb66f8 WatchSource:0}: Error finding container 9f4f51eb767ae7f7c84054855c9e8380054ac0eed8a38a9b1aefbbbf2dcb66f8: Status 404 returned error can't find the container with id 9f4f51eb767ae7f7c84054855c9e8380054ac0eed8a38a9b1aefbbbf2dcb66f8
Sep 10 04:42:07.864722 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:07.864684    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7bff86c86-9d7sj"
Sep 10 04:42:07.867830 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:07.867794    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7bff86c86-9d7sj"
Sep 10 04:42:08.141906 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:08.141835    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-n2sr7" event={"ID":"13570f73-c21d-4771-8349-f30c25ab27fb","Type":"ContainerStarted","Data":"c74d356f861d5a138edcb3a91a4bc8bd51cd9b84fa236d12df30c7c79c2e6a46"}
Sep 10 04:42:08.143213 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:08.143175    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-77cd4" event={"ID":"5e472a47-9b1d-4f3e-be2f-36ac4b0ebc7f","Type":"ContainerStarted","Data":"9f4f51eb767ae7f7c84054855c9e8380054ac0eed8a38a9b1aefbbbf2dcb66f8"}
Sep 10 04:42:08.143415 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:08.143397    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7bff86c86-9d7sj"
Sep 10 04:42:08.144799 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:08.144777    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7bff86c86-9d7sj"
Sep 10 04:42:08.819657 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:08.819584    2560 scope.go:117] "RemoveContainer" containerID="43f95fb8c459bc3c4fce943ce9833eb7e9f4fccc6de5ef7acfd7a9d39f929ada"
Sep 10 04:42:10.153737 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:10.153679    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-mpw59" event={"ID":"92e0e646-b15f-45be-8797-fcac67a89fd1","Type":"ContainerStarted","Data":"7927937244de97e4fe904043aade7aeffd62b6c78948a8b20431d1cf6f684bd5"}
Sep 10 04:42:10.156173 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:10.156034    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-p5zjp_8b3ec8dc-1508-4537-8dc3-b9de1ff22d03/console-operator/1.log"
Sep 10 04:42:10.156173 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:10.156109    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-p5zjp" event={"ID":"8b3ec8dc-1508-4537-8dc3-b9de1ff22d03","Type":"ContainerStarted","Data":"fd0a4471235a144f5790ab2e9c868ba5c53a89ccf32ba225ccff2ea555f294cf"}
Sep 10 04:42:10.156908 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:10.156840    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-p5zjp"
Sep 10 04:42:10.158947 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:10.158920    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tkl9f" event={"ID":"345fe3ae-0c3e-4924-af34-bf06acf51ac4","Type":"ContainerStarted","Data":"ffc47c96c9cc6cc4bd1ed3629a2bbe62138b75d7fc8b60fbf71dd5037f3e4b28"}
Sep 10 04:42:10.159049 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:10.158971    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tkl9f" event={"ID":"345fe3ae-0c3e-4924-af34-bf06acf51ac4","Type":"ContainerStarted","Data":"59ea862d2962dd5a4882856e728fc90b3238fa1279f1245845ab6330255af586"}
Sep 10 04:42:10.159483 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:10.159463    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-tkl9f"
Sep 10 04:42:10.162726 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:10.162608    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-x5xr6" event={"ID":"1f30b38a-507b-4294-b1a1-d58d2bc2bfb3","Type":"ContainerStarted","Data":"8f3ce240a549f7d807a38bea389415c8b52d5728159d2c3e4915964a6d1309a7"}
Sep 10 04:42:10.162726 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:10.162650    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-x5xr6" event={"ID":"1f30b38a-507b-4294-b1a1-d58d2bc2bfb3","Type":"ContainerStarted","Data":"d389e21c0535534a9ab0970b59d0e46514a39c9bff1aa04c7bb414756aa98c10"}
Sep 10 04:42:10.163545 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:10.163518    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-85b454874b-p5zjp"
Sep 10 04:42:10.179219 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:10.178980    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-mpw59" podStartSLOduration=47.739297012 podStartE2EDuration="51.178962713s" totalImagesPullingTime="3.439665701s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:41:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:42:10.178175017 +0000 UTC m=+69.840632765" watchObservedRunningTime="2026-09-10 04:42:10.178962713 +0000 UTC m=+69.841420461"
Sep 10 04:42:10.232455 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:10.232194    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-tkl9f" podStartSLOduration=33.804640793 podStartE2EDuration="37.232176024s" totalImagesPullingTime="3.427535231s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:41:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:42:10.205298721 +0000 UTC m=+69.867756469" watchObservedRunningTime="2026-09-10 04:42:10.232176024 +0000 UTC m=+69.894633773"
Sep 10 04:42:10.255227 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:10.254825    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-x5xr6" podStartSLOduration=47.920794958 podStartE2EDuration="51.254804795s" totalImagesPullingTime="3.334009837s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:41:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:42:10.253815546 +0000 UTC m=+69.916273295" watchObservedRunningTime="2026-09-10 04:42:10.254804795 +0000 UTC m=+69.917262543"
Sep 10 04:42:10.255227 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:10.255147    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-85b454874b-p5zjp" podStartSLOduration=42.579683441 podStartE2EDuration="51.255135846s" totalImagesPullingTime="8.675452405s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:41:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:42:10.231974901 +0000 UTC m=+69.894432648" watchObservedRunningTime="2026-09-10 04:42:10.255135846 +0000 UTC m=+69.917593592"
Sep 10 04:42:11.167545 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:11.167509    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-n2sr7" event={"ID":"13570f73-c21d-4771-8349-f30c25ab27fb","Type":"ContainerStarted","Data":"51dca397c73f6f79cf1353245ed991512b97714b6588c6e12551359498a9069e"}
Sep 10 04:42:11.168005 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:11.167565    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-n2sr7" event={"ID":"13570f73-c21d-4771-8349-f30c25ab27fb","Type":"ContainerStarted","Data":"e556aa9b7ba62f8cc34c6a2bb3d2ea4bb5b4027f8eb09d447d92c45ce48bce64"}
Sep 10 04:42:11.183947 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:11.183903    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-n2sr7" podStartSLOduration=66.69657882 podStartE2EDuration="1m10.183886683s" totalImagesPullingTime="3.487307863s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:41:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:42:11.183024015 +0000 UTC m=+70.845481762" watchObservedRunningTime="2026-09-10 04:42:11.183886683 +0000 UTC m=+70.846344427"
Sep 10 04:42:13.181905 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:13.181878    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-77cd4" event={"ID":"5e472a47-9b1d-4f3e-be2f-36ac4b0ebc7f","Type":"ContainerStarted","Data":"6ffa7c9f888ce22460e789be253014f33e3e70cc9df41aac0fae71ec69d98de7"}
Sep 10 04:42:13.196390 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:13.196343    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-77cd4" podStartSLOduration=66.450055882 podStartE2EDuration="1m12.19632572s" totalImagesPullingTime="5.746269838s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 04:41:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:42:13.195134637 +0000 UTC m=+72.857592387" watchObservedRunningTime="2026-09-10 04:42:13.19632572 +0000 UTC m=+72.858783475"
Sep 10 04:42:15.043748 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:15.043720    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-kq4qp"
Sep 10 04:42:19.757968 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:19.757933    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-89hdm"]
Sep 10 04:42:19.761007 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:19.760992    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-89hdm"
Sep 10 04:42:19.765018 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:19.764987    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 10 04:42:19.765119 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:19.765088    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 10 04:42:19.765713 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:19.765698    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 10 04:42:19.765758 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:19.765718    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-9hw97\""
Sep 10 04:42:19.765802 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:19.765769    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 10 04:42:19.892684 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:19.892651    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/39614aa5-4368-42f8-891e-79124c9686ce-metrics-client-ca\") pod \"node-exporter-89hdm\" (UID: \"39614aa5-4368-42f8-891e-79124c9686ce\") " pod="openshift-monitoring/node-exporter-89hdm"
Sep 10 04:42:19.892684 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:19.892684    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/39614aa5-4368-42f8-891e-79124c9686ce-root\") pod \"node-exporter-89hdm\" (UID: \"39614aa5-4368-42f8-891e-79124c9686ce\") " pod="openshift-monitoring/node-exporter-89hdm"
Sep 10 04:42:19.892870 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:19.892707    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/39614aa5-4368-42f8-891e-79124c9686ce-node-exporter-tls\") pod \"node-exporter-89hdm\" (UID: \"39614aa5-4368-42f8-891e-79124c9686ce\") " pod="openshift-monitoring/node-exporter-89hdm"
Sep 10 04:42:19.892870 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:19.892725    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/39614aa5-4368-42f8-891e-79124c9686ce-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-89hdm\" (UID: \"39614aa5-4368-42f8-891e-79124c9686ce\") " pod="openshift-monitoring/node-exporter-89hdm"
Sep 10 04:42:19.892870 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:19.892782    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/39614aa5-4368-42f8-891e-79124c9686ce-node-exporter-wtmp\") pod \"node-exporter-89hdm\" (UID: \"39614aa5-4368-42f8-891e-79124c9686ce\") " pod="openshift-monitoring/node-exporter-89hdm"
Sep 10 04:42:19.892870 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:19.892801    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/39614aa5-4368-42f8-891e-79124c9686ce-node-exporter-accelerators-collector-config\") pod \"node-exporter-89hdm\" (UID: \"39614aa5-4368-42f8-891e-79124c9686ce\") " pod="openshift-monitoring/node-exporter-89hdm"
Sep 10 04:42:19.892995 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:19.892866    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/39614aa5-4368-42f8-891e-79124c9686ce-sys\") pod \"node-exporter-89hdm\" (UID: \"39614aa5-4368-42f8-891e-79124c9686ce\") " pod="openshift-monitoring/node-exporter-89hdm"
Sep 10 04:42:19.892995 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:19.892931    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/39614aa5-4368-42f8-891e-79124c9686ce-node-exporter-textfile\") pod \"node-exporter-89hdm\" (UID: \"39614aa5-4368-42f8-891e-79124c9686ce\") " pod="openshift-monitoring/node-exporter-89hdm"
Sep 10 04:42:19.892995 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:19.892961    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfdrx\" (UniqueName: \"kubernetes.io/projected/39614aa5-4368-42f8-891e-79124c9686ce-kube-api-access-mfdrx\") pod \"node-exporter-89hdm\" (UID: \"39614aa5-4368-42f8-891e-79124c9686ce\") " pod="openshift-monitoring/node-exporter-89hdm"
Sep 10 04:42:19.993506 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:19.993482    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/39614aa5-4368-42f8-891e-79124c9686ce-metrics-client-ca\") pod \"node-exporter-89hdm\" (UID: \"39614aa5-4368-42f8-891e-79124c9686ce\") " pod="openshift-monitoring/node-exporter-89hdm"
Sep 10 04:42:19.993650 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:19.993513    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/39614aa5-4368-42f8-891e-79124c9686ce-root\") pod \"node-exporter-89hdm\" (UID: \"39614aa5-4368-42f8-891e-79124c9686ce\") " pod="openshift-monitoring/node-exporter-89hdm"
Sep 10 04:42:19.993650 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:19.993537    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/39614aa5-4368-42f8-891e-79124c9686ce-node-exporter-tls\") pod \"node-exporter-89hdm\" (UID: \"39614aa5-4368-42f8-891e-79124c9686ce\") " pod="openshift-monitoring/node-exporter-89hdm"
Sep 10 04:42:19.993650 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:19.993562    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/39614aa5-4368-42f8-891e-79124c9686ce-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-89hdm\" (UID: \"39614aa5-4368-42f8-891e-79124c9686ce\") " pod="openshift-monitoring/node-exporter-89hdm"
Sep 10 04:42:19.993650 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:19.993620    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/39614aa5-4368-42f8-891e-79124c9686ce-root\") pod \"node-exporter-89hdm\" (UID: \"39614aa5-4368-42f8-891e-79124c9686ce\") " pod="openshift-monitoring/node-exporter-89hdm"
Sep 10 04:42:19.993650 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:19.993622    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/39614aa5-4368-42f8-891e-79124c9686ce-node-exporter-wtmp\") pod \"node-exporter-89hdm\" (UID: \"39614aa5-4368-42f8-891e-79124c9686ce\") " pod="openshift-monitoring/node-exporter-89hdm"
Sep 10 04:42:19.993937 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:19.993683    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/39614aa5-4368-42f8-891e-79124c9686ce-node-exporter-accelerators-collector-config\") pod \"node-exporter-89hdm\" (UID: \"39614aa5-4368-42f8-891e-79124c9686ce\") " pod="openshift-monitoring/node-exporter-89hdm"
Sep 10 04:42:19.993937 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:19.993724    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/39614aa5-4368-42f8-891e-79124c9686ce-node-exporter-wtmp\") pod \"node-exporter-89hdm\" (UID: \"39614aa5-4368-42f8-891e-79124c9686ce\") " pod="openshift-monitoring/node-exporter-89hdm"
Sep 10 04:42:19.993937 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:19.993731    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/39614aa5-4368-42f8-891e-79124c9686ce-sys\") pod \"node-exporter-89hdm\" (UID: \"39614aa5-4368-42f8-891e-79124c9686ce\") " pod="openshift-monitoring/node-exporter-89hdm"
Sep 10 04:42:19.993937 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:19.993816    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/39614aa5-4368-42f8-891e-79124c9686ce-node-exporter-textfile\") pod \"node-exporter-89hdm\" (UID: \"39614aa5-4368-42f8-891e-79124c9686ce\") " pod="openshift-monitoring/node-exporter-89hdm"
Sep 10 04:42:19.993937 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:19.993838    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/39614aa5-4368-42f8-891e-79124c9686ce-sys\") pod \"node-exporter-89hdm\" (UID: \"39614aa5-4368-42f8-891e-79124c9686ce\") " pod="openshift-monitoring/node-exporter-89hdm"
Sep 10 04:42:19.993937 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:19.993872    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfdrx\" (UniqueName: \"kubernetes.io/projected/39614aa5-4368-42f8-891e-79124c9686ce-kube-api-access-mfdrx\") pod \"node-exporter-89hdm\" (UID: \"39614aa5-4368-42f8-891e-79124c9686ce\") " pod="openshift-monitoring/node-exporter-89hdm"
Sep 10 04:42:19.994198 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:19.994127    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/39614aa5-4368-42f8-891e-79124c9686ce-node-exporter-textfile\") pod \"node-exporter-89hdm\" (UID: \"39614aa5-4368-42f8-891e-79124c9686ce\") " pod="openshift-monitoring/node-exporter-89hdm"
Sep 10 04:42:19.994247 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:19.994191    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/39614aa5-4368-42f8-891e-79124c9686ce-metrics-client-ca\") pod \"node-exporter-89hdm\" (UID: \"39614aa5-4368-42f8-891e-79124c9686ce\") " pod="openshift-monitoring/node-exporter-89hdm"
Sep 10 04:42:19.994310 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:19.994289    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/39614aa5-4368-42f8-891e-79124c9686ce-node-exporter-accelerators-collector-config\") pod \"node-exporter-89hdm\" (UID: \"39614aa5-4368-42f8-891e-79124c9686ce\") " pod="openshift-monitoring/node-exporter-89hdm"
Sep 10 04:42:19.995962 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:19.995943    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/39614aa5-4368-42f8-891e-79124c9686ce-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-89hdm\" (UID: \"39614aa5-4368-42f8-891e-79124c9686ce\") " pod="openshift-monitoring/node-exporter-89hdm"
Sep 10 04:42:19.996086 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:19.996068    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/39614aa5-4368-42f8-891e-79124c9686ce-node-exporter-tls\") pod \"node-exporter-89hdm\" (UID: \"39614aa5-4368-42f8-891e-79124c9686ce\") " pod="openshift-monitoring/node-exporter-89hdm"
Sep 10 04:42:20.002119 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:20.002102    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfdrx\" (UniqueName: \"kubernetes.io/projected/39614aa5-4368-42f8-891e-79124c9686ce-kube-api-access-mfdrx\") pod \"node-exporter-89hdm\" (UID: \"39614aa5-4368-42f8-891e-79124c9686ce\") " pod="openshift-monitoring/node-exporter-89hdm"
Sep 10 04:42:20.069498 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:20.069450    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-89hdm"
Sep 10 04:42:20.079120 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:42:20.079097    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39614aa5_4368_42f8_891e_79124c9686ce.slice/crio-8badf14a09d3a0f66a6c34bde3a6ab5e030636c10b3ef871a2c4ca1ba292affe WatchSource:0}: Error finding container 8badf14a09d3a0f66a6c34bde3a6ab5e030636c10b3ef871a2c4ca1ba292affe: Status 404 returned error can't find the container with id 8badf14a09d3a0f66a6c34bde3a6ab5e030636c10b3ef871a2c4ca1ba292affe
Sep 10 04:42:20.210501 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:20.210470    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-89hdm" event={"ID":"39614aa5-4368-42f8-891e-79124c9686ce","Type":"ContainerStarted","Data":"8badf14a09d3a0f66a6c34bde3a6ab5e030636c10b3ef871a2c4ca1ba292affe"}
Sep 10 04:42:21.179416 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:21.179392    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-tkl9f"
Sep 10 04:42:22.220234 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:22.220199    2560 generic.go:356] "Generic (PLEG): container finished" podID="39614aa5-4368-42f8-891e-79124c9686ce" containerID="af46c101b29d6708a95275e8c68ecccc72068b9131fc008432de60665b107018" exitCode=0
Sep 10 04:42:22.220697 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:22.220275    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-89hdm" event={"ID":"39614aa5-4368-42f8-891e-79124c9686ce","Type":"ContainerDied","Data":"af46c101b29d6708a95275e8c68ecccc72068b9131fc008432de60665b107018"}
Sep 10 04:42:23.225673 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:23.225545    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-89hdm" event={"ID":"39614aa5-4368-42f8-891e-79124c9686ce","Type":"ContainerStarted","Data":"403037be0d0fb385059e3111008c2da32636ba48e2dd4287be8804e754d3062c"}
Sep 10 04:42:23.225673 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:23.225596    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-89hdm" event={"ID":"39614aa5-4368-42f8-891e-79124c9686ce","Type":"ContainerStarted","Data":"0ebdc71872f313bfc4e28c68667a2d0365753a8b07dcf6f17fd16bbbfbbcf2fe"}
Sep 10 04:42:23.243971 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:23.243927    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-89hdm" podStartSLOduration=3.109745741 podStartE2EDuration="4.243914619s" totalImagesPullingTime="1.064732381s" totalInitContainerRuntime="69.436497ms" isStatefulPod=true podCreationTimestamp="2026-09-10 04:42:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:42:23.243499414 +0000 UTC m=+82.905957162" watchObservedRunningTime="2026-09-10 04:42:23.243914619 +0000 UTC m=+82.906372366"
Sep 10 04:42:25.781318 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:25.781282    2560 patch_prober.go:28] interesting pod/image-registry-77586cf744-p4w2v container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 10 04:42:25.781743 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:25.781336    2560 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-77586cf744-p4w2v" podUID="1529c81a-0935-4a33-a02a-39323d37b580" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 04:42:27.141131 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:27.141102    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-77586cf744-p4w2v"
Sep 10 04:42:29.255494 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:29.255464    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-77586cf744-p4w2v"]
Sep 10 04:42:29.373454 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:29.373422    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-86888f4c4c-mgrtk"]
Sep 10 04:42:29.375772 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:29.375751    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86888f4c4c-mgrtk"
Sep 10 04:42:29.378236 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:29.378212    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 10 04:42:29.378346 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:29.378254    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 10 04:42:29.378610 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:29.378583    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 10 04:42:29.378727 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:29.378614    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 10 04:42:29.378727 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:29.378641    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 10 04:42:29.378912 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:29.378892    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-v4tq8\""
Sep 10 04:42:29.379008 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:29.378941    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 10 04:42:29.379008 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:29.378966    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 10 04:42:29.384638 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:29.384619    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 10 04:42:29.393266 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:29.393246    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86888f4c4c-mgrtk"]
Sep 10 04:42:29.456670 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:29.456644    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814-oauth-serving-cert\") pod \"console-86888f4c4c-mgrtk\" (UID: \"ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814\") " pod="openshift-console/console-86888f4c4c-mgrtk"
Sep 10 04:42:29.456796 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:29.456686    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814-service-ca\") pod \"console-86888f4c4c-mgrtk\" (UID: \"ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814\") " pod="openshift-console/console-86888f4c4c-mgrtk"
Sep 10 04:42:29.456796 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:29.456703    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814-trusted-ca-bundle\") pod \"console-86888f4c4c-mgrtk\" (UID: \"ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814\") " pod="openshift-console/console-86888f4c4c-mgrtk"
Sep 10 04:42:29.456796 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:29.456719    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sbwc\" (UniqueName: \"kubernetes.io/projected/ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814-kube-api-access-9sbwc\") pod \"console-86888f4c4c-mgrtk\" (UID: \"ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814\") " pod="openshift-console/console-86888f4c4c-mgrtk"
Sep 10 04:42:29.456796 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:29.456737    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814-console-oauth-config\") pod \"console-86888f4c4c-mgrtk\" (UID: \"ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814\") " pod="openshift-console/console-86888f4c4c-mgrtk"
Sep 10 04:42:29.456796 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:29.456767    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814-console-serving-cert\") pod \"console-86888f4c4c-mgrtk\" (UID: \"ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814\") " pod="openshift-console/console-86888f4c4c-mgrtk"
Sep 10 04:42:29.456983 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:29.456826    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814-console-config\") pod \"console-86888f4c4c-mgrtk\" (UID: \"ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814\") " pod="openshift-console/console-86888f4c4c-mgrtk"
Sep 10 04:42:29.558043 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:29.557988    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814-console-serving-cert\") pod \"console-86888f4c4c-mgrtk\" (UID: \"ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814\") " pod="openshift-console/console-86888f4c4c-mgrtk"
Sep 10 04:42:29.558043 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:29.558034    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814-console-config\") pod \"console-86888f4c4c-mgrtk\" (UID: \"ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814\") " pod="openshift-console/console-86888f4c4c-mgrtk"
Sep 10 04:42:29.558194 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:29.558056    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814-oauth-serving-cert\") pod \"console-86888f4c4c-mgrtk\" (UID: \"ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814\") " pod="openshift-console/console-86888f4c4c-mgrtk"
Sep 10 04:42:29.558194 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:29.558083    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814-service-ca\") pod \"console-86888f4c4c-mgrtk\" (UID: \"ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814\") " pod="openshift-console/console-86888f4c4c-mgrtk"
Sep 10 04:42:29.558194 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:29.558098    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814-trusted-ca-bundle\") pod \"console-86888f4c4c-mgrtk\" (UID: \"ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814\") " pod="openshift-console/console-86888f4c4c-mgrtk"
Sep 10 04:42:29.558194 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:29.558111    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sbwc\" (UniqueName: \"kubernetes.io/projected/ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814-kube-api-access-9sbwc\") pod \"console-86888f4c4c-mgrtk\" (UID: \"ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814\") " pod="openshift-console/console-86888f4c4c-mgrtk"
Sep 10 04:42:29.558194 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:29.558127    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814-console-oauth-config\") pod \"console-86888f4c4c-mgrtk\" (UID: \"ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814\") " pod="openshift-console/console-86888f4c4c-mgrtk"
Sep 10 04:42:29.558807 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:29.558783    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814-oauth-serving-cert\") pod \"console-86888f4c4c-mgrtk\" (UID: \"ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814\") " pod="openshift-console/console-86888f4c4c-mgrtk"
Sep 10 04:42:29.558807 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:29.558802    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814-console-config\") pod \"console-86888f4c4c-mgrtk\" (UID: \"ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814\") " pod="openshift-console/console-86888f4c4c-mgrtk"
Sep 10 04:42:29.558994 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:29.558961    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814-service-ca\") pod \"console-86888f4c4c-mgrtk\" (UID: \"ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814\") " pod="openshift-console/console-86888f4c4c-mgrtk"
Sep 10 04:42:29.559051 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:29.558991    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814-trusted-ca-bundle\") pod \"console-86888f4c4c-mgrtk\" (UID: \"ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814\") " pod="openshift-console/console-86888f4c4c-mgrtk"
Sep 10 04:42:29.560507 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:29.560478    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814-console-oauth-config\") pod \"console-86888f4c4c-mgrtk\" (UID: \"ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814\") " pod="openshift-console/console-86888f4c4c-mgrtk"
Sep 10 04:42:29.560710 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:29.560690    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814-console-serving-cert\") pod \"console-86888f4c4c-mgrtk\" (UID: \"ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814\") " pod="openshift-console/console-86888f4c4c-mgrtk"
Sep 10 04:42:29.570109 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:29.570088    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sbwc\" (UniqueName: \"kubernetes.io/projected/ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814-kube-api-access-9sbwc\") pod \"console-86888f4c4c-mgrtk\" (UID: \"ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814\") " pod="openshift-console/console-86888f4c4c-mgrtk"
Sep 10 04:42:29.685892 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:29.685866    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86888f4c4c-mgrtk"
Sep 10 04:42:29.963626 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:29.963546    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86888f4c4c-mgrtk"]
Sep 10 04:42:29.965636 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:42:29.965611    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffb3f01f_0c1e_4e20_b8d1_33feb9bc9814.slice/crio-3cd2cab1c1ae4409c805e007c78580296b846ac59830f02f3e8ad6d660526884 WatchSource:0}: Error finding container 3cd2cab1c1ae4409c805e007c78580296b846ac59830f02f3e8ad6d660526884: Status 404 returned error can't find the container with id 3cd2cab1c1ae4409c805e007c78580296b846ac59830f02f3e8ad6d660526884
Sep 10 04:42:30.250711 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:30.250632    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86888f4c4c-mgrtk" event={"ID":"ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814","Type":"ContainerStarted","Data":"3cd2cab1c1ae4409c805e007c78580296b846ac59830f02f3e8ad6d660526884"}
Sep 10 04:42:33.264508 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:33.264468    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86888f4c4c-mgrtk" event={"ID":"ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814","Type":"ContainerStarted","Data":"ec173865f9636bde699ae4c477fc6e845a1028566da6ee5cdfc6f846a36457b7"}
Sep 10 04:42:33.282217 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:33.282169    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-86888f4c4c-mgrtk" podStartSLOduration=1.587149229 podStartE2EDuration="4.282155643s" totalImagesPullingTime="2.695006414s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:42:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:42:33.281121707 +0000 UTC m=+92.943579445" watchObservedRunningTime="2026-09-10 04:42:33.282155643 +0000 UTC m=+92.944613390"
Sep 10 04:42:39.686396 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:39.686363    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-86888f4c4c-mgrtk"
Sep 10 04:42:39.686757 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:39.686424    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-86888f4c4c-mgrtk"
Sep 10 04:42:39.690883 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:39.690844    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-86888f4c4c-mgrtk"
Sep 10 04:42:40.293509 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:40.293484    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-86888f4c4c-mgrtk"
Sep 10 04:42:54.277865 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:54.277792    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-77586cf744-p4w2v" podUID="1529c81a-0935-4a33-a02a-39323d37b580" containerName="registry" containerID="cri-o://905f7aec54d78b76acedec36241f77db52a6011d4822563c395bc83342ceb5a7" gracePeriod=30
Sep 10 04:42:54.343173 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:54.343143    2560 generic.go:356] "Generic (PLEG): container finished" podID="5552ac0d-5458-4244-9cb1-e278a75e0451" containerID="21d46cc1441ee9a70f92a1df524ecddea482a0c9d04c594f6a19106eb1bb259d" exitCode=0
Sep 10 04:42:54.343278 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:54.343185    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-hkjtg" event={"ID":"5552ac0d-5458-4244-9cb1-e278a75e0451","Type":"ContainerDied","Data":"21d46cc1441ee9a70f92a1df524ecddea482a0c9d04c594f6a19106eb1bb259d"}
Sep 10 04:42:54.343494 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:54.343472    2560 scope.go:117] "RemoveContainer" containerID="21d46cc1441ee9a70f92a1df524ecddea482a0c9d04c594f6a19106eb1bb259d"
Sep 10 04:42:54.523387 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:54.523363    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77586cf744-p4w2v"
Sep 10 04:42:54.535128 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:54.535081    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1529c81a-0935-4a33-a02a-39323d37b580-trusted-ca\") pod \"1529c81a-0935-4a33-a02a-39323d37b580\" (UID: \"1529c81a-0935-4a33-a02a-39323d37b580\") "
Sep 10 04:42:54.535239 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:54.535154    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1529c81a-0935-4a33-a02a-39323d37b580-registry-tls\") pod \"1529c81a-0935-4a33-a02a-39323d37b580\" (UID: \"1529c81a-0935-4a33-a02a-39323d37b580\") "
Sep 10 04:42:54.535239 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:54.535184    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1529c81a-0935-4a33-a02a-39323d37b580-bound-sa-token\") pod \"1529c81a-0935-4a33-a02a-39323d37b580\" (UID: \"1529c81a-0935-4a33-a02a-39323d37b580\") "
Sep 10 04:42:54.535239 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:54.535215    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1529c81a-0935-4a33-a02a-39323d37b580-registry-certificates\") pod \"1529c81a-0935-4a33-a02a-39323d37b580\" (UID: \"1529c81a-0935-4a33-a02a-39323d37b580\") "
Sep 10 04:42:54.535239 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:54.535239    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rjlg2\" (UniqueName: \"kubernetes.io/projected/1529c81a-0935-4a33-a02a-39323d37b580-kube-api-access-rjlg2\") pod \"1529c81a-0935-4a33-a02a-39323d37b580\" (UID: \"1529c81a-0935-4a33-a02a-39323d37b580\") "
Sep 10 04:42:54.535443 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:54.535280    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1529c81a-0935-4a33-a02a-39323d37b580-installation-pull-secrets\") pod \"1529c81a-0935-4a33-a02a-39323d37b580\" (UID: \"1529c81a-0935-4a33-a02a-39323d37b580\") "
Sep 10 04:42:54.535443 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:54.535314    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1529c81a-0935-4a33-a02a-39323d37b580-ca-trust-extracted\") pod \"1529c81a-0935-4a33-a02a-39323d37b580\" (UID: \"1529c81a-0935-4a33-a02a-39323d37b580\") "
Sep 10 04:42:54.535443 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:54.535349    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1529c81a-0935-4a33-a02a-39323d37b580-image-registry-private-configuration\") pod \"1529c81a-0935-4a33-a02a-39323d37b580\" (UID: \"1529c81a-0935-4a33-a02a-39323d37b580\") "
Sep 10 04:42:54.535443 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:54.535409    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1529c81a-0935-4a33-a02a-39323d37b580-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "1529c81a-0935-4a33-a02a-39323d37b580" (UID: "1529c81a-0935-4a33-a02a-39323d37b580"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 04:42:54.535643 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:54.535590    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1529c81a-0935-4a33-a02a-39323d37b580-trusted-ca\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:42:54.535699 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:54.535675    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1529c81a-0935-4a33-a02a-39323d37b580-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "1529c81a-0935-4a33-a02a-39323d37b580" (UID: "1529c81a-0935-4a33-a02a-39323d37b580"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 04:42:54.538003 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:54.537962    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1529c81a-0935-4a33-a02a-39323d37b580-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "1529c81a-0935-4a33-a02a-39323d37b580" (UID: "1529c81a-0935-4a33-a02a-39323d37b580"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 04:42:54.538199 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:54.538142    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1529c81a-0935-4a33-a02a-39323d37b580-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "1529c81a-0935-4a33-a02a-39323d37b580" (UID: "1529c81a-0935-4a33-a02a-39323d37b580"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 04:42:54.538310 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:54.538289    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1529c81a-0935-4a33-a02a-39323d37b580-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "1529c81a-0935-4a33-a02a-39323d37b580" (UID: "1529c81a-0935-4a33-a02a-39323d37b580"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 04:42:54.538408 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:54.538385    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1529c81a-0935-4a33-a02a-39323d37b580-kube-api-access-rjlg2" (OuterVolumeSpecName: "kube-api-access-rjlg2") pod "1529c81a-0935-4a33-a02a-39323d37b580" (UID: "1529c81a-0935-4a33-a02a-39323d37b580"). InnerVolumeSpecName "kube-api-access-rjlg2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 04:42:54.538994 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:54.538972    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1529c81a-0935-4a33-a02a-39323d37b580-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "1529c81a-0935-4a33-a02a-39323d37b580" (UID: "1529c81a-0935-4a33-a02a-39323d37b580"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 04:42:54.544336 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:54.544311    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1529c81a-0935-4a33-a02a-39323d37b580-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "1529c81a-0935-4a33-a02a-39323d37b580" (UID: "1529c81a-0935-4a33-a02a-39323d37b580"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 04:42:54.636623 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:54.636586    2560 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1529c81a-0935-4a33-a02a-39323d37b580-registry-tls\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:42:54.636623 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:54.636623    2560 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1529c81a-0935-4a33-a02a-39323d37b580-bound-sa-token\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:42:54.636759 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:54.636635    2560 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1529c81a-0935-4a33-a02a-39323d37b580-registry-certificates\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:42:54.636759 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:54.636648    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rjlg2\" (UniqueName: \"kubernetes.io/projected/1529c81a-0935-4a33-a02a-39323d37b580-kube-api-access-rjlg2\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:42:54.636759 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:54.636660    2560 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1529c81a-0935-4a33-a02a-39323d37b580-installation-pull-secrets\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:42:54.636759 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:54.636672    2560 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1529c81a-0935-4a33-a02a-39323d37b580-ca-trust-extracted\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:42:54.636759 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:54.636684    2560 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1529c81a-0935-4a33-a02a-39323d37b580-image-registry-private-configuration\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:42:55.348278 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:55.348245    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-hkjtg" event={"ID":"5552ac0d-5458-4244-9cb1-e278a75e0451","Type":"ContainerStarted","Data":"2bedf91d4a18a29e6eb639f4fd6dc1fb93847d4fd7d2c63e90b0e6d5d25dfc40"}
Sep 10 04:42:55.349556 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:55.349524    2560 generic.go:356] "Generic (PLEG): container finished" podID="1529c81a-0935-4a33-a02a-39323d37b580" containerID="905f7aec54d78b76acedec36241f77db52a6011d4822563c395bc83342ceb5a7" exitCode=0
Sep 10 04:42:55.349684 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:55.349562    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77586cf744-p4w2v"
Sep 10 04:42:55.349684 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:55.349577    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77586cf744-p4w2v" event={"ID":"1529c81a-0935-4a33-a02a-39323d37b580","Type":"ContainerDied","Data":"905f7aec54d78b76acedec36241f77db52a6011d4822563c395bc83342ceb5a7"}
Sep 10 04:42:55.349684 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:55.349624    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77586cf744-p4w2v" event={"ID":"1529c81a-0935-4a33-a02a-39323d37b580","Type":"ContainerDied","Data":"b6d138a5877cafe62abdae7b3bd1e69cfec8b8163db99343a9ad255dc3b51c98"}
Sep 10 04:42:55.349684 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:55.349645    2560 scope.go:117] "RemoveContainer" containerID="905f7aec54d78b76acedec36241f77db52a6011d4822563c395bc83342ceb5a7"
Sep 10 04:42:55.359599 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:55.359540    2560 scope.go:117] "RemoveContainer" containerID="905f7aec54d78b76acedec36241f77db52a6011d4822563c395bc83342ceb5a7"
Sep 10 04:42:55.360030 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:42:55.360010    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"905f7aec54d78b76acedec36241f77db52a6011d4822563c395bc83342ceb5a7\": container with ID starting with 905f7aec54d78b76acedec36241f77db52a6011d4822563c395bc83342ceb5a7 not found: ID does not exist" containerID="905f7aec54d78b76acedec36241f77db52a6011d4822563c395bc83342ceb5a7"
Sep 10 04:42:55.360125 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:55.360037    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"905f7aec54d78b76acedec36241f77db52a6011d4822563c395bc83342ceb5a7"} err="failed to get container status \"905f7aec54d78b76acedec36241f77db52a6011d4822563c395bc83342ceb5a7\": rpc error: code = NotFound desc = could not find container \"905f7aec54d78b76acedec36241f77db52a6011d4822563c395bc83342ceb5a7\": container with ID starting with 905f7aec54d78b76acedec36241f77db52a6011d4822563c395bc83342ceb5a7 not found: ID does not exist"
Sep 10 04:42:55.382122 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:55.382094    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-77586cf744-p4w2v"]
Sep 10 04:42:55.385414 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:55.385396    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-77586cf744-p4w2v"]
Sep 10 04:42:56.824381 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:42:56.824353    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1529c81a-0935-4a33-a02a-39323d37b580" path="/var/lib/kubelet/pods/1529c81a-0935-4a33-a02a-39323d37b580/volumes"
Sep 10 04:43:09.407262 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:09.407228    2560 generic.go:356] "Generic (PLEG): container finished" podID="b0f33b82-87c0-4c48-a093-a91e3317cf73" containerID="ebd97eb680a6e732a4641ebe8bcf86782d373e95c59654bd7c1f3b6af11f3e35" exitCode=0
Sep 10 04:43:09.407660 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:09.407304    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-x8kmb" event={"ID":"b0f33b82-87c0-4c48-a093-a91e3317cf73","Type":"ContainerDied","Data":"ebd97eb680a6e732a4641ebe8bcf86782d373e95c59654bd7c1f3b6af11f3e35"}
Sep 10 04:43:09.407660 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:09.407621    2560 scope.go:117] "RemoveContainer" containerID="ebd97eb680a6e732a4641ebe8bcf86782d373e95c59654bd7c1f3b6af11f3e35"
Sep 10 04:43:10.412634 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:10.412600    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-x8kmb" event={"ID":"b0f33b82-87c0-4c48-a093-a91e3317cf73","Type":"ContainerStarted","Data":"033b37d60876ad8f6975f465a87f333d5601454c7a5aab2010be73756f3bfeeb"}
Sep 10 04:43:14.426389 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:14.426347    2560 generic.go:356] "Generic (PLEG): container finished" podID="ef57e894-f8b4-464e-b814-3ceada543c28" containerID="4a5974d399ed1675bf73fb2b8e532953fa3fe730d2b6ee17f598712ec3f7f769" exitCode=0
Sep 10 04:43:14.426808 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:14.426425    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-tgcbl" event={"ID":"ef57e894-f8b4-464e-b814-3ceada543c28","Type":"ContainerDied","Data":"4a5974d399ed1675bf73fb2b8e532953fa3fe730d2b6ee17f598712ec3f7f769"}
Sep 10 04:43:14.426808 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:14.426737    2560 scope.go:117] "RemoveContainer" containerID="4a5974d399ed1675bf73fb2b8e532953fa3fe730d2b6ee17f598712ec3f7f769"
Sep 10 04:43:15.432453 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:15.432421    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-tgcbl" event={"ID":"ef57e894-f8b4-464e-b814-3ceada543c28","Type":"ContainerStarted","Data":"25516648f177083ffac6e6b4e49864899d90b3d50ce792c248bb636010ff5b81"}
Sep 10 04:43:43.934887 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:43.934840    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-84c69d5fb8-hbv7m"]
Sep 10 04:43:43.935298 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:43.935091    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1529c81a-0935-4a33-a02a-39323d37b580" containerName="registry"
Sep 10 04:43:43.935298 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:43.935101    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1529c81a-0935-4a33-a02a-39323d37b580" containerName="registry"
Sep 10 04:43:43.935298 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:43.935159    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="1529c81a-0935-4a33-a02a-39323d37b580" containerName="registry"
Sep 10 04:43:43.939435 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:43.939415    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-84c69d5fb8-hbv7m"
Sep 10 04:43:43.941659 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:43.941631    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 10 04:43:43.941790 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:43.941681    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 10 04:43:43.941790 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:43.941733    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 10 04:43:43.941958 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:43.941873    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 10 04:43:43.942019 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:43.941967    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 10 04:43:43.942073 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:43.942047    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-4dgn9\""
Sep 10 04:43:43.946738 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:43.946699    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 10 04:43:43.951726 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:43.951698    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-84c69d5fb8-hbv7m"]
Sep 10 04:43:44.084255 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:44.084226    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e086bb59-3491-4c1a-badf-35db6ab31614-secret-telemeter-client\") pod \"telemeter-client-84c69d5fb8-hbv7m\" (UID: \"e086bb59-3491-4c1a-badf-35db6ab31614\") " pod="openshift-monitoring/telemeter-client-84c69d5fb8-hbv7m"
Sep 10 04:43:44.084393 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:44.084258    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e086bb59-3491-4c1a-badf-35db6ab31614-serving-certs-ca-bundle\") pod \"telemeter-client-84c69d5fb8-hbv7m\" (UID: \"e086bb59-3491-4c1a-badf-35db6ab31614\") " pod="openshift-monitoring/telemeter-client-84c69d5fb8-hbv7m"
Sep 10 04:43:44.084393 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:44.084279    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e086bb59-3491-4c1a-badf-35db6ab31614-telemeter-trusted-ca-bundle\") pod \"telemeter-client-84c69d5fb8-hbv7m\" (UID: \"e086bb59-3491-4c1a-badf-35db6ab31614\") " pod="openshift-monitoring/telemeter-client-84c69d5fb8-hbv7m"
Sep 10 04:43:44.084393 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:44.084327    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e086bb59-3491-4c1a-badf-35db6ab31614-metrics-client-ca\") pod \"telemeter-client-84c69d5fb8-hbv7m\" (UID: \"e086bb59-3491-4c1a-badf-35db6ab31614\") " pod="openshift-monitoring/telemeter-client-84c69d5fb8-hbv7m"
Sep 10 04:43:44.084393 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:44.084362    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e086bb59-3491-4c1a-badf-35db6ab31614-telemeter-client-tls\") pod \"telemeter-client-84c69d5fb8-hbv7m\" (UID: \"e086bb59-3491-4c1a-badf-35db6ab31614\") " pod="openshift-monitoring/telemeter-client-84c69d5fb8-hbv7m"
Sep 10 04:43:44.084561 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:44.084413    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e086bb59-3491-4c1a-badf-35db6ab31614-federate-client-tls\") pod \"telemeter-client-84c69d5fb8-hbv7m\" (UID: \"e086bb59-3491-4c1a-badf-35db6ab31614\") " pod="openshift-monitoring/telemeter-client-84c69d5fb8-hbv7m"
Sep 10 04:43:44.084561 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:44.084458    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e086bb59-3491-4c1a-badf-35db6ab31614-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-84c69d5fb8-hbv7m\" (UID: \"e086bb59-3491-4c1a-badf-35db6ab31614\") " pod="openshift-monitoring/telemeter-client-84c69d5fb8-hbv7m"
Sep 10 04:43:44.084561 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:44.084494    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xpk2\" (UniqueName: \"kubernetes.io/projected/e086bb59-3491-4c1a-badf-35db6ab31614-kube-api-access-7xpk2\") pod \"telemeter-client-84c69d5fb8-hbv7m\" (UID: \"e086bb59-3491-4c1a-badf-35db6ab31614\") " pod="openshift-monitoring/telemeter-client-84c69d5fb8-hbv7m"
Sep 10 04:43:44.185797 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:44.185731    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e086bb59-3491-4c1a-badf-35db6ab31614-telemeter-client-tls\") pod \"telemeter-client-84c69d5fb8-hbv7m\" (UID: \"e086bb59-3491-4c1a-badf-35db6ab31614\") " pod="openshift-monitoring/telemeter-client-84c69d5fb8-hbv7m"
Sep 10 04:43:44.185797 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:44.185767    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e086bb59-3491-4c1a-badf-35db6ab31614-federate-client-tls\") pod \"telemeter-client-84c69d5fb8-hbv7m\" (UID: \"e086bb59-3491-4c1a-badf-35db6ab31614\") " pod="openshift-monitoring/telemeter-client-84c69d5fb8-hbv7m"
Sep 10 04:43:44.185971 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:44.185801    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e086bb59-3491-4c1a-badf-35db6ab31614-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-84c69d5fb8-hbv7m\" (UID: \"e086bb59-3491-4c1a-badf-35db6ab31614\") " pod="openshift-monitoring/telemeter-client-84c69d5fb8-hbv7m"
Sep 10 04:43:44.185971 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:44.185866    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xpk2\" (UniqueName: \"kubernetes.io/projected/e086bb59-3491-4c1a-badf-35db6ab31614-kube-api-access-7xpk2\") pod \"telemeter-client-84c69d5fb8-hbv7m\" (UID: \"e086bb59-3491-4c1a-badf-35db6ab31614\") " pod="openshift-monitoring/telemeter-client-84c69d5fb8-hbv7m"
Sep 10 04:43:44.185971 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:44.185900    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e086bb59-3491-4c1a-badf-35db6ab31614-secret-telemeter-client\") pod \"telemeter-client-84c69d5fb8-hbv7m\" (UID: \"e086bb59-3491-4c1a-badf-35db6ab31614\") " pod="openshift-monitoring/telemeter-client-84c69d5fb8-hbv7m"
Sep 10 04:43:44.185971 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:44.185926    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e086bb59-3491-4c1a-badf-35db6ab31614-serving-certs-ca-bundle\") pod \"telemeter-client-84c69d5fb8-hbv7m\" (UID: \"e086bb59-3491-4c1a-badf-35db6ab31614\") " pod="openshift-monitoring/telemeter-client-84c69d5fb8-hbv7m"
Sep 10 04:43:44.185971 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:44.185961    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e086bb59-3491-4c1a-badf-35db6ab31614-telemeter-trusted-ca-bundle\") pod \"telemeter-client-84c69d5fb8-hbv7m\" (UID: \"e086bb59-3491-4c1a-badf-35db6ab31614\") " pod="openshift-monitoring/telemeter-client-84c69d5fb8-hbv7m"
Sep 10 04:43:44.186181 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:44.185990    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e086bb59-3491-4c1a-badf-35db6ab31614-metrics-client-ca\") pod \"telemeter-client-84c69d5fb8-hbv7m\" (UID: \"e086bb59-3491-4c1a-badf-35db6ab31614\") " pod="openshift-monitoring/telemeter-client-84c69d5fb8-hbv7m"
Sep 10 04:43:44.186720 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:44.186693    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e086bb59-3491-4c1a-badf-35db6ab31614-metrics-client-ca\") pod \"telemeter-client-84c69d5fb8-hbv7m\" (UID: \"e086bb59-3491-4c1a-badf-35db6ab31614\") " pod="openshift-monitoring/telemeter-client-84c69d5fb8-hbv7m"
Sep 10 04:43:44.186826 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:44.186755    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e086bb59-3491-4c1a-badf-35db6ab31614-serving-certs-ca-bundle\") pod \"telemeter-client-84c69d5fb8-hbv7m\" (UID: \"e086bb59-3491-4c1a-badf-35db6ab31614\") " pod="openshift-monitoring/telemeter-client-84c69d5fb8-hbv7m"
Sep 10 04:43:44.186901 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:44.186883    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e086bb59-3491-4c1a-badf-35db6ab31614-telemeter-trusted-ca-bundle\") pod \"telemeter-client-84c69d5fb8-hbv7m\" (UID: \"e086bb59-3491-4c1a-badf-35db6ab31614\") " pod="openshift-monitoring/telemeter-client-84c69d5fb8-hbv7m"
Sep 10 04:43:44.188352 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:44.188331    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e086bb59-3491-4c1a-badf-35db6ab31614-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-84c69d5fb8-hbv7m\" (UID: \"e086bb59-3491-4c1a-badf-35db6ab31614\") " pod="openshift-monitoring/telemeter-client-84c69d5fb8-hbv7m"
Sep 10 04:43:44.188446 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:44.188424    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e086bb59-3491-4c1a-badf-35db6ab31614-federate-client-tls\") pod \"telemeter-client-84c69d5fb8-hbv7m\" (UID: \"e086bb59-3491-4c1a-badf-35db6ab31614\") " pod="openshift-monitoring/telemeter-client-84c69d5fb8-hbv7m"
Sep 10 04:43:44.188741 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:44.188725    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e086bb59-3491-4c1a-badf-35db6ab31614-secret-telemeter-client\") pod \"telemeter-client-84c69d5fb8-hbv7m\" (UID: \"e086bb59-3491-4c1a-badf-35db6ab31614\") " pod="openshift-monitoring/telemeter-client-84c69d5fb8-hbv7m"
Sep 10 04:43:44.188796 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:44.188784    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e086bb59-3491-4c1a-badf-35db6ab31614-telemeter-client-tls\") pod \"telemeter-client-84c69d5fb8-hbv7m\" (UID: \"e086bb59-3491-4c1a-badf-35db6ab31614\") " pod="openshift-monitoring/telemeter-client-84c69d5fb8-hbv7m"
Sep 10 04:43:44.192754 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:44.192735    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xpk2\" (UniqueName: \"kubernetes.io/projected/e086bb59-3491-4c1a-badf-35db6ab31614-kube-api-access-7xpk2\") pod \"telemeter-client-84c69d5fb8-hbv7m\" (UID: \"e086bb59-3491-4c1a-badf-35db6ab31614\") " pod="openshift-monitoring/telemeter-client-84c69d5fb8-hbv7m"
Sep 10 04:43:44.248697 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:44.248677    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-84c69d5fb8-hbv7m"
Sep 10 04:43:44.527048 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:44.527022    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-84c69d5fb8-hbv7m"]
Sep 10 04:43:44.528620 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:43:44.528593    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode086bb59_3491_4c1a_badf_35db6ab31614.slice/crio-513502d7cc554d425dc5c957c0ddd55eb3318058523f1bd57728af7bc5ce439b WatchSource:0}: Error finding container 513502d7cc554d425dc5c957c0ddd55eb3318058523f1bd57728af7bc5ce439b: Status 404 returned error can't find the container with id 513502d7cc554d425dc5c957c0ddd55eb3318058523f1bd57728af7bc5ce439b
Sep 10 04:43:44.553837 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:44.553809    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-84c69d5fb8-hbv7m" event={"ID":"e086bb59-3491-4c1a-badf-35db6ab31614","Type":"ContainerStarted","Data":"513502d7cc554d425dc5c957c0ddd55eb3318058523f1bd57728af7bc5ce439b"}
Sep 10 04:43:46.563832 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:46.563799    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-84c69d5fb8-hbv7m" event={"ID":"e086bb59-3491-4c1a-badf-35db6ab31614","Type":"ContainerStarted","Data":"e72e5096cb590f3fbe72d207dd98fbbcf28ef226885e281bb439ca02b366af61"}
Sep 10 04:43:47.569247 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:47.569223    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-84c69d5fb8-hbv7m" event={"ID":"e086bb59-3491-4c1a-badf-35db6ab31614","Type":"ContainerStarted","Data":"3539f9a2a632c17136c102f511c4419c75cc3418ace76c3d5a17c92016ad3fd8"}
Sep 10 04:43:48.574439 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:48.574389    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-84c69d5fb8-hbv7m" event={"ID":"e086bb59-3491-4c1a-badf-35db6ab31614","Type":"ContainerStarted","Data":"195798ed3d049fb2c0bfe734f4df43d45f7b9f8215d57ce3446cfb1e9fe242c9"}
Sep 10 04:43:48.595931 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:48.595790    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-84c69d5fb8-hbv7m" podStartSLOduration=2.713960727 podStartE2EDuration="5.595772242s" totalImagesPullingTime="2.881811515s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:43:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:43:48.593818751 +0000 UTC m=+168.256276497" watchObservedRunningTime="2026-09-10 04:43:48.595772242 +0000 UTC m=+168.258229972"
Sep 10 04:43:48.679467 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:48.679433    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f4dc9fb78-jnrh4"]
Sep 10 04:43:48.682801 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:48.682777    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f4dc9fb78-jnrh4"
Sep 10 04:43:48.696391 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:48.696357    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f4dc9fb78-jnrh4"]
Sep 10 04:43:48.820726 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:48.820695    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e3a87b97-906d-4704-af34-067f1122f507-console-config\") pod \"console-7f4dc9fb78-jnrh4\" (UID: \"e3a87b97-906d-4704-af34-067f1122f507\") " pod="openshift-console/console-7f4dc9fb78-jnrh4"
Sep 10 04:43:48.820890 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:48.820741    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e3a87b97-906d-4704-af34-067f1122f507-service-ca\") pod \"console-7f4dc9fb78-jnrh4\" (UID: \"e3a87b97-906d-4704-af34-067f1122f507\") " pod="openshift-console/console-7f4dc9fb78-jnrh4"
Sep 10 04:43:48.820890 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:48.820758    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e3a87b97-906d-4704-af34-067f1122f507-oauth-serving-cert\") pod \"console-7f4dc9fb78-jnrh4\" (UID: \"e3a87b97-906d-4704-af34-067f1122f507\") " pod="openshift-console/console-7f4dc9fb78-jnrh4"
Sep 10 04:43:48.820890 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:48.820824    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ds69j\" (UniqueName: \"kubernetes.io/projected/e3a87b97-906d-4704-af34-067f1122f507-kube-api-access-ds69j\") pod \"console-7f4dc9fb78-jnrh4\" (UID: \"e3a87b97-906d-4704-af34-067f1122f507\") " pod="openshift-console/console-7f4dc9fb78-jnrh4"
Sep 10 04:43:48.820890 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:48.820880    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3a87b97-906d-4704-af34-067f1122f507-trusted-ca-bundle\") pod \"console-7f4dc9fb78-jnrh4\" (UID: \"e3a87b97-906d-4704-af34-067f1122f507\") " pod="openshift-console/console-7f4dc9fb78-jnrh4"
Sep 10 04:43:48.821062 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:48.820912    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e3a87b97-906d-4704-af34-067f1122f507-console-oauth-config\") pod \"console-7f4dc9fb78-jnrh4\" (UID: \"e3a87b97-906d-4704-af34-067f1122f507\") " pod="openshift-console/console-7f4dc9fb78-jnrh4"
Sep 10 04:43:48.821062 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:48.820951    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e3a87b97-906d-4704-af34-067f1122f507-console-serving-cert\") pod \"console-7f4dc9fb78-jnrh4\" (UID: \"e3a87b97-906d-4704-af34-067f1122f507\") " pod="openshift-console/console-7f4dc9fb78-jnrh4"
Sep 10 04:43:48.921711 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:48.921687    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ds69j\" (UniqueName: \"kubernetes.io/projected/e3a87b97-906d-4704-af34-067f1122f507-kube-api-access-ds69j\") pod \"console-7f4dc9fb78-jnrh4\" (UID: \"e3a87b97-906d-4704-af34-067f1122f507\") " pod="openshift-console/console-7f4dc9fb78-jnrh4"
Sep 10 04:43:48.921871 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:48.921726    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3a87b97-906d-4704-af34-067f1122f507-trusted-ca-bundle\") pod \"console-7f4dc9fb78-jnrh4\" (UID: \"e3a87b97-906d-4704-af34-067f1122f507\") " pod="openshift-console/console-7f4dc9fb78-jnrh4"
Sep 10 04:43:48.921871 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:48.921777    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e3a87b97-906d-4704-af34-067f1122f507-console-oauth-config\") pod \"console-7f4dc9fb78-jnrh4\" (UID: \"e3a87b97-906d-4704-af34-067f1122f507\") " pod="openshift-console/console-7f4dc9fb78-jnrh4"
Sep 10 04:43:48.921871 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:48.921816    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e3a87b97-906d-4704-af34-067f1122f507-console-serving-cert\") pod \"console-7f4dc9fb78-jnrh4\" (UID: \"e3a87b97-906d-4704-af34-067f1122f507\") " pod="openshift-console/console-7f4dc9fb78-jnrh4"
Sep 10 04:43:48.921871 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:48.921868    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e3a87b97-906d-4704-af34-067f1122f507-console-config\") pod \"console-7f4dc9fb78-jnrh4\" (UID: \"e3a87b97-906d-4704-af34-067f1122f507\") " pod="openshift-console/console-7f4dc9fb78-jnrh4"
Sep 10 04:43:48.922107 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:48.921922    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e3a87b97-906d-4704-af34-067f1122f507-service-ca\") pod \"console-7f4dc9fb78-jnrh4\" (UID: \"e3a87b97-906d-4704-af34-067f1122f507\") " pod="openshift-console/console-7f4dc9fb78-jnrh4"
Sep 10 04:43:48.922107 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:48.921945    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e3a87b97-906d-4704-af34-067f1122f507-oauth-serving-cert\") pod \"console-7f4dc9fb78-jnrh4\" (UID: \"e3a87b97-906d-4704-af34-067f1122f507\") " pod="openshift-console/console-7f4dc9fb78-jnrh4"
Sep 10 04:43:48.922702 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:48.922650    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e3a87b97-906d-4704-af34-067f1122f507-console-config\") pod \"console-7f4dc9fb78-jnrh4\" (UID: \"e3a87b97-906d-4704-af34-067f1122f507\") " pod="openshift-console/console-7f4dc9fb78-jnrh4"
Sep 10 04:43:48.922702 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:48.922666    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e3a87b97-906d-4704-af34-067f1122f507-oauth-serving-cert\") pod \"console-7f4dc9fb78-jnrh4\" (UID: \"e3a87b97-906d-4704-af34-067f1122f507\") " pod="openshift-console/console-7f4dc9fb78-jnrh4"
Sep 10 04:43:48.922702 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:48.922695    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e3a87b97-906d-4704-af34-067f1122f507-service-ca\") pod \"console-7f4dc9fb78-jnrh4\" (UID: \"e3a87b97-906d-4704-af34-067f1122f507\") " pod="openshift-console/console-7f4dc9fb78-jnrh4"
Sep 10 04:43:48.922975 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:48.922731    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3a87b97-906d-4704-af34-067f1122f507-trusted-ca-bundle\") pod \"console-7f4dc9fb78-jnrh4\" (UID: \"e3a87b97-906d-4704-af34-067f1122f507\") " pod="openshift-console/console-7f4dc9fb78-jnrh4"
Sep 10 04:43:48.924365 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:48.924335    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e3a87b97-906d-4704-af34-067f1122f507-console-serving-cert\") pod \"console-7f4dc9fb78-jnrh4\" (UID: \"e3a87b97-906d-4704-af34-067f1122f507\") " pod="openshift-console/console-7f4dc9fb78-jnrh4"
Sep 10 04:43:48.924564 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:48.924541    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e3a87b97-906d-4704-af34-067f1122f507-console-oauth-config\") pod \"console-7f4dc9fb78-jnrh4\" (UID: \"e3a87b97-906d-4704-af34-067f1122f507\") " pod="openshift-console/console-7f4dc9fb78-jnrh4"
Sep 10 04:43:48.928598 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:48.928579    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ds69j\" (UniqueName: \"kubernetes.io/projected/e3a87b97-906d-4704-af34-067f1122f507-kube-api-access-ds69j\") pod \"console-7f4dc9fb78-jnrh4\" (UID: \"e3a87b97-906d-4704-af34-067f1122f507\") " pod="openshift-console/console-7f4dc9fb78-jnrh4"
Sep 10 04:43:48.992244 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:48.992225    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f4dc9fb78-jnrh4"
Sep 10 04:43:49.262980 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:49.262956    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f4dc9fb78-jnrh4"]
Sep 10 04:43:49.265378 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:43:49.265347    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3a87b97_906d_4704_af34_067f1122f507.slice/crio-42b2e2a69c1e3da10d531c2c11808fa0fb4dc94c08024cffb096781e66509b0b WatchSource:0}: Error finding container 42b2e2a69c1e3da10d531c2c11808fa0fb4dc94c08024cffb096781e66509b0b: Status 404 returned error can't find the container with id 42b2e2a69c1e3da10d531c2c11808fa0fb4dc94c08024cffb096781e66509b0b
Sep 10 04:43:49.580155 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:49.580070    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f4dc9fb78-jnrh4" event={"ID":"e3a87b97-906d-4704-af34-067f1122f507","Type":"ContainerStarted","Data":"e4214c8d4222e4ffc34b57789f61c9c24367d7a34fd744e693995361ad5fa532"}
Sep 10 04:43:49.580155 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:49.580120    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f4dc9fb78-jnrh4" event={"ID":"e3a87b97-906d-4704-af34-067f1122f507","Type":"ContainerStarted","Data":"42b2e2a69c1e3da10d531c2c11808fa0fb4dc94c08024cffb096781e66509b0b"}
Sep 10 04:43:49.596232 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:49.596193    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7f4dc9fb78-jnrh4" podStartSLOduration=1.596179931 podStartE2EDuration="1.596179931s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:43:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:43:49.594899706 +0000 UTC m=+169.257357453" watchObservedRunningTime="2026-09-10 04:43:49.596179931 +0000 UTC m=+169.258637678"
Sep 10 04:43:58.992892 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:58.992804    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7f4dc9fb78-jnrh4"
Sep 10 04:43:58.992892 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:58.992873    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f4dc9fb78-jnrh4"
Sep 10 04:43:58.997463 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:58.997443    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7f4dc9fb78-jnrh4"
Sep 10 04:43:59.620462 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:59.620435    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7f4dc9fb78-jnrh4"
Sep 10 04:43:59.666094 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:43:59.666058    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86888f4c4c-mgrtk"]
Sep 10 04:44:24.691269 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:44:24.691222    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-86888f4c4c-mgrtk" podUID="ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814" containerName="console" containerID="cri-o://ec173865f9636bde699ae4c477fc6e845a1028566da6ee5cdfc6f846a36457b7" gracePeriod=15
Sep 10 04:44:24.926730 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:44:24.926708    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86888f4c4c-mgrtk"
Sep 10 04:44:24.971705 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:44:24.971650    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814-console-config\") pod \"ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814\" (UID: \"ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814\") "
Sep 10 04:44:24.971705 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:44:24.971688    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814-service-ca\") pod \"ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814\" (UID: \"ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814\") "
Sep 10 04:44:24.971893 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:44:24.971712    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814-trusted-ca-bundle\") pod \"ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814\" (UID: \"ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814\") "
Sep 10 04:44:24.971893 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:44:24.971749    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9sbwc\" (UniqueName: \"kubernetes.io/projected/ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814-kube-api-access-9sbwc\") pod \"ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814\" (UID: \"ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814\") "
Sep 10 04:44:24.971893 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:44:24.971811    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814-oauth-serving-cert\") pod \"ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814\" (UID: \"ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814\") "
Sep 10 04:44:24.971893 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:44:24.971835    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814-console-serving-cert\") pod \"ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814\" (UID: \"ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814\") "
Sep 10 04:44:24.972101 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:44:24.971945    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814-console-oauth-config\") pod \"ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814\" (UID: \"ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814\") "
Sep 10 04:44:24.972177 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:44:24.972142    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814-console-config" (OuterVolumeSpecName: "console-config") pod "ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814" (UID: "ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 04:44:24.972177 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:44:24.972159    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814-service-ca" (OuterVolumeSpecName: "service-ca") pod "ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814" (UID: "ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 04:44:24.972304 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:44:24.972232    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814" (UID: "ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 04:44:24.972304 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:44:24.972260    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814" (UID: "ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 04:44:24.974074 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:44:24.974039    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814-kube-api-access-9sbwc" (OuterVolumeSpecName: "kube-api-access-9sbwc") pod "ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814" (UID: "ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814"). InnerVolumeSpecName "kube-api-access-9sbwc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 04:44:24.974074 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:44:24.974055    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814" (UID: "ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 04:44:24.974217 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:44:24.974123    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814" (UID: "ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 04:44:25.073183 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:44:25.073159    2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814-console-oauth-config\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:44:25.073183 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:44:25.073179    2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814-console-config\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:44:25.073183 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:44:25.073188    2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814-service-ca\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:44:25.073348 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:44:25.073196    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814-trusted-ca-bundle\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:44:25.073348 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:44:25.073204    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9sbwc\" (UniqueName: \"kubernetes.io/projected/ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814-kube-api-access-9sbwc\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:44:25.073348 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:44:25.073213    2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814-oauth-serving-cert\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:44:25.073348 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:44:25.073221    2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814-console-serving-cert\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:44:25.711581 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:44:25.711550    2560 generic.go:356] "Generic (PLEG): container finished" podID="ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814" containerID="ec173865f9636bde699ae4c477fc6e845a1028566da6ee5cdfc6f846a36457b7" exitCode=0
Sep 10 04:44:25.711969 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:44:25.711596    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86888f4c4c-mgrtk"
Sep 10 04:44:25.711969 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:44:25.711610    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86888f4c4c-mgrtk" event={"ID":"ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814","Type":"ContainerDied","Data":"ec173865f9636bde699ae4c477fc6e845a1028566da6ee5cdfc6f846a36457b7"}
Sep 10 04:44:25.711969 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:44:25.711648    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86888f4c4c-mgrtk" event={"ID":"ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814","Type":"ContainerDied","Data":"3cd2cab1c1ae4409c805e007c78580296b846ac59830f02f3e8ad6d660526884"}
Sep 10 04:44:25.711969 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:44:25.711666    2560 scope.go:117] "RemoveContainer" containerID="ec173865f9636bde699ae4c477fc6e845a1028566da6ee5cdfc6f846a36457b7"
Sep 10 04:44:25.719810 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:44:25.719794    2560 scope.go:117] "RemoveContainer" containerID="ec173865f9636bde699ae4c477fc6e845a1028566da6ee5cdfc6f846a36457b7"
Sep 10 04:44:25.720083 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:44:25.720062    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec173865f9636bde699ae4c477fc6e845a1028566da6ee5cdfc6f846a36457b7\": container with ID starting with ec173865f9636bde699ae4c477fc6e845a1028566da6ee5cdfc6f846a36457b7 not found: ID does not exist" containerID="ec173865f9636bde699ae4c477fc6e845a1028566da6ee5cdfc6f846a36457b7"
Sep 10 04:44:25.720149 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:44:25.720094    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec173865f9636bde699ae4c477fc6e845a1028566da6ee5cdfc6f846a36457b7"} err="failed to get container status \"ec173865f9636bde699ae4c477fc6e845a1028566da6ee5cdfc6f846a36457b7\": rpc error: code = NotFound desc = could not find container \"ec173865f9636bde699ae4c477fc6e845a1028566da6ee5cdfc6f846a36457b7\": container with ID starting with ec173865f9636bde699ae4c477fc6e845a1028566da6ee5cdfc6f846a36457b7 not found: ID does not exist"
Sep 10 04:44:25.731674 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:44:25.731651    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86888f4c4c-mgrtk"]
Sep 10 04:44:25.734157 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:44:25.734136    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-86888f4c4c-mgrtk"]
Sep 10 04:44:26.823723 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:44:26.823681    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814" path="/var/lib/kubelet/pods/ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814/volumes"
Sep 10 04:45:09.264032 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:45:09.263997    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-85576d56f4-svxnh"]
Sep 10 04:45:09.264396 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:45:09.264286    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814" containerName="console"
Sep 10 04:45:09.264396 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:45:09.264298    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814" containerName="console"
Sep 10 04:45:09.264396 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:45:09.264349    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ffb3f01f-0c1e-4e20-b8d1-33feb9bc9814" containerName="console"
Sep 10 04:45:09.268521 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:45:09.268500    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85576d56f4-svxnh"
Sep 10 04:45:09.283260 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:45:09.283232    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85576d56f4-svxnh"]
Sep 10 04:45:09.375387 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:45:09.375359    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fedb3822-5912-4cf7-a018-ba2a5a05d29c-service-ca\") pod \"console-85576d56f4-svxnh\" (UID: \"fedb3822-5912-4cf7-a018-ba2a5a05d29c\") " pod="openshift-console/console-85576d56f4-svxnh"
Sep 10 04:45:09.375538 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:45:09.375391    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fedb3822-5912-4cf7-a018-ba2a5a05d29c-console-config\") pod \"console-85576d56f4-svxnh\" (UID: \"fedb3822-5912-4cf7-a018-ba2a5a05d29c\") " pod="openshift-console/console-85576d56f4-svxnh"
Sep 10 04:45:09.375538 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:45:09.375423    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fedb3822-5912-4cf7-a018-ba2a5a05d29c-oauth-serving-cert\") pod \"console-85576d56f4-svxnh\" (UID: \"fedb3822-5912-4cf7-a018-ba2a5a05d29c\") " pod="openshift-console/console-85576d56f4-svxnh"
Sep 10 04:45:09.375538 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:45:09.375506    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fedb3822-5912-4cf7-a018-ba2a5a05d29c-console-oauth-config\") pod \"console-85576d56f4-svxnh\" (UID: \"fedb3822-5912-4cf7-a018-ba2a5a05d29c\") " pod="openshift-console/console-85576d56f4-svxnh"
Sep 10 04:45:09.375696 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:45:09.375547    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fedb3822-5912-4cf7-a018-ba2a5a05d29c-console-serving-cert\") pod \"console-85576d56f4-svxnh\" (UID: \"fedb3822-5912-4cf7-a018-ba2a5a05d29c\") " pod="openshift-console/console-85576d56f4-svxnh"
Sep 10 04:45:09.375696 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:45:09.375574    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fedb3822-5912-4cf7-a018-ba2a5a05d29c-trusted-ca-bundle\") pod \"console-85576d56f4-svxnh\" (UID: \"fedb3822-5912-4cf7-a018-ba2a5a05d29c\") " pod="openshift-console/console-85576d56f4-svxnh"
Sep 10 04:45:09.375696 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:45:09.375603    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6br8\" (UniqueName: \"kubernetes.io/projected/fedb3822-5912-4cf7-a018-ba2a5a05d29c-kube-api-access-w6br8\") pod \"console-85576d56f4-svxnh\" (UID: \"fedb3822-5912-4cf7-a018-ba2a5a05d29c\") " pod="openshift-console/console-85576d56f4-svxnh"
Sep 10 04:45:09.476578 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:45:09.476546    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fedb3822-5912-4cf7-a018-ba2a5a05d29c-oauth-serving-cert\") pod \"console-85576d56f4-svxnh\" (UID: \"fedb3822-5912-4cf7-a018-ba2a5a05d29c\") " pod="openshift-console/console-85576d56f4-svxnh"
Sep 10 04:45:09.476731 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:45:09.476586    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fedb3822-5912-4cf7-a018-ba2a5a05d29c-console-oauth-config\") pod \"console-85576d56f4-svxnh\" (UID: \"fedb3822-5912-4cf7-a018-ba2a5a05d29c\") " pod="openshift-console/console-85576d56f4-svxnh"
Sep 10 04:45:09.476731 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:45:09.476605    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fedb3822-5912-4cf7-a018-ba2a5a05d29c-console-serving-cert\") pod \"console-85576d56f4-svxnh\" (UID: \"fedb3822-5912-4cf7-a018-ba2a5a05d29c\") " pod="openshift-console/console-85576d56f4-svxnh"
Sep 10 04:45:09.476731 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:45:09.476716    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fedb3822-5912-4cf7-a018-ba2a5a05d29c-trusted-ca-bundle\") pod \"console-85576d56f4-svxnh\" (UID: \"fedb3822-5912-4cf7-a018-ba2a5a05d29c\") " pod="openshift-console/console-85576d56f4-svxnh"
Sep 10 04:45:09.476927 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:45:09.476750    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6br8\" (UniqueName: \"kubernetes.io/projected/fedb3822-5912-4cf7-a018-ba2a5a05d29c-kube-api-access-w6br8\") pod \"console-85576d56f4-svxnh\" (UID: \"fedb3822-5912-4cf7-a018-ba2a5a05d29c\") " pod="openshift-console/console-85576d56f4-svxnh"
Sep 10 04:45:09.476927 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:45:09.476809    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fedb3822-5912-4cf7-a018-ba2a5a05d29c-service-ca\") pod \"console-85576d56f4-svxnh\" (UID: \"fedb3822-5912-4cf7-a018-ba2a5a05d29c\") " pod="openshift-console/console-85576d56f4-svxnh"
Sep 10 04:45:09.476927 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:45:09.476836    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fedb3822-5912-4cf7-a018-ba2a5a05d29c-console-config\") pod \"console-85576d56f4-svxnh\" (UID: \"fedb3822-5912-4cf7-a018-ba2a5a05d29c\") " pod="openshift-console/console-85576d56f4-svxnh"
Sep 10 04:45:09.477435 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:45:09.477411    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fedb3822-5912-4cf7-a018-ba2a5a05d29c-oauth-serving-cert\") pod \"console-85576d56f4-svxnh\" (UID: \"fedb3822-5912-4cf7-a018-ba2a5a05d29c\") " pod="openshift-console/console-85576d56f4-svxnh"
Sep 10 04:45:09.477556 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:45:09.477531    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fedb3822-5912-4cf7-a018-ba2a5a05d29c-service-ca\") pod \"console-85576d56f4-svxnh\" (UID: \"fedb3822-5912-4cf7-a018-ba2a5a05d29c\") " pod="openshift-console/console-85576d56f4-svxnh"
Sep 10 04:45:09.477595 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:45:09.477575    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fedb3822-5912-4cf7-a018-ba2a5a05d29c-console-config\") pod \"console-85576d56f4-svxnh\" (UID: \"fedb3822-5912-4cf7-a018-ba2a5a05d29c\") " pod="openshift-console/console-85576d56f4-svxnh"
Sep 10 04:45:09.477629 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:45:09.477594    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fedb3822-5912-4cf7-a018-ba2a5a05d29c-trusted-ca-bundle\") pod \"console-85576d56f4-svxnh\" (UID: \"fedb3822-5912-4cf7-a018-ba2a5a05d29c\") " pod="openshift-console/console-85576d56f4-svxnh"
Sep 10 04:45:09.479108 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:45:09.479082    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fedb3822-5912-4cf7-a018-ba2a5a05d29c-console-serving-cert\") pod \"console-85576d56f4-svxnh\" (UID: \"fedb3822-5912-4cf7-a018-ba2a5a05d29c\") " pod="openshift-console/console-85576d56f4-svxnh"
Sep 10 04:45:09.479108 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:45:09.479102    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fedb3822-5912-4cf7-a018-ba2a5a05d29c-console-oauth-config\") pod \"console-85576d56f4-svxnh\" (UID: \"fedb3822-5912-4cf7-a018-ba2a5a05d29c\") " pod="openshift-console/console-85576d56f4-svxnh"
Sep 10 04:45:09.486002 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:45:09.485985    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6br8\" (UniqueName: \"kubernetes.io/projected/fedb3822-5912-4cf7-a018-ba2a5a05d29c-kube-api-access-w6br8\") pod \"console-85576d56f4-svxnh\" (UID: \"fedb3822-5912-4cf7-a018-ba2a5a05d29c\") " pod="openshift-console/console-85576d56f4-svxnh"
Sep 10 04:45:09.578272 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:45:09.578222    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85576d56f4-svxnh"
Sep 10 04:45:09.850526 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:45:09.850501    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85576d56f4-svxnh"]
Sep 10 04:45:09.853043 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:45:09.853013    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfedb3822_5912_4cf7_a018_ba2a5a05d29c.slice/crio-19aef1529ad9bdbd107cd0205af124c9dfcefa3d13edb6c8a2c5a6adab5572d5 WatchSource:0}: Error finding container 19aef1529ad9bdbd107cd0205af124c9dfcefa3d13edb6c8a2c5a6adab5572d5: Status 404 returned error can't find the container with id 19aef1529ad9bdbd107cd0205af124c9dfcefa3d13edb6c8a2c5a6adab5572d5
Sep 10 04:45:09.874557 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:45:09.874529    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85576d56f4-svxnh" event={"ID":"fedb3822-5912-4cf7-a018-ba2a5a05d29c","Type":"ContainerStarted","Data":"19aef1529ad9bdbd107cd0205af124c9dfcefa3d13edb6c8a2c5a6adab5572d5"}
Sep 10 04:45:10.878983 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:45:10.878945    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85576d56f4-svxnh" event={"ID":"fedb3822-5912-4cf7-a018-ba2a5a05d29c","Type":"ContainerStarted","Data":"47f89af67bff8ee7c39683bd4805b5700e85afa4d83b2b1e0128504fb56321d0"}
Sep 10 04:45:10.895528 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:45:10.895481    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-85576d56f4-svxnh" podStartSLOduration=1.8954658850000001 podStartE2EDuration="1.895465885s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:45:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:45:10.893817357 +0000 UTC m=+250.556275102" watchObservedRunningTime="2026-09-10 04:45:10.895465885 +0000 UTC m=+250.557923631"
Sep 10 04:45:19.578760 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:45:19.578727    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-85576d56f4-svxnh"
Sep 10 04:45:19.579134 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:45:19.578783    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-85576d56f4-svxnh"
Sep 10 04:45:19.583363 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:45:19.583343    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-85576d56f4-svxnh"
Sep 10 04:45:19.913384 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:45:19.913357    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-85576d56f4-svxnh"
Sep 10 04:45:19.967328 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:45:19.967305    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f4dc9fb78-jnrh4"]
Sep 10 04:45:44.989310 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:45:44.989251    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7f4dc9fb78-jnrh4" podUID="e3a87b97-906d-4704-af34-067f1122f507" containerName="console" containerID="cri-o://e4214c8d4222e4ffc34b57789f61c9c24367d7a34fd744e693995361ad5fa532" gracePeriod=15
Sep 10 04:45:45.230079 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:45:45.230057    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f4dc9fb78-jnrh4"
Sep 10 04:45:45.323899 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:45:45.323810    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e3a87b97-906d-4704-af34-067f1122f507-oauth-serving-cert\") pod \"e3a87b97-906d-4704-af34-067f1122f507\" (UID: \"e3a87b97-906d-4704-af34-067f1122f507\") "
Sep 10 04:45:45.323899 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:45:45.323893    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e3a87b97-906d-4704-af34-067f1122f507-console-config\") pod \"e3a87b97-906d-4704-af34-067f1122f507\" (UID: \"e3a87b97-906d-4704-af34-067f1122f507\") "
Sep 10 04:45:45.324090 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:45:45.323989    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e3a87b97-906d-4704-af34-067f1122f507-console-serving-cert\") pod \"e3a87b97-906d-4704-af34-067f1122f507\" (UID: \"e3a87b97-906d-4704-af34-067f1122f507\") "
Sep 10 04:45:45.324090 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:45:45.324028    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ds69j\" (UniqueName: \"kubernetes.io/projected/e3a87b97-906d-4704-af34-067f1122f507-kube-api-access-ds69j\") pod \"e3a87b97-906d-4704-af34-067f1122f507\" (UID: \"e3a87b97-906d-4704-af34-067f1122f507\") "
Sep 10 04:45:45.324090 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:45:45.324056    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3a87b97-906d-4704-af34-067f1122f507-trusted-ca-bundle\") pod \"e3a87b97-906d-4704-af34-067f1122f507\" (UID: \"e3a87b97-906d-4704-af34-067f1122f507\") "
Sep 10 04:45:45.324246 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:45:45.324093    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e3a87b97-906d-4704-af34-067f1122f507-service-ca\") pod \"e3a87b97-906d-4704-af34-067f1122f507\" (UID: \"e3a87b97-906d-4704-af34-067f1122f507\") "
Sep 10 04:45:45.324246 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:45:45.324119    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e3a87b97-906d-4704-af34-067f1122f507-console-oauth-config\") pod \"e3a87b97-906d-4704-af34-067f1122f507\" (UID: \"e3a87b97-906d-4704-af34-067f1122f507\") "
Sep 10 04:45:45.324246 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:45:45.324155    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3a87b97-906d-4704-af34-067f1122f507-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e3a87b97-906d-4704-af34-067f1122f507" (UID: "e3a87b97-906d-4704-af34-067f1122f507"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 04:45:45.324439 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:45:45.324250    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3a87b97-906d-4704-af34-067f1122f507-console-config" (OuterVolumeSpecName: "console-config") pod "e3a87b97-906d-4704-af34-067f1122f507" (UID: "e3a87b97-906d-4704-af34-067f1122f507"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 04:45:45.324504 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:45:45.324482    2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e3a87b97-906d-4704-af34-067f1122f507-oauth-serving-cert\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:45:45.324504 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:45:45.324493    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3a87b97-906d-4704-af34-067f1122f507-service-ca" (OuterVolumeSpecName: "service-ca") pod "e3a87b97-906d-4704-af34-067f1122f507" (UID: "e3a87b97-906d-4704-af34-067f1122f507"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 04:45:45.324568 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:45:45.324506    2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e3a87b97-906d-4704-af34-067f1122f507-console-config\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:45:45.324568 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:45:45.324526    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3a87b97-906d-4704-af34-067f1122f507-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e3a87b97-906d-4704-af34-067f1122f507" (UID: "e3a87b97-906d-4704-af34-067f1122f507"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 04:45:45.326242 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:45:45.326209    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3a87b97-906d-4704-af34-067f1122f507-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e3a87b97-906d-4704-af34-067f1122f507" (UID: "e3a87b97-906d-4704-af34-067f1122f507"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 04:45:45.326353 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:45:45.326263    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3a87b97-906d-4704-af34-067f1122f507-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e3a87b97-906d-4704-af34-067f1122f507" (UID: "e3a87b97-906d-4704-af34-067f1122f507"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 04:45:45.326353 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:45:45.326288    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3a87b97-906d-4704-af34-067f1122f507-kube-api-access-ds69j" (OuterVolumeSpecName: "kube-api-access-ds69j") pod "e3a87b97-906d-4704-af34-067f1122f507" (UID: "e3a87b97-906d-4704-af34-067f1122f507"). InnerVolumeSpecName "kube-api-access-ds69j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 04:45:45.425881 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:45:45.425833    2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e3a87b97-906d-4704-af34-067f1122f507-console-serving-cert\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:45:45.425881 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:45:45.425876    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ds69j\" (UniqueName: \"kubernetes.io/projected/e3a87b97-906d-4704-af34-067f1122f507-kube-api-access-ds69j\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:45:45.426059 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:45:45.425890    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3a87b97-906d-4704-af34-067f1122f507-trusted-ca-bundle\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:45:45.426059 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:45:45.425902    2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e3a87b97-906d-4704-af34-067f1122f507-service-ca\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:45:45.426059 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:45:45.425915    2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e3a87b97-906d-4704-af34-067f1122f507-console-oauth-config\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:45:46.004663 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:45:46.004625    2560 generic.go:356] "Generic (PLEG): container finished" podID="e3a87b97-906d-4704-af34-067f1122f507" containerID="e4214c8d4222e4ffc34b57789f61c9c24367d7a34fd744e693995361ad5fa532" exitCode=0
Sep 10 04:45:46.005023 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:45:46.004672    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f4dc9fb78-jnrh4"
Sep 10 04:45:46.005023 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:45:46.004709    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f4dc9fb78-jnrh4" event={"ID":"e3a87b97-906d-4704-af34-067f1122f507","Type":"ContainerDied","Data":"e4214c8d4222e4ffc34b57789f61c9c24367d7a34fd744e693995361ad5fa532"}
Sep 10 04:45:46.005023 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:45:46.004764    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f4dc9fb78-jnrh4" event={"ID":"e3a87b97-906d-4704-af34-067f1122f507","Type":"ContainerDied","Data":"42b2e2a69c1e3da10d531c2c11808fa0fb4dc94c08024cffb096781e66509b0b"}
Sep 10 04:45:46.005023 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:45:46.004784    2560 scope.go:117] "RemoveContainer" containerID="e4214c8d4222e4ffc34b57789f61c9c24367d7a34fd744e693995361ad5fa532"
Sep 10 04:45:46.013174 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:45:46.013156    2560 scope.go:117] "RemoveContainer" containerID="e4214c8d4222e4ffc34b57789f61c9c24367d7a34fd744e693995361ad5fa532"
Sep 10 04:45:46.013441 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:45:46.013425    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4214c8d4222e4ffc34b57789f61c9c24367d7a34fd744e693995361ad5fa532\": container with ID starting with e4214c8d4222e4ffc34b57789f61c9c24367d7a34fd744e693995361ad5fa532 not found: ID does not exist" containerID="e4214c8d4222e4ffc34b57789f61c9c24367d7a34fd744e693995361ad5fa532"
Sep 10 04:45:46.013486 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:45:46.013449    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4214c8d4222e4ffc34b57789f61c9c24367d7a34fd744e693995361ad5fa532"} err="failed to get container status \"e4214c8d4222e4ffc34b57789f61c9c24367d7a34fd744e693995361ad5fa532\": rpc error: code = NotFound desc = could not find container \"e4214c8d4222e4ffc34b57789f61c9c24367d7a34fd744e693995361ad5fa532\": container with ID starting with e4214c8d4222e4ffc34b57789f61c9c24367d7a34fd744e693995361ad5fa532 not found: ID does not exist"
Sep 10 04:45:46.024004 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:45:46.023982    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f4dc9fb78-jnrh4"]
Sep 10 04:45:46.030110 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:45:46.030092    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7f4dc9fb78-jnrh4"]
Sep 10 04:45:46.823913 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:45:46.823886    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3a87b97-906d-4704-af34-067f1122f507" path="/var/lib/kubelet/pods/e3a87b97-906d-4704-af34-067f1122f507/volumes"
Sep 10 04:46:00.757092 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:00.757061    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-p5zjp_8b3ec8dc-1508-4537-8dc3-b9de1ff22d03/console-operator/1.log"
Sep 10 04:46:00.762496 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:00.762474    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-p5zjp_8b3ec8dc-1508-4537-8dc3-b9de1ff22d03/console-operator/1.log"
Sep 10 04:46:00.766529 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:00.766500    2560 kubelet.go:1648] "Image garbage collection succeeded"
Sep 10 04:46:19.298308 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:19.298271    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dwb5v"]
Sep 10 04:46:19.300789 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:19.298665    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3a87b97-906d-4704-af34-067f1122f507" containerName="console"
Sep 10 04:46:19.300789 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:19.298685    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3a87b97-906d-4704-af34-067f1122f507" containerName="console"
Sep 10 04:46:19.300789 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:19.298773    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3a87b97-906d-4704-af34-067f1122f507" containerName="console"
Sep 10 04:46:19.301651 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:19.301630    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dwb5v"
Sep 10 04:46:19.303788 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:19.303743    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9cccr\""
Sep 10 04:46:19.303788 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:19.303764    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 04:46:19.303961 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:19.303795    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 04:46:19.310072 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:19.310049    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dwb5v"]
Sep 10 04:46:19.375582 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:19.375551    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/35b6e19f-736a-4a59-9226-1134c8777e51-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dwb5v\" (UID: \"35b6e19f-736a-4a59-9226-1134c8777e51\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dwb5v"
Sep 10 04:46:19.375582 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:19.375585    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcm7m\" (UniqueName: \"kubernetes.io/projected/35b6e19f-736a-4a59-9226-1134c8777e51-kube-api-access-mcm7m\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dwb5v\" (UID: \"35b6e19f-736a-4a59-9226-1134c8777e51\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dwb5v"
Sep 10 04:46:19.375789 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:19.375609    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/35b6e19f-736a-4a59-9226-1134c8777e51-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dwb5v\" (UID: \"35b6e19f-736a-4a59-9226-1134c8777e51\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dwb5v"
Sep 10 04:46:19.476901 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:19.476864    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/35b6e19f-736a-4a59-9226-1134c8777e51-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dwb5v\" (UID: \"35b6e19f-736a-4a59-9226-1134c8777e51\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dwb5v"
Sep 10 04:46:19.477055 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:19.476907    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcm7m\" (UniqueName: \"kubernetes.io/projected/35b6e19f-736a-4a59-9226-1134c8777e51-kube-api-access-mcm7m\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dwb5v\" (UID: \"35b6e19f-736a-4a59-9226-1134c8777e51\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dwb5v"
Sep 10 04:46:19.477055 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:19.476942    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/35b6e19f-736a-4a59-9226-1134c8777e51-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dwb5v\" (UID: \"35b6e19f-736a-4a59-9226-1134c8777e51\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dwb5v"
Sep 10 04:46:19.477258 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:19.477237    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/35b6e19f-736a-4a59-9226-1134c8777e51-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dwb5v\" (UID: \"35b6e19f-736a-4a59-9226-1134c8777e51\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dwb5v"
Sep 10 04:46:19.477339 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:19.477317    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/35b6e19f-736a-4a59-9226-1134c8777e51-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dwb5v\" (UID: \"35b6e19f-736a-4a59-9226-1134c8777e51\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dwb5v"
Sep 10 04:46:19.483782 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:19.483741    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcm7m\" (UniqueName: \"kubernetes.io/projected/35b6e19f-736a-4a59-9226-1134c8777e51-kube-api-access-mcm7m\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dwb5v\" (UID: \"35b6e19f-736a-4a59-9226-1134c8777e51\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dwb5v"
Sep 10 04:46:19.610809 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:19.610739    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dwb5v"
Sep 10 04:46:19.880342 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:19.880313    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dwb5v"]
Sep 10 04:46:19.883135 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:46:19.883109    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35b6e19f_736a_4a59_9226_1134c8777e51.slice/crio-815da036dadceca01ca8e9465be0528ded6517c4768ebd8062c47c98a6abccd0 WatchSource:0}: Error finding container 815da036dadceca01ca8e9465be0528ded6517c4768ebd8062c47c98a6abccd0: Status 404 returned error can't find the container with id 815da036dadceca01ca8e9465be0528ded6517c4768ebd8062c47c98a6abccd0
Sep 10 04:46:19.884930 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:19.884912    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 04:46:20.136164 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:20.136098    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dwb5v" event={"ID":"35b6e19f-736a-4a59-9226-1134c8777e51","Type":"ContainerStarted","Data":"815da036dadceca01ca8e9465be0528ded6517c4768ebd8062c47c98a6abccd0"}
Sep 10 04:46:26.163446 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:26.163411    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dwb5v" event={"ID":"35b6e19f-736a-4a59-9226-1134c8777e51","Type":"ContainerStarted","Data":"c16647e8175ab04219afcfa50c0db2732c7dad50d8f65c26bfc4a546dd2ffe42"}
Sep 10 04:46:27.168524 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:27.168486    2560 generic.go:356] "Generic (PLEG): container finished" podID="35b6e19f-736a-4a59-9226-1134c8777e51" containerID="c16647e8175ab04219afcfa50c0db2732c7dad50d8f65c26bfc4a546dd2ffe42" exitCode=0
Sep 10 04:46:27.169039 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:27.168547    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dwb5v" event={"ID":"35b6e19f-736a-4a59-9226-1134c8777e51","Type":"ContainerDied","Data":"c16647e8175ab04219afcfa50c0db2732c7dad50d8f65c26bfc4a546dd2ffe42"}
Sep 10 04:46:34.198181 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:34.198098    2560 generic.go:356] "Generic (PLEG): container finished" podID="35b6e19f-736a-4a59-9226-1134c8777e51" containerID="0f17e8263a6a9aadc93c470449777992cc1c13db6dd70da9c6e4ef9efde8457e" exitCode=0
Sep 10 04:46:34.198181 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:34.198160    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dwb5v" event={"ID":"35b6e19f-736a-4a59-9226-1134c8777e51","Type":"ContainerDied","Data":"0f17e8263a6a9aadc93c470449777992cc1c13db6dd70da9c6e4ef9efde8457e"}
Sep 10 04:46:42.235607 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:42.235570    2560 generic.go:356] "Generic (PLEG): container finished" podID="35b6e19f-736a-4a59-9226-1134c8777e51" containerID="7e6f33b3114c6a9aec662bdb938c02fc96b8827cc0380609d67fce6b28776956" exitCode=0
Sep 10 04:46:42.235983 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:42.235625    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dwb5v" event={"ID":"35b6e19f-736a-4a59-9226-1134c8777e51","Type":"ContainerDied","Data":"7e6f33b3114c6a9aec662bdb938c02fc96b8827cc0380609d67fce6b28776956"}
Sep 10 04:46:43.401779 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:43.401754    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dwb5v"
Sep 10 04:46:43.460526 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:43.460498    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mcm7m\" (UniqueName: \"kubernetes.io/projected/35b6e19f-736a-4a59-9226-1134c8777e51-kube-api-access-mcm7m\") pod \"35b6e19f-736a-4a59-9226-1134c8777e51\" (UID: \"35b6e19f-736a-4a59-9226-1134c8777e51\") "
Sep 10 04:46:43.460667 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:43.460591    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/35b6e19f-736a-4a59-9226-1134c8777e51-util\") pod \"35b6e19f-736a-4a59-9226-1134c8777e51\" (UID: \"35b6e19f-736a-4a59-9226-1134c8777e51\") "
Sep 10 04:46:43.460667 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:43.460628    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/35b6e19f-736a-4a59-9226-1134c8777e51-bundle\") pod \"35b6e19f-736a-4a59-9226-1134c8777e51\" (UID: \"35b6e19f-736a-4a59-9226-1134c8777e51\") "
Sep 10 04:46:43.461282 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:43.461253    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35b6e19f-736a-4a59-9226-1134c8777e51-bundle" (OuterVolumeSpecName: "bundle") pod "35b6e19f-736a-4a59-9226-1134c8777e51" (UID: "35b6e19f-736a-4a59-9226-1134c8777e51"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 04:46:43.462605 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:43.462582    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35b6e19f-736a-4a59-9226-1134c8777e51-kube-api-access-mcm7m" (OuterVolumeSpecName: "kube-api-access-mcm7m") pod "35b6e19f-736a-4a59-9226-1134c8777e51" (UID: "35b6e19f-736a-4a59-9226-1134c8777e51"). InnerVolumeSpecName "kube-api-access-mcm7m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 04:46:43.464824 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:43.464802    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35b6e19f-736a-4a59-9226-1134c8777e51-util" (OuterVolumeSpecName: "util") pod "35b6e19f-736a-4a59-9226-1134c8777e51" (UID: "35b6e19f-736a-4a59-9226-1134c8777e51"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 04:46:43.562095 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:43.562047    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/35b6e19f-736a-4a59-9226-1134c8777e51-util\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:46:43.562095 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:43.562068    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/35b6e19f-736a-4a59-9226-1134c8777e51-bundle\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:46:43.562095 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:43.562078    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mcm7m\" (UniqueName: \"kubernetes.io/projected/35b6e19f-736a-4a59-9226-1134c8777e51-kube-api-access-mcm7m\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:46:44.245820 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:44.245787    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dwb5v" event={"ID":"35b6e19f-736a-4a59-9226-1134c8777e51","Type":"ContainerDied","Data":"815da036dadceca01ca8e9465be0528ded6517c4768ebd8062c47c98a6abccd0"}
Sep 10 04:46:44.245988 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:44.245830    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dwb5v"
Sep 10 04:46:44.245988 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:44.245833    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="815da036dadceca01ca8e9465be0528ded6517c4768ebd8062c47c98a6abccd0"
Sep 10 04:46:47.088240 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:47.088209    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4bmcc"]
Sep 10 04:46:47.088576 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:47.088468    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35b6e19f-736a-4a59-9226-1134c8777e51" containerName="util"
Sep 10 04:46:47.088576 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:47.088478    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="35b6e19f-736a-4a59-9226-1134c8777e51" containerName="util"
Sep 10 04:46:47.088576 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:47.088488    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35b6e19f-736a-4a59-9226-1134c8777e51" containerName="pull"
Sep 10 04:46:47.088576 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:47.088494    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="35b6e19f-736a-4a59-9226-1134c8777e51" containerName="pull"
Sep 10 04:46:47.088576 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:47.088500    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35b6e19f-736a-4a59-9226-1134c8777e51" containerName="extract"
Sep 10 04:46:47.088576 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:47.088508    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="35b6e19f-736a-4a59-9226-1134c8777e51" containerName="extract"
Sep 10 04:46:47.088576 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:47.088574    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="35b6e19f-736a-4a59-9226-1134c8777e51" containerName="extract"
Sep 10 04:46:47.090613 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:47.090597    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4bmcc"
Sep 10 04:46:47.093157 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:47.093135    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 10 04:46:47.093284 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:47.093169    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-4pv2s\""
Sep 10 04:46:47.093284 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:47.093173    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 10 04:46:47.107308 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:47.107287    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4bmcc"]
Sep 10 04:46:47.188682 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:47.188656    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wn56s\" (UniqueName: \"kubernetes.io/projected/a1261332-d32c-47f4-9c11-dff34e4237c3-kube-api-access-wn56s\") pod \"cert-manager-operator-controller-manager-55c444bf86-4bmcc\" (UID: \"a1261332-d32c-47f4-9c11-dff34e4237c3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4bmcc"
Sep 10 04:46:47.188821 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:47.188698    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a1261332-d32c-47f4-9c11-dff34e4237c3-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-4bmcc\" (UID: \"a1261332-d32c-47f4-9c11-dff34e4237c3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4bmcc"
Sep 10 04:46:47.290049 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:47.290012    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wn56s\" (UniqueName: \"kubernetes.io/projected/a1261332-d32c-47f4-9c11-dff34e4237c3-kube-api-access-wn56s\") pod \"cert-manager-operator-controller-manager-55c444bf86-4bmcc\" (UID: \"a1261332-d32c-47f4-9c11-dff34e4237c3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4bmcc"
Sep 10 04:46:47.290049 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:47.290059    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a1261332-d32c-47f4-9c11-dff34e4237c3-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-4bmcc\" (UID: \"a1261332-d32c-47f4-9c11-dff34e4237c3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4bmcc"
Sep 10 04:46:47.290358 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:47.290344    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a1261332-d32c-47f4-9c11-dff34e4237c3-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-4bmcc\" (UID: \"a1261332-d32c-47f4-9c11-dff34e4237c3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4bmcc"
Sep 10 04:46:47.297532 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:47.297513    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wn56s\" (UniqueName: \"kubernetes.io/projected/a1261332-d32c-47f4-9c11-dff34e4237c3-kube-api-access-wn56s\") pod \"cert-manager-operator-controller-manager-55c444bf86-4bmcc\" (UID: \"a1261332-d32c-47f4-9c11-dff34e4237c3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4bmcc"
Sep 10 04:46:47.399800 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:47.399765    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4bmcc"
Sep 10 04:46:47.678981 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:47.678927    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4bmcc"]
Sep 10 04:46:47.681325 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:46:47.681299    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1261332_d32c_47f4_9c11_dff34e4237c3.slice/crio-f6898bdeaca97445709c69f4f6794570db8634fed2789b9bf24ce9a2a3ea5025 WatchSource:0}: Error finding container f6898bdeaca97445709c69f4f6794570db8634fed2789b9bf24ce9a2a3ea5025: Status 404 returned error can't find the container with id f6898bdeaca97445709c69f4f6794570db8634fed2789b9bf24ce9a2a3ea5025
Sep 10 04:46:48.267946 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:48.267913    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4bmcc" event={"ID":"a1261332-d32c-47f4-9c11-dff34e4237c3","Type":"ContainerStarted","Data":"f6898bdeaca97445709c69f4f6794570db8634fed2789b9bf24ce9a2a3ea5025"}
Sep 10 04:46:49.274555 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:49.274516    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4bmcc" event={"ID":"a1261332-d32c-47f4-9c11-dff34e4237c3","Type":"ContainerStarted","Data":"73457203043d467da3cd2ca43fe0c38dbaf3532e7d9afe8ee25e5baa157b4fa6"}
Sep 10 04:46:49.298906 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:49.298828    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4bmcc" podStartSLOduration=0.802023322 podStartE2EDuration="2.298809257s" totalImagesPullingTime="1.496785935s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:46:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:46:49.297596007 +0000 UTC m=+348.960053754" watchObservedRunningTime="2026-09-10 04:46:49.298809257 +0000 UTC m=+348.961267004"
Sep 10 04:46:50.573266 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:50.573234    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f92p2r"]
Sep 10 04:46:50.575676 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:50.575656    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f92p2r"
Sep 10 04:46:50.577832 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:50.577809    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 04:46:50.577976 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:50.577882    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 04:46:50.578577 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:50.578561    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9cccr\""
Sep 10 04:46:50.584550 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:50.584529    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f92p2r"]
Sep 10 04:46:50.719826 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:50.719798    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5pvd\" (UniqueName: \"kubernetes.io/projected/50e4b00f-5532-4020-a3c5-5a8c9cfee35f-kube-api-access-c5pvd\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f92p2r\" (UID: \"50e4b00f-5532-4020-a3c5-5a8c9cfee35f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f92p2r"
Sep 10 04:46:50.719957 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:50.719838    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/50e4b00f-5532-4020-a3c5-5a8c9cfee35f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f92p2r\" (UID: \"50e4b00f-5532-4020-a3c5-5a8c9cfee35f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f92p2r"
Sep 10 04:46:50.719957 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:50.719922    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/50e4b00f-5532-4020-a3c5-5a8c9cfee35f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f92p2r\" (UID: \"50e4b00f-5532-4020-a3c5-5a8c9cfee35f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f92p2r"
Sep 10 04:46:50.820322 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:50.820295    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/50e4b00f-5532-4020-a3c5-5a8c9cfee35f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f92p2r\" (UID: \"50e4b00f-5532-4020-a3c5-5a8c9cfee35f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f92p2r"
Sep 10 04:46:50.820438 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:50.820376    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5pvd\" (UniqueName: \"kubernetes.io/projected/50e4b00f-5532-4020-a3c5-5a8c9cfee35f-kube-api-access-c5pvd\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f92p2r\" (UID: \"50e4b00f-5532-4020-a3c5-5a8c9cfee35f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f92p2r"
Sep 10 04:46:50.820438 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:50.820415    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/50e4b00f-5532-4020-a3c5-5a8c9cfee35f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f92p2r\" (UID: \"50e4b00f-5532-4020-a3c5-5a8c9cfee35f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f92p2r"
Sep 10 04:46:50.820642 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:50.820621    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/50e4b00f-5532-4020-a3c5-5a8c9cfee35f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f92p2r\" (UID: \"50e4b00f-5532-4020-a3c5-5a8c9cfee35f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f92p2r"
Sep 10 04:46:50.820767 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:50.820748    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/50e4b00f-5532-4020-a3c5-5a8c9cfee35f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f92p2r\" (UID: \"50e4b00f-5532-4020-a3c5-5a8c9cfee35f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f92p2r"
Sep 10 04:46:50.831320 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:50.831273    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5pvd\" (UniqueName: \"kubernetes.io/projected/50e4b00f-5532-4020-a3c5-5a8c9cfee35f-kube-api-access-c5pvd\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f92p2r\" (UID: \"50e4b00f-5532-4020-a3c5-5a8c9cfee35f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f92p2r"
Sep 10 04:46:50.884546 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:50.884525    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f92p2r"
Sep 10 04:46:51.152820 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:51.152793    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f92p2r"]
Sep 10 04:46:51.155203 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:46:51.155173    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50e4b00f_5532_4020_a3c5_5a8c9cfee35f.slice/crio-0c5649114f18b9ee16142b1fde5782844dc89972955fbba82c8dd63fc9d69fd3 WatchSource:0}: Error finding container 0c5649114f18b9ee16142b1fde5782844dc89972955fbba82c8dd63fc9d69fd3: Status 404 returned error can't find the container with id 0c5649114f18b9ee16142b1fde5782844dc89972955fbba82c8dd63fc9d69fd3
Sep 10 04:46:51.283629 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:51.283594    2560 generic.go:356] "Generic (PLEG): container finished" podID="50e4b00f-5532-4020-a3c5-5a8c9cfee35f" containerID="13227298f97121b7431cc99c034ba4644dc5739b31f6e97a5faae595b07babd1" exitCode=0
Sep 10 04:46:51.283725 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:51.283654    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f92p2r" event={"ID":"50e4b00f-5532-4020-a3c5-5a8c9cfee35f","Type":"ContainerDied","Data":"13227298f97121b7431cc99c034ba4644dc5739b31f6e97a5faae595b07babd1"}
Sep 10 04:46:51.283725 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:51.283703    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f92p2r" event={"ID":"50e4b00f-5532-4020-a3c5-5a8c9cfee35f","Type":"ContainerStarted","Data":"0c5649114f18b9ee16142b1fde5782844dc89972955fbba82c8dd63fc9d69fd3"}
Sep 10 04:46:52.890443 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:52.890414    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-g8hhk"]
Sep 10 04:46:52.895007 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:52.894982    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-g8hhk"
Sep 10 04:46:52.900401 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:52.899676    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 10 04:46:52.900401 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:52.900009    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 10 04:46:52.900401 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:52.900359    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-rn5dj\""
Sep 10 04:46:52.902989 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:52.902962    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-g8hhk"]
Sep 10 04:46:53.037305 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:53.037276    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5229693f-a7fb-44db-b449-6b5ae3f273bc-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-g8hhk\" (UID: \"5229693f-a7fb-44db-b449-6b5ae3f273bc\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-g8hhk"
Sep 10 04:46:53.037427 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:53.037335    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wg8r7\" (UniqueName: \"kubernetes.io/projected/5229693f-a7fb-44db-b449-6b5ae3f273bc-kube-api-access-wg8r7\") pod \"cert-manager-cainjector-559cdd8c87-g8hhk\" (UID: \"5229693f-a7fb-44db-b449-6b5ae3f273bc\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-g8hhk"
Sep 10 04:46:53.138191 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:53.138136    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5229693f-a7fb-44db-b449-6b5ae3f273bc-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-g8hhk\" (UID: \"5229693f-a7fb-44db-b449-6b5ae3f273bc\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-g8hhk"
Sep 10 04:46:53.138191 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:53.138173    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wg8r7\" (UniqueName: \"kubernetes.io/projected/5229693f-a7fb-44db-b449-6b5ae3f273bc-kube-api-access-wg8r7\") pod \"cert-manager-cainjector-559cdd8c87-g8hhk\" (UID: \"5229693f-a7fb-44db-b449-6b5ae3f273bc\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-g8hhk"
Sep 10 04:46:53.146923 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:53.146873    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5229693f-a7fb-44db-b449-6b5ae3f273bc-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-g8hhk\" (UID: \"5229693f-a7fb-44db-b449-6b5ae3f273bc\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-g8hhk"
Sep 10 04:46:53.146998 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:53.146924    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wg8r7\" (UniqueName: \"kubernetes.io/projected/5229693f-a7fb-44db-b449-6b5ae3f273bc-kube-api-access-wg8r7\") pod \"cert-manager-cainjector-559cdd8c87-g8hhk\" (UID: \"5229693f-a7fb-44db-b449-6b5ae3f273bc\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-g8hhk"
Sep 10 04:46:53.218602 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:53.218574    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-g8hhk"
Sep 10 04:46:53.294238 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:53.294211    2560 generic.go:356] "Generic (PLEG): container finished" podID="50e4b00f-5532-4020-a3c5-5a8c9cfee35f" containerID="5f36105ef0647d911510561bbeba3a5e9808f51ee959a862b9ef9683f1c3e46f" exitCode=0
Sep 10 04:46:53.294363 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:53.294292    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f92p2r" event={"ID":"50e4b00f-5532-4020-a3c5-5a8c9cfee35f","Type":"ContainerDied","Data":"5f36105ef0647d911510561bbeba3a5e9808f51ee959a862b9ef9683f1c3e46f"}
Sep 10 04:46:53.483837 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:53.483815    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-g8hhk"]
Sep 10 04:46:53.485900 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:46:53.485874    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5229693f_a7fb_44db_b449_6b5ae3f273bc.slice/crio-c5fbc6f4d24f0bbe586427dde99c27a8b8e80f4a7c5c8d5ec5ca4eee7096b6d1 WatchSource:0}: Error finding container c5fbc6f4d24f0bbe586427dde99c27a8b8e80f4a7c5c8d5ec5ca4eee7096b6d1: Status 404 returned error can't find the container with id c5fbc6f4d24f0bbe586427dde99c27a8b8e80f4a7c5c8d5ec5ca4eee7096b6d1
Sep 10 04:46:54.302279 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:54.302244    2560 generic.go:356] "Generic (PLEG): container finished" podID="50e4b00f-5532-4020-a3c5-5a8c9cfee35f" containerID="5852b6f4701311ce3a4f2082331679c2492e2a8c93ee98a8bf4d29b02c4457ee" exitCode=0
Sep 10 04:46:54.302726 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:54.302330    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f92p2r" event={"ID":"50e4b00f-5532-4020-a3c5-5a8c9cfee35f","Type":"ContainerDied","Data":"5852b6f4701311ce3a4f2082331679c2492e2a8c93ee98a8bf4d29b02c4457ee"}
Sep 10 04:46:54.303770 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:54.303734    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-g8hhk" event={"ID":"5229693f-a7fb-44db-b449-6b5ae3f273bc","Type":"ContainerStarted","Data":"c5fbc6f4d24f0bbe586427dde99c27a8b8e80f4a7c5c8d5ec5ca4eee7096b6d1"}
Sep 10 04:46:55.847806 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:55.847780    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f92p2r"
Sep 10 04:46:55.961819 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:55.961795    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c5pvd\" (UniqueName: \"kubernetes.io/projected/50e4b00f-5532-4020-a3c5-5a8c9cfee35f-kube-api-access-c5pvd\") pod \"50e4b00f-5532-4020-a3c5-5a8c9cfee35f\" (UID: \"50e4b00f-5532-4020-a3c5-5a8c9cfee35f\") "
Sep 10 04:46:55.961923 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:55.961827    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/50e4b00f-5532-4020-a3c5-5a8c9cfee35f-util\") pod \"50e4b00f-5532-4020-a3c5-5a8c9cfee35f\" (UID: \"50e4b00f-5532-4020-a3c5-5a8c9cfee35f\") "
Sep 10 04:46:55.961923 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:55.961918    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/50e4b00f-5532-4020-a3c5-5a8c9cfee35f-bundle\") pod \"50e4b00f-5532-4020-a3c5-5a8c9cfee35f\" (UID: \"50e4b00f-5532-4020-a3c5-5a8c9cfee35f\") "
Sep 10 04:46:55.962610 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:55.962437    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50e4b00f-5532-4020-a3c5-5a8c9cfee35f-bundle" (OuterVolumeSpecName: "bundle") pod "50e4b00f-5532-4020-a3c5-5a8c9cfee35f" (UID: "50e4b00f-5532-4020-a3c5-5a8c9cfee35f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 04:46:55.964322 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:55.964291    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50e4b00f-5532-4020-a3c5-5a8c9cfee35f-kube-api-access-c5pvd" (OuterVolumeSpecName: "kube-api-access-c5pvd") pod "50e4b00f-5532-4020-a3c5-5a8c9cfee35f" (UID: "50e4b00f-5532-4020-a3c5-5a8c9cfee35f"). InnerVolumeSpecName "kube-api-access-c5pvd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 04:46:55.967767 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:55.967735    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50e4b00f-5532-4020-a3c5-5a8c9cfee35f-util" (OuterVolumeSpecName: "util") pod "50e4b00f-5532-4020-a3c5-5a8c9cfee35f" (UID: "50e4b00f-5532-4020-a3c5-5a8c9cfee35f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 04:46:56.062593 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:56.062565    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/50e4b00f-5532-4020-a3c5-5a8c9cfee35f-bundle\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:46:56.062593 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:56.062590    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c5pvd\" (UniqueName: \"kubernetes.io/projected/50e4b00f-5532-4020-a3c5-5a8c9cfee35f-kube-api-access-c5pvd\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:46:56.062736 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:56.062603    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/50e4b00f-5532-4020-a3c5-5a8c9cfee35f-util\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:46:56.314810 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:56.314777    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f92p2r" event={"ID":"50e4b00f-5532-4020-a3c5-5a8c9cfee35f","Type":"ContainerDied","Data":"0c5649114f18b9ee16142b1fde5782844dc89972955fbba82c8dd63fc9d69fd3"}
Sep 10 04:46:56.315016 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:56.314830    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0c5649114f18b9ee16142b1fde5782844dc89972955fbba82c8dd63fc9d69fd3"
Sep 10 04:46:56.315016 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:56.314786    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f92p2r"
Sep 10 04:46:56.316538 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:56.316512    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-g8hhk" event={"ID":"5229693f-a7fb-44db-b449-6b5ae3f273bc","Type":"ContainerStarted","Data":"6b8e186a6aea3cabe9ad763b43be78a4993196ab2be3ff67ad6af3eae7210966"}
Sep 10 04:46:56.331130 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:46:56.331093    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-g8hhk" podStartSLOduration=1.936366466 podStartE2EDuration="4.33107999s" totalImagesPullingTime="2.394713524s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:46:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:46:56.330163103 +0000 UTC m=+355.992620851" watchObservedRunningTime="2026-09-10 04:46:56.33107999 +0000 UTC m=+355.993537737"
Sep 10 04:47:01.731165 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:01.731132    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-6mgk6"]
Sep 10 04:47:01.731556 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:01.731391    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50e4b00f-5532-4020-a3c5-5a8c9cfee35f" containerName="util"
Sep 10 04:47:01.731556 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:01.731401    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="50e4b00f-5532-4020-a3c5-5a8c9cfee35f" containerName="util"
Sep 10 04:47:01.731556 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:01.731415    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50e4b00f-5532-4020-a3c5-5a8c9cfee35f" containerName="extract"
Sep 10 04:47:01.731556 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:01.731420    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="50e4b00f-5532-4020-a3c5-5a8c9cfee35f" containerName="extract"
Sep 10 04:47:01.731556 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:01.731434    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50e4b00f-5532-4020-a3c5-5a8c9cfee35f" containerName="pull"
Sep 10 04:47:01.731556 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:01.731439    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="50e4b00f-5532-4020-a3c5-5a8c9cfee35f" containerName="pull"
Sep 10 04:47:01.731556 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:01.731482    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="50e4b00f-5532-4020-a3c5-5a8c9cfee35f" containerName="extract"
Sep 10 04:47:01.734515 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:01.734499    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-6mgk6"
Sep 10 04:47:01.736537 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:01.736517    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-x2spf\""
Sep 10 04:47:01.744156 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:01.744135    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-6mgk6"]
Sep 10 04:47:01.912473 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:01.912420    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfzgw\" (UniqueName: \"kubernetes.io/projected/f38edda6-8908-415b-9f41-34125ba44e47-kube-api-access-kfzgw\") pod \"cert-manager-55b4d954d5-6mgk6\" (UID: \"f38edda6-8908-415b-9f41-34125ba44e47\") " pod="cert-manager/cert-manager-55b4d954d5-6mgk6"
Sep 10 04:47:01.912654 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:01.912536    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f38edda6-8908-415b-9f41-34125ba44e47-bound-sa-token\") pod \"cert-manager-55b4d954d5-6mgk6\" (UID: \"f38edda6-8908-415b-9f41-34125ba44e47\") " pod="cert-manager/cert-manager-55b4d954d5-6mgk6"
Sep 10 04:47:02.013092 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:02.013011    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f38edda6-8908-415b-9f41-34125ba44e47-bound-sa-token\") pod \"cert-manager-55b4d954d5-6mgk6\" (UID: \"f38edda6-8908-415b-9f41-34125ba44e47\") " pod="cert-manager/cert-manager-55b4d954d5-6mgk6"
Sep 10 04:47:02.013092 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:02.013072    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfzgw\" (UniqueName: \"kubernetes.io/projected/f38edda6-8908-415b-9f41-34125ba44e47-kube-api-access-kfzgw\") pod \"cert-manager-55b4d954d5-6mgk6\" (UID: \"f38edda6-8908-415b-9f41-34125ba44e47\") " pod="cert-manager/cert-manager-55b4d954d5-6mgk6"
Sep 10 04:47:02.022971 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:02.022950    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f38edda6-8908-415b-9f41-34125ba44e47-bound-sa-token\") pod \"cert-manager-55b4d954d5-6mgk6\" (UID: \"f38edda6-8908-415b-9f41-34125ba44e47\") " pod="cert-manager/cert-manager-55b4d954d5-6mgk6"
Sep 10 04:47:02.023112 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:02.023096    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfzgw\" (UniqueName: \"kubernetes.io/projected/f38edda6-8908-415b-9f41-34125ba44e47-kube-api-access-kfzgw\") pod \"cert-manager-55b4d954d5-6mgk6\" (UID: \"f38edda6-8908-415b-9f41-34125ba44e47\") " pod="cert-manager/cert-manager-55b4d954d5-6mgk6"
Sep 10 04:47:02.043884 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:02.043831    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-6mgk6"
Sep 10 04:47:02.315078 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:02.314949    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-6mgk6"]
Sep 10 04:47:02.317688 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:47:02.317651    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf38edda6_8908_415b_9f41_34125ba44e47.slice/crio-36f5f065f0a0b66ec28aee3ae1c14aa915b8e43ebd312ccbef48a213d7e276a3 WatchSource:0}: Error finding container 36f5f065f0a0b66ec28aee3ae1c14aa915b8e43ebd312ccbef48a213d7e276a3: Status 404 returned error can't find the container with id 36f5f065f0a0b66ec28aee3ae1c14aa915b8e43ebd312ccbef48a213d7e276a3
Sep 10 04:47:02.343402 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:02.343378    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-6mgk6" event={"ID":"f38edda6-8908-415b-9f41-34125ba44e47","Type":"ContainerStarted","Data":"36f5f065f0a0b66ec28aee3ae1c14aa915b8e43ebd312ccbef48a213d7e276a3"}
Sep 10 04:47:03.349772 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:03.349737    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-6mgk6" event={"ID":"f38edda6-8908-415b-9f41-34125ba44e47","Type":"ContainerStarted","Data":"04c40c4d30896e088850984033d6b817c75915e5e9800c2d4c99068477f3b1dc"}
Sep 10 04:47:03.365965 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:03.365915    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-6mgk6" podStartSLOduration=2.365899248 podStartE2EDuration="2.365899248s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:47:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:47:03.36393162 +0000 UTC m=+363.026389368" watchObservedRunningTime="2026-09-10 04:47:03.365899248 +0000 UTC m=+363.028356994"
Sep 10 04:47:10.147132 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:10.147090    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrhr2r"]
Sep 10 04:47:10.150465 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:10.150449    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrhr2r"
Sep 10 04:47:10.152758 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:10.152737    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9cccr\""
Sep 10 04:47:10.152895 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:10.152775    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 04:47:10.153272 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:10.153256    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 04:47:10.159500 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:10.159472    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrhr2r"]
Sep 10 04:47:10.177209 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:10.177181    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/627e4557-b39c-4b70-9b7b-1d660e5cd79a-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrhr2r\" (UID: \"627e4557-b39c-4b70-9b7b-1d660e5cd79a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrhr2r"
Sep 10 04:47:10.177327 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:10.177234    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhhbz\" (UniqueName: \"kubernetes.io/projected/627e4557-b39c-4b70-9b7b-1d660e5cd79a-kube-api-access-xhhbz\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrhr2r\" (UID: \"627e4557-b39c-4b70-9b7b-1d660e5cd79a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrhr2r"
Sep 10 04:47:10.177327 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:10.177277    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/627e4557-b39c-4b70-9b7b-1d660e5cd79a-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrhr2r\" (UID: \"627e4557-b39c-4b70-9b7b-1d660e5cd79a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrhr2r"
Sep 10 04:47:10.278292 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:10.278260    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/627e4557-b39c-4b70-9b7b-1d660e5cd79a-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrhr2r\" (UID: \"627e4557-b39c-4b70-9b7b-1d660e5cd79a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrhr2r"
Sep 10 04:47:10.278292 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:10.278307    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhhbz\" (UniqueName: \"kubernetes.io/projected/627e4557-b39c-4b70-9b7b-1d660e5cd79a-kube-api-access-xhhbz\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrhr2r\" (UID: \"627e4557-b39c-4b70-9b7b-1d660e5cd79a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrhr2r"
Sep 10 04:47:10.278467 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:10.278336    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/627e4557-b39c-4b70-9b7b-1d660e5cd79a-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrhr2r\" (UID: \"627e4557-b39c-4b70-9b7b-1d660e5cd79a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrhr2r"
Sep 10 04:47:10.278642 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:10.278628    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/627e4557-b39c-4b70-9b7b-1d660e5cd79a-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrhr2r\" (UID: \"627e4557-b39c-4b70-9b7b-1d660e5cd79a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrhr2r"
Sep 10 04:47:10.278679 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:10.278625    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/627e4557-b39c-4b70-9b7b-1d660e5cd79a-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrhr2r\" (UID: \"627e4557-b39c-4b70-9b7b-1d660e5cd79a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrhr2r"
Sep 10 04:47:10.285521 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:10.285502    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhhbz\" (UniqueName: \"kubernetes.io/projected/627e4557-b39c-4b70-9b7b-1d660e5cd79a-kube-api-access-xhhbz\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrhr2r\" (UID: \"627e4557-b39c-4b70-9b7b-1d660e5cd79a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrhr2r"
Sep 10 04:47:10.460551 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:10.460489    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrhr2r"
Sep 10 04:47:10.728991 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:10.728965    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrhr2r"]
Sep 10 04:47:10.731027 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:47:10.731003    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod627e4557_b39c_4b70_9b7b_1d660e5cd79a.slice/crio-8d2d91d2fa9905f5f3b2552123239f40a5df561cd99ef9cd3786d46520ae9fa5 WatchSource:0}: Error finding container 8d2d91d2fa9905f5f3b2552123239f40a5df561cd99ef9cd3786d46520ae9fa5: Status 404 returned error can't find the container with id 8d2d91d2fa9905f5f3b2552123239f40a5df561cd99ef9cd3786d46520ae9fa5
Sep 10 04:47:11.386075 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:11.386041    2560 generic.go:356] "Generic (PLEG): container finished" podID="627e4557-b39c-4b70-9b7b-1d660e5cd79a" containerID="fb2e1db4bd40d226e9fd7251b5f98e100325e00fea1f91374ae611ea3cb05971" exitCode=0
Sep 10 04:47:11.386425 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:11.386121    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrhr2r" event={"ID":"627e4557-b39c-4b70-9b7b-1d660e5cd79a","Type":"ContainerDied","Data":"fb2e1db4bd40d226e9fd7251b5f98e100325e00fea1f91374ae611ea3cb05971"}
Sep 10 04:47:11.386425 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:11.386179    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrhr2r" event={"ID":"627e4557-b39c-4b70-9b7b-1d660e5cd79a","Type":"ContainerStarted","Data":"8d2d91d2fa9905f5f3b2552123239f40a5df561cd99ef9cd3786d46520ae9fa5"}
Sep 10 04:47:12.392405 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:12.392371    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrhr2r" event={"ID":"627e4557-b39c-4b70-9b7b-1d660e5cd79a","Type":"ContainerStarted","Data":"6b26efdefd12d890f9588ec4d98c8062573d670d55558e3ed212df29c4db2f07"}
Sep 10 04:47:13.399367 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:13.399328    2560 generic.go:356] "Generic (PLEG): container finished" podID="627e4557-b39c-4b70-9b7b-1d660e5cd79a" containerID="6b26efdefd12d890f9588ec4d98c8062573d670d55558e3ed212df29c4db2f07" exitCode=0
Sep 10 04:47:13.399805 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:13.399416    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrhr2r" event={"ID":"627e4557-b39c-4b70-9b7b-1d660e5cd79a","Type":"ContainerDied","Data":"6b26efdefd12d890f9588ec4d98c8062573d670d55558e3ed212df29c4db2f07"}
Sep 10 04:47:14.405269 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:14.405237    2560 generic.go:356] "Generic (PLEG): container finished" podID="627e4557-b39c-4b70-9b7b-1d660e5cd79a" containerID="5c2b5fa91b992842e4fb3222a436ac7d1bacee1e8d351842dfc82ea9855027a3" exitCode=0
Sep 10 04:47:14.405672 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:14.405288    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrhr2r" event={"ID":"627e4557-b39c-4b70-9b7b-1d660e5cd79a","Type":"ContainerDied","Data":"5c2b5fa91b992842e4fb3222a436ac7d1bacee1e8d351842dfc82ea9855027a3"}
Sep 10 04:47:15.529489 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:15.529465    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrhr2r"
Sep 10 04:47:15.616974 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:15.616942    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/627e4557-b39c-4b70-9b7b-1d660e5cd79a-util\") pod \"627e4557-b39c-4b70-9b7b-1d660e5cd79a\" (UID: \"627e4557-b39c-4b70-9b7b-1d660e5cd79a\") "
Sep 10 04:47:15.616974 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:15.616974    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/627e4557-b39c-4b70-9b7b-1d660e5cd79a-bundle\") pod \"627e4557-b39c-4b70-9b7b-1d660e5cd79a\" (UID: \"627e4557-b39c-4b70-9b7b-1d660e5cd79a\") "
Sep 10 04:47:15.617142 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:15.617002    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xhhbz\" (UniqueName: \"kubernetes.io/projected/627e4557-b39c-4b70-9b7b-1d660e5cd79a-kube-api-access-xhhbz\") pod \"627e4557-b39c-4b70-9b7b-1d660e5cd79a\" (UID: \"627e4557-b39c-4b70-9b7b-1d660e5cd79a\") "
Sep 10 04:47:15.617671 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:15.617640    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/627e4557-b39c-4b70-9b7b-1d660e5cd79a-bundle" (OuterVolumeSpecName: "bundle") pod "627e4557-b39c-4b70-9b7b-1d660e5cd79a" (UID: "627e4557-b39c-4b70-9b7b-1d660e5cd79a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 04:47:15.619086 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:15.619058    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/627e4557-b39c-4b70-9b7b-1d660e5cd79a-kube-api-access-xhhbz" (OuterVolumeSpecName: "kube-api-access-xhhbz") pod "627e4557-b39c-4b70-9b7b-1d660e5cd79a" (UID: "627e4557-b39c-4b70-9b7b-1d660e5cd79a"). InnerVolumeSpecName "kube-api-access-xhhbz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 04:47:15.622773 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:15.622748    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/627e4557-b39c-4b70-9b7b-1d660e5cd79a-util" (OuterVolumeSpecName: "util") pod "627e4557-b39c-4b70-9b7b-1d660e5cd79a" (UID: "627e4557-b39c-4b70-9b7b-1d660e5cd79a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 04:47:15.717957 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:15.717834    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/627e4557-b39c-4b70-9b7b-1d660e5cd79a-util\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:47:15.717957 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:15.717905    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/627e4557-b39c-4b70-9b7b-1d660e5cd79a-bundle\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:47:15.717957 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:15.717917    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xhhbz\" (UniqueName: \"kubernetes.io/projected/627e4557-b39c-4b70-9b7b-1d660e5cd79a-kube-api-access-xhhbz\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:47:16.417619 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:16.417584    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrhr2r" event={"ID":"627e4557-b39c-4b70-9b7b-1d660e5cd79a","Type":"ContainerDied","Data":"8d2d91d2fa9905f5f3b2552123239f40a5df561cd99ef9cd3786d46520ae9fa5"}
Sep 10 04:47:16.417619 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:16.417620    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrhr2r"
Sep 10 04:47:16.417619 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:16.417633    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8d2d91d2fa9905f5f3b2552123239f40a5df561cd99ef9cd3786d46520ae9fa5"
Sep 10 04:47:27.217984 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:27.217950    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d249f"]
Sep 10 04:47:27.218483 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:27.218217    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="627e4557-b39c-4b70-9b7b-1d660e5cd79a" containerName="extract"
Sep 10 04:47:27.218483 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:27.218228    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="627e4557-b39c-4b70-9b7b-1d660e5cd79a" containerName="extract"
Sep 10 04:47:27.218483 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:27.218241    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="627e4557-b39c-4b70-9b7b-1d660e5cd79a" containerName="pull"
Sep 10 04:47:27.218483 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:27.218246    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="627e4557-b39c-4b70-9b7b-1d660e5cd79a" containerName="pull"
Sep 10 04:47:27.218483 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:27.218255    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="627e4557-b39c-4b70-9b7b-1d660e5cd79a" containerName="util"
Sep 10 04:47:27.218483 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:27.218261    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="627e4557-b39c-4b70-9b7b-1d660e5cd79a" containerName="util"
Sep 10 04:47:27.218483 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:27.218316    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="627e4557-b39c-4b70-9b7b-1d660e5cd79a" containerName="extract"
Sep 10 04:47:27.222603 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:27.222585    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d249f"
Sep 10 04:47:27.224574 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:27.224556    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 04:47:27.224744 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:27.224731    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 04:47:27.224791 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:27.224774    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9cccr\""
Sep 10 04:47:27.229631 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:27.229608    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d249f"]
Sep 10 04:47:27.305624 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:27.305601    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d62e36b-133e-4d78-acbe-4b25383d13bb-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d249f\" (UID: \"5d62e36b-133e-4d78-acbe-4b25383d13bb\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d249f"
Sep 10 04:47:27.305715 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:27.305671    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52t8c\" (UniqueName: \"kubernetes.io/projected/5d62e36b-133e-4d78-acbe-4b25383d13bb-kube-api-access-52t8c\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d249f\" (UID: \"5d62e36b-133e-4d78-acbe-4b25383d13bb\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d249f"
Sep 10 04:47:27.305715 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:27.305709    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d62e36b-133e-4d78-acbe-4b25383d13bb-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d249f\" (UID: \"5d62e36b-133e-4d78-acbe-4b25383d13bb\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d249f"
Sep 10 04:47:27.406786 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:27.406761    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52t8c\" (UniqueName: \"kubernetes.io/projected/5d62e36b-133e-4d78-acbe-4b25383d13bb-kube-api-access-52t8c\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d249f\" (UID: \"5d62e36b-133e-4d78-acbe-4b25383d13bb\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d249f"
Sep 10 04:47:27.406905 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:27.406796    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d62e36b-133e-4d78-acbe-4b25383d13bb-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d249f\" (UID: \"5d62e36b-133e-4d78-acbe-4b25383d13bb\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d249f"
Sep 10 04:47:27.406905 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:27.406819    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d62e36b-133e-4d78-acbe-4b25383d13bb-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d249f\" (UID: \"5d62e36b-133e-4d78-acbe-4b25383d13bb\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d249f"
Sep 10 04:47:27.407139 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:27.407124    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d62e36b-133e-4d78-acbe-4b25383d13bb-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d249f\" (UID: \"5d62e36b-133e-4d78-acbe-4b25383d13bb\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d249f"
Sep 10 04:47:27.407178 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:27.407149    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d62e36b-133e-4d78-acbe-4b25383d13bb-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d249f\" (UID: \"5d62e36b-133e-4d78-acbe-4b25383d13bb\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d249f"
Sep 10 04:47:27.411942 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:27.411921    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-c57f4866c-hl9rp"]
Sep 10 04:47:27.414081 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:27.414066    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-c57f4866c-hl9rp"
Sep 10 04:47:27.416297 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:27.416272    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 10 04:47:27.416394 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:27.416300    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 10 04:47:27.416394 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:27.416360    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 10 04:47:27.416394 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:27.416383    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-dzbdb\""
Sep 10 04:47:27.416394 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:27.416390    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 10 04:47:27.420728 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:27.420683    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-52t8c\" (UniqueName: \"kubernetes.io/projected/5d62e36b-133e-4d78-acbe-4b25383d13bb-kube-api-access-52t8c\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d249f\" (UID: \"5d62e36b-133e-4d78-acbe-4b25383d13bb\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d249f"
Sep 10 04:47:27.429774 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:27.429746    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-c57f4866c-hl9rp"]
Sep 10 04:47:27.508057 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:27.507990    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ebd0eaa2-806f-4597-b997-4d96be4cca53-tmp\") pod \"opendatahub-operator-controller-manager-c57f4866c-hl9rp\" (UID: \"ebd0eaa2-806f-4597-b997-4d96be4cca53\") " pod="opendatahub/opendatahub-operator-controller-manager-c57f4866c-hl9rp"
Sep 10 04:47:27.508057 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:27.508038    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ebd0eaa2-806f-4597-b997-4d96be4cca53-apiservice-cert\") pod \"opendatahub-operator-controller-manager-c57f4866c-hl9rp\" (UID: \"ebd0eaa2-806f-4597-b997-4d96be4cca53\") " pod="opendatahub/opendatahub-operator-controller-manager-c57f4866c-hl9rp"
Sep 10 04:47:27.508231 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:27.508089    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ebd0eaa2-806f-4597-b997-4d96be4cca53-manifests\") pod \"opendatahub-operator-controller-manager-c57f4866c-hl9rp\" (UID: \"ebd0eaa2-806f-4597-b997-4d96be4cca53\") " pod="opendatahub/opendatahub-operator-controller-manager-c57f4866c-hl9rp"
Sep 10 04:47:27.508231 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:27.508122    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ebd0eaa2-806f-4597-b997-4d96be4cca53-webhook-cert\") pod \"opendatahub-operator-controller-manager-c57f4866c-hl9rp\" (UID: \"ebd0eaa2-806f-4597-b997-4d96be4cca53\") " pod="opendatahub/opendatahub-operator-controller-manager-c57f4866c-hl9rp"
Sep 10 04:47:27.508231 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:27.508215    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cx6bg\" (UniqueName: \"kubernetes.io/projected/ebd0eaa2-806f-4597-b997-4d96be4cca53-kube-api-access-cx6bg\") pod \"opendatahub-operator-controller-manager-c57f4866c-hl9rp\" (UID: \"ebd0eaa2-806f-4597-b997-4d96be4cca53\") " pod="opendatahub/opendatahub-operator-controller-manager-c57f4866c-hl9rp"
Sep 10 04:47:27.532965 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:27.532937    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d249f"
Sep 10 04:47:27.609543 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:27.609517    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cx6bg\" (UniqueName: \"kubernetes.io/projected/ebd0eaa2-806f-4597-b997-4d96be4cca53-kube-api-access-cx6bg\") pod \"opendatahub-operator-controller-manager-c57f4866c-hl9rp\" (UID: \"ebd0eaa2-806f-4597-b997-4d96be4cca53\") " pod="opendatahub/opendatahub-operator-controller-manager-c57f4866c-hl9rp"
Sep 10 04:47:27.609670 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:27.609562    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ebd0eaa2-806f-4597-b997-4d96be4cca53-tmp\") pod \"opendatahub-operator-controller-manager-c57f4866c-hl9rp\" (UID: \"ebd0eaa2-806f-4597-b997-4d96be4cca53\") " pod="opendatahub/opendatahub-operator-controller-manager-c57f4866c-hl9rp"
Sep 10 04:47:27.609670 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:27.609600    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ebd0eaa2-806f-4597-b997-4d96be4cca53-apiservice-cert\") pod \"opendatahub-operator-controller-manager-c57f4866c-hl9rp\" (UID: \"ebd0eaa2-806f-4597-b997-4d96be4cca53\") " pod="opendatahub/opendatahub-operator-controller-manager-c57f4866c-hl9rp"
Sep 10 04:47:27.609670 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:27.609618    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ebd0eaa2-806f-4597-b997-4d96be4cca53-manifests\") pod \"opendatahub-operator-controller-manager-c57f4866c-hl9rp\" (UID: \"ebd0eaa2-806f-4597-b997-4d96be4cca53\") " pod="opendatahub/opendatahub-operator-controller-manager-c57f4866c-hl9rp"
Sep 10 04:47:27.609670 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:27.609635    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ebd0eaa2-806f-4597-b997-4d96be4cca53-webhook-cert\") pod \"opendatahub-operator-controller-manager-c57f4866c-hl9rp\" (UID: \"ebd0eaa2-806f-4597-b997-4d96be4cca53\") " pod="opendatahub/opendatahub-operator-controller-manager-c57f4866c-hl9rp"
Sep 10 04:47:27.610131 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:27.610100    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ebd0eaa2-806f-4597-b997-4d96be4cca53-manifests\") pod \"opendatahub-operator-controller-manager-c57f4866c-hl9rp\" (UID: \"ebd0eaa2-806f-4597-b997-4d96be4cca53\") " pod="opendatahub/opendatahub-operator-controller-manager-c57f4866c-hl9rp"
Sep 10 04:47:27.611668 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:27.611639    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ebd0eaa2-806f-4597-b997-4d96be4cca53-tmp\") pod \"opendatahub-operator-controller-manager-c57f4866c-hl9rp\" (UID: \"ebd0eaa2-806f-4597-b997-4d96be4cca53\") " pod="opendatahub/opendatahub-operator-controller-manager-c57f4866c-hl9rp"
Sep 10 04:47:27.612400 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:27.612382    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ebd0eaa2-806f-4597-b997-4d96be4cca53-apiservice-cert\") pod \"opendatahub-operator-controller-manager-c57f4866c-hl9rp\" (UID: \"ebd0eaa2-806f-4597-b997-4d96be4cca53\") " pod="opendatahub/opendatahub-operator-controller-manager-c57f4866c-hl9rp"
Sep 10 04:47:27.612551 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:27.612527    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ebd0eaa2-806f-4597-b997-4d96be4cca53-webhook-cert\") pod \"opendatahub-operator-controller-manager-c57f4866c-hl9rp\" (UID: \"ebd0eaa2-806f-4597-b997-4d96be4cca53\") " pod="opendatahub/opendatahub-operator-controller-manager-c57f4866c-hl9rp"
Sep 10 04:47:27.617186 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:27.617167    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cx6bg\" (UniqueName: \"kubernetes.io/projected/ebd0eaa2-806f-4597-b997-4d96be4cca53-kube-api-access-cx6bg\") pod \"opendatahub-operator-controller-manager-c57f4866c-hl9rp\" (UID: \"ebd0eaa2-806f-4597-b997-4d96be4cca53\") " pod="opendatahub/opendatahub-operator-controller-manager-c57f4866c-hl9rp"
Sep 10 04:47:27.730409 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:27.730387    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-c57f4866c-hl9rp"
Sep 10 04:47:27.823973 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:27.823950    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d249f"]
Sep 10 04:47:27.825812 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:47:27.825789    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d62e36b_133e_4d78_acbe_4b25383d13bb.slice/crio-e055c3de6c8823b4e600c575b6fd2779ecab4bf63d6c0d12f9a3d1ef6d142437 WatchSource:0}: Error finding container e055c3de6c8823b4e600c575b6fd2779ecab4bf63d6c0d12f9a3d1ef6d142437: Status 404 returned error can't find the container with id e055c3de6c8823b4e600c575b6fd2779ecab4bf63d6c0d12f9a3d1ef6d142437
Sep 10 04:47:28.003120 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:28.003099    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-c57f4866c-hl9rp"]
Sep 10 04:47:28.005784 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:47:28.005758    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebd0eaa2_806f_4597_b997_4d96be4cca53.slice/crio-16da68fed1b6842a94d57cebe4bde7b1d7491137654a69857bb5734f224a5e8e WatchSource:0}: Error finding container 16da68fed1b6842a94d57cebe4bde7b1d7491137654a69857bb5734f224a5e8e: Status 404 returned error can't find the container with id 16da68fed1b6842a94d57cebe4bde7b1d7491137654a69857bb5734f224a5e8e
Sep 10 04:47:28.474129 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:28.474090    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c57f4866c-hl9rp" event={"ID":"ebd0eaa2-806f-4597-b997-4d96be4cca53","Type":"ContainerStarted","Data":"16da68fed1b6842a94d57cebe4bde7b1d7491137654a69857bb5734f224a5e8e"}
Sep 10 04:47:28.475869 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:28.475819    2560 generic.go:356] "Generic (PLEG): container finished" podID="5d62e36b-133e-4d78-acbe-4b25383d13bb" containerID="9894ad7bed2f01488c3a07b4b4a075f2565c619c24bd049ff4b65ad9b5bfa272" exitCode=0
Sep 10 04:47:28.475996 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:28.475881    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d249f" event={"ID":"5d62e36b-133e-4d78-acbe-4b25383d13bb","Type":"ContainerDied","Data":"9894ad7bed2f01488c3a07b4b4a075f2565c619c24bd049ff4b65ad9b5bfa272"}
Sep 10 04:47:28.475996 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:28.475935    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d249f" event={"ID":"5d62e36b-133e-4d78-acbe-4b25383d13bb","Type":"ContainerStarted","Data":"e055c3de6c8823b4e600c575b6fd2779ecab4bf63d6c0d12f9a3d1ef6d142437"}
Sep 10 04:47:29.484226 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:29.484129    2560 generic.go:356] "Generic (PLEG): container finished" podID="5d62e36b-133e-4d78-acbe-4b25383d13bb" containerID="a2964e079cdd1a73bc3352b4f21cb431a104a7fac814893138e12d2a27b651f3" exitCode=0
Sep 10 04:47:29.484226 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:29.484178    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d249f" event={"ID":"5d62e36b-133e-4d78-acbe-4b25383d13bb","Type":"ContainerDied","Data":"a2964e079cdd1a73bc3352b4f21cb431a104a7fac814893138e12d2a27b651f3"}
Sep 10 04:47:29.863599 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:29.860969    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7b55df5c64-xd5z8"]
Sep 10 04:47:29.868523 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:29.868492    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b55df5c64-xd5z8"
Sep 10 04:47:29.873770 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:29.873708    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b55df5c64-xd5z8"]
Sep 10 04:47:29.932398 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:29.932368    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aa152cea-7dd8-415c-844e-996635f2e428-console-oauth-config\") pod \"console-7b55df5c64-xd5z8\" (UID: \"aa152cea-7dd8-415c-844e-996635f2e428\") " pod="openshift-console/console-7b55df5c64-xd5z8"
Sep 10 04:47:29.932534 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:29.932410    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aa152cea-7dd8-415c-844e-996635f2e428-console-serving-cert\") pod \"console-7b55df5c64-xd5z8\" (UID: \"aa152cea-7dd8-415c-844e-996635f2e428\") " pod="openshift-console/console-7b55df5c64-xd5z8"
Sep 10 04:47:29.932534 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:29.932483    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aa152cea-7dd8-415c-844e-996635f2e428-service-ca\") pod \"console-7b55df5c64-xd5z8\" (UID: \"aa152cea-7dd8-415c-844e-996635f2e428\") " pod="openshift-console/console-7b55df5c64-xd5z8"
Sep 10 04:47:29.932534 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:29.932527    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aa152cea-7dd8-415c-844e-996635f2e428-oauth-serving-cert\") pod \"console-7b55df5c64-xd5z8\" (UID: \"aa152cea-7dd8-415c-844e-996635f2e428\") " pod="openshift-console/console-7b55df5c64-xd5z8"
Sep 10 04:47:29.932650 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:29.932570    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa152cea-7dd8-415c-844e-996635f2e428-trusted-ca-bundle\") pod \"console-7b55df5c64-xd5z8\" (UID: \"aa152cea-7dd8-415c-844e-996635f2e428\") " pod="openshift-console/console-7b55df5c64-xd5z8"
Sep 10 04:47:29.932683 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:29.932663    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aa152cea-7dd8-415c-844e-996635f2e428-console-config\") pod \"console-7b55df5c64-xd5z8\" (UID: \"aa152cea-7dd8-415c-844e-996635f2e428\") " pod="openshift-console/console-7b55df5c64-xd5z8"
Sep 10 04:47:29.932731 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:29.932714    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctqtr\" (UniqueName: \"kubernetes.io/projected/aa152cea-7dd8-415c-844e-996635f2e428-kube-api-access-ctqtr\") pod \"console-7b55df5c64-xd5z8\" (UID: \"aa152cea-7dd8-415c-844e-996635f2e428\") " pod="openshift-console/console-7b55df5c64-xd5z8"
Sep 10 04:47:30.033944 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:30.033913    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctqtr\" (UniqueName: \"kubernetes.io/projected/aa152cea-7dd8-415c-844e-996635f2e428-kube-api-access-ctqtr\") pod \"console-7b55df5c64-xd5z8\" (UID: \"aa152cea-7dd8-415c-844e-996635f2e428\") " pod="openshift-console/console-7b55df5c64-xd5z8"
Sep 10 04:47:30.034118 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:30.033986    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aa152cea-7dd8-415c-844e-996635f2e428-console-oauth-config\") pod \"console-7b55df5c64-xd5z8\" (UID: \"aa152cea-7dd8-415c-844e-996635f2e428\") " pod="openshift-console/console-7b55df5c64-xd5z8"
Sep 10 04:47:30.034118 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:30.034011    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aa152cea-7dd8-415c-844e-996635f2e428-console-serving-cert\") pod \"console-7b55df5c64-xd5z8\" (UID: \"aa152cea-7dd8-415c-844e-996635f2e428\") " pod="openshift-console/console-7b55df5c64-xd5z8"
Sep 10 04:47:30.034118 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:30.034039    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aa152cea-7dd8-415c-844e-996635f2e428-service-ca\") pod \"console-7b55df5c64-xd5z8\" (UID: \"aa152cea-7dd8-415c-844e-996635f2e428\") " pod="openshift-console/console-7b55df5c64-xd5z8"
Sep 10 04:47:30.034118 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:30.034062    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aa152cea-7dd8-415c-844e-996635f2e428-oauth-serving-cert\") pod \"console-7b55df5c64-xd5z8\" (UID: \"aa152cea-7dd8-415c-844e-996635f2e428\") " pod="openshift-console/console-7b55df5c64-xd5z8"
Sep 10 04:47:30.034118 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:30.034094    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa152cea-7dd8-415c-844e-996635f2e428-trusted-ca-bundle\") pod \"console-7b55df5c64-xd5z8\" (UID: \"aa152cea-7dd8-415c-844e-996635f2e428\") " pod="openshift-console/console-7b55df5c64-xd5z8"
Sep 10 04:47:30.034398 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:30.034153    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aa152cea-7dd8-415c-844e-996635f2e428-console-config\") pod \"console-7b55df5c64-xd5z8\" (UID: \"aa152cea-7dd8-415c-844e-996635f2e428\") " pod="openshift-console/console-7b55df5c64-xd5z8"
Sep 10 04:47:30.035084 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:30.035056    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aa152cea-7dd8-415c-844e-996635f2e428-console-config\") pod \"console-7b55df5c64-xd5z8\" (UID: \"aa152cea-7dd8-415c-844e-996635f2e428\") " pod="openshift-console/console-7b55df5c64-xd5z8"
Sep 10 04:47:30.035208 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:30.035108    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aa152cea-7dd8-415c-844e-996635f2e428-service-ca\") pod \"console-7b55df5c64-xd5z8\" (UID: \"aa152cea-7dd8-415c-844e-996635f2e428\") " pod="openshift-console/console-7b55df5c64-xd5z8"
Sep 10 04:47:30.035208 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:30.035172    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aa152cea-7dd8-415c-844e-996635f2e428-oauth-serving-cert\") pod \"console-7b55df5c64-xd5z8\" (UID: \"aa152cea-7dd8-415c-844e-996635f2e428\") " pod="openshift-console/console-7b55df5c64-xd5z8"
Sep 10 04:47:30.035326 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:30.035296    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa152cea-7dd8-415c-844e-996635f2e428-trusted-ca-bundle\") pod \"console-7b55df5c64-xd5z8\" (UID: \"aa152cea-7dd8-415c-844e-996635f2e428\") " pod="openshift-console/console-7b55df5c64-xd5z8"
Sep 10 04:47:30.036887 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:30.036867    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aa152cea-7dd8-415c-844e-996635f2e428-console-serving-cert\") pod \"console-7b55df5c64-xd5z8\" (UID: \"aa152cea-7dd8-415c-844e-996635f2e428\") " pod="openshift-console/console-7b55df5c64-xd5z8"
Sep 10 04:47:30.037044 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:30.037025    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aa152cea-7dd8-415c-844e-996635f2e428-console-oauth-config\") pod \"console-7b55df5c64-xd5z8\" (UID: \"aa152cea-7dd8-415c-844e-996635f2e428\") " pod="openshift-console/console-7b55df5c64-xd5z8"
Sep 10 04:47:30.041432 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:30.041413    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctqtr\" (UniqueName: \"kubernetes.io/projected/aa152cea-7dd8-415c-844e-996635f2e428-kube-api-access-ctqtr\") pod \"console-7b55df5c64-xd5z8\" (UID: \"aa152cea-7dd8-415c-844e-996635f2e428\") " pod="openshift-console/console-7b55df5c64-xd5z8"
Sep 10 04:47:30.181358 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:30.181323    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b55df5c64-xd5z8"
Sep 10 04:47:31.109809 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:31.109784    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b55df5c64-xd5z8"]
Sep 10 04:47:31.111812 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:47:31.111788    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa152cea_7dd8_415c_844e_996635f2e428.slice/crio-d5de8f9c046fe51afe57596f016364a0355b2a49727d1797b32d8840e3dc13ed WatchSource:0}: Error finding container d5de8f9c046fe51afe57596f016364a0355b2a49727d1797b32d8840e3dc13ed: Status 404 returned error can't find the container with id d5de8f9c046fe51afe57596f016364a0355b2a49727d1797b32d8840e3dc13ed
Sep 10 04:47:31.495338 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:31.495304    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b55df5c64-xd5z8" event={"ID":"aa152cea-7dd8-415c-844e-996635f2e428","Type":"ContainerStarted","Data":"0edbcb8012255137cca4f70ad62417d992d16f7e92a19804b92882baa6cfaf1c"}
Sep 10 04:47:31.495506 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:31.495359    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b55df5c64-xd5z8" event={"ID":"aa152cea-7dd8-415c-844e-996635f2e428","Type":"ContainerStarted","Data":"d5de8f9c046fe51afe57596f016364a0355b2a49727d1797b32d8840e3dc13ed"}
Sep 10 04:47:31.497020 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:31.496995    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c57f4866c-hl9rp" event={"ID":"ebd0eaa2-806f-4597-b997-4d96be4cca53","Type":"ContainerStarted","Data":"cccdb696fdb229cf8802a43de07251ccdc5346c02cc4b38ce0498ee7dc46af6f"}
Sep 10 04:47:31.499061 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:31.499038    2560 generic.go:356] "Generic (PLEG): container finished" podID="5d62e36b-133e-4d78-acbe-4b25383d13bb" containerID="f3b5b3c17ee96dd804440f6e0bf250ac3c516cd5c244bf8e0e3f029378724fe9" exitCode=0
Sep 10 04:47:31.499151 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:31.499096    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d249f" event={"ID":"5d62e36b-133e-4d78-acbe-4b25383d13bb","Type":"ContainerDied","Data":"f3b5b3c17ee96dd804440f6e0bf250ac3c516cd5c244bf8e0e3f029378724fe9"}
Sep 10 04:47:31.522447 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:31.522405    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7b55df5c64-xd5z8" podStartSLOduration=2.522392233 podStartE2EDuration="2.522392233s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:47:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:47:31.521396874 +0000 UTC m=+391.183854622" watchObservedRunningTime="2026-09-10 04:47:31.522392233 +0000 UTC m=+391.184849980"
Sep 10 04:47:32.505991 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:32.505955    2560 generic.go:356] "Generic (PLEG): container finished" podID="ebd0eaa2-806f-4597-b997-4d96be4cca53" containerID="cccdb696fdb229cf8802a43de07251ccdc5346c02cc4b38ce0498ee7dc46af6f" exitCode=0
Sep 10 04:47:32.506379 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:32.506049    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c57f4866c-hl9rp" event={"ID":"ebd0eaa2-806f-4597-b997-4d96be4cca53","Type":"ContainerDied","Data":"cccdb696fdb229cf8802a43de07251ccdc5346c02cc4b38ce0498ee7dc46af6f"}
Sep 10 04:47:32.640447 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:32.640419    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d249f"
Sep 10 04:47:32.759718 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:32.759648    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-52t8c\" (UniqueName: \"kubernetes.io/projected/5d62e36b-133e-4d78-acbe-4b25383d13bb-kube-api-access-52t8c\") pod \"5d62e36b-133e-4d78-acbe-4b25383d13bb\" (UID: \"5d62e36b-133e-4d78-acbe-4b25383d13bb\") "
Sep 10 04:47:32.759894 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:32.759715    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d62e36b-133e-4d78-acbe-4b25383d13bb-util\") pod \"5d62e36b-133e-4d78-acbe-4b25383d13bb\" (UID: \"5d62e36b-133e-4d78-acbe-4b25383d13bb\") "
Sep 10 04:47:32.759894 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:32.759771    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d62e36b-133e-4d78-acbe-4b25383d13bb-bundle\") pod \"5d62e36b-133e-4d78-acbe-4b25383d13bb\" (UID: \"5d62e36b-133e-4d78-acbe-4b25383d13bb\") "
Sep 10 04:47:32.760416 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:32.760383    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d62e36b-133e-4d78-acbe-4b25383d13bb-bundle" (OuterVolumeSpecName: "bundle") pod "5d62e36b-133e-4d78-acbe-4b25383d13bb" (UID: "5d62e36b-133e-4d78-acbe-4b25383d13bb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 04:47:32.761711 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:32.761687    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d62e36b-133e-4d78-acbe-4b25383d13bb-kube-api-access-52t8c" (OuterVolumeSpecName: "kube-api-access-52t8c") pod "5d62e36b-133e-4d78-acbe-4b25383d13bb" (UID: "5d62e36b-133e-4d78-acbe-4b25383d13bb"). InnerVolumeSpecName "kube-api-access-52t8c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 04:47:32.766136 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:32.766115    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d62e36b-133e-4d78-acbe-4b25383d13bb-util" (OuterVolumeSpecName: "util") pod "5d62e36b-133e-4d78-acbe-4b25383d13bb" (UID: "5d62e36b-133e-4d78-acbe-4b25383d13bb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 04:47:32.861048 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:32.861030    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-52t8c\" (UniqueName: \"kubernetes.io/projected/5d62e36b-133e-4d78-acbe-4b25383d13bb-kube-api-access-52t8c\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:47:32.861097 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:32.861050    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d62e36b-133e-4d78-acbe-4b25383d13bb-util\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:47:32.861097 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:32.861060    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d62e36b-133e-4d78-acbe-4b25383d13bb-bundle\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:47:33.512791 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:33.512764    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d249f"
Sep 10 04:47:33.513210 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:33.512793    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d249f" event={"ID":"5d62e36b-133e-4d78-acbe-4b25383d13bb","Type":"ContainerDied","Data":"e055c3de6c8823b4e600c575b6fd2779ecab4bf63d6c0d12f9a3d1ef6d142437"}
Sep 10 04:47:33.513210 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:33.512835    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e055c3de6c8823b4e600c575b6fd2779ecab4bf63d6c0d12f9a3d1ef6d142437"
Sep 10 04:47:33.515149 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:33.515122    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c57f4866c-hl9rp" event={"ID":"ebd0eaa2-806f-4597-b997-4d96be4cca53","Type":"ContainerStarted","Data":"ea19409c2cb78d6257c4d9f7ac6ea32c1d7a857488a8edeb5b367f2d494e5aac"}
Sep 10 04:47:33.515457 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:33.515441    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-c57f4866c-hl9rp"
Sep 10 04:47:33.534745 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:33.534701    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-c57f4866c-hl9rp" podStartSLOduration=2.218719112 podStartE2EDuration="6.534688612s" totalImagesPullingTime="3.237275894s" totalInitContainerRuntime="1.078693606s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:47:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:47:33.532644389 +0000 UTC m=+393.195102136" watchObservedRunningTime="2026-09-10 04:47:33.534688612 +0000 UTC m=+393.197146358"
Sep 10 04:47:40.182438 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:40.182404    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7b55df5c64-xd5z8"
Sep 10 04:47:40.182820 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:40.182683    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7b55df5c64-xd5z8"
Sep 10 04:47:40.187032 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:40.187012    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7b55df5c64-xd5z8"
Sep 10 04:47:40.552620 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:40.552543    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7b55df5c64-xd5z8"
Sep 10 04:47:40.603794 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:40.603753    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85576d56f4-svxnh"]
Sep 10 04:47:44.522165 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:44.522134    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-c57f4866c-hl9rp"
Sep 10 04:47:47.030417 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:47.030382    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-b5848dcdb-bjbmm"]
Sep 10 04:47:47.030794 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:47.030670    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d62e36b-133e-4d78-acbe-4b25383d13bb" containerName="extract"
Sep 10 04:47:47.030794 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:47.030681    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d62e36b-133e-4d78-acbe-4b25383d13bb" containerName="extract"
Sep 10 04:47:47.030794 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:47.030697    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d62e36b-133e-4d78-acbe-4b25383d13bb" containerName="util"
Sep 10 04:47:47.030794 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:47.030702    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d62e36b-133e-4d78-acbe-4b25383d13bb" containerName="util"
Sep 10 04:47:47.030794 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:47.030716    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d62e36b-133e-4d78-acbe-4b25383d13bb" containerName="pull"
Sep 10 04:47:47.030794 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:47.030722    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d62e36b-133e-4d78-acbe-4b25383d13bb" containerName="pull"
Sep 10 04:47:47.030794 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:47.030783    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d62e36b-133e-4d78-acbe-4b25383d13bb" containerName="extract"
Sep 10 04:47:47.038794 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:47.038776    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-b5848dcdb-bjbmm"
Sep 10 04:47:47.040952 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:47.040930    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 10 04:47:47.041071 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:47.040930    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 10 04:47:47.041151 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:47.041065    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-hr9th\""
Sep 10 04:47:47.046498 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:47.046478    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-b5848dcdb-bjbmm"]
Sep 10 04:47:47.175006 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:47.174964    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81258c1b-f1e0-41e3-bc6d-1f76ae3e3a93-tls-certs\") pod \"kube-auth-proxy-b5848dcdb-bjbmm\" (UID: \"81258c1b-f1e0-41e3-bc6d-1f76ae3e3a93\") " pod="openshift-ingress/kube-auth-proxy-b5848dcdb-bjbmm"
Sep 10 04:47:47.175177 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:47.175020    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/81258c1b-f1e0-41e3-bc6d-1f76ae3e3a93-tmp\") pod \"kube-auth-proxy-b5848dcdb-bjbmm\" (UID: \"81258c1b-f1e0-41e3-bc6d-1f76ae3e3a93\") " pod="openshift-ingress/kube-auth-proxy-b5848dcdb-bjbmm"
Sep 10 04:47:47.175177 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:47.175137    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q795f\" (UniqueName: \"kubernetes.io/projected/81258c1b-f1e0-41e3-bc6d-1f76ae3e3a93-kube-api-access-q795f\") pod \"kube-auth-proxy-b5848dcdb-bjbmm\" (UID: \"81258c1b-f1e0-41e3-bc6d-1f76ae3e3a93\") " pod="openshift-ingress/kube-auth-proxy-b5848dcdb-bjbmm"
Sep 10 04:47:47.276445 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:47.276422    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q795f\" (UniqueName: \"kubernetes.io/projected/81258c1b-f1e0-41e3-bc6d-1f76ae3e3a93-kube-api-access-q795f\") pod \"kube-auth-proxy-b5848dcdb-bjbmm\" (UID: \"81258c1b-f1e0-41e3-bc6d-1f76ae3e3a93\") " pod="openshift-ingress/kube-auth-proxy-b5848dcdb-bjbmm"
Sep 10 04:47:47.276558 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:47.276465    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81258c1b-f1e0-41e3-bc6d-1f76ae3e3a93-tls-certs\") pod \"kube-auth-proxy-b5848dcdb-bjbmm\" (UID: \"81258c1b-f1e0-41e3-bc6d-1f76ae3e3a93\") " pod="openshift-ingress/kube-auth-proxy-b5848dcdb-bjbmm"
Sep 10 04:47:47.276558 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:47.276492    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/81258c1b-f1e0-41e3-bc6d-1f76ae3e3a93-tmp\") pod \"kube-auth-proxy-b5848dcdb-bjbmm\" (UID: \"81258c1b-f1e0-41e3-bc6d-1f76ae3e3a93\") " pod="openshift-ingress/kube-auth-proxy-b5848dcdb-bjbmm"
Sep 10 04:47:47.278746 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:47.278717    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/81258c1b-f1e0-41e3-bc6d-1f76ae3e3a93-tmp\") pod \"kube-auth-proxy-b5848dcdb-bjbmm\" (UID: \"81258c1b-f1e0-41e3-bc6d-1f76ae3e3a93\") " pod="openshift-ingress/kube-auth-proxy-b5848dcdb-bjbmm"
Sep 10 04:47:47.278894 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:47.278876    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81258c1b-f1e0-41e3-bc6d-1f76ae3e3a93-tls-certs\") pod \"kube-auth-proxy-b5848dcdb-bjbmm\" (UID: \"81258c1b-f1e0-41e3-bc6d-1f76ae3e3a93\") " pod="openshift-ingress/kube-auth-proxy-b5848dcdb-bjbmm"
Sep 10 04:47:47.292505 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:47.292456    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q795f\" (UniqueName: \"kubernetes.io/projected/81258c1b-f1e0-41e3-bc6d-1f76ae3e3a93-kube-api-access-q795f\") pod \"kube-auth-proxy-b5848dcdb-bjbmm\" (UID: \"81258c1b-f1e0-41e3-bc6d-1f76ae3e3a93\") " pod="openshift-ingress/kube-auth-proxy-b5848dcdb-bjbmm"
Sep 10 04:47:47.348382 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:47.348361    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-b5848dcdb-bjbmm"
Sep 10 04:47:47.640966 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:47.640940    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-b5848dcdb-bjbmm"]
Sep 10 04:47:47.643524 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:47:47.643497    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81258c1b_f1e0_41e3_bc6d_1f76ae3e3a93.slice/crio-b7f6aaa2135c4b28f0638e345d2fb50e495a9e8b36e45f3351bc466eab07634c WatchSource:0}: Error finding container b7f6aaa2135c4b28f0638e345d2fb50e495a9e8b36e45f3351bc466eab07634c: Status 404 returned error can't find the container with id b7f6aaa2135c4b28f0638e345d2fb50e495a9e8b36e45f3351bc466eab07634c
Sep 10 04:47:48.247614 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:48.247579    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-g488m"]
Sep 10 04:47:48.251318 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:48.251291    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-g488m"
Sep 10 04:47:48.253662 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:48.253590    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 10 04:47:48.253662 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:48.253622    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-kghkv\""
Sep 10 04:47:48.253822 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:48.253745    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 10 04:47:48.253822 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:48.253786    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 10 04:47:48.253959 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:48.253871    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 10 04:47:48.264541 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:48.264235    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-g488m"]
Sep 10 04:47:48.384558 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:48.384503    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5h42m\" (UniqueName: \"kubernetes.io/projected/595bef20-3153-40d2-a8e3-bc8f66739730-kube-api-access-5h42m\") pod \"istiod-openshift-gateway-7b7995d5cd-g488m\" (UID: \"595bef20-3153-40d2-a8e3-bc8f66739730\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-g488m"
Sep 10 04:47:48.384558 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:48.384555    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/595bef20-3153-40d2-a8e3-bc8f66739730-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-g488m\" (UID: \"595bef20-3153-40d2-a8e3-bc8f66739730\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-g488m"
Sep 10 04:47:48.384907 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:48.384581    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/595bef20-3153-40d2-a8e3-bc8f66739730-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-g488m\" (UID: \"595bef20-3153-40d2-a8e3-bc8f66739730\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-g488m"
Sep 10 04:47:48.384907 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:48.384622    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/595bef20-3153-40d2-a8e3-bc8f66739730-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-g488m\" (UID: \"595bef20-3153-40d2-a8e3-bc8f66739730\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-g488m"
Sep 10 04:47:48.384907 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:48.384726    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/595bef20-3153-40d2-a8e3-bc8f66739730-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-g488m\" (UID: \"595bef20-3153-40d2-a8e3-bc8f66739730\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-g488m"
Sep 10 04:47:48.384907 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:48.384798    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/595bef20-3153-40d2-a8e3-bc8f66739730-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-g488m\" (UID: \"595bef20-3153-40d2-a8e3-bc8f66739730\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-g488m"
Sep 10 04:47:48.384907 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:48.384864    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/595bef20-3153-40d2-a8e3-bc8f66739730-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-g488m\" (UID: \"595bef20-3153-40d2-a8e3-bc8f66739730\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-g488m"
Sep 10 04:47:48.485770 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:48.485713    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/595bef20-3153-40d2-a8e3-bc8f66739730-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-g488m\" (UID: \"595bef20-3153-40d2-a8e3-bc8f66739730\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-g488m"
Sep 10 04:47:48.485955 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:48.485782    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/595bef20-3153-40d2-a8e3-bc8f66739730-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-g488m\" (UID: \"595bef20-3153-40d2-a8e3-bc8f66739730\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-g488m"
Sep 10 04:47:48.485955 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:48.485819    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/595bef20-3153-40d2-a8e3-bc8f66739730-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-g488m\" (UID: \"595bef20-3153-40d2-a8e3-bc8f66739730\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-g488m"
Sep 10 04:47:48.485955 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:48.485890    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5h42m\" (UniqueName: \"kubernetes.io/projected/595bef20-3153-40d2-a8e3-bc8f66739730-kube-api-access-5h42m\") pod \"istiod-openshift-gateway-7b7995d5cd-g488m\" (UID: \"595bef20-3153-40d2-a8e3-bc8f66739730\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-g488m"
Sep 10 04:47:48.485955 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:48.485925    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/595bef20-3153-40d2-a8e3-bc8f66739730-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-g488m\" (UID: \"595bef20-3153-40d2-a8e3-bc8f66739730\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-g488m"
Sep 10 04:47:48.486168 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:48.485971    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/595bef20-3153-40d2-a8e3-bc8f66739730-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-g488m\" (UID: \"595bef20-3153-40d2-a8e3-bc8f66739730\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-g488m"
Sep 10 04:47:48.486168 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:48.486012    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/595bef20-3153-40d2-a8e3-bc8f66739730-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-g488m\" (UID: \"595bef20-3153-40d2-a8e3-bc8f66739730\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-g488m"
Sep 10 04:47:48.486823 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:48.486775    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/595bef20-3153-40d2-a8e3-bc8f66739730-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-g488m\" (UID: \"595bef20-3153-40d2-a8e3-bc8f66739730\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-g488m"
Sep 10 04:47:48.488938 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:48.488914    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/595bef20-3153-40d2-a8e3-bc8f66739730-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-g488m\" (UID: \"595bef20-3153-40d2-a8e3-bc8f66739730\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-g488m"
Sep 10 04:47:48.489052 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:48.488977    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/595bef20-3153-40d2-a8e3-bc8f66739730-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-g488m\" (UID: \"595bef20-3153-40d2-a8e3-bc8f66739730\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-g488m"
Sep 10 04:47:48.489197 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:48.489166    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/595bef20-3153-40d2-a8e3-bc8f66739730-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-g488m\" (UID: \"595bef20-3153-40d2-a8e3-bc8f66739730\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-g488m"
Sep 10 04:47:48.489413 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:48.489389    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/595bef20-3153-40d2-a8e3-bc8f66739730-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-g488m\" (UID: \"595bef20-3153-40d2-a8e3-bc8f66739730\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-g488m"
Sep 10 04:47:48.494137 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:48.494110    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5h42m\" (UniqueName: \"kubernetes.io/projected/595bef20-3153-40d2-a8e3-bc8f66739730-kube-api-access-5h42m\") pod \"istiod-openshift-gateway-7b7995d5cd-g488m\" (UID: \"595bef20-3153-40d2-a8e3-bc8f66739730\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-g488m"
Sep 10 04:47:48.494276 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:48.494257    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/595bef20-3153-40d2-a8e3-bc8f66739730-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-g488m\" (UID: \"595bef20-3153-40d2-a8e3-bc8f66739730\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-g488m"
Sep 10 04:47:48.565000 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:48.564919    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-g488m"
Sep 10 04:47:48.591672 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:48.591635    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-b5848dcdb-bjbmm" event={"ID":"81258c1b-f1e0-41e3-bc6d-1f76ae3e3a93","Type":"ContainerStarted","Data":"b7f6aaa2135c4b28f0638e345d2fb50e495a9e8b36e45f3351bc466eab07634c"}
Sep 10 04:47:48.855762 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:48.855726    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-g488m"]
Sep 10 04:47:50.170140 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:47:50.170110    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod595bef20_3153_40d2_a8e3_bc8f66739730.slice/crio-9fe2f732094f1acd7ee3c415683c5486e3e702e627fe515baf159c20a1665c1f WatchSource:0}: Error finding container 9fe2f732094f1acd7ee3c415683c5486e3e702e627fe515baf159c20a1665c1f: Status 404 returned error can't find the container with id 9fe2f732094f1acd7ee3c415683c5486e3e702e627fe515baf159c20a1665c1f
Sep 10 04:47:50.602716 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:50.602625    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-b5848dcdb-bjbmm" event={"ID":"81258c1b-f1e0-41e3-bc6d-1f76ae3e3a93","Type":"ContainerStarted","Data":"ff2e748d31e2df6987185b3cfc1ffec5c2c59f3c90b41d15903e0cb8dff20662"}
Sep 10 04:47:50.603916 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:50.603884    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-g488m" event={"ID":"595bef20-3153-40d2-a8e3-bc8f66739730","Type":"ContainerStarted","Data":"9fe2f732094f1acd7ee3c415683c5486e3e702e627fe515baf159c20a1665c1f"}
Sep 10 04:47:50.618211 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:50.618171    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-b5848dcdb-bjbmm" podStartSLOduration=1.038946079 podStartE2EDuration="3.618158203s" totalImagesPullingTime="2.579212124s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:47:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:47:50.616047958 +0000 UTC m=+410.278505704" watchObservedRunningTime="2026-09-10 04:47:50.618158203 +0000 UTC m=+410.280615982"
Sep 10 04:47:52.406019 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:52.405982    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 04:47:52.406258 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:52.406052    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 04:47:52.615063 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:52.615032    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-g488m" event={"ID":"595bef20-3153-40d2-a8e3-bc8f66739730","Type":"ContainerStarted","Data":"b029a9036a57627384391b4f4d23f7f80d7f405abc1026be96f67f4b32981094"}
Sep 10 04:47:52.615247 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:52.615092    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-g488m"
Sep 10 04:47:52.638432 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:52.638370    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-g488m" podStartSLOduration=2.404910874 podStartE2EDuration="4.638351818s" totalImagesPullingTime="2.233440944s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:47:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:47:52.637635011 +0000 UTC m=+412.300092759" watchObservedRunningTime="2026-09-10 04:47:52.638351818 +0000 UTC m=+412.300809565"
Sep 10 04:47:53.624524 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:53.624488    2560 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-g488m container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 04:47:53.624939 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:53.624559    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-g488m" podUID="595bef20-3153-40d2-a8e3-bc8f66739730" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 04:47:56.623837 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:47:56.623804    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-g488m"
Sep 10 04:48:05.629340 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:05.629280    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-85576d56f4-svxnh" podUID="fedb3822-5912-4cf7-a018-ba2a5a05d29c" containerName="console" containerID="cri-o://47f89af67bff8ee7c39683bd4805b5700e85afa4d83b2b1e0128504fb56321d0" gracePeriod=15
Sep 10 04:48:05.875098 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:05.875075    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85576d56f4-svxnh"
Sep 10 04:48:06.028748 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:06.028676    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fedb3822-5912-4cf7-a018-ba2a5a05d29c-service-ca\") pod \"fedb3822-5912-4cf7-a018-ba2a5a05d29c\" (UID: \"fedb3822-5912-4cf7-a018-ba2a5a05d29c\") "
Sep 10 04:48:06.028748 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:06.028706    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fedb3822-5912-4cf7-a018-ba2a5a05d29c-console-config\") pod \"fedb3822-5912-4cf7-a018-ba2a5a05d29c\" (UID: \"fedb3822-5912-4cf7-a018-ba2a5a05d29c\") "
Sep 10 04:48:06.028748 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:06.028726    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fedb3822-5912-4cf7-a018-ba2a5a05d29c-trusted-ca-bundle\") pod \"fedb3822-5912-4cf7-a018-ba2a5a05d29c\" (UID: \"fedb3822-5912-4cf7-a018-ba2a5a05d29c\") "
Sep 10 04:48:06.029120 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:06.028873    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fedb3822-5912-4cf7-a018-ba2a5a05d29c-console-oauth-config\") pod \"fedb3822-5912-4cf7-a018-ba2a5a05d29c\" (UID: \"fedb3822-5912-4cf7-a018-ba2a5a05d29c\") "
Sep 10 04:48:06.029120 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:06.028920    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fedb3822-5912-4cf7-a018-ba2a5a05d29c-console-serving-cert\") pod \"fedb3822-5912-4cf7-a018-ba2a5a05d29c\" (UID: \"fedb3822-5912-4cf7-a018-ba2a5a05d29c\") "
Sep 10 04:48:06.029120 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:06.028942    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w6br8\" (UniqueName: \"kubernetes.io/projected/fedb3822-5912-4cf7-a018-ba2a5a05d29c-kube-api-access-w6br8\") pod \"fedb3822-5912-4cf7-a018-ba2a5a05d29c\" (UID: \"fedb3822-5912-4cf7-a018-ba2a5a05d29c\") "
Sep 10 04:48:06.029120 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:06.028971    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fedb3822-5912-4cf7-a018-ba2a5a05d29c-oauth-serving-cert\") pod \"fedb3822-5912-4cf7-a018-ba2a5a05d29c\" (UID: \"fedb3822-5912-4cf7-a018-ba2a5a05d29c\") "
Sep 10 04:48:06.029120 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:06.029064    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fedb3822-5912-4cf7-a018-ba2a5a05d29c-service-ca" (OuterVolumeSpecName: "service-ca") pod "fedb3822-5912-4cf7-a018-ba2a5a05d29c" (UID: "fedb3822-5912-4cf7-a018-ba2a5a05d29c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 04:48:06.029357 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:06.029128    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fedb3822-5912-4cf7-a018-ba2a5a05d29c-console-config" (OuterVolumeSpecName: "console-config") pod "fedb3822-5912-4cf7-a018-ba2a5a05d29c" (UID: "fedb3822-5912-4cf7-a018-ba2a5a05d29c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 04:48:06.029357 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:06.029153    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fedb3822-5912-4cf7-a018-ba2a5a05d29c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "fedb3822-5912-4cf7-a018-ba2a5a05d29c" (UID: "fedb3822-5912-4cf7-a018-ba2a5a05d29c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 04:48:06.029454 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:06.029369    2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fedb3822-5912-4cf7-a018-ba2a5a05d29c-service-ca\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:48:06.029454 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:06.029390    2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fedb3822-5912-4cf7-a018-ba2a5a05d29c-console-config\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:48:06.029454 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:06.029405    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fedb3822-5912-4cf7-a018-ba2a5a05d29c-trusted-ca-bundle\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:48:06.029454 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:06.029425    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fedb3822-5912-4cf7-a018-ba2a5a05d29c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "fedb3822-5912-4cf7-a018-ba2a5a05d29c" (UID: "fedb3822-5912-4cf7-a018-ba2a5a05d29c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 04:48:06.030976 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:06.030947    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fedb3822-5912-4cf7-a018-ba2a5a05d29c-kube-api-access-w6br8" (OuterVolumeSpecName: "kube-api-access-w6br8") pod "fedb3822-5912-4cf7-a018-ba2a5a05d29c" (UID: "fedb3822-5912-4cf7-a018-ba2a5a05d29c"). InnerVolumeSpecName "kube-api-access-w6br8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 04:48:06.031348 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:06.031324    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fedb3822-5912-4cf7-a018-ba2a5a05d29c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "fedb3822-5912-4cf7-a018-ba2a5a05d29c" (UID: "fedb3822-5912-4cf7-a018-ba2a5a05d29c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 04:48:06.031348 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:06.031340    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fedb3822-5912-4cf7-a018-ba2a5a05d29c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "fedb3822-5912-4cf7-a018-ba2a5a05d29c" (UID: "fedb3822-5912-4cf7-a018-ba2a5a05d29c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 04:48:06.130535 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:06.130512    2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fedb3822-5912-4cf7-a018-ba2a5a05d29c-console-serving-cert\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:48:06.130535 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:06.130532    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w6br8\" (UniqueName: \"kubernetes.io/projected/fedb3822-5912-4cf7-a018-ba2a5a05d29c-kube-api-access-w6br8\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:48:06.130662 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:06.130542    2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fedb3822-5912-4cf7-a018-ba2a5a05d29c-oauth-serving-cert\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:48:06.130662 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:06.130551    2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fedb3822-5912-4cf7-a018-ba2a5a05d29c-console-oauth-config\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:48:06.684123 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:06.684087    2560 generic.go:356] "Generic (PLEG): container finished" podID="fedb3822-5912-4cf7-a018-ba2a5a05d29c" containerID="47f89af67bff8ee7c39683bd4805b5700e85afa4d83b2b1e0128504fb56321d0" exitCode=0
Sep 10 04:48:06.684503 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:06.684133    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85576d56f4-svxnh"
Sep 10 04:48:06.684503 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:06.684173    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85576d56f4-svxnh" event={"ID":"fedb3822-5912-4cf7-a018-ba2a5a05d29c","Type":"ContainerDied","Data":"47f89af67bff8ee7c39683bd4805b5700e85afa4d83b2b1e0128504fb56321d0"}
Sep 10 04:48:06.684503 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:06.684228    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85576d56f4-svxnh" event={"ID":"fedb3822-5912-4cf7-a018-ba2a5a05d29c","Type":"ContainerDied","Data":"19aef1529ad9bdbd107cd0205af124c9dfcefa3d13edb6c8a2c5a6adab5572d5"}
Sep 10 04:48:06.684503 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:06.684255    2560 scope.go:117] "RemoveContainer" containerID="47f89af67bff8ee7c39683bd4805b5700e85afa4d83b2b1e0128504fb56321d0"
Sep 10 04:48:06.692996 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:06.692979    2560 scope.go:117] "RemoveContainer" containerID="47f89af67bff8ee7c39683bd4805b5700e85afa4d83b2b1e0128504fb56321d0"
Sep 10 04:48:06.693264 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:48:06.693246    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47f89af67bff8ee7c39683bd4805b5700e85afa4d83b2b1e0128504fb56321d0\": container with ID starting with 47f89af67bff8ee7c39683bd4805b5700e85afa4d83b2b1e0128504fb56321d0 not found: ID does not exist" containerID="47f89af67bff8ee7c39683bd4805b5700e85afa4d83b2b1e0128504fb56321d0"
Sep 10 04:48:06.693309 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:06.693272    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47f89af67bff8ee7c39683bd4805b5700e85afa4d83b2b1e0128504fb56321d0"} err="failed to get container status \"47f89af67bff8ee7c39683bd4805b5700e85afa4d83b2b1e0128504fb56321d0\": rpc error: code = NotFound desc = could not find container \"47f89af67bff8ee7c39683bd4805b5700e85afa4d83b2b1e0128504fb56321d0\": container with ID starting with 47f89af67bff8ee7c39683bd4805b5700e85afa4d83b2b1e0128504fb56321d0 not found: ID does not exist"
Sep 10 04:48:06.704734 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:06.704711    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85576d56f4-svxnh"]
Sep 10 04:48:06.706841 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:06.706822    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-85576d56f4-svxnh"]
Sep 10 04:48:06.824031 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:06.824010    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fedb3822-5912-4cf7-a018-ba2a5a05d29c" path="/var/lib/kubelet/pods/fedb3822-5912-4cf7-a018-ba2a5a05d29c/volumes"
Sep 10 04:48:08.205554 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:08.205523    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-dkq9k"]
Sep 10 04:48:08.205923 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:08.205896    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fedb3822-5912-4cf7-a018-ba2a5a05d29c" containerName="console"
Sep 10 04:48:08.205923 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:08.205910    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="fedb3822-5912-4cf7-a018-ba2a5a05d29c" containerName="console"
Sep 10 04:48:08.206004 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:08.205973    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="fedb3822-5912-4cf7-a018-ba2a5a05d29c" containerName="console"
Sep 10 04:48:08.208926 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:08.208911    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dkq9k"
Sep 10 04:48:08.212060 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:08.212037    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-mdplx\""
Sep 10 04:48:08.212168 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:08.212133    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 10 04:48:08.229110 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:08.229090    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-dkq9k"]
Sep 10 04:48:08.233499 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:08.233481    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-6gtvq"]
Sep 10 04:48:08.235517 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:08.235500    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6gtvq"
Sep 10 04:48:08.237947 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:08.237925    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-55g5s\""
Sep 10 04:48:08.238423 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:08.238410    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 10 04:48:08.251524 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:08.251502    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-6gtvq"]
Sep 10 04:48:08.349135 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:08.349096    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhmsh\" (UniqueName: \"kubernetes.io/projected/dfccac4b-ddde-448b-b213-d807b7c99177-kube-api-access-qhmsh\") pod \"llmisvc-controller-manager-777c6bd7d5-6gtvq\" (UID: \"dfccac4b-ddde-448b-b213-d807b7c99177\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6gtvq"
Sep 10 04:48:08.349319 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:08.349147    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6kfj\" (UniqueName: \"kubernetes.io/projected/74acb377-c278-43a1-bcd6-f480b6f2ac7d-kube-api-access-n6kfj\") pod \"kserve-controller-manager-d6f4b65b8-dkq9k\" (UID: \"74acb377-c278-43a1-bcd6-f480b6f2ac7d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dkq9k"
Sep 10 04:48:08.349319 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:08.349224    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/74acb377-c278-43a1-bcd6-f480b6f2ac7d-cert\") pod \"kserve-controller-manager-d6f4b65b8-dkq9k\" (UID: \"74acb377-c278-43a1-bcd6-f480b6f2ac7d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dkq9k"
Sep 10 04:48:08.349319 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:08.349281    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dfccac4b-ddde-448b-b213-d807b7c99177-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-6gtvq\" (UID: \"dfccac4b-ddde-448b-b213-d807b7c99177\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6gtvq"
Sep 10 04:48:08.450389 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:08.450356    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6kfj\" (UniqueName: \"kubernetes.io/projected/74acb377-c278-43a1-bcd6-f480b6f2ac7d-kube-api-access-n6kfj\") pod \"kserve-controller-manager-d6f4b65b8-dkq9k\" (UID: \"74acb377-c278-43a1-bcd6-f480b6f2ac7d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dkq9k"
Sep 10 04:48:08.450559 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:08.450401    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/74acb377-c278-43a1-bcd6-f480b6f2ac7d-cert\") pod \"kserve-controller-manager-d6f4b65b8-dkq9k\" (UID: \"74acb377-c278-43a1-bcd6-f480b6f2ac7d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dkq9k"
Sep 10 04:48:08.450559 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:08.450491    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dfccac4b-ddde-448b-b213-d807b7c99177-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-6gtvq\" (UID: \"dfccac4b-ddde-448b-b213-d807b7c99177\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6gtvq"
Sep 10 04:48:08.450559 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:48:08.450522    2560 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Sep 10 04:48:08.450719 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:48:08.450570    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74acb377-c278-43a1-bcd6-f480b6f2ac7d-cert podName:74acb377-c278-43a1-bcd6-f480b6f2ac7d nodeName:}" failed. No retries permitted until 2026-09-10 04:48:08.950554737 +0000 UTC m=+428.613012462 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/74acb377-c278-43a1-bcd6-f480b6f2ac7d-cert") pod "kserve-controller-manager-d6f4b65b8-dkq9k" (UID: "74acb377-c278-43a1-bcd6-f480b6f2ac7d") : secret "kserve-webhook-server-cert" not found
Sep 10 04:48:08.450719 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:08.450583    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhmsh\" (UniqueName: \"kubernetes.io/projected/dfccac4b-ddde-448b-b213-d807b7c99177-kube-api-access-qhmsh\") pod \"llmisvc-controller-manager-777c6bd7d5-6gtvq\" (UID: \"dfccac4b-ddde-448b-b213-d807b7c99177\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6gtvq"
Sep 10 04:48:08.450719 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:48:08.450605    2560 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Sep 10 04:48:08.450719 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:48:08.450654    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfccac4b-ddde-448b-b213-d807b7c99177-cert podName:dfccac4b-ddde-448b-b213-d807b7c99177 nodeName:}" failed. No retries permitted until 2026-09-10 04:48:08.950638826 +0000 UTC m=+428.613096556 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/dfccac4b-ddde-448b-b213-d807b7c99177-cert") pod "llmisvc-controller-manager-777c6bd7d5-6gtvq" (UID: "dfccac4b-ddde-448b-b213-d807b7c99177") : secret "llmisvc-webhook-server-cert" not found
Sep 10 04:48:08.468597 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:08.468535    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhmsh\" (UniqueName: \"kubernetes.io/projected/dfccac4b-ddde-448b-b213-d807b7c99177-kube-api-access-qhmsh\") pod \"llmisvc-controller-manager-777c6bd7d5-6gtvq\" (UID: \"dfccac4b-ddde-448b-b213-d807b7c99177\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6gtvq"
Sep 10 04:48:08.474321 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:08.474301    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6kfj\" (UniqueName: \"kubernetes.io/projected/74acb377-c278-43a1-bcd6-f480b6f2ac7d-kube-api-access-n6kfj\") pod \"kserve-controller-manager-d6f4b65b8-dkq9k\" (UID: \"74acb377-c278-43a1-bcd6-f480b6f2ac7d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dkq9k"
Sep 10 04:48:08.956290 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:08.956253    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/74acb377-c278-43a1-bcd6-f480b6f2ac7d-cert\") pod \"kserve-controller-manager-d6f4b65b8-dkq9k\" (UID: \"74acb377-c278-43a1-bcd6-f480b6f2ac7d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dkq9k"
Sep 10 04:48:08.956480 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:08.956318    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dfccac4b-ddde-448b-b213-d807b7c99177-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-6gtvq\" (UID: \"dfccac4b-ddde-448b-b213-d807b7c99177\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6gtvq"
Sep 10 04:48:08.958923 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:08.958899    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dfccac4b-ddde-448b-b213-d807b7c99177-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-6gtvq\" (UID: \"dfccac4b-ddde-448b-b213-d807b7c99177\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6gtvq"
Sep 10 04:48:08.959048 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:08.958946    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/74acb377-c278-43a1-bcd6-f480b6f2ac7d-cert\") pod \"kserve-controller-manager-d6f4b65b8-dkq9k\" (UID: \"74acb377-c278-43a1-bcd6-f480b6f2ac7d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dkq9k"
Sep 10 04:48:09.119074 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:09.119039    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dkq9k"
Sep 10 04:48:09.145003 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:09.144975    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6gtvq"
Sep 10 04:48:09.388446 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:09.388423    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-dkq9k"]
Sep 10 04:48:09.390094 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:48:09.390072    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74acb377_c278_43a1_bcd6_f480b6f2ac7d.slice/crio-54d8657ad8c1c94f7c5a1f5b81ec5946f9669ea865f93547136eadb85f0c2ce5 WatchSource:0}: Error finding container 54d8657ad8c1c94f7c5a1f5b81ec5946f9669ea865f93547136eadb85f0c2ce5: Status 404 returned error can't find the container with id 54d8657ad8c1c94f7c5a1f5b81ec5946f9669ea865f93547136eadb85f0c2ce5
Sep 10 04:48:09.419118 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:09.419100    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-6gtvq"]
Sep 10 04:48:09.420890 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:48:09.420867    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poddfccac4b_ddde_448b_b213_d807b7c99177.slice/crio-108a74767569f8abfbf72a10cbdbc743c41aa6be79481044e35774921388989a WatchSource:0}: Error finding container 108a74767569f8abfbf72a10cbdbc743c41aa6be79481044e35774921388989a: Status 404 returned error can't find the container with id 108a74767569f8abfbf72a10cbdbc743c41aa6be79481044e35774921388989a
Sep 10 04:48:09.700276 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:09.700177    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6gtvq" event={"ID":"dfccac4b-ddde-448b-b213-d807b7c99177","Type":"ContainerStarted","Data":"108a74767569f8abfbf72a10cbdbc743c41aa6be79481044e35774921388989a"}
Sep 10 04:48:09.701298 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:09.701278    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dkq9k" event={"ID":"74acb377-c278-43a1-bcd6-f480b6f2ac7d","Type":"ContainerStarted","Data":"54d8657ad8c1c94f7c5a1f5b81ec5946f9669ea865f93547136eadb85f0c2ce5"}
Sep 10 04:48:10.316820 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:10.316787    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-g488m"]
Sep 10 04:48:10.317071 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:10.317027    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-g488m" podUID="595bef20-3153-40d2-a8e3-bc8f66739730" containerName="discovery" containerID="cri-o://b029a9036a57627384391b4f4d23f7f80d7f405abc1026be96f67f4b32981094" gracePeriod=30
Sep 10 04:48:10.707616 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:10.707589    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-g488m"
Sep 10 04:48:10.708652 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:10.708625    2560 generic.go:356] "Generic (PLEG): container finished" podID="595bef20-3153-40d2-a8e3-bc8f66739730" containerID="b029a9036a57627384391b4f4d23f7f80d7f405abc1026be96f67f4b32981094" exitCode=0
Sep 10 04:48:10.708750 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:10.708700    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-g488m" event={"ID":"595bef20-3153-40d2-a8e3-bc8f66739730","Type":"ContainerDied","Data":"b029a9036a57627384391b4f4d23f7f80d7f405abc1026be96f67f4b32981094"}
Sep 10 04:48:10.708809 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:10.708761    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-g488m" event={"ID":"595bef20-3153-40d2-a8e3-bc8f66739730","Type":"ContainerDied","Data":"9fe2f732094f1acd7ee3c415683c5486e3e702e627fe515baf159c20a1665c1f"}
Sep 10 04:48:10.708809 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:10.708789    2560 scope.go:117] "RemoveContainer" containerID="b029a9036a57627384391b4f4d23f7f80d7f405abc1026be96f67f4b32981094"
Sep 10 04:48:10.749276 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:10.749249    2560 scope.go:117] "RemoveContainer" containerID="b029a9036a57627384391b4f4d23f7f80d7f405abc1026be96f67f4b32981094"
Sep 10 04:48:10.749625 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:48:10.749604    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b029a9036a57627384391b4f4d23f7f80d7f405abc1026be96f67f4b32981094\": container with ID starting with b029a9036a57627384391b4f4d23f7f80d7f405abc1026be96f67f4b32981094 not found: ID does not exist" containerID="b029a9036a57627384391b4f4d23f7f80d7f405abc1026be96f67f4b32981094"
Sep 10 04:48:10.749699 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:10.749634    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b029a9036a57627384391b4f4d23f7f80d7f405abc1026be96f67f4b32981094"} err="failed to get container status \"b029a9036a57627384391b4f4d23f7f80d7f405abc1026be96f67f4b32981094\": rpc error: code = NotFound desc = could not find container \"b029a9036a57627384391b4f4d23f7f80d7f405abc1026be96f67f4b32981094\": container with ID starting with b029a9036a57627384391b4f4d23f7f80d7f405abc1026be96f67f4b32981094 not found: ID does not exist"
Sep 10 04:48:10.873866 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:10.873760    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/595bef20-3153-40d2-a8e3-bc8f66739730-cacerts\") pod \"595bef20-3153-40d2-a8e3-bc8f66739730\" (UID: \"595bef20-3153-40d2-a8e3-bc8f66739730\") "
Sep 10 04:48:10.873866 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:10.873825    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/595bef20-3153-40d2-a8e3-bc8f66739730-istio-csr-ca-configmap\") pod \"595bef20-3153-40d2-a8e3-bc8f66739730\" (UID: \"595bef20-3153-40d2-a8e3-bc8f66739730\") "
Sep 10 04:48:10.874056 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:10.873877    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/595bef20-3153-40d2-a8e3-bc8f66739730-local-certs\") pod \"595bef20-3153-40d2-a8e3-bc8f66739730\" (UID: \"595bef20-3153-40d2-a8e3-bc8f66739730\") "
Sep 10 04:48:10.874056 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:10.873931    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/595bef20-3153-40d2-a8e3-bc8f66739730-istio-token\") pod \"595bef20-3153-40d2-a8e3-bc8f66739730\" (UID: \"595bef20-3153-40d2-a8e3-bc8f66739730\") "
Sep 10 04:48:10.874056 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:10.873955    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5h42m\" (UniqueName: \"kubernetes.io/projected/595bef20-3153-40d2-a8e3-bc8f66739730-kube-api-access-5h42m\") pod \"595bef20-3153-40d2-a8e3-bc8f66739730\" (UID: \"595bef20-3153-40d2-a8e3-bc8f66739730\") "
Sep 10 04:48:10.874056 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:10.873986    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/595bef20-3153-40d2-a8e3-bc8f66739730-istio-kubeconfig\") pod \"595bef20-3153-40d2-a8e3-bc8f66739730\" (UID: \"595bef20-3153-40d2-a8e3-bc8f66739730\") "
Sep 10 04:48:10.874056 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:10.874020    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/595bef20-3153-40d2-a8e3-bc8f66739730-istio-csr-dns-cert\") pod \"595bef20-3153-40d2-a8e3-bc8f66739730\" (UID: \"595bef20-3153-40d2-a8e3-bc8f66739730\") "
Sep 10 04:48:10.874999 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:10.874933    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/595bef20-3153-40d2-a8e3-bc8f66739730-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "595bef20-3153-40d2-a8e3-bc8f66739730" (UID: "595bef20-3153-40d2-a8e3-bc8f66739730"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 04:48:10.877193 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:10.877143    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/595bef20-3153-40d2-a8e3-bc8f66739730-cacerts" (OuterVolumeSpecName: "cacerts") pod "595bef20-3153-40d2-a8e3-bc8f66739730" (UID: "595bef20-3153-40d2-a8e3-bc8f66739730"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 04:48:10.877193 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:10.877145    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/595bef20-3153-40d2-a8e3-bc8f66739730-local-certs" (OuterVolumeSpecName: "local-certs") pod "595bef20-3153-40d2-a8e3-bc8f66739730" (UID: "595bef20-3153-40d2-a8e3-bc8f66739730"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 04:48:10.877589 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:10.877412    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/595bef20-3153-40d2-a8e3-bc8f66739730-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "595bef20-3153-40d2-a8e3-bc8f66739730" (UID: "595bef20-3153-40d2-a8e3-bc8f66739730"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 04:48:10.877589 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:10.877424    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/595bef20-3153-40d2-a8e3-bc8f66739730-kube-api-access-5h42m" (OuterVolumeSpecName: "kube-api-access-5h42m") pod "595bef20-3153-40d2-a8e3-bc8f66739730" (UID: "595bef20-3153-40d2-a8e3-bc8f66739730"). InnerVolumeSpecName "kube-api-access-5h42m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 04:48:10.877589 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:10.877509    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/595bef20-3153-40d2-a8e3-bc8f66739730-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "595bef20-3153-40d2-a8e3-bc8f66739730" (UID: "595bef20-3153-40d2-a8e3-bc8f66739730"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 04:48:10.878683 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:10.878650    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/595bef20-3153-40d2-a8e3-bc8f66739730-istio-token" (OuterVolumeSpecName: "istio-token") pod "595bef20-3153-40d2-a8e3-bc8f66739730" (UID: "595bef20-3153-40d2-a8e3-bc8f66739730"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 04:48:10.975282 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:10.975213    2560 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/595bef20-3153-40d2-a8e3-bc8f66739730-istio-csr-dns-cert\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:48:10.975282 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:10.975241    2560 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/595bef20-3153-40d2-a8e3-bc8f66739730-cacerts\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:48:10.975282 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:10.975251    2560 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/595bef20-3153-40d2-a8e3-bc8f66739730-istio-csr-ca-configmap\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:48:10.975282 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:10.975265    2560 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/595bef20-3153-40d2-a8e3-bc8f66739730-local-certs\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:48:10.975282 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:10.975279    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/595bef20-3153-40d2-a8e3-bc8f66739730-istio-token\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:48:10.975592 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:10.975289    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5h42m\" (UniqueName: \"kubernetes.io/projected/595bef20-3153-40d2-a8e3-bc8f66739730-kube-api-access-5h42m\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:48:10.975592 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:10.975297    2560 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/595bef20-3153-40d2-a8e3-bc8f66739730-istio-kubeconfig\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:48:11.715113 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:11.715087    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-g488m"
Sep 10 04:48:11.737379 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:11.737350    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-g488m"]
Sep 10 04:48:11.743761 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:11.743736    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-g488m"]
Sep 10 04:48:12.721489 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:12.721445    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dkq9k" event={"ID":"74acb377-c278-43a1-bcd6-f480b6f2ac7d","Type":"ContainerStarted","Data":"d045dbe28e12e11e206b347195fdf0f5ed8ed47939ceeaa47b5440bb3237284a"}
Sep 10 04:48:12.721984 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:12.721517    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dkq9k"
Sep 10 04:48:12.722978 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:12.722956    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6gtvq" event={"ID":"dfccac4b-ddde-448b-b213-d807b7c99177","Type":"ContainerStarted","Data":"c0d01f895d250c19ac999fac0f254a295128f695cacd18e013a690656019358c"}
Sep 10 04:48:12.723055 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:12.723015    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6gtvq"
Sep 10 04:48:12.739147 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:12.739107    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dkq9k" podStartSLOduration=2.031952461 podStartE2EDuration="4.739093661s" totalImagesPullingTime="2.7071412s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:48:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:48:12.73844081 +0000 UTC m=+432.400898556" watchObservedRunningTime="2026-09-10 04:48:12.739093661 +0000 UTC m=+432.401551408"
Sep 10 04:48:12.754694 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:12.754656    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6gtvq" podStartSLOduration=2.073784535 podStartE2EDuration="4.75464289s" totalImagesPullingTime="2.680858355s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:48:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:48:12.754440247 +0000 UTC m=+432.416897997" watchObservedRunningTime="2026-09-10 04:48:12.75464289 +0000 UTC m=+432.417100637"
Sep 10 04:48:12.824633 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:12.824602    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="595bef20-3153-40d2-a8e3-bc8f66739730" path="/var/lib/kubelet/pods/595bef20-3153-40d2-a8e3-bc8f66739730/volumes"
Sep 10 04:48:43.730432 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:43.730399    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6gtvq"
Sep 10 04:48:43.733478 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:48:43.733458    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dkq9k"
Sep 10 04:49:03.156465 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:03.156434    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adlk6c"]
Sep 10 04:49:03.156879 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:03.156741    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="595bef20-3153-40d2-a8e3-bc8f66739730" containerName="discovery"
Sep 10 04:49:03.156879 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:03.156752    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="595bef20-3153-40d2-a8e3-bc8f66739730" containerName="discovery"
Sep 10 04:49:03.156879 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:03.156814    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="595bef20-3153-40d2-a8e3-bc8f66739730" containerName="discovery"
Sep 10 04:49:03.161264 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:03.161247    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adlk6c"
Sep 10 04:49:03.164112 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:03.164079    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9cccr\""
Sep 10 04:49:03.164232 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:03.164179    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 04:49:03.164774 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:03.164756    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 04:49:03.172359 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:03.172338    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adlk6c"]
Sep 10 04:49:03.256174 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:03.256143    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjhs8c"]
Sep 10 04:49:03.259443 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:03.259427    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjhs8c"
Sep 10 04:49:03.267592 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:03.267552    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/02840772-7101-49fc-ad4d-495fb13bfdc9-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adlk6c\" (UID: \"02840772-7101-49fc-ad4d-495fb13bfdc9\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adlk6c"
Sep 10 04:49:03.267764 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:03.267593    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8wm8\" (UniqueName: \"kubernetes.io/projected/02840772-7101-49fc-ad4d-495fb13bfdc9-kube-api-access-t8wm8\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adlk6c\" (UID: \"02840772-7101-49fc-ad4d-495fb13bfdc9\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adlk6c"
Sep 10 04:49:03.267764 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:03.267699    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/02840772-7101-49fc-ad4d-495fb13bfdc9-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adlk6c\" (UID: \"02840772-7101-49fc-ad4d-495fb13bfdc9\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adlk6c"
Sep 10 04:49:03.268384 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:03.268360    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjhs8c"]
Sep 10 04:49:03.368834 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:03.368809    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/02840772-7101-49fc-ad4d-495fb13bfdc9-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adlk6c\" (UID: \"02840772-7101-49fc-ad4d-495fb13bfdc9\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adlk6c"
Sep 10 04:49:03.368975 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:03.368840    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/10672a7e-c4dc-4d1c-a669-8f9454432c0c-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjhs8c\" (UID: \"10672a7e-c4dc-4d1c-a669-8f9454432c0c\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjhs8c"
Sep 10 04:49:03.368975 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:03.368880    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/10672a7e-c4dc-4d1c-a669-8f9454432c0c-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjhs8c\" (UID: \"10672a7e-c4dc-4d1c-a669-8f9454432c0c\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjhs8c"
Sep 10 04:49:03.368975 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:03.368899    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xs5k6\" (UniqueName: \"kubernetes.io/projected/10672a7e-c4dc-4d1c-a669-8f9454432c0c-kube-api-access-xs5k6\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjhs8c\" (UID: \"10672a7e-c4dc-4d1c-a669-8f9454432c0c\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjhs8c"
Sep 10 04:49:03.368975 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:03.368932    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/02840772-7101-49fc-ad4d-495fb13bfdc9-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adlk6c\" (UID: \"02840772-7101-49fc-ad4d-495fb13bfdc9\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adlk6c"
Sep 10 04:49:03.368975 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:03.368953    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8wm8\" (UniqueName: \"kubernetes.io/projected/02840772-7101-49fc-ad4d-495fb13bfdc9-kube-api-access-t8wm8\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adlk6c\" (UID: \"02840772-7101-49fc-ad4d-495fb13bfdc9\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adlk6c"
Sep 10 04:49:03.369287 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:03.369245    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/02840772-7101-49fc-ad4d-495fb13bfdc9-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adlk6c\" (UID: \"02840772-7101-49fc-ad4d-495fb13bfdc9\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adlk6c"
Sep 10 04:49:03.369287 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:03.369249    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/02840772-7101-49fc-ad4d-495fb13bfdc9-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adlk6c\" (UID: \"02840772-7101-49fc-ad4d-495fb13bfdc9\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adlk6c"
Sep 10 04:49:03.378827 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:03.378807    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8wm8\" (UniqueName: \"kubernetes.io/projected/02840772-7101-49fc-ad4d-495fb13bfdc9-kube-api-access-t8wm8\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adlk6c\" (UID: \"02840772-7101-49fc-ad4d-495fb13bfdc9\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adlk6c"
Sep 10 04:49:03.419560 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:03.419509    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c672rsk"]
Sep 10 04:49:03.422881 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:03.422868    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c672rsk"
Sep 10 04:49:03.432473 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:03.432452    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c672rsk"]
Sep 10 04:49:03.465745 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:03.465724    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qhfcc"]
Sep 10 04:49:03.469029 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:03.469015    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qhfcc"
Sep 10 04:49:03.469361 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:03.469344    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/10672a7e-c4dc-4d1c-a669-8f9454432c0c-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjhs8c\" (UID: \"10672a7e-c4dc-4d1c-a669-8f9454432c0c\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjhs8c"
Sep 10 04:49:03.469443 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:03.469386    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/10672a7e-c4dc-4d1c-a669-8f9454432c0c-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjhs8c\" (UID: \"10672a7e-c4dc-4d1c-a669-8f9454432c0c\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjhs8c"
Sep 10 04:49:03.469443 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:03.469420    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xs5k6\" (UniqueName: \"kubernetes.io/projected/10672a7e-c4dc-4d1c-a669-8f9454432c0c-kube-api-access-xs5k6\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjhs8c\" (UID: \"10672a7e-c4dc-4d1c-a669-8f9454432c0c\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjhs8c"
Sep 10 04:49:03.469612 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:03.469598    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adlk6c"
Sep 10 04:49:03.469702 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:03.469685    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/10672a7e-c4dc-4d1c-a669-8f9454432c0c-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjhs8c\" (UID: \"10672a7e-c4dc-4d1c-a669-8f9454432c0c\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjhs8c"
Sep 10 04:49:03.469767 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:03.469740    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/10672a7e-c4dc-4d1c-a669-8f9454432c0c-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjhs8c\" (UID: \"10672a7e-c4dc-4d1c-a669-8f9454432c0c\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjhs8c"
Sep 10 04:49:03.478665 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:03.477383    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xs5k6\" (UniqueName: \"kubernetes.io/projected/10672a7e-c4dc-4d1c-a669-8f9454432c0c-kube-api-access-xs5k6\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjhs8c\" (UID: \"10672a7e-c4dc-4d1c-a669-8f9454432c0c\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjhs8c"
Sep 10 04:49:03.481965 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:03.481941    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qhfcc"]
Sep 10 04:49:03.569161 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:03.569131    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjhs8c"
Sep 10 04:49:03.570491 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:03.570463    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97vbl\" (UniqueName: \"kubernetes.io/projected/375a3bdd-0886-4370-b1e7-ad6bc3bd658d-kube-api-access-97vbl\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qhfcc\" (UID: \"375a3bdd-0886-4370-b1e7-ad6bc3bd658d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qhfcc"
Sep 10 04:49:03.570593 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:03.570503    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/375a3bdd-0886-4370-b1e7-ad6bc3bd658d-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qhfcc\" (UID: \"375a3bdd-0886-4370-b1e7-ad6bc3bd658d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qhfcc"
Sep 10 04:49:03.570593 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:03.570524    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ea9629ec-d805-4f64-b3d0-50100d699098-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c672rsk\" (UID: \"ea9629ec-d805-4f64-b3d0-50100d699098\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c672rsk"
Sep 10 04:49:03.570720 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:03.570611    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fvbf\" (UniqueName: \"kubernetes.io/projected/ea9629ec-d805-4f64-b3d0-50100d699098-kube-api-access-4fvbf\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c672rsk\" (UID: \"ea9629ec-d805-4f64-b3d0-50100d699098\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c672rsk"
Sep 10 04:49:03.570720 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:03.570664    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/375a3bdd-0886-4370-b1e7-ad6bc3bd658d-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qhfcc\" (UID: \"375a3bdd-0886-4370-b1e7-ad6bc3bd658d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qhfcc"
Sep 10 04:49:03.570804 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:03.570717    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ea9629ec-d805-4f64-b3d0-50100d699098-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c672rsk\" (UID: \"ea9629ec-d805-4f64-b3d0-50100d699098\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c672rsk"
Sep 10 04:49:03.672046 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:03.671984    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ea9629ec-d805-4f64-b3d0-50100d699098-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c672rsk\" (UID: \"ea9629ec-d805-4f64-b3d0-50100d699098\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c672rsk"
Sep 10 04:49:03.672046 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:03.672033    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fvbf\" (UniqueName: \"kubernetes.io/projected/ea9629ec-d805-4f64-b3d0-50100d699098-kube-api-access-4fvbf\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c672rsk\" (UID: \"ea9629ec-d805-4f64-b3d0-50100d699098\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c672rsk"
Sep 10 04:49:03.672210 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:03.672082    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/375a3bdd-0886-4370-b1e7-ad6bc3bd658d-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qhfcc\" (UID: \"375a3bdd-0886-4370-b1e7-ad6bc3bd658d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qhfcc"
Sep 10 04:49:03.672210 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:03.672122    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ea9629ec-d805-4f64-b3d0-50100d699098-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c672rsk\" (UID: \"ea9629ec-d805-4f64-b3d0-50100d699098\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c672rsk"
Sep 10 04:49:03.672210 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:03.672150    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97vbl\" (UniqueName: \"kubernetes.io/projected/375a3bdd-0886-4370-b1e7-ad6bc3bd658d-kube-api-access-97vbl\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qhfcc\" (UID: \"375a3bdd-0886-4370-b1e7-ad6bc3bd658d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qhfcc"
Sep 10 04:49:03.672210 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:03.672182    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/375a3bdd-0886-4370-b1e7-ad6bc3bd658d-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qhfcc\" (UID: \"375a3bdd-0886-4370-b1e7-ad6bc3bd658d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qhfcc"
Sep 10 04:49:03.672416 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:03.672390    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ea9629ec-d805-4f64-b3d0-50100d699098-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c672rsk\" (UID: \"ea9629ec-d805-4f64-b3d0-50100d699098\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c672rsk"
Sep 10 04:49:03.672474 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:03.672412    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ea9629ec-d805-4f64-b3d0-50100d699098-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c672rsk\" (UID: \"ea9629ec-d805-4f64-b3d0-50100d699098\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c672rsk"
Sep 10 04:49:03.672529 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:03.672499    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/375a3bdd-0886-4370-b1e7-ad6bc3bd658d-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qhfcc\" (UID: \"375a3bdd-0886-4370-b1e7-ad6bc3bd658d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qhfcc"
Sep 10 04:49:03.672570 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:03.672534    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/375a3bdd-0886-4370-b1e7-ad6bc3bd658d-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qhfcc\" (UID: \"375a3bdd-0886-4370-b1e7-ad6bc3bd658d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qhfcc"
Sep 10 04:49:03.679526 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:03.679506    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fvbf\" (UniqueName: \"kubernetes.io/projected/ea9629ec-d805-4f64-b3d0-50100d699098-kube-api-access-4fvbf\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c672rsk\" (UID: \"ea9629ec-d805-4f64-b3d0-50100d699098\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c672rsk"
Sep 10 04:49:03.679621 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:03.679554    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-97vbl\" (UniqueName: \"kubernetes.io/projected/375a3bdd-0886-4370-b1e7-ad6bc3bd658d-kube-api-access-97vbl\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qhfcc\" (UID: \"375a3bdd-0886-4370-b1e7-ad6bc3bd658d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qhfcc"
Sep 10 04:49:03.731351 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:03.731332    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c672rsk"
Sep 10 04:49:03.744630 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:03.744612    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adlk6c"]
Sep 10 04:49:03.746240 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:49:03.746204    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02840772_7101_49fc_ad4d_495fb13bfdc9.slice/crio-a9c0380cf22dc45fc17dd2e462d24a639b1f25e01a167494c6c466363ddf7544 WatchSource:0}: Error finding container a9c0380cf22dc45fc17dd2e462d24a639b1f25e01a167494c6c466363ddf7544: Status 404 returned error can't find the container with id a9c0380cf22dc45fc17dd2e462d24a639b1f25e01a167494c6c466363ddf7544
Sep 10 04:49:03.798105 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:03.798079    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qhfcc"
Sep 10 04:49:03.841718 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:03.841649    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjhs8c"]
Sep 10 04:49:03.844219 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:49:03.844193    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10672a7e_c4dc_4d1c_a669_8f9454432c0c.slice/crio-a02cd99f944d5d2ae0553022ef719add18c862d22b3cfc78a6ee5107aa98deb2 WatchSource:0}: Error finding container a02cd99f944d5d2ae0553022ef719add18c862d22b3cfc78a6ee5107aa98deb2: Status 404 returned error can't find the container with id a02cd99f944d5d2ae0553022ef719add18c862d22b3cfc78a6ee5107aa98deb2
Sep 10 04:49:03.967731 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:03.967697    2560 generic.go:356] "Generic (PLEG): container finished" podID="02840772-7101-49fc-ad4d-495fb13bfdc9" containerID="ab7818feacf89900dee2c1abbc994e744caee565b092340957a828dcc3d0cbfa" exitCode=0
Sep 10 04:49:03.967862 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:03.967789    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adlk6c" event={"ID":"02840772-7101-49fc-ad4d-495fb13bfdc9","Type":"ContainerDied","Data":"ab7818feacf89900dee2c1abbc994e744caee565b092340957a828dcc3d0cbfa"}
Sep 10 04:49:03.967939 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:03.967870    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adlk6c" event={"ID":"02840772-7101-49fc-ad4d-495fb13bfdc9","Type":"ContainerStarted","Data":"a9c0380cf22dc45fc17dd2e462d24a639b1f25e01a167494c6c466363ddf7544"}
Sep 10 04:49:03.969641 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:03.969622    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjhs8c" event={"ID":"10672a7e-c4dc-4d1c-a669-8f9454432c0c","Type":"ContainerStarted","Data":"fb06e0b17bb25d21c5aee1833c43783720d1f005cf23b959f595593fdd7fe23a"}
Sep 10 04:49:03.969750 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:03.969657    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjhs8c" event={"ID":"10672a7e-c4dc-4d1c-a669-8f9454432c0c","Type":"ContainerStarted","Data":"a02cd99f944d5d2ae0553022ef719add18c862d22b3cfc78a6ee5107aa98deb2"}
Sep 10 04:49:04.004805 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:04.004783    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c672rsk"]
Sep 10 04:49:04.043555 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:49:04.043532    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea9629ec_d805_4f64_b3d0_50100d699098.slice/crio-def80d814894e10e13180cca00b5d9716ea1410bb998f99c52729b03cf1f84dd WatchSource:0}: Error finding container def80d814894e10e13180cca00b5d9716ea1410bb998f99c52729b03cf1f84dd: Status 404 returned error can't find the container with id def80d814894e10e13180cca00b5d9716ea1410bb998f99c52729b03cf1f84dd
Sep 10 04:49:04.075982 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:04.075946    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qhfcc"]
Sep 10 04:49:04.078514 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:49:04.078254    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod375a3bdd_0886_4370_b1e7_ad6bc3bd658d.slice/crio-989b8e5076f302bc6199e7ec440fa65bd96da591554a0eaee0a9393f5c1fff9e WatchSource:0}: Error finding container 989b8e5076f302bc6199e7ec440fa65bd96da591554a0eaee0a9393f5c1fff9e: Status 404 returned error can't find the container with id 989b8e5076f302bc6199e7ec440fa65bd96da591554a0eaee0a9393f5c1fff9e
Sep 10 04:49:04.976254 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:04.976224    2560 generic.go:356] "Generic (PLEG): container finished" podID="375a3bdd-0886-4370-b1e7-ad6bc3bd658d" containerID="7858f3e6ea0631fbf438fed13069af74ea0fa09ed393a8952c9393f081a10574" exitCode=0
Sep 10 04:49:04.976663 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:04.976306    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qhfcc" event={"ID":"375a3bdd-0886-4370-b1e7-ad6bc3bd658d","Type":"ContainerDied","Data":"7858f3e6ea0631fbf438fed13069af74ea0fa09ed393a8952c9393f081a10574"}
Sep 10 04:49:04.976663 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:04.976364    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qhfcc" event={"ID":"375a3bdd-0886-4370-b1e7-ad6bc3bd658d","Type":"ContainerStarted","Data":"989b8e5076f302bc6199e7ec440fa65bd96da591554a0eaee0a9393f5c1fff9e"}
Sep 10 04:49:04.977939 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:04.977920    2560 generic.go:356] "Generic (PLEG): container finished" podID="10672a7e-c4dc-4d1c-a669-8f9454432c0c" containerID="fb06e0b17bb25d21c5aee1833c43783720d1f005cf23b959f595593fdd7fe23a" exitCode=0
Sep 10 04:49:04.978025 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:04.978001    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjhs8c" event={"ID":"10672a7e-c4dc-4d1c-a669-8f9454432c0c","Type":"ContainerDied","Data":"fb06e0b17bb25d21c5aee1833c43783720d1f005cf23b959f595593fdd7fe23a"}
Sep 10 04:49:04.979595 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:04.979572    2560 generic.go:356] "Generic (PLEG): container finished" podID="ea9629ec-d805-4f64-b3d0-50100d699098" containerID="5ef9fd59289cb273990f03b69f86cca161460b5ea06d4f7082dabd37662a53dd" exitCode=0
Sep 10 04:49:04.979670 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:04.979619    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c672rsk" event={"ID":"ea9629ec-d805-4f64-b3d0-50100d699098","Type":"ContainerDied","Data":"5ef9fd59289cb273990f03b69f86cca161460b5ea06d4f7082dabd37662a53dd"}
Sep 10 04:49:04.979670 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:04.979653    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c672rsk" event={"ID":"ea9629ec-d805-4f64-b3d0-50100d699098","Type":"ContainerStarted","Data":"def80d814894e10e13180cca00b5d9716ea1410bb998f99c52729b03cf1f84dd"}
Sep 10 04:49:05.987077 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:05.987049    2560 generic.go:356] "Generic (PLEG): container finished" podID="10672a7e-c4dc-4d1c-a669-8f9454432c0c" containerID="0c7eb7cdc0174c3e4f4011103a547efb7c29aa218aa2d6b8ef7c87c50b0373fd" exitCode=0
Sep 10 04:49:05.987418 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:05.987130    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjhs8c" event={"ID":"10672a7e-c4dc-4d1c-a669-8f9454432c0c","Type":"ContainerDied","Data":"0c7eb7cdc0174c3e4f4011103a547efb7c29aa218aa2d6b8ef7c87c50b0373fd"}
Sep 10 04:49:05.989177 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:05.989153    2560 generic.go:356] "Generic (PLEG): container finished" podID="375a3bdd-0886-4370-b1e7-ad6bc3bd658d" containerID="a47cbb8f3ca691f28d9fdb1204574fb891bd25d7f0a8cbc65ec4aa8b907b4a36" exitCode=0
Sep 10 04:49:05.989238 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:05.989196    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qhfcc" event={"ID":"375a3bdd-0886-4370-b1e7-ad6bc3bd658d","Type":"ContainerDied","Data":"a47cbb8f3ca691f28d9fdb1204574fb891bd25d7f0a8cbc65ec4aa8b907b4a36"}
Sep 10 04:49:06.997035 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:06.996998    2560 generic.go:356] "Generic (PLEG): container finished" podID="375a3bdd-0886-4370-b1e7-ad6bc3bd658d" containerID="1f17190c0ccef03faddd154e96aedd04dfab0cffb14e43f59553ad3a43cd028f" exitCode=0
Sep 10 04:49:06.997444 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:06.997084    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qhfcc" event={"ID":"375a3bdd-0886-4370-b1e7-ad6bc3bd658d","Type":"ContainerDied","Data":"1f17190c0ccef03faddd154e96aedd04dfab0cffb14e43f59553ad3a43cd028f"}
Sep 10 04:49:06.999182 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:06.999161    2560 generic.go:356] "Generic (PLEG): container finished" podID="10672a7e-c4dc-4d1c-a669-8f9454432c0c" containerID="7428ed8a956ac206ec9b92be5d3565a78a123d399a6728a3e267e3296a5a379b" exitCode=0
Sep 10 04:49:06.999275 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:06.999244    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjhs8c" event={"ID":"10672a7e-c4dc-4d1c-a669-8f9454432c0c","Type":"ContainerDied","Data":"7428ed8a956ac206ec9b92be5d3565a78a123d399a6728a3e267e3296a5a379b"}
Sep 10 04:49:07.001099 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:07.001075    2560 generic.go:356] "Generic (PLEG): container finished" podID="ea9629ec-d805-4f64-b3d0-50100d699098" containerID="5b74db717c312ced401cc1707305368e05fd77de4edccc07b7f5b92a026159e9" exitCode=0
Sep 10 04:49:07.001191 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:07.001109    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c672rsk" event={"ID":"ea9629ec-d805-4f64-b3d0-50100d699098","Type":"ContainerDied","Data":"5b74db717c312ced401cc1707305368e05fd77de4edccc07b7f5b92a026159e9"}
Sep 10 04:49:08.009636 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:08.009602    2560 generic.go:356] "Generic (PLEG): container finished" podID="ea9629ec-d805-4f64-b3d0-50100d699098" containerID="9a69e76ab739b051950a755cec6b15f4aa63c297fc0bd5bafa7f7d7878e3c288" exitCode=0
Sep 10 04:49:08.010006 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:08.009680    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c672rsk" event={"ID":"ea9629ec-d805-4f64-b3d0-50100d699098","Type":"ContainerDied","Data":"9a69e76ab739b051950a755cec6b15f4aa63c297fc0bd5bafa7f7d7878e3c288"}
Sep 10 04:49:08.148004 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:08.147983    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjhs8c"
Sep 10 04:49:08.151066 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:08.151047    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qhfcc"
Sep 10 04:49:08.304968 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:08.304891    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/10672a7e-c4dc-4d1c-a669-8f9454432c0c-bundle\") pod \"10672a7e-c4dc-4d1c-a669-8f9454432c0c\" (UID: \"10672a7e-c4dc-4d1c-a669-8f9454432c0c\") "
Sep 10 04:49:08.304968 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:08.304928    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/375a3bdd-0886-4370-b1e7-ad6bc3bd658d-bundle\") pod \"375a3bdd-0886-4370-b1e7-ad6bc3bd658d\" (UID: \"375a3bdd-0886-4370-b1e7-ad6bc3bd658d\") "
Sep 10 04:49:08.305161 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:08.304987    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xs5k6\" (UniqueName: \"kubernetes.io/projected/10672a7e-c4dc-4d1c-a669-8f9454432c0c-kube-api-access-xs5k6\") pod \"10672a7e-c4dc-4d1c-a669-8f9454432c0c\" (UID: \"10672a7e-c4dc-4d1c-a669-8f9454432c0c\") "
Sep 10 04:49:08.305161 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:08.305018    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/375a3bdd-0886-4370-b1e7-ad6bc3bd658d-util\") pod \"375a3bdd-0886-4370-b1e7-ad6bc3bd658d\" (UID: \"375a3bdd-0886-4370-b1e7-ad6bc3bd658d\") "
Sep 10 04:49:08.305161 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:08.305053    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/10672a7e-c4dc-4d1c-a669-8f9454432c0c-util\") pod \"10672a7e-c4dc-4d1c-a669-8f9454432c0c\" (UID: \"10672a7e-c4dc-4d1c-a669-8f9454432c0c\") "
Sep 10 04:49:08.305161 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:08.305086    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-97vbl\" (UniqueName: \"kubernetes.io/projected/375a3bdd-0886-4370-b1e7-ad6bc3bd658d-kube-api-access-97vbl\") pod \"375a3bdd-0886-4370-b1e7-ad6bc3bd658d\" (UID: \"375a3bdd-0886-4370-b1e7-ad6bc3bd658d\") "
Sep 10 04:49:08.305581 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:08.305534    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10672a7e-c4dc-4d1c-a669-8f9454432c0c-bundle" (OuterVolumeSpecName: "bundle") pod "10672a7e-c4dc-4d1c-a669-8f9454432c0c" (UID: "10672a7e-c4dc-4d1c-a669-8f9454432c0c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 04:49:08.305581 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:08.305548    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/375a3bdd-0886-4370-b1e7-ad6bc3bd658d-bundle" (OuterVolumeSpecName: "bundle") pod "375a3bdd-0886-4370-b1e7-ad6bc3bd658d" (UID: "375a3bdd-0886-4370-b1e7-ad6bc3bd658d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 04:49:08.307159 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:08.307135    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10672a7e-c4dc-4d1c-a669-8f9454432c0c-kube-api-access-xs5k6" (OuterVolumeSpecName: "kube-api-access-xs5k6") pod "10672a7e-c4dc-4d1c-a669-8f9454432c0c" (UID: "10672a7e-c4dc-4d1c-a669-8f9454432c0c"). InnerVolumeSpecName "kube-api-access-xs5k6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 04:49:08.307581 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:08.307557    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/375a3bdd-0886-4370-b1e7-ad6bc3bd658d-kube-api-access-97vbl" (OuterVolumeSpecName: "kube-api-access-97vbl") pod "375a3bdd-0886-4370-b1e7-ad6bc3bd658d" (UID: "375a3bdd-0886-4370-b1e7-ad6bc3bd658d"). InnerVolumeSpecName "kube-api-access-97vbl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 04:49:08.311191 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:08.311155    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10672a7e-c4dc-4d1c-a669-8f9454432c0c-util" (OuterVolumeSpecName: "util") pod "10672a7e-c4dc-4d1c-a669-8f9454432c0c" (UID: "10672a7e-c4dc-4d1c-a669-8f9454432c0c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 04:49:08.311664 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:08.311642    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/375a3bdd-0886-4370-b1e7-ad6bc3bd658d-util" (OuterVolumeSpecName: "util") pod "375a3bdd-0886-4370-b1e7-ad6bc3bd658d" (UID: "375a3bdd-0886-4370-b1e7-ad6bc3bd658d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 04:49:08.406165 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:08.406138    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/10672a7e-c4dc-4d1c-a669-8f9454432c0c-bundle\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:49:08.406165 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:08.406163    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/375a3bdd-0886-4370-b1e7-ad6bc3bd658d-bundle\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:49:08.406332 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:08.406172    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xs5k6\" (UniqueName: \"kubernetes.io/projected/10672a7e-c4dc-4d1c-a669-8f9454432c0c-kube-api-access-xs5k6\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:49:08.406332 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:08.406183    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/375a3bdd-0886-4370-b1e7-ad6bc3bd658d-util\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:49:08.406332 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:08.406191    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/10672a7e-c4dc-4d1c-a669-8f9454432c0c-util\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:49:08.406332 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:08.406199    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-97vbl\" (UniqueName: \"kubernetes.io/projected/375a3bdd-0886-4370-b1e7-ad6bc3bd658d-kube-api-access-97vbl\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:49:09.016013 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:09.015980    2560 generic.go:356] "Generic (PLEG): container finished" podID="02840772-7101-49fc-ad4d-495fb13bfdc9" containerID="15f0032089b911a6bb41a024a64001caea4dd2989ee2e05aec59ab4e6e43cb2c" exitCode=0
Sep 10 04:49:09.016013 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:09.016015    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adlk6c" event={"ID":"02840772-7101-49fc-ad4d-495fb13bfdc9","Type":"ContainerDied","Data":"15f0032089b911a6bb41a024a64001caea4dd2989ee2e05aec59ab4e6e43cb2c"}
Sep 10 04:49:09.018212 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:09.018194    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjhs8c"
Sep 10 04:49:09.018314 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:09.018218    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cjhs8c" event={"ID":"10672a7e-c4dc-4d1c-a669-8f9454432c0c","Type":"ContainerDied","Data":"a02cd99f944d5d2ae0553022ef719add18c862d22b3cfc78a6ee5107aa98deb2"}
Sep 10 04:49:09.018314 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:09.018265    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a02cd99f944d5d2ae0553022ef719add18c862d22b3cfc78a6ee5107aa98deb2"
Sep 10 04:49:09.020386 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:09.020365    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qhfcc"
Sep 10 04:49:09.020479 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:09.020380    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qhfcc" event={"ID":"375a3bdd-0886-4370-b1e7-ad6bc3bd658d","Type":"ContainerDied","Data":"989b8e5076f302bc6199e7ec440fa65bd96da591554a0eaee0a9393f5c1fff9e"}
Sep 10 04:49:09.020479 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:09.020429    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="989b8e5076f302bc6199e7ec440fa65bd96da591554a0eaee0a9393f5c1fff9e"
Sep 10 04:49:09.154049 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:09.154028    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c672rsk"
Sep 10 04:49:09.313934 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:09.313907    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ea9629ec-d805-4f64-b3d0-50100d699098-util\") pod \"ea9629ec-d805-4f64-b3d0-50100d699098\" (UID: \"ea9629ec-d805-4f64-b3d0-50100d699098\") "
Sep 10 04:49:09.314054 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:09.313985    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ea9629ec-d805-4f64-b3d0-50100d699098-bundle\") pod \"ea9629ec-d805-4f64-b3d0-50100d699098\" (UID: \"ea9629ec-d805-4f64-b3d0-50100d699098\") "
Sep 10 04:49:09.314054 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:09.314014    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4fvbf\" (UniqueName: \"kubernetes.io/projected/ea9629ec-d805-4f64-b3d0-50100d699098-kube-api-access-4fvbf\") pod \"ea9629ec-d805-4f64-b3d0-50100d699098\" (UID: \"ea9629ec-d805-4f64-b3d0-50100d699098\") "
Sep 10 04:49:09.314395 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:09.314366    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea9629ec-d805-4f64-b3d0-50100d699098-bundle" (OuterVolumeSpecName: "bundle") pod "ea9629ec-d805-4f64-b3d0-50100d699098" (UID: "ea9629ec-d805-4f64-b3d0-50100d699098"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 04:49:09.316021 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:09.316000    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea9629ec-d805-4f64-b3d0-50100d699098-kube-api-access-4fvbf" (OuterVolumeSpecName: "kube-api-access-4fvbf") pod "ea9629ec-d805-4f64-b3d0-50100d699098" (UID: "ea9629ec-d805-4f64-b3d0-50100d699098"). InnerVolumeSpecName "kube-api-access-4fvbf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 04:49:09.415146 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:09.415089    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ea9629ec-d805-4f64-b3d0-50100d699098-bundle\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:49:09.415146 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:09.415112    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4fvbf\" (UniqueName: \"kubernetes.io/projected/ea9629ec-d805-4f64-b3d0-50100d699098-kube-api-access-4fvbf\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:49:09.509560 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:09.509528    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea9629ec-d805-4f64-b3d0-50100d699098-util" (OuterVolumeSpecName: "util") pod "ea9629ec-d805-4f64-b3d0-50100d699098" (UID: "ea9629ec-d805-4f64-b3d0-50100d699098"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 04:49:09.515601 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:09.515581    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ea9629ec-d805-4f64-b3d0-50100d699098-util\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:49:10.027670 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:10.027621    2560 generic.go:356] "Generic (PLEG): container finished" podID="02840772-7101-49fc-ad4d-495fb13bfdc9" containerID="504a60774066d563690b050065a9dba55302e0554002762f016b88ca0ad33d8c" exitCode=0
Sep 10 04:49:10.028094 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:10.027705    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adlk6c" event={"ID":"02840772-7101-49fc-ad4d-495fb13bfdc9","Type":"ContainerDied","Data":"504a60774066d563690b050065a9dba55302e0554002762f016b88ca0ad33d8c"}
Sep 10 04:49:10.029639 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:10.029618    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c672rsk" event={"ID":"ea9629ec-d805-4f64-b3d0-50100d699098","Type":"ContainerDied","Data":"def80d814894e10e13180cca00b5d9716ea1410bb998f99c52729b03cf1f84dd"}
Sep 10 04:49:10.029752 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:10.029641    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c672rsk"
Sep 10 04:49:10.029752 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:10.029650    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="def80d814894e10e13180cca00b5d9716ea1410bb998f99c52729b03cf1f84dd"
Sep 10 04:49:11.156011 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:11.155987    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adlk6c"
Sep 10 04:49:11.330709 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:11.330631    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/02840772-7101-49fc-ad4d-495fb13bfdc9-util\") pod \"02840772-7101-49fc-ad4d-495fb13bfdc9\" (UID: \"02840772-7101-49fc-ad4d-495fb13bfdc9\") "
Sep 10 04:49:11.330709 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:11.330690    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/02840772-7101-49fc-ad4d-495fb13bfdc9-bundle\") pod \"02840772-7101-49fc-ad4d-495fb13bfdc9\" (UID: \"02840772-7101-49fc-ad4d-495fb13bfdc9\") "
Sep 10 04:49:11.330909 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:11.330729    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t8wm8\" (UniqueName: \"kubernetes.io/projected/02840772-7101-49fc-ad4d-495fb13bfdc9-kube-api-access-t8wm8\") pod \"02840772-7101-49fc-ad4d-495fb13bfdc9\" (UID: \"02840772-7101-49fc-ad4d-495fb13bfdc9\") "
Sep 10 04:49:11.331495 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:11.331469    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02840772-7101-49fc-ad4d-495fb13bfdc9-bundle" (OuterVolumeSpecName: "bundle") pod "02840772-7101-49fc-ad4d-495fb13bfdc9" (UID: "02840772-7101-49fc-ad4d-495fb13bfdc9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 04:49:11.332818 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:11.332793    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02840772-7101-49fc-ad4d-495fb13bfdc9-kube-api-access-t8wm8" (OuterVolumeSpecName: "kube-api-access-t8wm8") pod "02840772-7101-49fc-ad4d-495fb13bfdc9" (UID: "02840772-7101-49fc-ad4d-495fb13bfdc9"). InnerVolumeSpecName "kube-api-access-t8wm8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 04:49:11.335561 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:11.335534    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02840772-7101-49fc-ad4d-495fb13bfdc9-util" (OuterVolumeSpecName: "util") pod "02840772-7101-49fc-ad4d-495fb13bfdc9" (UID: "02840772-7101-49fc-ad4d-495fb13bfdc9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 04:49:11.431409 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:11.431382    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t8wm8\" (UniqueName: \"kubernetes.io/projected/02840772-7101-49fc-ad4d-495fb13bfdc9-kube-api-access-t8wm8\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:49:11.431409 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:11.431406    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/02840772-7101-49fc-ad4d-495fb13bfdc9-util\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:49:11.431559 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:11.431417    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/02840772-7101-49fc-ad4d-495fb13bfdc9-bundle\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:49:12.042368 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:12.042339    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adlk6c"
Sep 10 04:49:12.042531 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:12.042374    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adlk6c" event={"ID":"02840772-7101-49fc-ad4d-495fb13bfdc9","Type":"ContainerDied","Data":"a9c0380cf22dc45fc17dd2e462d24a639b1f25e01a167494c6c466363ddf7544"}
Sep 10 04:49:12.042531 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:12.042411    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a9c0380cf22dc45fc17dd2e462d24a639b1f25e01a167494c6c466363ddf7544"
Sep 10 04:49:16.948156 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:16.948125    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-7ngfc"]
Sep 10 04:49:16.948581 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:16.948423    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10672a7e-c4dc-4d1c-a669-8f9454432c0c" containerName="util"
Sep 10 04:49:16.948581 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:16.948433    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="10672a7e-c4dc-4d1c-a669-8f9454432c0c" containerName="util"
Sep 10 04:49:16.948581 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:16.948443    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea9629ec-d805-4f64-b3d0-50100d699098" containerName="pull"
Sep 10 04:49:16.948581 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:16.948449    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea9629ec-d805-4f64-b3d0-50100d699098" containerName="pull"
Sep 10 04:49:16.948581 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:16.948456    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02840772-7101-49fc-ad4d-495fb13bfdc9" containerName="extract"
Sep 10 04:49:16.948581 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:16.948461    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="02840772-7101-49fc-ad4d-495fb13bfdc9" containerName="extract"
Sep 10 04:49:16.948581 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:16.948472    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="375a3bdd-0886-4370-b1e7-ad6bc3bd658d" containerName="util"
Sep 10 04:49:16.948581 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:16.948476    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="375a3bdd-0886-4370-b1e7-ad6bc3bd658d" containerName="util"
Sep 10 04:49:16.948581 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:16.948482    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea9629ec-d805-4f64-b3d0-50100d699098" containerName="extract"
Sep 10 04:49:16.948581 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:16.948487    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea9629ec-d805-4f64-b3d0-50100d699098" containerName="extract"
Sep 10 04:49:16.948581 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:16.948494    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="375a3bdd-0886-4370-b1e7-ad6bc3bd658d" containerName="extract"
Sep 10 04:49:16.948581 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:16.948498    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="375a3bdd-0886-4370-b1e7-ad6bc3bd658d" containerName="extract"
Sep 10 04:49:16.948581 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:16.948505    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02840772-7101-49fc-ad4d-495fb13bfdc9" containerName="pull"
Sep 10 04:49:16.948581 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:16.948510    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="02840772-7101-49fc-ad4d-495fb13bfdc9" containerName="pull"
Sep 10 04:49:16.948581 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:16.948517    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea9629ec-d805-4f64-b3d0-50100d699098" containerName="util"
Sep 10 04:49:16.948581 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:16.948522    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea9629ec-d805-4f64-b3d0-50100d699098" containerName="util"
Sep 10 04:49:16.948581 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:16.948527    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10672a7e-c4dc-4d1c-a669-8f9454432c0c" containerName="extract"
Sep 10 04:49:16.948581 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:16.948532    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="10672a7e-c4dc-4d1c-a669-8f9454432c0c" containerName="extract"
Sep 10 04:49:16.948581 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:16.948541    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="375a3bdd-0886-4370-b1e7-ad6bc3bd658d" containerName="pull"
Sep 10 04:49:16.948581 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:16.948546    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="375a3bdd-0886-4370-b1e7-ad6bc3bd658d" containerName="pull"
Sep 10 04:49:16.948581 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:16.948559    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02840772-7101-49fc-ad4d-495fb13bfdc9" containerName="util"
Sep 10 04:49:16.948581 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:16.948563    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="02840772-7101-49fc-ad4d-495fb13bfdc9" containerName="util"
Sep 10 04:49:16.948581 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:16.948568    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10672a7e-c4dc-4d1c-a669-8f9454432c0c" containerName="pull"
Sep 10 04:49:16.948581 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:16.948573    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="10672a7e-c4dc-4d1c-a669-8f9454432c0c" containerName="pull"
Sep 10 04:49:16.949283 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:16.948619    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="10672a7e-c4dc-4d1c-a669-8f9454432c0c" containerName="extract"
Sep 10 04:49:16.949283 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:16.948627    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="02840772-7101-49fc-ad4d-495fb13bfdc9" containerName="extract"
Sep 10 04:49:16.949283 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:16.948632    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="375a3bdd-0886-4370-b1e7-ad6bc3bd658d" containerName="extract"
Sep 10 04:49:16.949283 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:16.948638    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea9629ec-d805-4f64-b3d0-50100d699098" containerName="extract"
Sep 10 04:49:16.951149 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:16.951132    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-7ngfc"
Sep 10 04:49:16.953350 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:16.953329    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 10 04:49:16.953516 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:16.953497    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 10 04:49:16.953571 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:16.953534    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-49qrn\""
Sep 10 04:49:16.963327 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:16.963306    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-7ngfc"]
Sep 10 04:49:17.070075 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:17.070039    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msthw\" (UniqueName: \"kubernetes.io/projected/1c878856-9baa-43f0-b4b1-41d7a6a94c0f-kube-api-access-msthw\") pod \"authorino-operator-76b478bd78-7ngfc\" (UID: \"1c878856-9baa-43f0-b4b1-41d7a6a94c0f\") " pod="kuadrant-system/authorino-operator-76b478bd78-7ngfc"
Sep 10 04:49:17.170491 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:17.170451    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msthw\" (UniqueName: \"kubernetes.io/projected/1c878856-9baa-43f0-b4b1-41d7a6a94c0f-kube-api-access-msthw\") pod \"authorino-operator-76b478bd78-7ngfc\" (UID: \"1c878856-9baa-43f0-b4b1-41d7a6a94c0f\") " pod="kuadrant-system/authorino-operator-76b478bd78-7ngfc"
Sep 10 04:49:17.178618 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:17.178595    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-msthw\" (UniqueName: \"kubernetes.io/projected/1c878856-9baa-43f0-b4b1-41d7a6a94c0f-kube-api-access-msthw\") pod \"authorino-operator-76b478bd78-7ngfc\" (UID: \"1c878856-9baa-43f0-b4b1-41d7a6a94c0f\") " pod="kuadrant-system/authorino-operator-76b478bd78-7ngfc"
Sep 10 04:49:17.261437 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:17.261358    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-7ngfc"
Sep 10 04:49:17.536030 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:17.536005    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-7ngfc"]
Sep 10 04:49:17.537694 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:49:17.537671    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c878856_9baa_43f0_b4b1_41d7a6a94c0f.slice/crio-2392d4f3c86214b8d5dfdb9ea4658273a2f5642a9206275ecdec0c82b1891e2c WatchSource:0}: Error finding container 2392d4f3c86214b8d5dfdb9ea4658273a2f5642a9206275ecdec0c82b1891e2c: Status 404 returned error can't find the container with id 2392d4f3c86214b8d5dfdb9ea4658273a2f5642a9206275ecdec0c82b1891e2c
Sep 10 04:49:18.075864 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:18.075815    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-7ngfc" event={"ID":"1c878856-9baa-43f0-b4b1-41d7a6a94c0f","Type":"ContainerStarted","Data":"2392d4f3c86214b8d5dfdb9ea4658273a2f5642a9206275ecdec0c82b1891e2c"}
Sep 10 04:49:19.153262 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:19.153229    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-fpjhq"]
Sep 10 04:49:19.157877 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:19.157843    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-fpjhq"
Sep 10 04:49:19.160083 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:19.160057    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 10 04:49:19.160201 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:19.160109    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-wqd74\""
Sep 10 04:49:19.168453 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:19.168427    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-fpjhq"]
Sep 10 04:49:19.287555 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:19.287508    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rv4dw\" (UniqueName: \"kubernetes.io/projected/211d18a3-f851-4561-9ffa-3a66d5ec0c01-kube-api-access-rv4dw\") pod \"dns-operator-controller-manager-7b84cd7c9c-fpjhq\" (UID: \"211d18a3-f851-4561-9ffa-3a66d5ec0c01\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-fpjhq"
Sep 10 04:49:19.388913 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:19.388876    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rv4dw\" (UniqueName: \"kubernetes.io/projected/211d18a3-f851-4561-9ffa-3a66d5ec0c01-kube-api-access-rv4dw\") pod \"dns-operator-controller-manager-7b84cd7c9c-fpjhq\" (UID: \"211d18a3-f851-4561-9ffa-3a66d5ec0c01\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-fpjhq"
Sep 10 04:49:19.400091 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:19.400059    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rv4dw\" (UniqueName: \"kubernetes.io/projected/211d18a3-f851-4561-9ffa-3a66d5ec0c01-kube-api-access-rv4dw\") pod \"dns-operator-controller-manager-7b84cd7c9c-fpjhq\" (UID: \"211d18a3-f851-4561-9ffa-3a66d5ec0c01\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-fpjhq"
Sep 10 04:49:19.471275 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:19.471201    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-fpjhq"
Sep 10 04:49:20.089114 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:20.089032    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-7ngfc" event={"ID":"1c878856-9baa-43f0-b4b1-41d7a6a94c0f","Type":"ContainerStarted","Data":"24617e3857920b5cdfffc32429a51afc9b082fd5912cea689da3a971332d13e7"}
Sep 10 04:49:20.089114 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:20.089096    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-7ngfc"
Sep 10 04:49:20.092778 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:20.092756    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-fpjhq"]
Sep 10 04:49:20.094451 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:49:20.094425    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod211d18a3_f851_4561_9ffa_3a66d5ec0c01.slice/crio-ad54d6ca73be3ca985add375f2596c6ae60445aacf0d52d56d94ad25e7eae514 WatchSource:0}: Error finding container ad54d6ca73be3ca985add375f2596c6ae60445aacf0d52d56d94ad25e7eae514: Status 404 returned error can't find the container with id ad54d6ca73be3ca985add375f2596c6ae60445aacf0d52d56d94ad25e7eae514
Sep 10 04:49:20.110682 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:20.110636    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-7ngfc" podStartSLOduration=1.7497505740000001 podStartE2EDuration="4.110621279s" totalImagesPullingTime="2.360870705s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:49:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:49:20.110081548 +0000 UTC m=+499.772539286" watchObservedRunningTime="2026-09-10 04:49:20.110621279 +0000 UTC m=+499.773079025"
Sep 10 04:49:21.096602 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:21.096557    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-fpjhq" event={"ID":"211d18a3-f851-4561-9ffa-3a66d5ec0c01","Type":"ContainerStarted","Data":"ad54d6ca73be3ca985add375f2596c6ae60445aacf0d52d56d94ad25e7eae514"}
Sep 10 04:49:22.103563 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:22.103474    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-fpjhq" event={"ID":"211d18a3-f851-4561-9ffa-3a66d5ec0c01","Type":"ContainerStarted","Data":"480553b2c7101f12f52df868c4bdfb9ee902a653eeeacf96870bf622a9625f59"}
Sep 10 04:49:22.103563 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:22.103538    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-fpjhq"
Sep 10 04:49:22.121877 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:22.121819    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-fpjhq" podStartSLOduration=1.459803808 podStartE2EDuration="3.121804617s" totalImagesPullingTime="1.662000809s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:49:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:49:22.119487968 +0000 UTC m=+501.781945716" watchObservedRunningTime="2026-09-10 04:49:22.121804617 +0000 UTC m=+501.784262364"
Sep 10 04:49:23.671082 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:23.671047    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-b2lcr"]
Sep 10 04:49:23.673276 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:23.673260    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-b2lcr"
Sep 10 04:49:23.675694 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:23.675673    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-4cwpk\""
Sep 10 04:49:23.694093 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:23.694071    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-b2lcr"]
Sep 10 04:49:23.823023 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:23.822995    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wch2\" (UniqueName: \"kubernetes.io/projected/7c65dd1e-8a7e-4bb5-913e-6c3f40ae3e68-kube-api-access-5wch2\") pod \"kuadrant-operator-controller-manager-76f8f686bf-b2lcr\" (UID: \"7c65dd1e-8a7e-4bb5-913e-6c3f40ae3e68\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-b2lcr"
Sep 10 04:49:23.823154 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:23.823050    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7c65dd1e-8a7e-4bb5-913e-6c3f40ae3e68-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-b2lcr\" (UID: \"7c65dd1e-8a7e-4bb5-913e-6c3f40ae3e68\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-b2lcr"
Sep 10 04:49:23.923655 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:23.923597    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wch2\" (UniqueName: \"kubernetes.io/projected/7c65dd1e-8a7e-4bb5-913e-6c3f40ae3e68-kube-api-access-5wch2\") pod \"kuadrant-operator-controller-manager-76f8f686bf-b2lcr\" (UID: \"7c65dd1e-8a7e-4bb5-913e-6c3f40ae3e68\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-b2lcr"
Sep 10 04:49:23.923655 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:23.923638    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7c65dd1e-8a7e-4bb5-913e-6c3f40ae3e68-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-b2lcr\" (UID: \"7c65dd1e-8a7e-4bb5-913e-6c3f40ae3e68\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-b2lcr"
Sep 10 04:49:23.923990 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:23.923972    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7c65dd1e-8a7e-4bb5-913e-6c3f40ae3e68-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-b2lcr\" (UID: \"7c65dd1e-8a7e-4bb5-913e-6c3f40ae3e68\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-b2lcr"
Sep 10 04:49:23.944969 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:23.944944    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wch2\" (UniqueName: \"kubernetes.io/projected/7c65dd1e-8a7e-4bb5-913e-6c3f40ae3e68-kube-api-access-5wch2\") pod \"kuadrant-operator-controller-manager-76f8f686bf-b2lcr\" (UID: \"7c65dd1e-8a7e-4bb5-913e-6c3f40ae3e68\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-b2lcr"
Sep 10 04:49:23.982765 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:23.982735    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-b2lcr"
Sep 10 04:49:24.257005 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:24.256981    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-b2lcr"]
Sep 10 04:49:24.258007 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:49:24.257983    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c65dd1e_8a7e_4bb5_913e_6c3f40ae3e68.slice/crio-5fb3838ba401d5ce26c927985484d15695862629ce21f69d86541cb1dfb46e8b WatchSource:0}: Error finding container 5fb3838ba401d5ce26c927985484d15695862629ce21f69d86541cb1dfb46e8b: Status 404 returned error can't find the container with id 5fb3838ba401d5ce26c927985484d15695862629ce21f69d86541cb1dfb46e8b
Sep 10 04:49:25.121651 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:25.121616    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-b2lcr" event={"ID":"7c65dd1e-8a7e-4bb5-913e-6c3f40ae3e68","Type":"ContainerStarted","Data":"5fb3838ba401d5ce26c927985484d15695862629ce21f69d86541cb1dfb46e8b"}
Sep 10 04:49:25.559313 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:25.559226    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-xkmsw"]
Sep 10 04:49:25.563061 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:25.563036    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xkmsw"
Sep 10 04:49:25.566303 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:25.566277    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-s6f68\""
Sep 10 04:49:25.601636 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:25.601613    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-xkmsw"]
Sep 10 04:49:25.739989 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:25.739946    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvkc2\" (UniqueName: \"kubernetes.io/projected/36555c02-4993-42f7-93b7-213209cb8f3d-kube-api-access-pvkc2\") pod \"limitador-operator-controller-manager-74495c69f8-xkmsw\" (UID: \"36555c02-4993-42f7-93b7-213209cb8f3d\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xkmsw"
Sep 10 04:49:25.841196 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:25.841117    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvkc2\" (UniqueName: \"kubernetes.io/projected/36555c02-4993-42f7-93b7-213209cb8f3d-kube-api-access-pvkc2\") pod \"limitador-operator-controller-manager-74495c69f8-xkmsw\" (UID: \"36555c02-4993-42f7-93b7-213209cb8f3d\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xkmsw"
Sep 10 04:49:25.850256 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:25.850225    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvkc2\" (UniqueName: \"kubernetes.io/projected/36555c02-4993-42f7-93b7-213209cb8f3d-kube-api-access-pvkc2\") pod \"limitador-operator-controller-manager-74495c69f8-xkmsw\" (UID: \"36555c02-4993-42f7-93b7-213209cb8f3d\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xkmsw"
Sep 10 04:49:25.876735 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:25.876710    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xkmsw"
Sep 10 04:49:26.186844 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:26.186809    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-xkmsw"]
Sep 10 04:49:26.188609 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:49:26.188582    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36555c02_4993_42f7_93b7_213209cb8f3d.slice/crio-ffadaedcedd8fc3e0bdf7da462fe81de6097ac48113a9bb27f809449e5efdc36 WatchSource:0}: Error finding container ffadaedcedd8fc3e0bdf7da462fe81de6097ac48113a9bb27f809449e5efdc36: Status 404 returned error can't find the container with id ffadaedcedd8fc3e0bdf7da462fe81de6097ac48113a9bb27f809449e5efdc36
Sep 10 04:49:27.136802 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:27.136755    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xkmsw" event={"ID":"36555c02-4993-42f7-93b7-213209cb8f3d","Type":"ContainerStarted","Data":"ffadaedcedd8fc3e0bdf7da462fe81de6097ac48113a9bb27f809449e5efdc36"}
Sep 10 04:49:28.146433 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:28.146387    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-b2lcr" event={"ID":"7c65dd1e-8a7e-4bb5-913e-6c3f40ae3e68","Type":"ContainerStarted","Data":"8de70ec812a29b0511fed9e64d7a123c13d65b21c7516f27082684cd9c034e44"}
Sep 10 04:49:28.146867 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:28.146526    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-b2lcr"
Sep 10 04:49:28.169693 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:28.169595    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-b2lcr" podStartSLOduration=1.513002894 podStartE2EDuration="5.169574043s" totalImagesPullingTime="3.656571149s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:49:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:49:28.166841104 +0000 UTC m=+507.829298853" watchObservedRunningTime="2026-09-10 04:49:28.169574043 +0000 UTC m=+507.832031791"
Sep 10 04:49:29.153814 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:29.153779    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xkmsw" event={"ID":"36555c02-4993-42f7-93b7-213209cb8f3d","Type":"ContainerStarted","Data":"08163df16c170efa8810ad5402fa08d642bdfa9db35c685bb6b2b32d9cd1e959"}
Sep 10 04:49:29.154178 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:29.153838    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xkmsw"
Sep 10 04:49:29.172314 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:29.172267    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xkmsw" podStartSLOduration=1.7134516340000001 podStartE2EDuration="4.172253144s" totalImagesPullingTime="2.45880151s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:49:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:49:29.169706499 +0000 UTC m=+508.832164245" watchObservedRunningTime="2026-09-10 04:49:29.172253144 +0000 UTC m=+508.834710891"
Sep 10 04:49:30.752904 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:30.752869    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-dq6l2"]
Sep 10 04:49:30.756415 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:30.756391    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-dq6l2"
Sep 10 04:49:30.758500 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:30.758476    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Sep 10 04:49:30.758607 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:30.758476    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-rjw8b\""
Sep 10 04:49:30.758607 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:30.758511    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Sep 10 04:49:30.762972 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:30.762932    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-dq6l2"]
Sep 10 04:49:30.785548 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:30.785526    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/468710e9-c46c-4cd7-9cd5-edca50b0e5c7-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-dq6l2\" (UID: \"468710e9-c46c-4cd7-9cd5-edca50b0e5c7\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-dq6l2"
Sep 10 04:49:30.785673 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:30.785574    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfv4c\" (UniqueName: \"kubernetes.io/projected/468710e9-c46c-4cd7-9cd5-edca50b0e5c7-kube-api-access-vfv4c\") pod \"kuadrant-console-plugin-fbdd4f445-dq6l2\" (UID: \"468710e9-c46c-4cd7-9cd5-edca50b0e5c7\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-dq6l2"
Sep 10 04:49:30.785741 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:30.785690    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/468710e9-c46c-4cd7-9cd5-edca50b0e5c7-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-dq6l2\" (UID: \"468710e9-c46c-4cd7-9cd5-edca50b0e5c7\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-dq6l2"
Sep 10 04:49:30.886411 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:30.886382    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/468710e9-c46c-4cd7-9cd5-edca50b0e5c7-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-dq6l2\" (UID: \"468710e9-c46c-4cd7-9cd5-edca50b0e5c7\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-dq6l2"
Sep 10 04:49:30.886540 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:30.886492    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/468710e9-c46c-4cd7-9cd5-edca50b0e5c7-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-dq6l2\" (UID: \"468710e9-c46c-4cd7-9cd5-edca50b0e5c7\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-dq6l2"
Sep 10 04:49:30.886540 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:49:30.886508    2560 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Sep 10 04:49:30.886662 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:49:30.886588    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/468710e9-c46c-4cd7-9cd5-edca50b0e5c7-plugin-serving-cert podName:468710e9-c46c-4cd7-9cd5-edca50b0e5c7 nodeName:}" failed. No retries permitted until 2026-09-10 04:49:31.386565686 +0000 UTC m=+511.049023416 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/468710e9-c46c-4cd7-9cd5-edca50b0e5c7-plugin-serving-cert") pod "kuadrant-console-plugin-fbdd4f445-dq6l2" (UID: "468710e9-c46c-4cd7-9cd5-edca50b0e5c7") : secret "plugin-serving-cert" not found
Sep 10 04:49:30.886662 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:30.886642    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfv4c\" (UniqueName: \"kubernetes.io/projected/468710e9-c46c-4cd7-9cd5-edca50b0e5c7-kube-api-access-vfv4c\") pod \"kuadrant-console-plugin-fbdd4f445-dq6l2\" (UID: \"468710e9-c46c-4cd7-9cd5-edca50b0e5c7\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-dq6l2"
Sep 10 04:49:30.887386 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:30.887364    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/468710e9-c46c-4cd7-9cd5-edca50b0e5c7-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-dq6l2\" (UID: \"468710e9-c46c-4cd7-9cd5-edca50b0e5c7\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-dq6l2"
Sep 10 04:49:30.894151 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:30.894133    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfv4c\" (UniqueName: \"kubernetes.io/projected/468710e9-c46c-4cd7-9cd5-edca50b0e5c7-kube-api-access-vfv4c\") pod \"kuadrant-console-plugin-fbdd4f445-dq6l2\" (UID: \"468710e9-c46c-4cd7-9cd5-edca50b0e5c7\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-dq6l2"
Sep 10 04:49:31.099491 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:31.099420    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-7ngfc"
Sep 10 04:49:31.390453 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:31.390427    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/468710e9-c46c-4cd7-9cd5-edca50b0e5c7-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-dq6l2\" (UID: \"468710e9-c46c-4cd7-9cd5-edca50b0e5c7\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-dq6l2"
Sep 10 04:49:31.392744 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:31.392712    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/468710e9-c46c-4cd7-9cd5-edca50b0e5c7-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-dq6l2\" (UID: \"468710e9-c46c-4cd7-9cd5-edca50b0e5c7\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-dq6l2"
Sep 10 04:49:31.666144 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:31.666073    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-dq6l2"
Sep 10 04:49:31.939051 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:31.939026    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-dq6l2"]
Sep 10 04:49:31.940355 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:49:31.940328    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod468710e9_c46c_4cd7_9cd5_edca50b0e5c7.slice/crio-f2f1556ea2fc1e6eda13b5af5b8e2300fcd7be89326ddc8455b92922bef7010b WatchSource:0}: Error finding container f2f1556ea2fc1e6eda13b5af5b8e2300fcd7be89326ddc8455b92922bef7010b: Status 404 returned error can't find the container with id f2f1556ea2fc1e6eda13b5af5b8e2300fcd7be89326ddc8455b92922bef7010b
Sep 10 04:49:32.171605 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:32.171570    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-dq6l2" event={"ID":"468710e9-c46c-4cd7-9cd5-edca50b0e5c7","Type":"ContainerStarted","Data":"f2f1556ea2fc1e6eda13b5af5b8e2300fcd7be89326ddc8455b92922bef7010b"}
Sep 10 04:49:33.110610 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:33.110579    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-fpjhq"
Sep 10 04:49:37.202719 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:37.202687    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-dq6l2" event={"ID":"468710e9-c46c-4cd7-9cd5-edca50b0e5c7","Type":"ContainerStarted","Data":"d0ef42c47dfc511f865f59abc9d4382bf950c7ffda63fc05b0030d3d51f1debc"}
Sep 10 04:49:37.218519 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:37.218473    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-dq6l2" podStartSLOduration=2.671277956 podStartE2EDuration="7.218458738s" totalImagesPullingTime="4.547180782s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:49:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:49:37.217339503 +0000 UTC m=+516.879797249" watchObservedRunningTime="2026-09-10 04:49:37.218458738 +0000 UTC m=+516.880916484"
Sep 10 04:49:39.156626 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:39.156597    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-b2lcr"
Sep 10 04:49:40.146257 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:40.146223    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-bprsw"]
Sep 10 04:49:40.151124 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:40.151103    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-bprsw"
Sep 10 04:49:40.161302 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:40.161271    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xkmsw"
Sep 10 04:49:40.169009 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:40.168990    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-bprsw"]
Sep 10 04:49:40.251944 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:40.251911    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvs5x\" (UniqueName: \"kubernetes.io/projected/686539ef-4a3c-4fe1-9326-c7ccbdd1d3a5-kube-api-access-cvs5x\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-bprsw\" (UID: \"686539ef-4a3c-4fe1-9326-c7ccbdd1d3a5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-bprsw"
Sep 10 04:49:40.252103 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:40.252082    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/686539ef-4a3c-4fe1-9326-c7ccbdd1d3a5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-bprsw\" (UID: \"686539ef-4a3c-4fe1-9326-c7ccbdd1d3a5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-bprsw"
Sep 10 04:49:40.353030 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:40.352995    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/686539ef-4a3c-4fe1-9326-c7ccbdd1d3a5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-bprsw\" (UID: \"686539ef-4a3c-4fe1-9326-c7ccbdd1d3a5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-bprsw"
Sep 10 04:49:40.353187 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:40.353050    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvs5x\" (UniqueName: \"kubernetes.io/projected/686539ef-4a3c-4fe1-9326-c7ccbdd1d3a5-kube-api-access-cvs5x\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-bprsw\" (UID: \"686539ef-4a3c-4fe1-9326-c7ccbdd1d3a5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-bprsw"
Sep 10 04:49:40.353379 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:40.353358    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/686539ef-4a3c-4fe1-9326-c7ccbdd1d3a5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-bprsw\" (UID: \"686539ef-4a3c-4fe1-9326-c7ccbdd1d3a5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-bprsw"
Sep 10 04:49:40.369501 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:40.369481    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvs5x\" (UniqueName: \"kubernetes.io/projected/686539ef-4a3c-4fe1-9326-c7ccbdd1d3a5-kube-api-access-cvs5x\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-bprsw\" (UID: \"686539ef-4a3c-4fe1-9326-c7ccbdd1d3a5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-bprsw"
Sep 10 04:49:40.462003 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:40.461949    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-bprsw"
Sep 10 04:49:40.752100 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:40.752076    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-bprsw"]
Sep 10 04:49:40.754621 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:49:40.754592    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod686539ef_4a3c_4fe1_9326_c7ccbdd1d3a5.slice/crio-520d83de7464b67bb1855aebec993332bb5e4fee1413b17f700fea3c9a9f57a2 WatchSource:0}: Error finding container 520d83de7464b67bb1855aebec993332bb5e4fee1413b17f700fea3c9a9f57a2: Status 404 returned error can't find the container with id 520d83de7464b67bb1855aebec993332bb5e4fee1413b17f700fea3c9a9f57a2
Sep 10 04:49:41.226249 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:41.226215    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-bprsw" event={"ID":"686539ef-4a3c-4fe1-9326-c7ccbdd1d3a5","Type":"ContainerStarted","Data":"6e55d3815bb0e84776e369ab6e586ddac8c3112faf5e2d32721222af5008aec4"}
Sep 10 04:49:41.226644 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:41.226262    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-bprsw" event={"ID":"686539ef-4a3c-4fe1-9326-c7ccbdd1d3a5","Type":"ContainerStarted","Data":"520d83de7464b67bb1855aebec993332bb5e4fee1413b17f700fea3c9a9f57a2"}
Sep 10 04:49:41.226644 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:41.226293    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-bprsw"
Sep 10 04:49:41.246403 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:41.246353    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-bprsw" podStartSLOduration=1.24633418 podStartE2EDuration="1.24633418s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:49:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:49:41.244681091 +0000 UTC m=+520.907138838" watchObservedRunningTime="2026-09-10 04:49:41.24633418 +0000 UTC m=+520.908791930"
Sep 10 04:49:41.357724 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:41.357692    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-bprsw"]
Sep 10 04:49:41.368619 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:41.368592    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-bprsw"]
Sep 10 04:49:41.384423 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:41.384396    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-ghmpc"]
Sep 10 04:49:41.384935 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:41.384919    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="686539ef-4a3c-4fe1-9326-c7ccbdd1d3a5" containerName="manager"
Sep 10 04:49:41.384984 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:41.384939    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="686539ef-4a3c-4fe1-9326-c7ccbdd1d3a5" containerName="manager"
Sep 10 04:49:41.385050 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:41.385040    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="686539ef-4a3c-4fe1-9326-c7ccbdd1d3a5" containerName="manager"
Sep 10 04:49:41.388480 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:41.388447    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-b2lcr"]
Sep 10 04:49:41.388782 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:41.388762    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-ghmpc"
Sep 10 04:49:41.389057 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:41.388804    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-b2lcr" podUID="7c65dd1e-8a7e-4bb5-913e-6c3f40ae3e68" containerName="manager" containerID="cri-o://8de70ec812a29b0511fed9e64d7a123c13d65b21c7516f27082684cd9c034e44" gracePeriod=2
Sep 10 04:49:41.390562 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:41.390446    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-b2lcr"]
Sep 10 04:49:41.391253 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:49:41.391174    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-b2lcr\" is forbidden: User \"system:node:ip-10-0-138-27.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-27.ec2.internal' and this object" podUID="7c65dd1e-8a7e-4bb5-913e-6c3f40ae3e68" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-b2lcr"
Sep 10 04:49:41.393055 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:49:41.392989    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-b2lcr\" is forbidden: User \"system:node:ip-10-0-138-27.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-27.ec2.internal' and this object" podUID="7c65dd1e-8a7e-4bb5-913e-6c3f40ae3e68" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-b2lcr"
Sep 10 04:49:41.409178 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:41.409109    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-ghmpc"]
Sep 10 04:49:41.411207 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:41.411185    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-xkmsw"]
Sep 10 04:49:41.411603 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:41.411373    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xkmsw" podUID="36555c02-4993-42f7-93b7-213209cb8f3d" containerName="manager" containerID="cri-o://08163df16c170efa8810ad5402fa08d642bdfa9db35c685bb6b2b32d9cd1e959" gracePeriod=2
Sep 10 04:49:41.414320 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:41.414295    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-xkmsw"]
Sep 10 04:49:41.419010 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:41.418991    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nphp9"]
Sep 10 04:49:41.419306 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:41.419294    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c65dd1e-8a7e-4bb5-913e-6c3f40ae3e68" containerName="manager"
Sep 10 04:49:41.419353 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:41.419308    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c65dd1e-8a7e-4bb5-913e-6c3f40ae3e68" containerName="manager"
Sep 10 04:49:41.419353 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:41.419326    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36555c02-4993-42f7-93b7-213209cb8f3d" containerName="manager"
Sep 10 04:49:41.419353 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:41.419332    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="36555c02-4993-42f7-93b7-213209cb8f3d" containerName="manager"
Sep 10 04:49:41.419445 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:41.419382    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="36555c02-4993-42f7-93b7-213209cb8f3d" containerName="manager"
Sep 10 04:49:41.419445 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:41.419393    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c65dd1e-8a7e-4bb5-913e-6c3f40ae3e68" containerName="manager"
Sep 10 04:49:41.424257 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:41.424232    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nphp9"
Sep 10 04:49:41.424805 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:49:41.424780    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-b2lcr\" is forbidden: User \"system:node:ip-10-0-138-27.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-27.ec2.internal' and this object" podUID="7c65dd1e-8a7e-4bb5-913e-6c3f40ae3e68" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-b2lcr"
Sep 10 04:49:41.426319 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:49:41.426296    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-xkmsw\" is forbidden: User \"system:node:ip-10-0-138-27.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-27.ec2.internal' and this object" podUID="36555c02-4993-42f7-93b7-213209cb8f3d" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xkmsw"
Sep 10 04:49:41.427809 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:49:41.427762    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-b2lcr\" is forbidden: User \"system:node:ip-10-0-138-27.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-27.ec2.internal' and this object" podUID="7c65dd1e-8a7e-4bb5-913e-6c3f40ae3e68" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-b2lcr"
Sep 10 04:49:41.437290 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:41.437267    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-jtp8g"]
Sep 10 04:49:41.441682 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:41.441658    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-jtp8g"
Sep 10 04:49:41.442575 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:41.442550    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nphp9"]
Sep 10 04:49:41.453426 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:41.453405    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-jtp8g"]
Sep 10 04:49:41.462478 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:41.462447    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a69de829-2d81-46dc-b69e-ff78730dbb60-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-nphp9\" (UID: \"a69de829-2d81-46dc-b69e-ff78730dbb60\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nphp9"
Sep 10 04:49:41.462591 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:41.462513    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tcts\" (UniqueName: \"kubernetes.io/projected/a69de829-2d81-46dc-b69e-ff78730dbb60-kube-api-access-2tcts\") pod \"kuadrant-operator-controller-manager-76f8f686bf-nphp9\" (UID: \"a69de829-2d81-46dc-b69e-ff78730dbb60\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nphp9"
Sep 10 04:49:41.462789 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:41.462609    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9842fe55-0213-4f6e-84a7-fa6953d4f833-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-ghmpc\" (UID: \"9842fe55-0213-4f6e-84a7-fa6953d4f833\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-ghmpc"
Sep 10 04:49:41.462789 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:41.462649    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gzx7\" (UniqueName: \"kubernetes.io/projected/9842fe55-0213-4f6e-84a7-fa6953d4f833-kube-api-access-7gzx7\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-ghmpc\" (UID: \"9842fe55-0213-4f6e-84a7-fa6953d4f833\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-ghmpc"
Sep 10 04:49:41.462789 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:41.462671    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2kj8\" (UniqueName: \"kubernetes.io/projected/e0dc06ae-7d96-49cb-bd11-043e343c59f9-kube-api-access-j2kj8\") pod \"limitador-operator-controller-manager-74495c69f8-jtp8g\" (UID: \"e0dc06ae-7d96-49cb-bd11-043e343c59f9\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-jtp8g"
Sep 10 04:49:41.466632 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:49:41.466605    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-xkmsw\" is forbidden: User \"system:node:ip-10-0-138-27.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-27.ec2.internal' and this object" podUID="36555c02-4993-42f7-93b7-213209cb8f3d" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xkmsw"
Sep 10 04:49:41.483734 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:49:41.483673    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-xkmsw\" is forbidden: User \"system:node:ip-10-0-138-27.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-27.ec2.internal' and this object" podUID="36555c02-4993-42f7-93b7-213209cb8f3d" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xkmsw"
Sep 10 04:49:41.485073 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:49:41.485051    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-b2lcr\" is forbidden: User \"system:node:ip-10-0-138-27.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-27.ec2.internal' and this object" podUID="7c65dd1e-8a7e-4bb5-913e-6c3f40ae3e68" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-b2lcr"
Sep 10 04:49:41.564104 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:41.564062    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gzx7\" (UniqueName: \"kubernetes.io/projected/9842fe55-0213-4f6e-84a7-fa6953d4f833-kube-api-access-7gzx7\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-ghmpc\" (UID: \"9842fe55-0213-4f6e-84a7-fa6953d4f833\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-ghmpc"
Sep 10 04:49:41.564293 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:41.564121    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2kj8\" (UniqueName: \"kubernetes.io/projected/e0dc06ae-7d96-49cb-bd11-043e343c59f9-kube-api-access-j2kj8\") pod \"limitador-operator-controller-manager-74495c69f8-jtp8g\" (UID: \"e0dc06ae-7d96-49cb-bd11-043e343c59f9\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-jtp8g"
Sep 10 04:49:41.564293 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:41.564157    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a69de829-2d81-46dc-b69e-ff78730dbb60-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-nphp9\" (UID: \"a69de829-2d81-46dc-b69e-ff78730dbb60\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nphp9"
Sep 10 04:49:41.564293 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:41.564221    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tcts\" (UniqueName: \"kubernetes.io/projected/a69de829-2d81-46dc-b69e-ff78730dbb60-kube-api-access-2tcts\") pod \"kuadrant-operator-controller-manager-76f8f686bf-nphp9\" (UID: \"a69de829-2d81-46dc-b69e-ff78730dbb60\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nphp9"
Sep 10 04:49:41.564464 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:41.564301    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9842fe55-0213-4f6e-84a7-fa6953d4f833-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-ghmpc\" (UID: \"9842fe55-0213-4f6e-84a7-fa6953d4f833\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-ghmpc"
Sep 10 04:49:41.564690 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:41.564666    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a69de829-2d81-46dc-b69e-ff78730dbb60-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-nphp9\" (UID: \"a69de829-2d81-46dc-b69e-ff78730dbb60\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nphp9"
Sep 10 04:49:41.564783 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:41.564698    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9842fe55-0213-4f6e-84a7-fa6953d4f833-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-ghmpc\" (UID: \"9842fe55-0213-4f6e-84a7-fa6953d4f833\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-ghmpc"
Sep 10 04:49:41.573676 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:41.573652    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2kj8\" (UniqueName: \"kubernetes.io/projected/e0dc06ae-7d96-49cb-bd11-043e343c59f9-kube-api-access-j2kj8\") pod \"limitador-operator-controller-manager-74495c69f8-jtp8g\" (UID: \"e0dc06ae-7d96-49cb-bd11-043e343c59f9\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-jtp8g"
Sep 10 04:49:41.573803 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:41.573682    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tcts\" (UniqueName: \"kubernetes.io/projected/a69de829-2d81-46dc-b69e-ff78730dbb60-kube-api-access-2tcts\") pod \"kuadrant-operator-controller-manager-76f8f686bf-nphp9\" (UID: \"a69de829-2d81-46dc-b69e-ff78730dbb60\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nphp9"
Sep 10 04:49:41.574393 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:41.574372    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gzx7\" (UniqueName: \"kubernetes.io/projected/9842fe55-0213-4f6e-84a7-fa6953d4f833-kube-api-access-7gzx7\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-ghmpc\" (UID: \"9842fe55-0213-4f6e-84a7-fa6953d4f833\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-ghmpc"
Sep 10 04:49:41.642954 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:41.642931    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-b2lcr"
Sep 10 04:49:41.644942 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:49:41.644902    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-xkmsw\" is forbidden: User \"system:node:ip-10-0-138-27.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-27.ec2.internal' and this object" podUID="36555c02-4993-42f7-93b7-213209cb8f3d" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xkmsw"
Sep 10 04:49:41.646367 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:49:41.646342    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-b2lcr\" is forbidden: User \"system:node:ip-10-0-138-27.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-27.ec2.internal' and this object" podUID="7c65dd1e-8a7e-4bb5-913e-6c3f40ae3e68" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-b2lcr"
Sep 10 04:49:41.652118 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:41.652101    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xkmsw"
Sep 10 04:49:41.653731 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:49:41.653711    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-xkmsw\" is forbidden: User \"system:node:ip-10-0-138-27.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-27.ec2.internal' and this object" podUID="36555c02-4993-42f7-93b7-213209cb8f3d" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xkmsw"
Sep 10 04:49:41.655130 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:49:41.655111    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-b2lcr\" is forbidden: User \"system:node:ip-10-0-138-27.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-27.ec2.internal' and this object" podUID="7c65dd1e-8a7e-4bb5-913e-6c3f40ae3e68" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-b2lcr"
Sep 10 04:49:41.665475 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:41.665455    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7c65dd1e-8a7e-4bb5-913e-6c3f40ae3e68-extensions-socket-volume\") pod \"7c65dd1e-8a7e-4bb5-913e-6c3f40ae3e68\" (UID: \"7c65dd1e-8a7e-4bb5-913e-6c3f40ae3e68\") "
Sep 10 04:49:41.665533 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:41.665491    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5wch2\" (UniqueName: \"kubernetes.io/projected/7c65dd1e-8a7e-4bb5-913e-6c3f40ae3e68-kube-api-access-5wch2\") pod \"7c65dd1e-8a7e-4bb5-913e-6c3f40ae3e68\" (UID: \"7c65dd1e-8a7e-4bb5-913e-6c3f40ae3e68\") "
Sep 10 04:49:41.665533 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:41.665515    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pvkc2\" (UniqueName: \"kubernetes.io/projected/36555c02-4993-42f7-93b7-213209cb8f3d-kube-api-access-pvkc2\") pod \"36555c02-4993-42f7-93b7-213209cb8f3d\" (UID: \"36555c02-4993-42f7-93b7-213209cb8f3d\") "
Sep 10 04:49:41.666022 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:41.665997    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c65dd1e-8a7e-4bb5-913e-6c3f40ae3e68-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "7c65dd1e-8a7e-4bb5-913e-6c3f40ae3e68" (UID: "7c65dd1e-8a7e-4bb5-913e-6c3f40ae3e68"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 04:49:41.667596 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:41.667572    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36555c02-4993-42f7-93b7-213209cb8f3d-kube-api-access-pvkc2" (OuterVolumeSpecName: "kube-api-access-pvkc2") pod "36555c02-4993-42f7-93b7-213209cb8f3d" (UID: "36555c02-4993-42f7-93b7-213209cb8f3d"). InnerVolumeSpecName "kube-api-access-pvkc2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 04:49:41.667666 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:41.667593    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c65dd1e-8a7e-4bb5-913e-6c3f40ae3e68-kube-api-access-5wch2" (OuterVolumeSpecName: "kube-api-access-5wch2") pod "7c65dd1e-8a7e-4bb5-913e-6c3f40ae3e68" (UID: "7c65dd1e-8a7e-4bb5-913e-6c3f40ae3e68"). InnerVolumeSpecName "kube-api-access-5wch2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 04:49:41.701526 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:41.701504    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-ghmpc"
Sep 10 04:49:41.766774 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:41.766737    2560 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7c65dd1e-8a7e-4bb5-913e-6c3f40ae3e68-extensions-socket-volume\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:49:41.766892 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:41.766777    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5wch2\" (UniqueName: \"kubernetes.io/projected/7c65dd1e-8a7e-4bb5-913e-6c3f40ae3e68-kube-api-access-5wch2\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:49:41.766892 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:41.766799    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pvkc2\" (UniqueName: \"kubernetes.io/projected/36555c02-4993-42f7-93b7-213209cb8f3d-kube-api-access-pvkc2\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:49:41.824787 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:41.824762    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nphp9"
Sep 10 04:49:41.831433 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:41.831394    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-jtp8g"
Sep 10 04:49:41.996876 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:41.996819    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-ghmpc"]
Sep 10 04:49:42.000189 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:49:42.000129    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9842fe55_0213_4f6e_84a7_fa6953d4f833.slice/crio-7be6fc1f7af653b35578e222df3c1b75bd10ee54bcaf6475361098a551d6cd10 WatchSource:0}: Error finding container 7be6fc1f7af653b35578e222df3c1b75bd10ee54bcaf6475361098a551d6cd10: Status 404 returned error can't find the container with id 7be6fc1f7af653b35578e222df3c1b75bd10ee54bcaf6475361098a551d6cd10
Sep 10 04:49:42.135681 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:42.135649    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nphp9"]
Sep 10 04:49:42.145162 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:42.145126    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-jtp8g"]
Sep 10 04:49:42.233576 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:42.233549    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-jtp8g" event={"ID":"e0dc06ae-7d96-49cb-bd11-043e343c59f9","Type":"ContainerStarted","Data":"3ad00a6d3ce66f1ec8b28a1b82f16fd6710b1e61fda02b59f8d0fba6a3e139e3"}
Sep 10 04:49:42.233950 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:42.233604    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-jtp8g"
Sep 10 04:49:42.233950 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:42.233631    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-jtp8g" event={"ID":"e0dc06ae-7d96-49cb-bd11-043e343c59f9","Type":"ContainerStarted","Data":"1d5fb77148c42a6ede3436b1700f8819a65d401b66e107a78e877a412d72c36f"}
Sep 10 04:49:42.235072 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:42.235045    2560 generic.go:356] "Generic (PLEG): container finished" podID="7c65dd1e-8a7e-4bb5-913e-6c3f40ae3e68" containerID="8de70ec812a29b0511fed9e64d7a123c13d65b21c7516f27082684cd9c034e44" exitCode=0
Sep 10 04:49:42.235149 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:42.235096    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-b2lcr"
Sep 10 04:49:42.235149 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:42.235125    2560 scope.go:117] "RemoveContainer" containerID="8de70ec812a29b0511fed9e64d7a123c13d65b21c7516f27082684cd9c034e44"
Sep 10 04:49:42.237240 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:42.237107    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nphp9" event={"ID":"a69de829-2d81-46dc-b69e-ff78730dbb60","Type":"ContainerStarted","Data":"5ff3f3194da71ec3890914ca1100ac468bc23d9dc1adc9a0bd1e961e820efa7b"}
Sep 10 04:49:42.237240 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:42.237149    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nphp9" event={"ID":"a69de829-2d81-46dc-b69e-ff78730dbb60","Type":"ContainerStarted","Data":"aa669c222905555456fdefbbe16610820588abff7a172facd673b66d78d4364e"}
Sep 10 04:49:42.237694 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:42.237477    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nphp9"
Sep 10 04:49:42.238111 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:49:42.238088    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-xkmsw\" is forbidden: User \"system:node:ip-10-0-138-27.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-27.ec2.internal' and this object" podUID="36555c02-4993-42f7-93b7-213209cb8f3d" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xkmsw"
Sep 10 04:49:42.238986 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:42.238961    2560 generic.go:356] "Generic (PLEG): container finished" podID="36555c02-4993-42f7-93b7-213209cb8f3d" containerID="08163df16c170efa8810ad5402fa08d642bdfa9db35c685bb6b2b32d9cd1e959" exitCode=0
Sep 10 04:49:42.239104 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:42.239019    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xkmsw"
Sep 10 04:49:42.241610 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:49:42.241583    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-b2lcr\" is forbidden: User \"system:node:ip-10-0-138-27.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-27.ec2.internal' and this object" podUID="7c65dd1e-8a7e-4bb5-913e-6c3f40ae3e68" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-b2lcr"
Sep 10 04:49:42.242313 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:49:42.242287    2560 kuberuntime_manager.go:649] "Missing actuated resource record" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-bprsw" container="manager"
Sep 10 04:49:42.242953 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:42.242933    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-ghmpc" event={"ID":"9842fe55-0213-4f6e-84a7-fa6953d4f833","Type":"ContainerStarted","Data":"674722018ca2f6b2ea15069203f31fd907bf358d2fa26de8a6cac68a79ba06de"}
Sep 10 04:49:42.243128 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:42.243112    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-ghmpc"
Sep 10 04:49:42.243261 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:42.243244    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-ghmpc" event={"ID":"9842fe55-0213-4f6e-84a7-fa6953d4f833","Type":"ContainerStarted","Data":"7be6fc1f7af653b35578e222df3c1b75bd10ee54bcaf6475361098a551d6cd10"}
Sep 10 04:49:42.247022 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:42.246912    2560 scope.go:117] "RemoveContainer" containerID="8de70ec812a29b0511fed9e64d7a123c13d65b21c7516f27082684cd9c034e44"
Sep 10 04:49:42.247752 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:49:42.247213    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8de70ec812a29b0511fed9e64d7a123c13d65b21c7516f27082684cd9c034e44\": container with ID starting with 8de70ec812a29b0511fed9e64d7a123c13d65b21c7516f27082684cd9c034e44 not found: ID does not exist" containerID="8de70ec812a29b0511fed9e64d7a123c13d65b21c7516f27082684cd9c034e44"
Sep 10 04:49:42.247752 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:42.247250    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8de70ec812a29b0511fed9e64d7a123c13d65b21c7516f27082684cd9c034e44"} err="failed to get container status \"8de70ec812a29b0511fed9e64d7a123c13d65b21c7516f27082684cd9c034e44\": rpc error: code = NotFound desc = could not find container \"8de70ec812a29b0511fed9e64d7a123c13d65b21c7516f27082684cd9c034e44\": container with ID starting with 8de70ec812a29b0511fed9e64d7a123c13d65b21c7516f27082684cd9c034e44 not found: ID does not exist"
Sep 10 04:49:42.247752 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:42.247273    2560 scope.go:117] "RemoveContainer" containerID="08163df16c170efa8810ad5402fa08d642bdfa9db35c685bb6b2b32d9cd1e959"
Sep 10 04:49:42.258748 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:42.258734    2560 scope.go:117] "RemoveContainer" containerID="08163df16c170efa8810ad5402fa08d642bdfa9db35c685bb6b2b32d9cd1e959"
Sep 10 04:49:42.259017 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:49:42.258995    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08163df16c170efa8810ad5402fa08d642bdfa9db35c685bb6b2b32d9cd1e959\": container with ID starting with 08163df16c170efa8810ad5402fa08d642bdfa9db35c685bb6b2b32d9cd1e959 not found: ID does not exist" containerID="08163df16c170efa8810ad5402fa08d642bdfa9db35c685bb6b2b32d9cd1e959"
Sep 10 04:49:42.259087 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:42.259022    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08163df16c170efa8810ad5402fa08d642bdfa9db35c685bb6b2b32d9cd1e959"} err="failed to get container status \"08163df16c170efa8810ad5402fa08d642bdfa9db35c685bb6b2b32d9cd1e959\": rpc error: code = NotFound desc = could not find container \"08163df16c170efa8810ad5402fa08d642bdfa9db35c685bb6b2b32d9cd1e959\": container with ID starting with 08163df16c170efa8810ad5402fa08d642bdfa9db35c685bb6b2b32d9cd1e959 not found: ID does not exist"
Sep 10 04:49:42.280926 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:42.280884    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-jtp8g" podStartSLOduration=1.280869478 podStartE2EDuration="1.280869478s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:49:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:49:42.280772632 +0000 UTC m=+521.943230380" watchObservedRunningTime="2026-09-10 04:49:42.280869478 +0000 UTC m=+521.943327224"
Sep 10 04:49:42.312252 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:42.312212    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-ghmpc" podStartSLOduration=1.312200273 podStartE2EDuration="1.312200273s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:49:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:49:42.310315671 +0000 UTC m=+521.972773417" watchObservedRunningTime="2026-09-10 04:49:42.312200273 +0000 UTC m=+521.974658020"
Sep 10 04:49:42.341570 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:42.341525    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nphp9" podStartSLOduration=1.341510451 podStartE2EDuration="1.341510451s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:49:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:49:42.340198291 +0000 UTC m=+522.002656040" watchObservedRunningTime="2026-09-10 04:49:42.341510451 +0000 UTC m=+522.003968199"
Sep 10 04:49:42.343112 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:49:42.343083    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-xkmsw\" is forbidden: User \"system:node:ip-10-0-138-27.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-27.ec2.internal' and this object" podUID="36555c02-4993-42f7-93b7-213209cb8f3d" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xkmsw"
Sep 10 04:49:42.345192 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:49:42.345162    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-67c5dcb48c-bprsw\" is forbidden: User \"system:node:ip-10-0-138-27.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-27.ec2.internal' and this object" podUID="686539ef-4a3c-4fe1-9326-c7ccbdd1d3a5" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-bprsw"
Sep 10 04:49:42.349810 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:49:42.349777    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-b2lcr\" is forbidden: User \"system:node:ip-10-0-138-27.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-27.ec2.internal' and this object" podUID="7c65dd1e-8a7e-4bb5-913e-6c3f40ae3e68" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-b2lcr"
Sep 10 04:49:42.824869 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:42.824824    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36555c02-4993-42f7-93b7-213209cb8f3d" path="/var/lib/kubelet/pods/36555c02-4993-42f7-93b7-213209cb8f3d/volumes"
Sep 10 04:49:42.825209 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:42.825195    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c65dd1e-8a7e-4bb5-913e-6c3f40ae3e68" path="/var/lib/kubelet/pods/7c65dd1e-8a7e-4bb5-913e-6c3f40ae3e68/volumes"
Sep 10 04:49:43.251079 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:43.251038    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-bprsw" podUID="686539ef-4a3c-4fe1-9326-c7ccbdd1d3a5" containerName="manager" containerID="cri-o://6e55d3815bb0e84776e369ab6e586ddac8c3112faf5e2d32721222af5008aec4" gracePeriod=2
Sep 10 04:49:43.488441 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:43.488417    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-bprsw"
Sep 10 04:49:43.580141 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:43.580083    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cvs5x\" (UniqueName: \"kubernetes.io/projected/686539ef-4a3c-4fe1-9326-c7ccbdd1d3a5-kube-api-access-cvs5x\") pod \"686539ef-4a3c-4fe1-9326-c7ccbdd1d3a5\" (UID: \"686539ef-4a3c-4fe1-9326-c7ccbdd1d3a5\") "
Sep 10 04:49:43.580141 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:43.580138    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/686539ef-4a3c-4fe1-9326-c7ccbdd1d3a5-extensions-socket-volume\") pod \"686539ef-4a3c-4fe1-9326-c7ccbdd1d3a5\" (UID: \"686539ef-4a3c-4fe1-9326-c7ccbdd1d3a5\") "
Sep 10 04:49:43.580534 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:43.580511    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/686539ef-4a3c-4fe1-9326-c7ccbdd1d3a5-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "686539ef-4a3c-4fe1-9326-c7ccbdd1d3a5" (UID: "686539ef-4a3c-4fe1-9326-c7ccbdd1d3a5"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 04:49:43.582107 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:43.582086    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/686539ef-4a3c-4fe1-9326-c7ccbdd1d3a5-kube-api-access-cvs5x" (OuterVolumeSpecName: "kube-api-access-cvs5x") pod "686539ef-4a3c-4fe1-9326-c7ccbdd1d3a5" (UID: "686539ef-4a3c-4fe1-9326-c7ccbdd1d3a5"). InnerVolumeSpecName "kube-api-access-cvs5x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 04:49:43.681571 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:43.681545    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cvs5x\" (UniqueName: \"kubernetes.io/projected/686539ef-4a3c-4fe1-9326-c7ccbdd1d3a5-kube-api-access-cvs5x\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:49:43.681571 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:43.681569    2560 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/686539ef-4a3c-4fe1-9326-c7ccbdd1d3a5-extensions-socket-volume\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:49:44.259095 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:44.259063    2560 generic.go:356] "Generic (PLEG): container finished" podID="686539ef-4a3c-4fe1-9326-c7ccbdd1d3a5" containerID="6e55d3815bb0e84776e369ab6e586ddac8c3112faf5e2d32721222af5008aec4" exitCode=0
Sep 10 04:49:44.259483 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:44.259104    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-bprsw"
Sep 10 04:49:44.259483 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:44.259168    2560 scope.go:117] "RemoveContainer" containerID="6e55d3815bb0e84776e369ab6e586ddac8c3112faf5e2d32721222af5008aec4"
Sep 10 04:49:44.261087 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:49:44.261060    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-67c5dcb48c-bprsw\" is forbidden: User \"system:node:ip-10-0-138-27.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-27.ec2.internal' and this object" podUID="686539ef-4a3c-4fe1-9326-c7ccbdd1d3a5" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-bprsw"
Sep 10 04:49:44.268021 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:44.268002    2560 scope.go:117] "RemoveContainer" containerID="6e55d3815bb0e84776e369ab6e586ddac8c3112faf5e2d32721222af5008aec4"
Sep 10 04:49:44.268290 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:49:44.268272    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e55d3815bb0e84776e369ab6e586ddac8c3112faf5e2d32721222af5008aec4\": container with ID starting with 6e55d3815bb0e84776e369ab6e586ddac8c3112faf5e2d32721222af5008aec4 not found: ID does not exist" containerID="6e55d3815bb0e84776e369ab6e586ddac8c3112faf5e2d32721222af5008aec4"
Sep 10 04:49:44.268331 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:44.268298    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e55d3815bb0e84776e369ab6e586ddac8c3112faf5e2d32721222af5008aec4"} err="failed to get container status \"6e55d3815bb0e84776e369ab6e586ddac8c3112faf5e2d32721222af5008aec4\": rpc error: code = NotFound desc = could not find container \"6e55d3815bb0e84776e369ab6e586ddac8c3112faf5e2d32721222af5008aec4\": container with ID starting with 6e55d3815bb0e84776e369ab6e586ddac8c3112faf5e2d32721222af5008aec4 not found: ID does not exist"
Sep 10 04:49:44.268430 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:49:44.268415    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-67c5dcb48c-bprsw\" is forbidden: User \"system:node:ip-10-0-138-27.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-27.ec2.internal' and this object" podUID="686539ef-4a3c-4fe1-9326-c7ccbdd1d3a5" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-bprsw"
Sep 10 04:49:44.825538 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:44.825505    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="686539ef-4a3c-4fe1-9326-c7ccbdd1d3a5" path="/var/lib/kubelet/pods/686539ef-4a3c-4fe1-9326-c7ccbdd1d3a5/volumes"
Sep 10 04:49:53.254322 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:53.254242    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nphp9"
Sep 10 04:49:53.254322 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:53.254314    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-jtp8g"
Sep 10 04:49:53.254689 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:53.254476    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-ghmpc"
Sep 10 04:49:53.337726 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:53.337694    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nphp9"]
Sep 10 04:49:53.337920 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:53.337892    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nphp9" podUID="a69de829-2d81-46dc-b69e-ff78730dbb60" containerName="manager" containerID="cri-o://5ff3f3194da71ec3890914ca1100ac468bc23d9dc1adc9a0bd1e961e820efa7b" gracePeriod=10
Sep 10 04:49:53.587007 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:53.586979    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nphp9"
Sep 10 04:49:53.620243 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:53.620155    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xv7fs"]
Sep 10 04:49:53.620541 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:53.620527    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a69de829-2d81-46dc-b69e-ff78730dbb60" containerName="manager"
Sep 10 04:49:53.620597 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:53.620543    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a69de829-2d81-46dc-b69e-ff78730dbb60" containerName="manager"
Sep 10 04:49:53.620640 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:53.620598    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a69de829-2d81-46dc-b69e-ff78730dbb60" containerName="manager"
Sep 10 04:49:53.622443 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:53.622427    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xv7fs"
Sep 10 04:49:53.637896 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:53.637868    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xv7fs"]
Sep 10 04:49:53.656315 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:53.656289    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a69de829-2d81-46dc-b69e-ff78730dbb60-extensions-socket-volume\") pod \"a69de829-2d81-46dc-b69e-ff78730dbb60\" (UID: \"a69de829-2d81-46dc-b69e-ff78730dbb60\") "
Sep 10 04:49:53.656439 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:53.656342    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2tcts\" (UniqueName: \"kubernetes.io/projected/a69de829-2d81-46dc-b69e-ff78730dbb60-kube-api-access-2tcts\") pod \"a69de829-2d81-46dc-b69e-ff78730dbb60\" (UID: \"a69de829-2d81-46dc-b69e-ff78730dbb60\") "
Sep 10 04:49:53.656507 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:53.656454    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8zfp\" (UniqueName: \"kubernetes.io/projected/70785dd7-57c4-4902-a64d-94051bf12e6c-kube-api-access-m8zfp\") pod \"kuadrant-operator-controller-manager-5769f99d9f-xv7fs\" (UID: \"70785dd7-57c4-4902-a64d-94051bf12e6c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xv7fs"
Sep 10 04:49:53.656507 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:53.656481    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/70785dd7-57c4-4902-a64d-94051bf12e6c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-xv7fs\" (UID: \"70785dd7-57c4-4902-a64d-94051bf12e6c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xv7fs"
Sep 10 04:49:53.656685 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:53.656662    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a69de829-2d81-46dc-b69e-ff78730dbb60-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a69de829-2d81-46dc-b69e-ff78730dbb60" (UID: "a69de829-2d81-46dc-b69e-ff78730dbb60"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 04:49:53.658251 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:53.658229    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a69de829-2d81-46dc-b69e-ff78730dbb60-kube-api-access-2tcts" (OuterVolumeSpecName: "kube-api-access-2tcts") pod "a69de829-2d81-46dc-b69e-ff78730dbb60" (UID: "a69de829-2d81-46dc-b69e-ff78730dbb60"). InnerVolumeSpecName "kube-api-access-2tcts". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 04:49:53.757424 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:53.757403    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8zfp\" (UniqueName: \"kubernetes.io/projected/70785dd7-57c4-4902-a64d-94051bf12e6c-kube-api-access-m8zfp\") pod \"kuadrant-operator-controller-manager-5769f99d9f-xv7fs\" (UID: \"70785dd7-57c4-4902-a64d-94051bf12e6c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xv7fs"
Sep 10 04:49:53.757524 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:53.757435    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/70785dd7-57c4-4902-a64d-94051bf12e6c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-xv7fs\" (UID: \"70785dd7-57c4-4902-a64d-94051bf12e6c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xv7fs"
Sep 10 04:49:53.757524 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:53.757469    2560 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a69de829-2d81-46dc-b69e-ff78730dbb60-extensions-socket-volume\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:49:53.757524 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:53.757478    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2tcts\" (UniqueName: \"kubernetes.io/projected/a69de829-2d81-46dc-b69e-ff78730dbb60-kube-api-access-2tcts\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:49:53.757750 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:53.757735    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/70785dd7-57c4-4902-a64d-94051bf12e6c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-xv7fs\" (UID: \"70785dd7-57c4-4902-a64d-94051bf12e6c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xv7fs"
Sep 10 04:49:53.774124 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:53.774103    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8zfp\" (UniqueName: \"kubernetes.io/projected/70785dd7-57c4-4902-a64d-94051bf12e6c-kube-api-access-m8zfp\") pod \"kuadrant-operator-controller-manager-5769f99d9f-xv7fs\" (UID: \"70785dd7-57c4-4902-a64d-94051bf12e6c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xv7fs"
Sep 10 04:49:53.933576 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:53.933556    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xv7fs"
Sep 10 04:49:54.245114 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:54.245090    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xv7fs"]
Sep 10 04:49:54.245829 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:49:54.245809    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70785dd7_57c4_4902_a64d_94051bf12e6c.slice/crio-3a86e599a4c74b9455d81a89c5350eb272b88811829c7a6d9e5007806861affe WatchSource:0}: Error finding container 3a86e599a4c74b9455d81a89c5350eb272b88811829c7a6d9e5007806861affe: Status 404 returned error can't find the container with id 3a86e599a4c74b9455d81a89c5350eb272b88811829c7a6d9e5007806861affe
Sep 10 04:49:54.316477 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:54.316445    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xv7fs" event={"ID":"70785dd7-57c4-4902-a64d-94051bf12e6c","Type":"ContainerStarted","Data":"e248af7e192e851578ea64f8fc6396fea2812a38634d980928fb760985a2d55e"}
Sep 10 04:49:54.316878 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:54.316512    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xv7fs"
Sep 10 04:49:54.316878 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:54.316539    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xv7fs" event={"ID":"70785dd7-57c4-4902-a64d-94051bf12e6c","Type":"ContainerStarted","Data":"3a86e599a4c74b9455d81a89c5350eb272b88811829c7a6d9e5007806861affe"}
Sep 10 04:49:54.318823 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:54.318739    2560 generic.go:356] "Generic (PLEG): container finished" podID="a69de829-2d81-46dc-b69e-ff78730dbb60" containerID="5ff3f3194da71ec3890914ca1100ac468bc23d9dc1adc9a0bd1e961e820efa7b" exitCode=0
Sep 10 04:49:54.318823 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:54.318777    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nphp9" event={"ID":"a69de829-2d81-46dc-b69e-ff78730dbb60","Type":"ContainerDied","Data":"5ff3f3194da71ec3890914ca1100ac468bc23d9dc1adc9a0bd1e961e820efa7b"}
Sep 10 04:49:54.319032 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:54.318831    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nphp9" event={"ID":"a69de829-2d81-46dc-b69e-ff78730dbb60","Type":"ContainerDied","Data":"aa669c222905555456fdefbbe16610820588abff7a172facd673b66d78d4364e"}
Sep 10 04:49:54.319032 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:54.318784    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nphp9"
Sep 10 04:49:54.319032 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:54.318876    2560 scope.go:117] "RemoveContainer" containerID="5ff3f3194da71ec3890914ca1100ac468bc23d9dc1adc9a0bd1e961e820efa7b"
Sep 10 04:49:54.335935 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:54.335914    2560 scope.go:117] "RemoveContainer" containerID="5ff3f3194da71ec3890914ca1100ac468bc23d9dc1adc9a0bd1e961e820efa7b"
Sep 10 04:49:54.336196 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:49:54.336178    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ff3f3194da71ec3890914ca1100ac468bc23d9dc1adc9a0bd1e961e820efa7b\": container with ID starting with 5ff3f3194da71ec3890914ca1100ac468bc23d9dc1adc9a0bd1e961e820efa7b not found: ID does not exist" containerID="5ff3f3194da71ec3890914ca1100ac468bc23d9dc1adc9a0bd1e961e820efa7b"
Sep 10 04:49:54.336263 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:54.336209    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ff3f3194da71ec3890914ca1100ac468bc23d9dc1adc9a0bd1e961e820efa7b"} err="failed to get container status \"5ff3f3194da71ec3890914ca1100ac468bc23d9dc1adc9a0bd1e961e820efa7b\": rpc error: code = NotFound desc = could not find container \"5ff3f3194da71ec3890914ca1100ac468bc23d9dc1adc9a0bd1e961e820efa7b\": container with ID starting with 5ff3f3194da71ec3890914ca1100ac468bc23d9dc1adc9a0bd1e961e820efa7b not found: ID does not exist"
Sep 10 04:49:54.337921 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:54.337881    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xv7fs" podStartSLOduration=1.337869009 podStartE2EDuration="1.337869009s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:49:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:49:54.337336671 +0000 UTC m=+533.999794418" watchObservedRunningTime="2026-09-10 04:49:54.337869009 +0000 UTC m=+534.000326747"
Sep 10 04:49:54.353033 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:54.353004    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nphp9"]
Sep 10 04:49:54.366105 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:54.366084    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nphp9"]
Sep 10 04:49:54.824568 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:49:54.824527    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a69de829-2d81-46dc-b69e-ff78730dbb60" path="/var/lib/kubelet/pods/a69de829-2d81-46dc-b69e-ff78730dbb60/volumes"
Sep 10 04:50:05.332469 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:05.332439    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xv7fs"
Sep 10 04:50:05.393701 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:05.393669    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-ghmpc"]
Sep 10 04:50:05.393965 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:05.393942    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-ghmpc" podUID="9842fe55-0213-4f6e-84a7-fa6953d4f833" containerName="manager" containerID="cri-o://674722018ca2f6b2ea15069203f31fd907bf358d2fa26de8a6cac68a79ba06de" gracePeriod=10
Sep 10 04:50:05.650502 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:05.650475    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-ghmpc"
Sep 10 04:50:05.751561 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:05.751531    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7gzx7\" (UniqueName: \"kubernetes.io/projected/9842fe55-0213-4f6e-84a7-fa6953d4f833-kube-api-access-7gzx7\") pod \"9842fe55-0213-4f6e-84a7-fa6953d4f833\" (UID: \"9842fe55-0213-4f6e-84a7-fa6953d4f833\") "
Sep 10 04:50:05.751715 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:05.751581    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9842fe55-0213-4f6e-84a7-fa6953d4f833-extensions-socket-volume\") pod \"9842fe55-0213-4f6e-84a7-fa6953d4f833\" (UID: \"9842fe55-0213-4f6e-84a7-fa6953d4f833\") "
Sep 10 04:50:05.751976 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:05.751952    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9842fe55-0213-4f6e-84a7-fa6953d4f833-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9842fe55-0213-4f6e-84a7-fa6953d4f833" (UID: "9842fe55-0213-4f6e-84a7-fa6953d4f833"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 04:50:05.753603 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:05.753579    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9842fe55-0213-4f6e-84a7-fa6953d4f833-kube-api-access-7gzx7" (OuterVolumeSpecName: "kube-api-access-7gzx7") pod "9842fe55-0213-4f6e-84a7-fa6953d4f833" (UID: "9842fe55-0213-4f6e-84a7-fa6953d4f833"). InnerVolumeSpecName "kube-api-access-7gzx7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 04:50:05.852975 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:05.852936    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7gzx7\" (UniqueName: \"kubernetes.io/projected/9842fe55-0213-4f6e-84a7-fa6953d4f833-kube-api-access-7gzx7\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:50:05.852975 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:05.852972    2560 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9842fe55-0213-4f6e-84a7-fa6953d4f833-extensions-socket-volume\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:50:06.386976 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:06.386941    2560 generic.go:356] "Generic (PLEG): container finished" podID="9842fe55-0213-4f6e-84a7-fa6953d4f833" containerID="674722018ca2f6b2ea15069203f31fd907bf358d2fa26de8a6cac68a79ba06de" exitCode=0
Sep 10 04:50:06.387419 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:06.386985    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-ghmpc"
Sep 10 04:50:06.387419 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:06.387025    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-ghmpc" event={"ID":"9842fe55-0213-4f6e-84a7-fa6953d4f833","Type":"ContainerDied","Data":"674722018ca2f6b2ea15069203f31fd907bf358d2fa26de8a6cac68a79ba06de"}
Sep 10 04:50:06.387419 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:06.387087    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-ghmpc" event={"ID":"9842fe55-0213-4f6e-84a7-fa6953d4f833","Type":"ContainerDied","Data":"7be6fc1f7af653b35578e222df3c1b75bd10ee54bcaf6475361098a551d6cd10"}
Sep 10 04:50:06.387419 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:06.387121    2560 scope.go:117] "RemoveContainer" containerID="674722018ca2f6b2ea15069203f31fd907bf358d2fa26de8a6cac68a79ba06de"
Sep 10 04:50:06.396306 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:06.396120    2560 scope.go:117] "RemoveContainer" containerID="674722018ca2f6b2ea15069203f31fd907bf358d2fa26de8a6cac68a79ba06de"
Sep 10 04:50:06.396417 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:50:06.396397    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"674722018ca2f6b2ea15069203f31fd907bf358d2fa26de8a6cac68a79ba06de\": container with ID starting with 674722018ca2f6b2ea15069203f31fd907bf358d2fa26de8a6cac68a79ba06de not found: ID does not exist" containerID="674722018ca2f6b2ea15069203f31fd907bf358d2fa26de8a6cac68a79ba06de"
Sep 10 04:50:06.396461 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:06.396424    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"674722018ca2f6b2ea15069203f31fd907bf358d2fa26de8a6cac68a79ba06de"} err="failed to get container status \"674722018ca2f6b2ea15069203f31fd907bf358d2fa26de8a6cac68a79ba06de\": rpc error: code = NotFound desc = could not find container \"674722018ca2f6b2ea15069203f31fd907bf358d2fa26de8a6cac68a79ba06de\": container with ID starting with 674722018ca2f6b2ea15069203f31fd907bf358d2fa26de8a6cac68a79ba06de not found: ID does not exist"
Sep 10 04:50:06.408660 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:06.408634    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-ghmpc"]
Sep 10 04:50:06.412262 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:06.412240    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-ghmpc"]
Sep 10 04:50:06.825470 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:06.825396    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9842fe55-0213-4f6e-84a7-fa6953d4f833" path="/var/lib/kubelet/pods/9842fe55-0213-4f6e-84a7-fa6953d4f833/volumes"
Sep 10 04:50:23.697044 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:23.697007    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-bgzks"]
Sep 10 04:50:23.697508 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:23.697346    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9842fe55-0213-4f6e-84a7-fa6953d4f833" containerName="manager"
Sep 10 04:50:23.697508 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:23.697357    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9842fe55-0213-4f6e-84a7-fa6953d4f833" containerName="manager"
Sep 10 04:50:23.697508 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:23.697419    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9842fe55-0213-4f6e-84a7-fa6953d4f833" containerName="manager"
Sep 10 04:50:23.718418 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:23.718394    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-bgzks"]
Sep 10 04:50:23.718546 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:23.718482    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-bgzks"
Sep 10 04:50:23.720620 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:23.720601    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 10 04:50:23.791679 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:23.791647    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-bgzks"]
Sep 10 04:50:23.796927 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:23.796896    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8337b4db-cbe8-45df-bfcb-5378c92f210f-config-file\") pod \"limitador-limitador-8588749977-bgzks\" (UID: \"8337b4db-cbe8-45df-bfcb-5378c92f210f\") " pod="kuadrant-system/limitador-limitador-8588749977-bgzks"
Sep 10 04:50:23.797057 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:23.796983    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twkjk\" (UniqueName: \"kubernetes.io/projected/8337b4db-cbe8-45df-bfcb-5378c92f210f-kube-api-access-twkjk\") pod \"limitador-limitador-8588749977-bgzks\" (UID: \"8337b4db-cbe8-45df-bfcb-5378c92f210f\") " pod="kuadrant-system/limitador-limitador-8588749977-bgzks"
Sep 10 04:50:23.897841 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:23.897812    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8337b4db-cbe8-45df-bfcb-5378c92f210f-config-file\") pod \"limitador-limitador-8588749977-bgzks\" (UID: \"8337b4db-cbe8-45df-bfcb-5378c92f210f\") " pod="kuadrant-system/limitador-limitador-8588749977-bgzks"
Sep 10 04:50:23.898006 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:23.897899    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twkjk\" (UniqueName: \"kubernetes.io/projected/8337b4db-cbe8-45df-bfcb-5378c92f210f-kube-api-access-twkjk\") pod \"limitador-limitador-8588749977-bgzks\" (UID: \"8337b4db-cbe8-45df-bfcb-5378c92f210f\") " pod="kuadrant-system/limitador-limitador-8588749977-bgzks"
Sep 10 04:50:23.898594 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:23.898569    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8337b4db-cbe8-45df-bfcb-5378c92f210f-config-file\") pod \"limitador-limitador-8588749977-bgzks\" (UID: \"8337b4db-cbe8-45df-bfcb-5378c92f210f\") " pod="kuadrant-system/limitador-limitador-8588749977-bgzks"
Sep 10 04:50:23.905348 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:23.905327    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-twkjk\" (UniqueName: \"kubernetes.io/projected/8337b4db-cbe8-45df-bfcb-5378c92f210f-kube-api-access-twkjk\") pod \"limitador-limitador-8588749977-bgzks\" (UID: \"8337b4db-cbe8-45df-bfcb-5378c92f210f\") " pod="kuadrant-system/limitador-limitador-8588749977-bgzks"
Sep 10 04:50:23.998969 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:23.998906    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 04:50:24.002323 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:24.002307    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"
Sep 10 04:50:24.008760 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:24.008738    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 04:50:24.028070 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:24.028045    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-bgzks"
Sep 10 04:50:24.037929 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:24.037907    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 04:50:24.100558 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:24.100392    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e07d792c-848b-45b3-bfa2-4bf3b39663b8-config-file\") pod \"limitador-limitador-84994f7ffc-5xnsh\" (UID: \"e07d792c-848b-45b3-bfa2-4bf3b39663b8\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"
Sep 10 04:50:24.100558 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:24.100426    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hd7mj\" (UniqueName: \"kubernetes.io/projected/e07d792c-848b-45b3-bfa2-4bf3b39663b8-kube-api-access-hd7mj\") pod \"limitador-limitador-84994f7ffc-5xnsh\" (UID: \"e07d792c-848b-45b3-bfa2-4bf3b39663b8\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"
Sep 10 04:50:24.201604 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:24.201576    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e07d792c-848b-45b3-bfa2-4bf3b39663b8-config-file\") pod \"limitador-limitador-84994f7ffc-5xnsh\" (UID: \"e07d792c-848b-45b3-bfa2-4bf3b39663b8\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"
Sep 10 04:50:24.201765 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:24.201610    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hd7mj\" (UniqueName: \"kubernetes.io/projected/e07d792c-848b-45b3-bfa2-4bf3b39663b8-kube-api-access-hd7mj\") pod \"limitador-limitador-84994f7ffc-5xnsh\" (UID: \"e07d792c-848b-45b3-bfa2-4bf3b39663b8\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"
Sep 10 04:50:24.202283 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:24.202262    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e07d792c-848b-45b3-bfa2-4bf3b39663b8-config-file\") pod \"limitador-limitador-84994f7ffc-5xnsh\" (UID: \"e07d792c-848b-45b3-bfa2-4bf3b39663b8\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"
Sep 10 04:50:24.208947 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:24.208921    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hd7mj\" (UniqueName: \"kubernetes.io/projected/e07d792c-848b-45b3-bfa2-4bf3b39663b8-kube-api-access-hd7mj\") pod \"limitador-limitador-84994f7ffc-5xnsh\" (UID: \"e07d792c-848b-45b3-bfa2-4bf3b39663b8\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"
Sep 10 04:50:24.298789 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:24.298765    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-bgzks"]
Sep 10 04:50:24.300770 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:50:24.300742    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8337b4db_cbe8_45df_bfcb_5378c92f210f.slice/crio-41e6e0bc989b8e39b30f1268dc9ce872b68e2533f41c41c569f7568e8f865c63 WatchSource:0}: Error finding container 41e6e0bc989b8e39b30f1268dc9ce872b68e2533f41c41c569f7568e8f865c63: Status 404 returned error can't find the container with id 41e6e0bc989b8e39b30f1268dc9ce872b68e2533f41c41c569f7568e8f865c63
Sep 10 04:50:24.313441 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:24.313421    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"
Sep 10 04:50:24.494709 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:24.494679    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-bgzks" event={"ID":"8337b4db-cbe8-45df-bfcb-5378c92f210f","Type":"ContainerStarted","Data":"41e6e0bc989b8e39b30f1268dc9ce872b68e2533f41c41c569f7568e8f865c63"}
Sep 10 04:50:24.584191 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:24.584168    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 04:50:24.586075 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:50:24.586043    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode07d792c_848b_45b3_bfa2_4bf3b39663b8.slice/crio-10247d50a55a644646a58650a2f6b81ada26a79ab2342d1722b3d0b7a071a5cb WatchSource:0}: Error finding container 10247d50a55a644646a58650a2f6b81ada26a79ab2342d1722b3d0b7a071a5cb: Status 404 returned error can't find the container with id 10247d50a55a644646a58650a2f6b81ada26a79ab2342d1722b3d0b7a071a5cb
Sep 10 04:50:25.502638 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:25.502596    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-5xnsh" event={"ID":"e07d792c-848b-45b3-bfa2-4bf3b39663b8","Type":"ContainerStarted","Data":"10247d50a55a644646a58650a2f6b81ada26a79ab2342d1722b3d0b7a071a5cb"}
Sep 10 04:50:26.508918 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:26.508880    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-bgzks" event={"ID":"8337b4db-cbe8-45df-bfcb-5378c92f210f","Type":"ContainerStarted","Data":"18fd8c5054f679b79c0532e84a05c64229153b2a995d4b061148005885fde04e"}
Sep 10 04:50:26.509335 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:26.509054    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-bgzks"
Sep 10 04:50:26.510577 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:26.510539    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-5xnsh" event={"ID":"e07d792c-848b-45b3-bfa2-4bf3b39663b8","Type":"ContainerStarted","Data":"a976eb2c1af6cc840c64e3eec52973b59379b78eb181d762fc7c74735c385490"}
Sep 10 04:50:26.510707 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:26.510628    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"
Sep 10 04:50:26.528971 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:26.526279    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-bgzks" podStartSLOduration=2.139711393 podStartE2EDuration="3.526259949s" totalImagesPullingTime="1.386548556s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:50:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:50:26.522357548 +0000 UTC m=+566.184815296" watchObservedRunningTime="2026-09-10 04:50:26.526259949 +0000 UTC m=+566.188717698"
Sep 10 04:50:26.538228 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:26.538183    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-5xnsh" podStartSLOduration=2.438018971 podStartE2EDuration="3.538173118s" totalImagesPullingTime="1.100154147s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:50:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:50:26.536685957 +0000 UTC m=+566.199143706" watchObservedRunningTime="2026-09-10 04:50:26.538173118 +0000 UTC m=+566.200630864"
Sep 10 04:50:37.517945 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:37.517916    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"
Sep 10 04:50:37.518306 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:37.517983    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-bgzks"
Sep 10 04:50:37.579766 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:37.579734    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-bgzks"]
Sep 10 04:50:37.579940 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:37.579920    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-bgzks" podUID="8337b4db-cbe8-45df-bfcb-5378c92f210f" containerName="limitador" containerID="cri-o://18fd8c5054f679b79c0532e84a05c64229153b2a995d4b061148005885fde04e" gracePeriod=30
Sep 10 04:50:38.513973 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:38.513951    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-bgzks"
Sep 10 04:50:38.576735 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:38.576698    2560 generic.go:356] "Generic (PLEG): container finished" podID="8337b4db-cbe8-45df-bfcb-5378c92f210f" containerID="18fd8c5054f679b79c0532e84a05c64229153b2a995d4b061148005885fde04e" exitCode=0
Sep 10 04:50:38.577065 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:38.576756    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-bgzks"
Sep 10 04:50:38.577065 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:38.576782    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-bgzks" event={"ID":"8337b4db-cbe8-45df-bfcb-5378c92f210f","Type":"ContainerDied","Data":"18fd8c5054f679b79c0532e84a05c64229153b2a995d4b061148005885fde04e"}
Sep 10 04:50:38.577065 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:38.576876    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-bgzks" event={"ID":"8337b4db-cbe8-45df-bfcb-5378c92f210f","Type":"ContainerDied","Data":"41e6e0bc989b8e39b30f1268dc9ce872b68e2533f41c41c569f7568e8f865c63"}
Sep 10 04:50:38.577065 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:38.576901    2560 scope.go:117] "RemoveContainer" containerID="18fd8c5054f679b79c0532e84a05c64229153b2a995d4b061148005885fde04e"
Sep 10 04:50:38.585638 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:38.585470    2560 scope.go:117] "RemoveContainer" containerID="18fd8c5054f679b79c0532e84a05c64229153b2a995d4b061148005885fde04e"
Sep 10 04:50:38.585738 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:50:38.585720    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18fd8c5054f679b79c0532e84a05c64229153b2a995d4b061148005885fde04e\": container with ID starting with 18fd8c5054f679b79c0532e84a05c64229153b2a995d4b061148005885fde04e not found: ID does not exist" containerID="18fd8c5054f679b79c0532e84a05c64229153b2a995d4b061148005885fde04e"
Sep 10 04:50:38.585781 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:38.585746    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18fd8c5054f679b79c0532e84a05c64229153b2a995d4b061148005885fde04e"} err="failed to get container status \"18fd8c5054f679b79c0532e84a05c64229153b2a995d4b061148005885fde04e\": rpc error: code = NotFound desc = could not find container \"18fd8c5054f679b79c0532e84a05c64229153b2a995d4b061148005885fde04e\": container with ID starting with 18fd8c5054f679b79c0532e84a05c64229153b2a995d4b061148005885fde04e not found: ID does not exist"
Sep 10 04:50:38.614025 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:38.614005    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-twkjk\" (UniqueName: \"kubernetes.io/projected/8337b4db-cbe8-45df-bfcb-5378c92f210f-kube-api-access-twkjk\") pod \"8337b4db-cbe8-45df-bfcb-5378c92f210f\" (UID: \"8337b4db-cbe8-45df-bfcb-5378c92f210f\") "
Sep 10 04:50:38.614146 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:38.614131    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8337b4db-cbe8-45df-bfcb-5378c92f210f-config-file\") pod \"8337b4db-cbe8-45df-bfcb-5378c92f210f\" (UID: \"8337b4db-cbe8-45df-bfcb-5378c92f210f\") "
Sep 10 04:50:38.614424 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:38.614403    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8337b4db-cbe8-45df-bfcb-5378c92f210f-config-file" (OuterVolumeSpecName: "config-file") pod "8337b4db-cbe8-45df-bfcb-5378c92f210f" (UID: "8337b4db-cbe8-45df-bfcb-5378c92f210f"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 04:50:38.616058 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:38.616034    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8337b4db-cbe8-45df-bfcb-5378c92f210f-kube-api-access-twkjk" (OuterVolumeSpecName: "kube-api-access-twkjk") pod "8337b4db-cbe8-45df-bfcb-5378c92f210f" (UID: "8337b4db-cbe8-45df-bfcb-5378c92f210f"). InnerVolumeSpecName "kube-api-access-twkjk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 04:50:38.714668 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:38.714617    2560 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8337b4db-cbe8-45df-bfcb-5378c92f210f-config-file\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:50:38.714668 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:38.714637    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-twkjk\" (UniqueName: \"kubernetes.io/projected/8337b4db-cbe8-45df-bfcb-5378c92f210f-kube-api-access-twkjk\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:50:38.892358 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:38.892333    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-bgzks"]
Sep 10 04:50:38.894399 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:38.894379    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-bgzks"]
Sep 10 04:50:40.826161 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:40.826130    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8337b4db-cbe8-45df-bfcb-5378c92f210f" path="/var/lib/kubelet/pods/8337b4db-cbe8-45df-bfcb-5378c92f210f/volumes"
Sep 10 04:50:44.108173 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:44.108143    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-l85dx"]
Sep 10 04:50:44.108657 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:44.108637    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8337b4db-cbe8-45df-bfcb-5378c92f210f" containerName="limitador"
Sep 10 04:50:44.108739 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:44.108659    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="8337b4db-cbe8-45df-bfcb-5378c92f210f" containerName="limitador"
Sep 10 04:50:44.108781 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:44.108769    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="8337b4db-cbe8-45df-bfcb-5378c92f210f" containerName="limitador"
Sep 10 04:50:44.113315 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:44.113296    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-l85dx"
Sep 10 04:50:44.115472 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:44.115446    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 10 04:50:44.115595 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:44.115471    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-8w47t\""
Sep 10 04:50:44.115595 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:44.115490    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 10 04:50:44.116161 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:44.116132    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 04:50:44.120000 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:44.119980    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-l85dx"]
Sep 10 04:50:44.257712 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:44.257688    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z865d\" (UniqueName: \"kubernetes.io/projected/0dc1823b-e1c9-4283-972f-b1f242f7171a-kube-api-access-z865d\") pod \"postgres-69fb4594cf-l85dx\" (UID: \"0dc1823b-e1c9-4283-972f-b1f242f7171a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-l85dx"
Sep 10 04:50:44.257831 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:44.257738    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/0dc1823b-e1c9-4283-972f-b1f242f7171a-data\") pod \"postgres-69fb4594cf-l85dx\" (UID: \"0dc1823b-e1c9-4283-972f-b1f242f7171a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-l85dx"
Sep 10 04:50:44.358614 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:44.358549    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z865d\" (UniqueName: \"kubernetes.io/projected/0dc1823b-e1c9-4283-972f-b1f242f7171a-kube-api-access-z865d\") pod \"postgres-69fb4594cf-l85dx\" (UID: \"0dc1823b-e1c9-4283-972f-b1f242f7171a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-l85dx"
Sep 10 04:50:44.358614 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:44.358590    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/0dc1823b-e1c9-4283-972f-b1f242f7171a-data\") pod \"postgres-69fb4594cf-l85dx\" (UID: \"0dc1823b-e1c9-4283-972f-b1f242f7171a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-l85dx"
Sep 10 04:50:44.358912 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:44.358896    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/0dc1823b-e1c9-4283-972f-b1f242f7171a-data\") pod \"postgres-69fb4594cf-l85dx\" (UID: \"0dc1823b-e1c9-4283-972f-b1f242f7171a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-l85dx"
Sep 10 04:50:44.365399 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:44.365378    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z865d\" (UniqueName: \"kubernetes.io/projected/0dc1823b-e1c9-4283-972f-b1f242f7171a-kube-api-access-z865d\") pod \"postgres-69fb4594cf-l85dx\" (UID: \"0dc1823b-e1c9-4283-972f-b1f242f7171a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-l85dx"
Sep 10 04:50:44.426262 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:44.426230    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-l85dx"
Sep 10 04:50:44.710603 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:44.710581    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-l85dx"]
Sep 10 04:50:44.712200 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:50:44.712171    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0dc1823b_e1c9_4283_972f_b1f242f7171a.slice/crio-42c5c062e72014a980ba6116e40f5f83a4ef4628fd0244fd3d1e7b5d91963bdb WatchSource:0}: Error finding container 42c5c062e72014a980ba6116e40f5f83a4ef4628fd0244fd3d1e7b5d91963bdb: Status 404 returned error can't find the container with id 42c5c062e72014a980ba6116e40f5f83a4ef4628fd0244fd3d1e7b5d91963bdb
Sep 10 04:50:45.618575 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:45.618540    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-l85dx" event={"ID":"0dc1823b-e1c9-4283-972f-b1f242f7171a","Type":"ContainerStarted","Data":"42c5c062e72014a980ba6116e40f5f83a4ef4628fd0244fd3d1e7b5d91963bdb"}
Sep 10 04:50:47.632153 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:47.632122    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-l85dx" event={"ID":"0dc1823b-e1c9-4283-972f-b1f242f7171a","Type":"ContainerStarted","Data":"2ff28f68608b21acf1e704afa5e730dc4f38d9073ba7880bf9aec53f66b162a3"}
Sep 10 04:50:47.632564 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:47.632187    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-l85dx"
Sep 10 04:50:47.648540 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:47.648490    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-l85dx" podStartSLOduration=1.411466826 podStartE2EDuration="3.648472852s" totalImagesPullingTime="2.237006026s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:50:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:50:47.647910568 +0000 UTC m=+587.310368316" watchObservedRunningTime="2026-09-10 04:50:47.648472852 +0000 UTC m=+587.310930651"
Sep 10 04:50:53.666805 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:50:53.666773    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-l85dx"
Sep 10 04:51:00.796931 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:51:00.796904    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-p5zjp_8b3ec8dc-1508-4537-8dc3-b9de1ff22d03/console-operator/1.log"
Sep 10 04:51:00.808481 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:51:00.808453    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-p5zjp_8b3ec8dc-1508-4537-8dc3-b9de1ff22d03/console-operator/1.log"
Sep 10 04:51:01.794221 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:51:01.794188    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7597cb784c-845nm"]
Sep 10 04:51:01.802561 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:51:01.802538    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7597cb784c-845nm"
Sep 10 04:51:01.805461 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:51:01.805443    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-z9tjc\""
Sep 10 04:51:01.805575 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:51:01.805478    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 10 04:51:01.805655 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:51:01.805635    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 10 04:51:01.805716 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:51:01.805635    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 10 04:51:01.806608 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:51:01.806587    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7597cb784c-845nm"]
Sep 10 04:51:01.886128 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:51:01.886101    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f3aaedd5-d3e1-497a-88bb-1214e7dc512b-webhook-cert\") pod \"maas-controller-7597cb784c-845nm\" (UID: \"f3aaedd5-d3e1-497a-88bb-1214e7dc512b\") " pod="opendatahub/maas-controller-7597cb784c-845nm"
Sep 10 04:51:01.886257 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:51:01.886143    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7jbh\" (UniqueName: \"kubernetes.io/projected/f3aaedd5-d3e1-497a-88bb-1214e7dc512b-kube-api-access-q7jbh\") pod \"maas-controller-7597cb784c-845nm\" (UID: \"f3aaedd5-d3e1-497a-88bb-1214e7dc512b\") " pod="opendatahub/maas-controller-7597cb784c-845nm"
Sep 10 04:51:01.886257 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:51:01.886220    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3aaedd5-d3e1-497a-88bb-1214e7dc512b-metrics-certs\") pod \"maas-controller-7597cb784c-845nm\" (UID: \"f3aaedd5-d3e1-497a-88bb-1214e7dc512b\") " pod="opendatahub/maas-controller-7597cb784c-845nm"
Sep 10 04:51:01.987018 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:51:01.986989    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7jbh\" (UniqueName: \"kubernetes.io/projected/f3aaedd5-d3e1-497a-88bb-1214e7dc512b-kube-api-access-q7jbh\") pod \"maas-controller-7597cb784c-845nm\" (UID: \"f3aaedd5-d3e1-497a-88bb-1214e7dc512b\") " pod="opendatahub/maas-controller-7597cb784c-845nm"
Sep 10 04:51:01.987135 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:51:01.987046    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3aaedd5-d3e1-497a-88bb-1214e7dc512b-metrics-certs\") pod \"maas-controller-7597cb784c-845nm\" (UID: \"f3aaedd5-d3e1-497a-88bb-1214e7dc512b\") " pod="opendatahub/maas-controller-7597cb784c-845nm"
Sep 10 04:51:01.987135 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:51:01.987098    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f3aaedd5-d3e1-497a-88bb-1214e7dc512b-webhook-cert\") pod \"maas-controller-7597cb784c-845nm\" (UID: \"f3aaedd5-d3e1-497a-88bb-1214e7dc512b\") " pod="opendatahub/maas-controller-7597cb784c-845nm"
Sep 10 04:51:01.987207 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:51:01.987187    2560 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Sep 10 04:51:01.987256 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:51:01.987247    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3aaedd5-d3e1-497a-88bb-1214e7dc512b-webhook-cert podName:f3aaedd5-d3e1-497a-88bb-1214e7dc512b nodeName:}" failed. No retries permitted until 2026-09-10 04:51:02.487232533 +0000 UTC m=+602.149690271 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/f3aaedd5-d3e1-497a-88bb-1214e7dc512b-webhook-cert") pod "maas-controller-7597cb784c-845nm" (UID: "f3aaedd5-d3e1-497a-88bb-1214e7dc512b") : secret "maas-controller-webhook-cert" not found
Sep 10 04:51:01.989478 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:51:01.989451    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3aaedd5-d3e1-497a-88bb-1214e7dc512b-metrics-certs\") pod \"maas-controller-7597cb784c-845nm\" (UID: \"f3aaedd5-d3e1-497a-88bb-1214e7dc512b\") " pod="opendatahub/maas-controller-7597cb784c-845nm"
Sep 10 04:51:01.996953 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:51:01.996932    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7jbh\" (UniqueName: \"kubernetes.io/projected/f3aaedd5-d3e1-497a-88bb-1214e7dc512b-kube-api-access-q7jbh\") pod \"maas-controller-7597cb784c-845nm\" (UID: \"f3aaedd5-d3e1-497a-88bb-1214e7dc512b\") " pod="opendatahub/maas-controller-7597cb784c-845nm"
Sep 10 04:51:02.491127 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:51:02.491083    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f3aaedd5-d3e1-497a-88bb-1214e7dc512b-webhook-cert\") pod \"maas-controller-7597cb784c-845nm\" (UID: \"f3aaedd5-d3e1-497a-88bb-1214e7dc512b\") " pod="opendatahub/maas-controller-7597cb784c-845nm"
Sep 10 04:51:02.493462 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:51:02.493439    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f3aaedd5-d3e1-497a-88bb-1214e7dc512b-webhook-cert\") pod \"maas-controller-7597cb784c-845nm\" (UID: \"f3aaedd5-d3e1-497a-88bb-1214e7dc512b\") " pod="opendatahub/maas-controller-7597cb784c-845nm"
Sep 10 04:51:02.714365 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:51:02.714331    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7597cb784c-845nm"
Sep 10 04:51:02.986093 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:51:02.986071    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7597cb784c-845nm"]
Sep 10 04:51:02.987969 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:51:02.987943    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3aaedd5_d3e1_497a_88bb_1214e7dc512b.slice/crio-72a74f9b0f82bd66f0abc321f52d7d40e4d97af663a29fb2671e629cc93f06f1 WatchSource:0}: Error finding container 72a74f9b0f82bd66f0abc321f52d7d40e4d97af663a29fb2671e629cc93f06f1: Status 404 returned error can't find the container with id 72a74f9b0f82bd66f0abc321f52d7d40e4d97af663a29fb2671e629cc93f06f1
Sep 10 04:51:03.723514 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:51:03.723480    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7597cb784c-845nm" event={"ID":"f3aaedd5-d3e1-497a-88bb-1214e7dc512b","Type":"ContainerStarted","Data":"72a74f9b0f82bd66f0abc321f52d7d40e4d97af663a29fb2671e629cc93f06f1"}
Sep 10 04:51:05.737205 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:51:05.737167    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7597cb784c-845nm" event={"ID":"f3aaedd5-d3e1-497a-88bb-1214e7dc512b","Type":"ContainerStarted","Data":"1d05d749dec13e9265d220dd4f5ed28370afd2ac39f638a7ca489a11ede5b6c2"}
Sep 10 04:51:05.737617 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:51:05.737266    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7597cb784c-845nm"
Sep 10 04:51:05.768350 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:51:05.768303    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7597cb784c-845nm" podStartSLOduration=2.26896235 podStartE2EDuration="4.768289556s" totalImagesPullingTime="2.499327206s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:51:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:51:05.768046112 +0000 UTC m=+605.430503859" watchObservedRunningTime="2026-09-10 04:51:05.768289556 +0000 UTC m=+605.430747303"
Sep 10 04:51:16.745134 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:51:16.745101    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7597cb784c-845nm"
Sep 10 04:51:39.521907 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:51:39.521875    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 04:51:56.888718 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:51:56.888687    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 04:52:15.095964 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:52:15.095928    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 04:52:21.495078 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:52:21.495038    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7w7x9"]
Sep 10 04:52:21.499723 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:52:21.499698    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7w7x9"
Sep 10 04:52:21.502522 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:52:21.502500    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 10 04:52:21.502606 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:52:21.502524    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 10 04:52:21.502606 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:52:21.502531    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 10 04:52:21.502690 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:52:21.502502    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-bstcg\""
Sep 10 04:52:21.507232 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:52:21.507210    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7w7x9"]
Sep 10 04:52:21.610760 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:52:21.610731    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gt4xc\" (UniqueName: \"kubernetes.io/projected/c782af71-9da6-4795-b73f-1186db77ffee-kube-api-access-gt4xc\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-7w7x9\" (UID: \"c782af71-9da6-4795-b73f-1186db77ffee\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7w7x9"
Sep 10 04:52:21.610917 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:52:21.610766    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c782af71-9da6-4795-b73f-1186db77ffee-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-7w7x9\" (UID: \"c782af71-9da6-4795-b73f-1186db77ffee\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7w7x9"
Sep 10 04:52:21.610917 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:52:21.610785    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c782af71-9da6-4795-b73f-1186db77ffee-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-7w7x9\" (UID: \"c782af71-9da6-4795-b73f-1186db77ffee\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7w7x9"
Sep 10 04:52:21.610917 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:52:21.610843    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c782af71-9da6-4795-b73f-1186db77ffee-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-7w7x9\" (UID: \"c782af71-9da6-4795-b73f-1186db77ffee\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7w7x9"
Sep 10 04:52:21.610917 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:52:21.610911    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c782af71-9da6-4795-b73f-1186db77ffee-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-7w7x9\" (UID: \"c782af71-9da6-4795-b73f-1186db77ffee\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7w7x9"
Sep 10 04:52:21.611114 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:52:21.610944    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c782af71-9da6-4795-b73f-1186db77ffee-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-7w7x9\" (UID: \"c782af71-9da6-4795-b73f-1186db77ffee\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7w7x9"
Sep 10 04:52:21.711333 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:52:21.711306    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gt4xc\" (UniqueName: \"kubernetes.io/projected/c782af71-9da6-4795-b73f-1186db77ffee-kube-api-access-gt4xc\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-7w7x9\" (UID: \"c782af71-9da6-4795-b73f-1186db77ffee\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7w7x9"
Sep 10 04:52:21.711454 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:52:21.711340    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c782af71-9da6-4795-b73f-1186db77ffee-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-7w7x9\" (UID: \"c782af71-9da6-4795-b73f-1186db77ffee\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7w7x9"
Sep 10 04:52:21.711454 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:52:21.711358    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c782af71-9da6-4795-b73f-1186db77ffee-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-7w7x9\" (UID: \"c782af71-9da6-4795-b73f-1186db77ffee\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7w7x9"
Sep 10 04:52:21.711454 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:52:21.711397    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c782af71-9da6-4795-b73f-1186db77ffee-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-7w7x9\" (UID: \"c782af71-9da6-4795-b73f-1186db77ffee\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7w7x9"
Sep 10 04:52:21.711454 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:52:21.711431    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c782af71-9da6-4795-b73f-1186db77ffee-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-7w7x9\" (UID: \"c782af71-9da6-4795-b73f-1186db77ffee\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7w7x9"
Sep 10 04:52:21.711454 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:52:21.711450    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c782af71-9da6-4795-b73f-1186db77ffee-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-7w7x9\" (UID: \"c782af71-9da6-4795-b73f-1186db77ffee\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7w7x9"
Sep 10 04:52:21.711733 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:52:21.711712    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c782af71-9da6-4795-b73f-1186db77ffee-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-7w7x9\" (UID: \"c782af71-9da6-4795-b73f-1186db77ffee\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7w7x9"
Sep 10 04:52:21.711876 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:52:21.711830    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c782af71-9da6-4795-b73f-1186db77ffee-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-7w7x9\" (UID: \"c782af71-9da6-4795-b73f-1186db77ffee\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7w7x9"
Sep 10 04:52:21.711946 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:52:21.711905    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c782af71-9da6-4795-b73f-1186db77ffee-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-7w7x9\" (UID: \"c782af71-9da6-4795-b73f-1186db77ffee\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7w7x9"
Sep 10 04:52:21.713632 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:52:21.713614    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c782af71-9da6-4795-b73f-1186db77ffee-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-7w7x9\" (UID: \"c782af71-9da6-4795-b73f-1186db77ffee\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7w7x9"
Sep 10 04:52:21.713918 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:52:21.713899    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c782af71-9da6-4795-b73f-1186db77ffee-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-7w7x9\" (UID: \"c782af71-9da6-4795-b73f-1186db77ffee\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7w7x9"
Sep 10 04:52:21.718577 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:52:21.718559    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gt4xc\" (UniqueName: \"kubernetes.io/projected/c782af71-9da6-4795-b73f-1186db77ffee-kube-api-access-gt4xc\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-7w7x9\" (UID: \"c782af71-9da6-4795-b73f-1186db77ffee\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7w7x9"
Sep 10 04:52:21.810834 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:52:21.810767    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7w7x9"
Sep 10 04:52:22.084181 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:52:22.084153    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7w7x9"]
Sep 10 04:52:22.085172 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:52:22.085145    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc782af71_9da6_4795_b73f_1186db77ffee.slice/crio-7990097930c00d2cbba1109c089a6cc19a61b51b85478c77f92d3decd44e4936 WatchSource:0}: Error finding container 7990097930c00d2cbba1109c089a6cc19a61b51b85478c77f92d3decd44e4936: Status 404 returned error can't find the container with id 7990097930c00d2cbba1109c089a6cc19a61b51b85478c77f92d3decd44e4936
Sep 10 04:52:22.086713 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:52:22.086688    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 04:52:22.162756 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:52:22.162729    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7w7x9" event={"ID":"c782af71-9da6-4795-b73f-1186db77ffee","Type":"ContainerStarted","Data":"7990097930c00d2cbba1109c089a6cc19a61b51b85478c77f92d3decd44e4936"}
Sep 10 04:52:22.495157 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:52:22.495119    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 04:52:23.171916 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:52:23.171888    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7w7x9" event={"ID":"c782af71-9da6-4795-b73f-1186db77ffee","Type":"ContainerStarted","Data":"8b03230aac24a7d08048e8a3f75ce7e1a09498818a077f8df1872712f0fde794"}
Sep 10 04:52:23.190187 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:52:23.190131    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7w7x9" podStartSLOduration=1.23228995 podStartE2EDuration="2.190110658s" totalImagesPullingTime="957.820708ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:52:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:52:23.187901948 +0000 UTC m=+682.850359697" watchObservedRunningTime="2026-09-10 04:52:23.190110658 +0000 UTC m=+682.852568407"
Sep 10 04:52:31.811083 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:52:31.811051    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7w7x9"
Sep 10 04:52:31.811590 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:52:31.811126    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7w7x9"
Sep 10 04:52:31.823446 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:52:31.823422    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7w7x9"
Sep 10 04:52:32.231865 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:52:32.231826    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-7w7x9"
Sep 10 04:52:33.184653 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:52:33.184618    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-74gbq"]
Sep 10 04:52:33.188301 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:52:33.188274    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-74gbq"
Sep 10 04:52:33.190385 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:52:33.190366    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Sep 10 04:52:33.200423 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:52:33.200396    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-74gbq"]
Sep 10 04:52:33.301211 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:52:33.301181    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dfbce4ad-006d-4e46-85c8-cdc8c94711c1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-74gbq\" (UID: \"dfbce4ad-006d-4e46-85c8-cdc8c94711c1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-74gbq"
Sep 10 04:52:33.301211 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:52:33.301213    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dfbce4ad-006d-4e46-85c8-cdc8c94711c1-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-74gbq\" (UID: \"dfbce4ad-006d-4e46-85c8-cdc8c94711c1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-74gbq"
Sep 10 04:52:33.301450 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:52:33.301234    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btcmn\" (UniqueName: \"kubernetes.io/projected/dfbce4ad-006d-4e46-85c8-cdc8c94711c1-kube-api-access-btcmn\") pod \"e2e-trlp-test-simulated-kserve-598466548d-74gbq\" (UID: \"dfbce4ad-006d-4e46-85c8-cdc8c94711c1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-74gbq"
Sep 10 04:52:33.301450 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:52:33.301257    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dfbce4ad-006d-4e46-85c8-cdc8c94711c1-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-74gbq\" (UID: \"dfbce4ad-006d-4e46-85c8-cdc8c94711c1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-74gbq"
Sep 10 04:52:33.301450 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:52:33.301355    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dfbce4ad-006d-4e46-85c8-cdc8c94711c1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-74gbq\" (UID: \"dfbce4ad-006d-4e46-85c8-cdc8c94711c1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-74gbq"
Sep 10 04:52:33.301450 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:52:33.301444    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dfbce4ad-006d-4e46-85c8-cdc8c94711c1-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-74gbq\" (UID: \"dfbce4ad-006d-4e46-85c8-cdc8c94711c1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-74gbq"
Sep 10 04:52:33.402294 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:52:33.402261    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dfbce4ad-006d-4e46-85c8-cdc8c94711c1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-74gbq\" (UID: \"dfbce4ad-006d-4e46-85c8-cdc8c94711c1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-74gbq"
Sep 10 04:52:33.402447 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:52:33.402297    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dfbce4ad-006d-4e46-85c8-cdc8c94711c1-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-74gbq\" (UID: \"dfbce4ad-006d-4e46-85c8-cdc8c94711c1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-74gbq"
Sep 10 04:52:33.402447 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:52:33.402325    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btcmn\" (UniqueName: \"kubernetes.io/projected/dfbce4ad-006d-4e46-85c8-cdc8c94711c1-kube-api-access-btcmn\") pod \"e2e-trlp-test-simulated-kserve-598466548d-74gbq\" (UID: \"dfbce4ad-006d-4e46-85c8-cdc8c94711c1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-74gbq"
Sep 10 04:52:33.402447 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:52:33.402360    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dfbce4ad-006d-4e46-85c8-cdc8c94711c1-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-74gbq\" (UID: \"dfbce4ad-006d-4e46-85c8-cdc8c94711c1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-74gbq"
Sep 10 04:52:33.402447 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:52:33.402402    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dfbce4ad-006d-4e46-85c8-cdc8c94711c1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-74gbq\" (UID: \"dfbce4ad-006d-4e46-85c8-cdc8c94711c1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-74gbq"
Sep 10 04:52:33.402655 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:52:33.402448    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dfbce4ad-006d-4e46-85c8-cdc8c94711c1-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-74gbq\" (UID: \"dfbce4ad-006d-4e46-85c8-cdc8c94711c1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-74gbq"
Sep 10 04:52:33.402706 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:52:33.402683    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dfbce4ad-006d-4e46-85c8-cdc8c94711c1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-74gbq\" (UID: \"dfbce4ad-006d-4e46-85c8-cdc8c94711c1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-74gbq"
Sep 10 04:52:33.402770 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:52:33.402749    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dfbce4ad-006d-4e46-85c8-cdc8c94711c1-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-74gbq\" (UID: \"dfbce4ad-006d-4e46-85c8-cdc8c94711c1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-74gbq"
Sep 10 04:52:33.402832 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:52:33.402811    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dfbce4ad-006d-4e46-85c8-cdc8c94711c1-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-74gbq\" (UID: \"dfbce4ad-006d-4e46-85c8-cdc8c94711c1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-74gbq"
Sep 10 04:52:33.404682 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:52:33.404661    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dfbce4ad-006d-4e46-85c8-cdc8c94711c1-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-74gbq\" (UID: \"dfbce4ad-006d-4e46-85c8-cdc8c94711c1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-74gbq"
Sep 10 04:52:33.404873 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:52:33.404839    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dfbce4ad-006d-4e46-85c8-cdc8c94711c1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-74gbq\" (UID: \"dfbce4ad-006d-4e46-85c8-cdc8c94711c1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-74gbq"
Sep 10 04:52:33.409664 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:52:33.409642    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-btcmn\" (UniqueName: \"kubernetes.io/projected/dfbce4ad-006d-4e46-85c8-cdc8c94711c1-kube-api-access-btcmn\") pod \"e2e-trlp-test-simulated-kserve-598466548d-74gbq\" (UID: \"dfbce4ad-006d-4e46-85c8-cdc8c94711c1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-74gbq"
Sep 10 04:52:33.499819 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:52:33.499748    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-74gbq"
Sep 10 04:52:33.775528 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:52:33.775491    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-74gbq"]
Sep 10 04:52:33.776673 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:52:33.776651    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfbce4ad_006d_4e46_85c8_cdc8c94711c1.slice/crio-d50474177b29d2ad511ebbd0f1909d207316473a1913d81b9126bb74110cf3f1 WatchSource:0}: Error finding container d50474177b29d2ad511ebbd0f1909d207316473a1913d81b9126bb74110cf3f1: Status 404 returned error can't find the container with id d50474177b29d2ad511ebbd0f1909d207316473a1913d81b9126bb74110cf3f1
Sep 10 04:52:34.233137 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:52:34.233095    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-74gbq" event={"ID":"dfbce4ad-006d-4e46-85c8-cdc8c94711c1","Type":"ContainerStarted","Data":"1fec8a7620a6e70610ccc70f93f08b2231f8c7600654716a93bf60ce5bf32aa4"}
Sep 10 04:52:34.233551 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:52:34.233161    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-74gbq" event={"ID":"dfbce4ad-006d-4e46-85c8-cdc8c94711c1","Type":"ContainerStarted","Data":"d50474177b29d2ad511ebbd0f1909d207316473a1913d81b9126bb74110cf3f1"}
Sep 10 04:52:34.253386 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:52:34.253321    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-74gbq" podStartSLOduration=1.077199133 podStartE2EDuration="1.253298697s" totalImagesPullingTime="176.099564ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:52:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:52:34.250951566 +0000 UTC m=+693.913409315" watchObservedRunningTime="2026-09-10 04:52:34.253298697 +0000 UTC m=+693.915756446"
Sep 10 04:52:34.300825 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:52:34.300789    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 04:52:40.600646 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:52:40.600612    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 04:52:43.500653 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:52:43.500620    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-74gbq"
Sep 10 04:52:43.501082 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:52:43.500694    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-74gbq"
Sep 10 04:52:43.513392 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:52:43.513367    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-74gbq"
Sep 10 04:52:44.302910 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:52:44.302882    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-74gbq"
Sep 10 04:52:47.993483 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:52:47.993449    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 04:52:55.702249 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:52:55.702166    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 04:54:47.949023 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:47.948987    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj"]
Sep 10 04:54:47.957682 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:47.957653    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj"
Sep 10 04:54:47.961103 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:47.960842    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-f3cc69-openshift-default-dockercfg-kk276\""
Sep 10 04:54:47.961412 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:47.961374    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 10 04:54:47.964868 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:47.964824    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj"]
Sep 10 04:54:48.070718 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:48.070686    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36df3522-93d4-4e24-80c4-68752d6e395d-istio-data\") pod \"e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj\" (UID: \"36df3522-93d4-4e24-80c4-68752d6e395d\") " pod="openshift-ingress/e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj"
Sep 10 04:54:48.070882 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:48.070748    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36df3522-93d4-4e24-80c4-68752d6e395d-credential-socket\") pod \"e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj\" (UID: \"36df3522-93d4-4e24-80c4-68752d6e395d\") " pod="openshift-ingress/e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj"
Sep 10 04:54:48.070882 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:48.070798    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36df3522-93d4-4e24-80c4-68752d6e395d-workload-certs\") pod \"e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj\" (UID: \"36df3522-93d4-4e24-80c4-68752d6e395d\") " pod="openshift-ingress/e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj"
Sep 10 04:54:48.070882 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:48.070817    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36df3522-93d4-4e24-80c4-68752d6e395d-istiod-ca-cert\") pod \"e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj\" (UID: \"36df3522-93d4-4e24-80c4-68752d6e395d\") " pod="openshift-ingress/e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj"
Sep 10 04:54:48.071010 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:48.070905    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36df3522-93d4-4e24-80c4-68752d6e395d-istio-token\") pod \"e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj\" (UID: \"36df3522-93d4-4e24-80c4-68752d6e395d\") " pod="openshift-ingress/e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj"
Sep 10 04:54:48.071010 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:48.070946    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36df3522-93d4-4e24-80c4-68752d6e395d-workload-socket\") pod \"e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj\" (UID: \"36df3522-93d4-4e24-80c4-68752d6e395d\") " pod="openshift-ingress/e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj"
Sep 10 04:54:48.071010 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:48.070970    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlf6h\" (UniqueName: \"kubernetes.io/projected/36df3522-93d4-4e24-80c4-68752d6e395d-kube-api-access-zlf6h\") pod \"e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj\" (UID: \"36df3522-93d4-4e24-80c4-68752d6e395d\") " pod="openshift-ingress/e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj"
Sep 10 04:54:48.071010 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:48.070995    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36df3522-93d4-4e24-80c4-68752d6e395d-istio-envoy\") pod \"e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj\" (UID: \"36df3522-93d4-4e24-80c4-68752d6e395d\") " pod="openshift-ingress/e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj"
Sep 10 04:54:48.071136 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:48.071017    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36df3522-93d4-4e24-80c4-68752d6e395d-istio-podinfo\") pod \"e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj\" (UID: \"36df3522-93d4-4e24-80c4-68752d6e395d\") " pod="openshift-ingress/e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj"
Sep 10 04:54:48.172123 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:48.172093    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36df3522-93d4-4e24-80c4-68752d6e395d-istio-envoy\") pod \"e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj\" (UID: \"36df3522-93d4-4e24-80c4-68752d6e395d\") " pod="openshift-ingress/e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj"
Sep 10 04:54:48.172254 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:48.172128    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36df3522-93d4-4e24-80c4-68752d6e395d-istio-podinfo\") pod \"e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj\" (UID: \"36df3522-93d4-4e24-80c4-68752d6e395d\") " pod="openshift-ingress/e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj"
Sep 10 04:54:48.172254 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:48.172150    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36df3522-93d4-4e24-80c4-68752d6e395d-istio-data\") pod \"e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj\" (UID: \"36df3522-93d4-4e24-80c4-68752d6e395d\") " pod="openshift-ingress/e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj"
Sep 10 04:54:48.172254 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:48.172195    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36df3522-93d4-4e24-80c4-68752d6e395d-credential-socket\") pod \"e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj\" (UID: \"36df3522-93d4-4e24-80c4-68752d6e395d\") " pod="openshift-ingress/e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj"
Sep 10 04:54:48.172254 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:48.172220    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36df3522-93d4-4e24-80c4-68752d6e395d-workload-certs\") pod \"e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj\" (UID: \"36df3522-93d4-4e24-80c4-68752d6e395d\") " pod="openshift-ingress/e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj"
Sep 10 04:54:48.172254 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:48.172239    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36df3522-93d4-4e24-80c4-68752d6e395d-istiod-ca-cert\") pod \"e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj\" (UID: \"36df3522-93d4-4e24-80c4-68752d6e395d\") " pod="openshift-ingress/e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj"
Sep 10 04:54:48.172515 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:48.172266    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36df3522-93d4-4e24-80c4-68752d6e395d-istio-token\") pod \"e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj\" (UID: \"36df3522-93d4-4e24-80c4-68752d6e395d\") " pod="openshift-ingress/e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj"
Sep 10 04:54:48.172515 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:48.172309    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36df3522-93d4-4e24-80c4-68752d6e395d-workload-socket\") pod \"e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj\" (UID: \"36df3522-93d4-4e24-80c4-68752d6e395d\") " pod="openshift-ingress/e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj"
Sep 10 04:54:48.172515 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:48.172338    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlf6h\" (UniqueName: \"kubernetes.io/projected/36df3522-93d4-4e24-80c4-68752d6e395d-kube-api-access-zlf6h\") pod \"e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj\" (UID: \"36df3522-93d4-4e24-80c4-68752d6e395d\") " pod="openshift-ingress/e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj"
Sep 10 04:54:48.172675 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:48.172564    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36df3522-93d4-4e24-80c4-68752d6e395d-istio-data\") pod \"e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj\" (UID: \"36df3522-93d4-4e24-80c4-68752d6e395d\") " pod="openshift-ingress/e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj"
Sep 10 04:54:48.172735 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:48.172693    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36df3522-93d4-4e24-80c4-68752d6e395d-workload-certs\") pod \"e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj\" (UID: \"36df3522-93d4-4e24-80c4-68752d6e395d\") " pod="openshift-ingress/e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj"
Sep 10 04:54:48.172735 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:48.172702    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36df3522-93d4-4e24-80c4-68752d6e395d-credential-socket\") pod \"e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj\" (UID: \"36df3522-93d4-4e24-80c4-68752d6e395d\") " pod="openshift-ingress/e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj"
Sep 10 04:54:48.172896 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:48.172873    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36df3522-93d4-4e24-80c4-68752d6e395d-workload-socket\") pod \"e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj\" (UID: \"36df3522-93d4-4e24-80c4-68752d6e395d\") " pod="openshift-ingress/e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj"
Sep 10 04:54:48.172974 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:48.172938    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36df3522-93d4-4e24-80c4-68752d6e395d-istiod-ca-cert\") pod \"e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj\" (UID: \"36df3522-93d4-4e24-80c4-68752d6e395d\") " pod="openshift-ingress/e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj"
Sep 10 04:54:48.174513 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:48.174493    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36df3522-93d4-4e24-80c4-68752d6e395d-istio-envoy\") pod \"e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj\" (UID: \"36df3522-93d4-4e24-80c4-68752d6e395d\") " pod="openshift-ingress/e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj"
Sep 10 04:54:48.174622 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:48.174594    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36df3522-93d4-4e24-80c4-68752d6e395d-istio-podinfo\") pod \"e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj\" (UID: \"36df3522-93d4-4e24-80c4-68752d6e395d\") " pod="openshift-ingress/e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj"
Sep 10 04:54:48.179373 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:48.179353    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36df3522-93d4-4e24-80c4-68752d6e395d-istio-token\") pod \"e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj\" (UID: \"36df3522-93d4-4e24-80c4-68752d6e395d\") " pod="openshift-ingress/e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj"
Sep 10 04:54:48.179588 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:48.179565    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlf6h\" (UniqueName: \"kubernetes.io/projected/36df3522-93d4-4e24-80c4-68752d6e395d-kube-api-access-zlf6h\") pod \"e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj\" (UID: \"36df3522-93d4-4e24-80c4-68752d6e395d\") " pod="openshift-ingress/e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj"
Sep 10 04:54:48.270973 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:48.270914    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj"
Sep 10 04:54:48.554776 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:48.554740    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj"]
Sep 10 04:54:48.556305 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:54:48.556273    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36df3522_93d4_4e24_80c4_68752d6e395d.slice/crio-e5d8ecbd5db100fab01ea88ecd24bb16d6b98e64941a1a648b760ef70077b306 WatchSource:0}: Error finding container e5d8ecbd5db100fab01ea88ecd24bb16d6b98e64941a1a648b760ef70077b306: Status 404 returned error can't find the container with id e5d8ecbd5db100fab01ea88ecd24bb16d6b98e64941a1a648b760ef70077b306
Sep 10 04:54:48.981654 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:48.981624    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj" event={"ID":"36df3522-93d4-4e24-80c4-68752d6e395d","Type":"ContainerStarted","Data":"e5d8ecbd5db100fab01ea88ecd24bb16d6b98e64941a1a648b760ef70077b306"}
Sep 10 04:54:49.711314 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:49.711273    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7870-86d778"]
Sep 10 04:54:49.714843 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:49.714820    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7870-86d778"
Sep 10 04:54:49.717075 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:49.717050    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-6n9j9\""
Sep 10 04:54:49.721131 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:49.721104    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7870-86d778"]
Sep 10 04:54:49.788128 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:49.788098    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftrz6\" (UniqueName: \"kubernetes.io/projected/88b0897d-e4ce-43d6-a1a5-67752f6b45c5-kube-api-access-ftrz6\") pod \"test-curl-7870-86d778\" (UID: \"88b0897d-e4ce-43d6-a1a5-67752f6b45c5\") " pod="opendatahub/test-curl-7870-86d778"
Sep 10 04:54:49.888946 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:49.888910    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftrz6\" (UniqueName: \"kubernetes.io/projected/88b0897d-e4ce-43d6-a1a5-67752f6b45c5-kube-api-access-ftrz6\") pod \"test-curl-7870-86d778\" (UID: \"88b0897d-e4ce-43d6-a1a5-67752f6b45c5\") " pod="opendatahub/test-curl-7870-86d778"
Sep 10 04:54:49.897388 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:49.897360    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftrz6\" (UniqueName: \"kubernetes.io/projected/88b0897d-e4ce-43d6-a1a5-67752f6b45c5-kube-api-access-ftrz6\") pod \"test-curl-7870-86d778\" (UID: \"88b0897d-e4ce-43d6-a1a5-67752f6b45c5\") " pod="opendatahub/test-curl-7870-86d778"
Sep 10 04:54:50.027754 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:50.027687    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7870-86d778"
Sep 10 04:54:50.318444 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:50.318417    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7870-86d778"]
Sep 10 04:54:50.320710 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:54:50.320680    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod88b0897d_e4ce_43d6_a1a5_67752f6b45c5.slice/crio-ee6c50834b449ed0ca656ec8c3bc1671379cfe5e71f641d00f1fd4e4247b1396 WatchSource:0}: Error finding container ee6c50834b449ed0ca656ec8c3bc1671379cfe5e71f641d00f1fd4e4247b1396: Status 404 returned error can't find the container with id ee6c50834b449ed0ca656ec8c3bc1671379cfe5e71f641d00f1fd4e4247b1396
Sep 10 04:54:50.995472 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:50.995435    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7870-86d778" event={"ID":"88b0897d-e4ce-43d6-a1a5-67752f6b45c5","Type":"ContainerStarted","Data":"ee6c50834b449ed0ca656ec8c3bc1671379cfe5e71f641d00f1fd4e4247b1396"}
Sep 10 04:54:51.400971 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:51.400936    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 04:54:51.401248 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:51.401009    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 04:54:51.401248 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:51.401036    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 04:54:51.896250 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:51.896209    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 04:54:52.004258 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:52.004219    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj" event={"ID":"36df3522-93d4-4e24-80c4-68752d6e395d","Type":"ContainerStarted","Data":"2f4587f8bcf737c5fa7bd835f545210ae4ba4904f1b9710a6add1e27603db557"}
Sep 10 04:54:52.024670 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:52.024623    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj" podStartSLOduration=2.182362407 podStartE2EDuration="5.024606308s" totalImagesPullingTime="2.842243901s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:54:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:54:52.021753701 +0000 UTC m=+831.684211449" watchObservedRunningTime="2026-09-10 04:54:52.024606308 +0000 UTC m=+831.687064058"
Sep 10 04:54:52.271505 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:52.271420    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj"
Sep 10 04:54:52.273295 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:52.273265    2560 patch_prober.go:28] interesting pod/e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Sep 10 04:54:52.273439 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:52.273335    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj" podUID="36df3522-93d4-4e24-80c4-68752d6e395d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Sep 10 04:54:53.276064 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:53.275983    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj"
Sep 10 04:54:54.016777 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:54.016739    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7870-86d778" event={"ID":"88b0897d-e4ce-43d6-a1a5-67752f6b45c5","Type":"ContainerStarted","Data":"7f0bd720096294e1b247b23d77e39f823fd0806e6383fcd0a93ebf97418f5c39"}
Sep 10 04:54:54.017183 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:54.017160    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj"
Sep 10 04:54:54.017995 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:54.017973    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj"
Sep 10 04:54:54.034380 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:54.034341    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7870-86d778" podStartSLOduration=2.407959236 podStartE2EDuration="5.034325906s" totalImagesPullingTime="2.62636667s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:54:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:54:54.031238135 +0000 UTC m=+833.693695883" watchObservedRunningTime="2026-09-10 04:54:54.034325906 +0000 UTC m=+833.696783653"
Sep 10 04:54:54.625701 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:54.625668    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7870-86d778"]
Sep 10 04:54:54.634619 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:54.634593    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7870-86d778"]
Sep 10 04:54:54.775113 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:54.775034    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7870-05f511"]
Sep 10 04:54:54.775479 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:54.775463    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88b0897d-e4ce-43d6-a1a5-67752f6b45c5" containerName="test-curl-7870-86d778"
Sep 10 04:54:54.775547 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:54.775481    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="88b0897d-e4ce-43d6-a1a5-67752f6b45c5" containerName="test-curl-7870-86d778"
Sep 10 04:54:54.775547 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:54.775542    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="88b0897d-e4ce-43d6-a1a5-67752f6b45c5" containerName="test-curl-7870-86d778"
Sep 10 04:54:54.778868 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:54.778830    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7870-05f511"
Sep 10 04:54:54.781894 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:54.781869    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7870-05f511"]
Sep 10 04:54:54.938098 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:54.938054    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzglk\" (UniqueName: \"kubernetes.io/projected/9bf16abb-27cf-4594-9afb-88d2bfad13e9-kube-api-access-fzglk\") pod \"test-curl-7870-05f511\" (UID: \"9bf16abb-27cf-4594-9afb-88d2bfad13e9\") " pod="opendatahub/test-curl-7870-05f511"
Sep 10 04:54:55.023010 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:54:55.022981    2560 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7870-86d778" container="test-curl-7870-86d778"
Sep 10 04:54:55.039050 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:55.038981    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzglk\" (UniqueName: \"kubernetes.io/projected/9bf16abb-27cf-4594-9afb-88d2bfad13e9-kube-api-access-fzglk\") pod \"test-curl-7870-05f511\" (UID: \"9bf16abb-27cf-4594-9afb-88d2bfad13e9\") " pod="opendatahub/test-curl-7870-05f511"
Sep 10 04:54:55.046547 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:55.046515    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzglk\" (UniqueName: \"kubernetes.io/projected/9bf16abb-27cf-4594-9afb-88d2bfad13e9-kube-api-access-fzglk\") pod \"test-curl-7870-05f511\" (UID: \"9bf16abb-27cf-4594-9afb-88d2bfad13e9\") " pod="opendatahub/test-curl-7870-05f511"
Sep 10 04:54:55.089826 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:55.089802    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7870-05f511"
Sep 10 04:54:55.362705 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:55.362681    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7870-05f511"]
Sep 10 04:54:55.364574 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:54:55.364548    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9bf16abb_27cf_4594_9afb_88d2bfad13e9.slice/crio-deef83278d25856070f06a1ac07ae2fd3c5b5219d6fc6963b216282f685f2a2e WatchSource:0}: Error finding container deef83278d25856070f06a1ac07ae2fd3c5b5219d6fc6963b216282f685f2a2e: Status 404 returned error can't find the container with id deef83278d25856070f06a1ac07ae2fd3c5b5219d6fc6963b216282f685f2a2e
Sep 10 04:54:56.030325 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:56.030285    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7870-05f511" event={"ID":"9bf16abb-27cf-4594-9afb-88d2bfad13e9","Type":"ContainerStarted","Data":"5b7fe3450d132700ba6a6d41035565df106e64cc630c504acb1ca4b0db568456"}
Sep 10 04:54:56.030784 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:56.030332    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7870-05f511" event={"ID":"9bf16abb-27cf-4594-9afb-88d2bfad13e9","Type":"ContainerStarted","Data":"deef83278d25856070f06a1ac07ae2fd3c5b5219d6fc6963b216282f685f2a2e"}
Sep 10 04:54:56.030784 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:56.030612    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7870-86d778" podUID="88b0897d-e4ce-43d6-a1a5-67752f6b45c5" containerName="test-curl-7870-86d778" containerID="cri-o://7f0bd720096294e1b247b23d77e39f823fd0806e6383fcd0a93ebf97418f5c39" gracePeriod=2
Sep 10 04:54:56.055324 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:56.055250    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7870-05f511" podStartSLOduration=2.055233167 podStartE2EDuration="2.055233167s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:54:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:54:56.052958069 +0000 UTC m=+835.715415816" watchObservedRunningTime="2026-09-10 04:54:56.055233167 +0000 UTC m=+835.717690938"
Sep 10 04:54:56.063800 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:56.063771    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-f3cc69-6bb7995f88-fkfnd"]
Sep 10 04:54:56.067276 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:56.067251    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f3cc69-6bb7995f88-fkfnd"
Sep 10 04:54:56.069491 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:56.069459    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-f3cc69-serving-cert\""
Sep 10 04:54:56.069721 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:56.069704    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-ksvhk\""
Sep 10 04:54:56.070035 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:56.070016    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 10 04:54:56.101833 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:56.101795    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-f3cc69-6bb7995f88-fkfnd"]
Sep 10 04:54:56.151233 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:56.151195    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58ktf\" (UniqueName: \"kubernetes.io/projected/4b7a8b05-05bf-4c07-97a5-e7f20f687eee-kube-api-access-58ktf\") pod \"maas-api-e2e-inf-a-f3cc69-6bb7995f88-fkfnd\" (UID: \"4b7a8b05-05bf-4c07-97a5-e7f20f687eee\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f3cc69-6bb7995f88-fkfnd"
Sep 10 04:54:56.151357 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:56.151248    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b7a8b05-05bf-4c07-97a5-e7f20f687eee-maas-api-tls\") pod \"maas-api-e2e-inf-a-f3cc69-6bb7995f88-fkfnd\" (UID: \"4b7a8b05-05bf-4c07-97a5-e7f20f687eee\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f3cc69-6bb7995f88-fkfnd"
Sep 10 04:54:56.151357 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:56.151270    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b7a8b05-05bf-4c07-97a5-e7f20f687eee-metrics-certs\") pod \"maas-api-e2e-inf-a-f3cc69-6bb7995f88-fkfnd\" (UID: \"4b7a8b05-05bf-4c07-97a5-e7f20f687eee\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f3cc69-6bb7995f88-fkfnd"
Sep 10 04:54:56.151357 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:56.151312    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b7a8b05-05bf-4c07-97a5-e7f20f687eee-openshift-service-ca\") pod \"maas-api-e2e-inf-a-f3cc69-6bb7995f88-fkfnd\" (UID: \"4b7a8b05-05bf-4c07-97a5-e7f20f687eee\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f3cc69-6bb7995f88-fkfnd"
Sep 10 04:54:56.251842 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:56.251805    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58ktf\" (UniqueName: \"kubernetes.io/projected/4b7a8b05-05bf-4c07-97a5-e7f20f687eee-kube-api-access-58ktf\") pod \"maas-api-e2e-inf-a-f3cc69-6bb7995f88-fkfnd\" (UID: \"4b7a8b05-05bf-4c07-97a5-e7f20f687eee\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f3cc69-6bb7995f88-fkfnd"
Sep 10 04:54:56.251992 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:56.251880    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b7a8b05-05bf-4c07-97a5-e7f20f687eee-maas-api-tls\") pod \"maas-api-e2e-inf-a-f3cc69-6bb7995f88-fkfnd\" (UID: \"4b7a8b05-05bf-4c07-97a5-e7f20f687eee\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f3cc69-6bb7995f88-fkfnd"
Sep 10 04:54:56.251992 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:56.251914    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b7a8b05-05bf-4c07-97a5-e7f20f687eee-metrics-certs\") pod \"maas-api-e2e-inf-a-f3cc69-6bb7995f88-fkfnd\" (UID: \"4b7a8b05-05bf-4c07-97a5-e7f20f687eee\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f3cc69-6bb7995f88-fkfnd"
Sep 10 04:54:56.251992 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:56.251958    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b7a8b05-05bf-4c07-97a5-e7f20f687eee-openshift-service-ca\") pod \"maas-api-e2e-inf-a-f3cc69-6bb7995f88-fkfnd\" (UID: \"4b7a8b05-05bf-4c07-97a5-e7f20f687eee\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f3cc69-6bb7995f88-fkfnd"
Sep 10 04:54:56.252617 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:56.252594    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b7a8b05-05bf-4c07-97a5-e7f20f687eee-openshift-service-ca\") pod \"maas-api-e2e-inf-a-f3cc69-6bb7995f88-fkfnd\" (UID: \"4b7a8b05-05bf-4c07-97a5-e7f20f687eee\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f3cc69-6bb7995f88-fkfnd"
Sep 10 04:54:56.254416 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:56.254387    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b7a8b05-05bf-4c07-97a5-e7f20f687eee-maas-api-tls\") pod \"maas-api-e2e-inf-a-f3cc69-6bb7995f88-fkfnd\" (UID: \"4b7a8b05-05bf-4c07-97a5-e7f20f687eee\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f3cc69-6bb7995f88-fkfnd"
Sep 10 04:54:56.254496 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:56.254441    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b7a8b05-05bf-4c07-97a5-e7f20f687eee-metrics-certs\") pod \"maas-api-e2e-inf-a-f3cc69-6bb7995f88-fkfnd\" (UID: \"4b7a8b05-05bf-4c07-97a5-e7f20f687eee\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f3cc69-6bb7995f88-fkfnd"
Sep 10 04:54:56.259572 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:56.259550    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58ktf\" (UniqueName: \"kubernetes.io/projected/4b7a8b05-05bf-4c07-97a5-e7f20f687eee-kube-api-access-58ktf\") pod \"maas-api-e2e-inf-a-f3cc69-6bb7995f88-fkfnd\" (UID: \"4b7a8b05-05bf-4c07-97a5-e7f20f687eee\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f3cc69-6bb7995f88-fkfnd"
Sep 10 04:54:56.379596 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:56.379557    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f3cc69-6bb7995f88-fkfnd"
Sep 10 04:54:56.658471 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:56.658443    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-f3cc69-6bb7995f88-fkfnd"]
Sep 10 04:54:56.660133 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:54:56.660101    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b7a8b05_05bf_4c07_97a5_e7f20f687eee.slice/crio-7cab1dee6027b8ecff3763312481a267bdd78f4104d93555c81d7721a74faa5a WatchSource:0}: Error finding container 7cab1dee6027b8ecff3763312481a267bdd78f4104d93555c81d7721a74faa5a: Status 404 returned error can't find the container with id 7cab1dee6027b8ecff3763312481a267bdd78f4104d93555c81d7721a74faa5a
Sep 10 04:54:56.678472 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:56.678449    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7870-05f511"]
Sep 10 04:54:56.682365 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:56.682342    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7870-05f511"]
Sep 10 04:54:57.038438 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:57.038344    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f3cc69-6bb7995f88-fkfnd" event={"ID":"4b7a8b05-05bf-4c07-97a5-e7f20f687eee","Type":"ContainerStarted","Data":"7cab1dee6027b8ecff3763312481a267bdd78f4104d93555c81d7721a74faa5a"}
Sep 10 04:54:57.038898 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:54:57.038542    2560 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7870-05f511" container="test-curl-7870-05f511"
Sep 10 04:54:57.490734 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:57.490701    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-autores-53c734-openshift-default-67d97c479b-wxvzk"]
Sep 10 04:54:57.491236 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:57.491219    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bf16abb-27cf-4594-9afb-88d2bfad13e9" containerName="test-curl-7870-05f511"
Sep 10 04:54:57.491236 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:57.491237    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bf16abb-27cf-4594-9afb-88d2bfad13e9" containerName="test-curl-7870-05f511"
Sep 10 04:54:57.491391 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:57.491347    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bf16abb-27cf-4594-9afb-88d2bfad13e9" containerName="test-curl-7870-05f511"
Sep 10 04:54:57.493893 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:57.493869    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-53c734-openshift-default-67d97c479b-wxvzk"
Sep 10 04:54:57.496186 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:57.496161    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-autores-53c734-openshift-default-dockercfg-zxjl5\""
Sep 10 04:54:57.505406 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:57.504346    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-53c734-openshift-default-67d97c479b-wxvzk"]
Sep 10 04:54:57.664285 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:57.664251    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25b2ee13-7792-46e0-a085-8c2c06b3b825-workload-certs\") pod \"e2e-autores-53c734-openshift-default-67d97c479b-wxvzk\" (UID: \"25b2ee13-7792-46e0-a085-8c2c06b3b825\") " pod="openshift-ingress/e2e-autores-53c734-openshift-default-67d97c479b-wxvzk"
Sep 10 04:54:57.664462 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:57.664322    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25b2ee13-7792-46e0-a085-8c2c06b3b825-istio-envoy\") pod \"e2e-autores-53c734-openshift-default-67d97c479b-wxvzk\" (UID: \"25b2ee13-7792-46e0-a085-8c2c06b3b825\") " pod="openshift-ingress/e2e-autores-53c734-openshift-default-67d97c479b-wxvzk"
Sep 10 04:54:57.664462 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:57.664353    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25b2ee13-7792-46e0-a085-8c2c06b3b825-istio-token\") pod \"e2e-autores-53c734-openshift-default-67d97c479b-wxvzk\" (UID: \"25b2ee13-7792-46e0-a085-8c2c06b3b825\") " pod="openshift-ingress/e2e-autores-53c734-openshift-default-67d97c479b-wxvzk"
Sep 10 04:54:57.664462 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:57.664401    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25b2ee13-7792-46e0-a085-8c2c06b3b825-workload-socket\") pod \"e2e-autores-53c734-openshift-default-67d97c479b-wxvzk\" (UID: \"25b2ee13-7792-46e0-a085-8c2c06b3b825\") " pod="openshift-ingress/e2e-autores-53c734-openshift-default-67d97c479b-wxvzk"
Sep 10 04:54:57.664462 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:57.664428    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25b2ee13-7792-46e0-a085-8c2c06b3b825-istio-data\") pod \"e2e-autores-53c734-openshift-default-67d97c479b-wxvzk\" (UID: \"25b2ee13-7792-46e0-a085-8c2c06b3b825\") " pod="openshift-ingress/e2e-autores-53c734-openshift-default-67d97c479b-wxvzk"
Sep 10 04:54:57.664667 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:57.664462    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25b2ee13-7792-46e0-a085-8c2c06b3b825-istio-podinfo\") pod \"e2e-autores-53c734-openshift-default-67d97c479b-wxvzk\" (UID: \"25b2ee13-7792-46e0-a085-8c2c06b3b825\") " pod="openshift-ingress/e2e-autores-53c734-openshift-default-67d97c479b-wxvzk"
Sep 10 04:54:57.664667 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:57.664488    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25b2ee13-7792-46e0-a085-8c2c06b3b825-istiod-ca-cert\") pod \"e2e-autores-53c734-openshift-default-67d97c479b-wxvzk\" (UID: \"25b2ee13-7792-46e0-a085-8c2c06b3b825\") " pod="openshift-ingress/e2e-autores-53c734-openshift-default-67d97c479b-wxvzk"
Sep 10 04:54:57.664667 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:57.664546    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25b2ee13-7792-46e0-a085-8c2c06b3b825-credential-socket\") pod \"e2e-autores-53c734-openshift-default-67d97c479b-wxvzk\" (UID: \"25b2ee13-7792-46e0-a085-8c2c06b3b825\") " pod="openshift-ingress/e2e-autores-53c734-openshift-default-67d97c479b-wxvzk"
Sep 10 04:54:57.664667 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:57.664573    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cpvn\" (UniqueName: \"kubernetes.io/projected/25b2ee13-7792-46e0-a085-8c2c06b3b825-kube-api-access-8cpvn\") pod \"e2e-autores-53c734-openshift-default-67d97c479b-wxvzk\" (UID: \"25b2ee13-7792-46e0-a085-8c2c06b3b825\") " pod="openshift-ingress/e2e-autores-53c734-openshift-default-67d97c479b-wxvzk"
Sep 10 04:54:57.765827 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:57.765749    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25b2ee13-7792-46e0-a085-8c2c06b3b825-workload-socket\") pod \"e2e-autores-53c734-openshift-default-67d97c479b-wxvzk\" (UID: \"25b2ee13-7792-46e0-a085-8c2c06b3b825\") " pod="openshift-ingress/e2e-autores-53c734-openshift-default-67d97c479b-wxvzk"
Sep 10 04:54:57.765827 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:57.765782    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25b2ee13-7792-46e0-a085-8c2c06b3b825-istio-data\") pod \"e2e-autores-53c734-openshift-default-67d97c479b-wxvzk\" (UID: \"25b2ee13-7792-46e0-a085-8c2c06b3b825\") " pod="openshift-ingress/e2e-autores-53c734-openshift-default-67d97c479b-wxvzk"
Sep 10 04:54:57.765827 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:57.765808    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25b2ee13-7792-46e0-a085-8c2c06b3b825-istio-podinfo\") pod \"e2e-autores-53c734-openshift-default-67d97c479b-wxvzk\" (UID: \"25b2ee13-7792-46e0-a085-8c2c06b3b825\") " pod="openshift-ingress/e2e-autores-53c734-openshift-default-67d97c479b-wxvzk"
Sep 10 04:54:57.766132 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:57.765831    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25b2ee13-7792-46e0-a085-8c2c06b3b825-istiod-ca-cert\") pod \"e2e-autores-53c734-openshift-default-67d97c479b-wxvzk\" (UID: \"25b2ee13-7792-46e0-a085-8c2c06b3b825\") " pod="openshift-ingress/e2e-autores-53c734-openshift-default-67d97c479b-wxvzk"
Sep 10 04:54:57.766132 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:57.765887    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25b2ee13-7792-46e0-a085-8c2c06b3b825-credential-socket\") pod \"e2e-autores-53c734-openshift-default-67d97c479b-wxvzk\" (UID: \"25b2ee13-7792-46e0-a085-8c2c06b3b825\") " pod="openshift-ingress/e2e-autores-53c734-openshift-default-67d97c479b-wxvzk"
Sep 10 04:54:57.766132 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:57.765915    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cpvn\" (UniqueName: \"kubernetes.io/projected/25b2ee13-7792-46e0-a085-8c2c06b3b825-kube-api-access-8cpvn\") pod \"e2e-autores-53c734-openshift-default-67d97c479b-wxvzk\" (UID: \"25b2ee13-7792-46e0-a085-8c2c06b3b825\") " pod="openshift-ingress/e2e-autores-53c734-openshift-default-67d97c479b-wxvzk"
Sep 10 04:54:57.766132 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:57.765979    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25b2ee13-7792-46e0-a085-8c2c06b3b825-workload-certs\") pod \"e2e-autores-53c734-openshift-default-67d97c479b-wxvzk\" (UID: \"25b2ee13-7792-46e0-a085-8c2c06b3b825\") " pod="openshift-ingress/e2e-autores-53c734-openshift-default-67d97c479b-wxvzk"
Sep 10 04:54:57.766132 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:57.766056    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25b2ee13-7792-46e0-a085-8c2c06b3b825-istio-envoy\") pod \"e2e-autores-53c734-openshift-default-67d97c479b-wxvzk\" (UID: \"25b2ee13-7792-46e0-a085-8c2c06b3b825\") " pod="openshift-ingress/e2e-autores-53c734-openshift-default-67d97c479b-wxvzk"
Sep 10 04:54:57.766132 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:57.766083    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25b2ee13-7792-46e0-a085-8c2c06b3b825-istio-token\") pod \"e2e-autores-53c734-openshift-default-67d97c479b-wxvzk\" (UID: \"25b2ee13-7792-46e0-a085-8c2c06b3b825\") " pod="openshift-ingress/e2e-autores-53c734-openshift-default-67d97c479b-wxvzk"
Sep 10 04:54:57.766432 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:57.766249    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25b2ee13-7792-46e0-a085-8c2c06b3b825-workload-socket\") pod \"e2e-autores-53c734-openshift-default-67d97c479b-wxvzk\" (UID: \"25b2ee13-7792-46e0-a085-8c2c06b3b825\") " pod="openshift-ingress/e2e-autores-53c734-openshift-default-67d97c479b-wxvzk"
Sep 10 04:54:57.766497 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:57.766466    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25b2ee13-7792-46e0-a085-8c2c06b3b825-workload-certs\") pod \"e2e-autores-53c734-openshift-default-67d97c479b-wxvzk\" (UID: \"25b2ee13-7792-46e0-a085-8c2c06b3b825\") " pod="openshift-ingress/e2e-autores-53c734-openshift-default-67d97c479b-wxvzk"
Sep 10 04:54:57.766497 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:57.766488    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25b2ee13-7792-46e0-a085-8c2c06b3b825-istio-data\") pod \"e2e-autores-53c734-openshift-default-67d97c479b-wxvzk\" (UID: \"25b2ee13-7792-46e0-a085-8c2c06b3b825\") " pod="openshift-ingress/e2e-autores-53c734-openshift-default-67d97c479b-wxvzk"
Sep 10 04:54:57.766604 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:57.766506    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25b2ee13-7792-46e0-a085-8c2c06b3b825-credential-socket\") pod \"e2e-autores-53c734-openshift-default-67d97c479b-wxvzk\" (UID: \"25b2ee13-7792-46e0-a085-8c2c06b3b825\") " pod="openshift-ingress/e2e-autores-53c734-openshift-default-67d97c479b-wxvzk"
Sep 10 04:54:57.766946 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:57.766923    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25b2ee13-7792-46e0-a085-8c2c06b3b825-istiod-ca-cert\") pod \"e2e-autores-53c734-openshift-default-67d97c479b-wxvzk\" (UID: \"25b2ee13-7792-46e0-a085-8c2c06b3b825\") " pod="openshift-ingress/e2e-autores-53c734-openshift-default-67d97c479b-wxvzk"
Sep 10 04:54:57.768743 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:57.768718    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25b2ee13-7792-46e0-a085-8c2c06b3b825-istio-envoy\") pod \"e2e-autores-53c734-openshift-default-67d97c479b-wxvzk\" (UID: \"25b2ee13-7792-46e0-a085-8c2c06b3b825\") " pod="openshift-ingress/e2e-autores-53c734-openshift-default-67d97c479b-wxvzk"
Sep 10 04:54:57.768959 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:57.768928    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25b2ee13-7792-46e0-a085-8c2c06b3b825-istio-podinfo\") pod \"e2e-autores-53c734-openshift-default-67d97c479b-wxvzk\" (UID: \"25b2ee13-7792-46e0-a085-8c2c06b3b825\") " pod="openshift-ingress/e2e-autores-53c734-openshift-default-67d97c479b-wxvzk"
Sep 10 04:54:57.773184 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:57.773160    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25b2ee13-7792-46e0-a085-8c2c06b3b825-istio-token\") pod \"e2e-autores-53c734-openshift-default-67d97c479b-wxvzk\" (UID: \"25b2ee13-7792-46e0-a085-8c2c06b3b825\") " pod="openshift-ingress/e2e-autores-53c734-openshift-default-67d97c479b-wxvzk"
Sep 10 04:54:57.773588 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:57.773567    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cpvn\" (UniqueName: \"kubernetes.io/projected/25b2ee13-7792-46e0-a085-8c2c06b3b825-kube-api-access-8cpvn\") pod \"e2e-autores-53c734-openshift-default-67d97c479b-wxvzk\" (UID: \"25b2ee13-7792-46e0-a085-8c2c06b3b825\") " pod="openshift-ingress/e2e-autores-53c734-openshift-default-67d97c479b-wxvzk"
Sep 10 04:54:57.809493 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:57.809429    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-53c734-openshift-default-67d97c479b-wxvzk"
Sep 10 04:54:58.045975 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:58.045944    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7870-05f511" podUID="9bf16abb-27cf-4594-9afb-88d2bfad13e9" containerName="test-curl-7870-05f511" containerID="cri-o://5b7fe3450d132700ba6a6d41035565df106e64cc630c504acb1ca4b0db568456" gracePeriod=2
Sep 10 04:54:58.337065 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:58.337037    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7870-86d778"
Sep 10 04:54:58.466686 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:58.466660    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-53c734-openshift-default-67d97c479b-wxvzk"]
Sep 10 04:54:58.468814 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:54:58.468777    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25b2ee13_7792_46e0_a085_8c2c06b3b825.slice/crio-ac125381d5ec25e3a2dba3094f7e314d6a396183f1a3dcbe9d87f0f204782b4a WatchSource:0}: Error finding container ac125381d5ec25e3a2dba3094f7e314d6a396183f1a3dcbe9d87f0f204782b4a: Status 404 returned error can't find the container with id ac125381d5ec25e3a2dba3094f7e314d6a396183f1a3dcbe9d87f0f204782b4a
Sep 10 04:54:58.471740 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:58.471718    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ftrz6\" (UniqueName: \"kubernetes.io/projected/88b0897d-e4ce-43d6-a1a5-67752f6b45c5-kube-api-access-ftrz6\") pod \"88b0897d-e4ce-43d6-a1a5-67752f6b45c5\" (UID: \"88b0897d-e4ce-43d6-a1a5-67752f6b45c5\") "
Sep 10 04:54:58.472419 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:58.472388    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 04:54:58.472516 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:58.472473    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 04:54:58.472580 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:58.472523    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 04:54:58.474107 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:58.474070    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88b0897d-e4ce-43d6-a1a5-67752f6b45c5-kube-api-access-ftrz6" (OuterVolumeSpecName: "kube-api-access-ftrz6") pod "88b0897d-e4ce-43d6-a1a5-67752f6b45c5" (UID: "88b0897d-e4ce-43d6-a1a5-67752f6b45c5"). InnerVolumeSpecName "kube-api-access-ftrz6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 04:54:58.572873 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:58.572774    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ftrz6\" (UniqueName: \"kubernetes.io/projected/88b0897d-e4ce-43d6-a1a5-67752f6b45c5-kube-api-access-ftrz6\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:54:58.825733 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:58.825663    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88b0897d-e4ce-43d6-a1a5-67752f6b45c5" path="/var/lib/kubelet/pods/88b0897d-e4ce-43d6-a1a5-67752f6b45c5/volumes"
Sep 10 04:54:59.053266 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:59.053228    2560 generic.go:356] "Generic (PLEG): container finished" podID="88b0897d-e4ce-43d6-a1a5-67752f6b45c5" containerID="7f0bd720096294e1b247b23d77e39f823fd0806e6383fcd0a93ebf97418f5c39" exitCode=137
Sep 10 04:54:59.053715 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:59.053275    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7870-86d778"
Sep 10 04:54:59.053715 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:59.053325    2560 scope.go:117] "RemoveContainer" containerID="7f0bd720096294e1b247b23d77e39f823fd0806e6383fcd0a93ebf97418f5c39"
Sep 10 04:54:59.055297 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:59.055234    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f3cc69-6bb7995f88-fkfnd" event={"ID":"4b7a8b05-05bf-4c07-97a5-e7f20f687eee","Type":"ContainerStarted","Data":"c535e01867f03fa893d11699493e1003f5b6c677a5ebcf5287ef786511d68243"}
Sep 10 04:54:59.055421 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:59.055326    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f3cc69-6bb7995f88-fkfnd"
Sep 10 04:54:59.057052 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:59.057029    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-53c734-openshift-default-67d97c479b-wxvzk" event={"ID":"25b2ee13-7792-46e0-a085-8c2c06b3b825","Type":"ContainerStarted","Data":"6be4f1c279c65b0bce2479c94b65c2245d50ea8d98916a803da5420949509b0c"}
Sep 10 04:54:59.057153 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:59.057076    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-53c734-openshift-default-67d97c479b-wxvzk" event={"ID":"25b2ee13-7792-46e0-a085-8c2c06b3b825","Type":"ContainerStarted","Data":"ac125381d5ec25e3a2dba3094f7e314d6a396183f1a3dcbe9d87f0f204782b4a"}
Sep 10 04:54:59.062221 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:59.062204    2560 scope.go:117] "RemoveContainer" containerID="7f0bd720096294e1b247b23d77e39f823fd0806e6383fcd0a93ebf97418f5c39"
Sep 10 04:54:59.062486 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:54:59.062462    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f0bd720096294e1b247b23d77e39f823fd0806e6383fcd0a93ebf97418f5c39\": container with ID starting with 7f0bd720096294e1b247b23d77e39f823fd0806e6383fcd0a93ebf97418f5c39 not found: ID does not exist" containerID="7f0bd720096294e1b247b23d77e39f823fd0806e6383fcd0a93ebf97418f5c39"
Sep 10 04:54:59.062580 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:59.062494    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f0bd720096294e1b247b23d77e39f823fd0806e6383fcd0a93ebf97418f5c39"} err="failed to get container status \"7f0bd720096294e1b247b23d77e39f823fd0806e6383fcd0a93ebf97418f5c39\": rpc error: code = NotFound desc = could not find container \"7f0bd720096294e1b247b23d77e39f823fd0806e6383fcd0a93ebf97418f5c39\": container with ID starting with 7f0bd720096294e1b247b23d77e39f823fd0806e6383fcd0a93ebf97418f5c39 not found: ID does not exist"
Sep 10 04:54:59.071001 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:59.070965    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f3cc69-6bb7995f88-fkfnd" podStartSLOduration=1.5064702639999998 podStartE2EDuration="3.070952313s" totalImagesPullingTime="1.564482049s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:54:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:54:59.070128163 +0000 UTC m=+838.732585910" watchObservedRunningTime="2026-09-10 04:54:59.070952313 +0000 UTC m=+838.733410060"
Sep 10 04:54:59.094401 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:59.094334    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-autores-53c734-openshift-default-67d97c479b-wxvzk" podStartSLOduration=2.094322149 podStartE2EDuration="2.094322149s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:54:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:54:59.093266876 +0000 UTC m=+838.755724624" watchObservedRunningTime="2026-09-10 04:54:59.094322149 +0000 UTC m=+838.756779896"
Sep 10 04:54:59.810303 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:59.810265    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-53c734-openshift-default-67d97c479b-wxvzk"
Sep 10 04:54:59.815072 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:54:59.815047    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-53c734-openshift-default-67d97c479b-wxvzk"
Sep 10 04:55:00.065332 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:00.065299    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-53c734-openshift-default-67d97c479b-wxvzk"
Sep 10 04:55:00.066221 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:00.066191    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-53c734-openshift-default-67d97c479b-wxvzk"
Sep 10 04:55:00.241608 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:00.241581    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7870-05f511"
Sep 10 04:55:00.390482 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:00.390452    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fzglk\" (UniqueName: \"kubernetes.io/projected/9bf16abb-27cf-4594-9afb-88d2bfad13e9-kube-api-access-fzglk\") pod \"9bf16abb-27cf-4594-9afb-88d2bfad13e9\" (UID: \"9bf16abb-27cf-4594-9afb-88d2bfad13e9\") "
Sep 10 04:55:00.392452 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:00.392423    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bf16abb-27cf-4594-9afb-88d2bfad13e9-kube-api-access-fzglk" (OuterVolumeSpecName: "kube-api-access-fzglk") pod "9bf16abb-27cf-4594-9afb-88d2bfad13e9" (UID: "9bf16abb-27cf-4594-9afb-88d2bfad13e9"). InnerVolumeSpecName "kube-api-access-fzglk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 04:55:00.492053 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:00.492028    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fzglk\" (UniqueName: \"kubernetes.io/projected/9bf16abb-27cf-4594-9afb-88d2bfad13e9-kube-api-access-fzglk\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:55:00.827082 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:00.826993    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9bf16abb-27cf-4594-9afb-88d2bfad13e9" path="/var/lib/kubelet/pods/9bf16abb-27cf-4594-9afb-88d2bfad13e9/volumes"
Sep 10 04:55:01.073049 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:01.073017    2560 generic.go:356] "Generic (PLEG): container finished" podID="9bf16abb-27cf-4594-9afb-88d2bfad13e9" containerID="5b7fe3450d132700ba6a6d41035565df106e64cc630c504acb1ca4b0db568456" exitCode=137
Sep 10 04:55:01.073509 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:01.073062    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7870-05f511"
Sep 10 04:55:01.073509 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:01.073123    2560 scope.go:117] "RemoveContainer" containerID="5b7fe3450d132700ba6a6d41035565df106e64cc630c504acb1ca4b0db568456"
Sep 10 04:55:01.082234 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:01.082201    2560 scope.go:117] "RemoveContainer" containerID="5b7fe3450d132700ba6a6d41035565df106e64cc630c504acb1ca4b0db568456"
Sep 10 04:55:01.082475 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:55:01.082457    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b7fe3450d132700ba6a6d41035565df106e64cc630c504acb1ca4b0db568456\": container with ID starting with 5b7fe3450d132700ba6a6d41035565df106e64cc630c504acb1ca4b0db568456 not found: ID does not exist" containerID="5b7fe3450d132700ba6a6d41035565df106e64cc630c504acb1ca4b0db568456"
Sep 10 04:55:01.082526 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:01.082482    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b7fe3450d132700ba6a6d41035565df106e64cc630c504acb1ca4b0db568456"} err="failed to get container status \"5b7fe3450d132700ba6a6d41035565df106e64cc630c504acb1ca4b0db568456\": rpc error: code = NotFound desc = could not find container \"5b7fe3450d132700ba6a6d41035565df106e64cc630c504acb1ca4b0db568456\": container with ID starting with 5b7fe3450d132700ba6a6d41035565df106e64cc630c504acb1ca4b0db568456 not found: ID does not exist"
Sep 10 04:55:02.400117 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:02.400083    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-53c734-7d4fb5594f-gc5xr"]
Sep 10 04:55:02.405391 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:02.405366    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-53c734-7d4fb5594f-gc5xr"
Sep 10 04:55:02.407431 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:02.407409    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-autores-53c734-serving-cert\""
Sep 10 04:55:02.414657 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:02.414322    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-53c734-7d4fb5594f-gc5xr"]
Sep 10 04:55:02.511710 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:02.511678    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a63d1621-8256-40d6-ae7c-8e1aa1e88777-openshift-service-ca\") pod \"maas-api-e2e-autores-53c734-7d4fb5594f-gc5xr\" (UID: \"a63d1621-8256-40d6-ae7c-8e1aa1e88777\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-53c734-7d4fb5594f-gc5xr"
Sep 10 04:55:02.511710 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:02.511712    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdlt8\" (UniqueName: \"kubernetes.io/projected/a63d1621-8256-40d6-ae7c-8e1aa1e88777-kube-api-access-tdlt8\") pod \"maas-api-e2e-autores-53c734-7d4fb5594f-gc5xr\" (UID: \"a63d1621-8256-40d6-ae7c-8e1aa1e88777\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-53c734-7d4fb5594f-gc5xr"
Sep 10 04:55:02.511940 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:02.511743    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a63d1621-8256-40d6-ae7c-8e1aa1e88777-metrics-certs\") pod \"maas-api-e2e-autores-53c734-7d4fb5594f-gc5xr\" (UID: \"a63d1621-8256-40d6-ae7c-8e1aa1e88777\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-53c734-7d4fb5594f-gc5xr"
Sep 10 04:55:02.511940 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:02.511825    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a63d1621-8256-40d6-ae7c-8e1aa1e88777-maas-api-tls\") pod \"maas-api-e2e-autores-53c734-7d4fb5594f-gc5xr\" (UID: \"a63d1621-8256-40d6-ae7c-8e1aa1e88777\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-53c734-7d4fb5594f-gc5xr"
Sep 10 04:55:02.612630 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:02.612592    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a63d1621-8256-40d6-ae7c-8e1aa1e88777-metrics-certs\") pod \"maas-api-e2e-autores-53c734-7d4fb5594f-gc5xr\" (UID: \"a63d1621-8256-40d6-ae7c-8e1aa1e88777\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-53c734-7d4fb5594f-gc5xr"
Sep 10 04:55:02.612630 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:02.612635    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a63d1621-8256-40d6-ae7c-8e1aa1e88777-maas-api-tls\") pod \"maas-api-e2e-autores-53c734-7d4fb5594f-gc5xr\" (UID: \"a63d1621-8256-40d6-ae7c-8e1aa1e88777\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-53c734-7d4fb5594f-gc5xr"
Sep 10 04:55:02.612838 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:02.612718    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a63d1621-8256-40d6-ae7c-8e1aa1e88777-openshift-service-ca\") pod \"maas-api-e2e-autores-53c734-7d4fb5594f-gc5xr\" (UID: \"a63d1621-8256-40d6-ae7c-8e1aa1e88777\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-53c734-7d4fb5594f-gc5xr"
Sep 10 04:55:02.612838 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:02.612735    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdlt8\" (UniqueName: \"kubernetes.io/projected/a63d1621-8256-40d6-ae7c-8e1aa1e88777-kube-api-access-tdlt8\") pod \"maas-api-e2e-autores-53c734-7d4fb5594f-gc5xr\" (UID: \"a63d1621-8256-40d6-ae7c-8e1aa1e88777\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-53c734-7d4fb5594f-gc5xr"
Sep 10 04:55:02.613446 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:55:02.613423    2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-autores-53c734-serving-cert: secret "maas-api-e2e-autores-53c734-serving-cert" not found
Sep 10 04:55:02.613515 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:55:02.613502    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a63d1621-8256-40d6-ae7c-8e1aa1e88777-maas-api-tls podName:a63d1621-8256-40d6-ae7c-8e1aa1e88777 nodeName:}" failed. No retries permitted until 2026-09-10 04:55:03.11348147 +0000 UTC m=+842.775939200 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a63d1621-8256-40d6-ae7c-8e1aa1e88777-maas-api-tls") pod "maas-api-e2e-autores-53c734-7d4fb5594f-gc5xr" (UID: "a63d1621-8256-40d6-ae7c-8e1aa1e88777") : secret "maas-api-e2e-autores-53c734-serving-cert" not found
Sep 10 04:55:02.613996 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:02.613974    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a63d1621-8256-40d6-ae7c-8e1aa1e88777-openshift-service-ca\") pod \"maas-api-e2e-autores-53c734-7d4fb5594f-gc5xr\" (UID: \"a63d1621-8256-40d6-ae7c-8e1aa1e88777\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-53c734-7d4fb5594f-gc5xr"
Sep 10 04:55:02.615645 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:02.615616    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a63d1621-8256-40d6-ae7c-8e1aa1e88777-metrics-certs\") pod \"maas-api-e2e-autores-53c734-7d4fb5594f-gc5xr\" (UID: \"a63d1621-8256-40d6-ae7c-8e1aa1e88777\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-53c734-7d4fb5594f-gc5xr"
Sep 10 04:55:02.621827 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:02.621802    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdlt8\" (UniqueName: \"kubernetes.io/projected/a63d1621-8256-40d6-ae7c-8e1aa1e88777-kube-api-access-tdlt8\") pod \"maas-api-e2e-autores-53c734-7d4fb5594f-gc5xr\" (UID: \"a63d1621-8256-40d6-ae7c-8e1aa1e88777\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-53c734-7d4fb5594f-gc5xr"
Sep 10 04:55:03.117833 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:03.117760    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a63d1621-8256-40d6-ae7c-8e1aa1e88777-maas-api-tls\") pod \"maas-api-e2e-autores-53c734-7d4fb5594f-gc5xr\" (UID: \"a63d1621-8256-40d6-ae7c-8e1aa1e88777\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-53c734-7d4fb5594f-gc5xr"
Sep 10 04:55:03.120249 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:03.120225    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a63d1621-8256-40d6-ae7c-8e1aa1e88777-maas-api-tls\") pod \"maas-api-e2e-autores-53c734-7d4fb5594f-gc5xr\" (UID: \"a63d1621-8256-40d6-ae7c-8e1aa1e88777\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-53c734-7d4fb5594f-gc5xr"
Sep 10 04:55:03.320792 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:03.320025    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-53c734-7d4fb5594f-gc5xr"
Sep 10 04:55:03.624791 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:03.624761    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-53c734-7d4fb5594f-gc5xr"]
Sep 10 04:55:03.626842 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:55:03.626813    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda63d1621_8256_40d6_ae7c_8e1aa1e88777.slice/crio-4ab9d5977e7bc4b185aa2434a9aabdd59068aa82ca0fd21890c530f288875b6e WatchSource:0}: Error finding container 4ab9d5977e7bc4b185aa2434a9aabdd59068aa82ca0fd21890c530f288875b6e: Status 404 returned error can't find the container with id 4ab9d5977e7bc4b185aa2434a9aabdd59068aa82ca0fd21890c530f288875b6e
Sep 10 04:55:04.093373 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:04.093332    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-53c734-7d4fb5594f-gc5xr" event={"ID":"a63d1621-8256-40d6-ae7c-8e1aa1e88777","Type":"ContainerStarted","Data":"4ab9d5977e7bc4b185aa2434a9aabdd59068aa82ca0fd21890c530f288875b6e"}
Sep 10 04:55:05.070931 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:05.070902    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f3cc69-6bb7995f88-fkfnd"
Sep 10 04:55:05.102169 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:05.102084    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-53c734-7d4fb5594f-gc5xr" event={"ID":"a63d1621-8256-40d6-ae7c-8e1aa1e88777","Type":"ContainerStarted","Data":"ce1411ae04577e3c9093b905af4525458c58e725fa05052c84b33b5f1affbb02"}
Sep 10 04:55:05.102341 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:05.102232    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-53c734-7d4fb5594f-gc5xr"
Sep 10 04:55:05.118094 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:05.118019    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-autores-53c734-7d4fb5594f-gc5xr" podStartSLOduration=2.510459137 podStartE2EDuration="3.11800256s" totalImagesPullingTime="607.543423ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:55:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:55:05.116316809 +0000 UTC m=+844.778774563" watchObservedRunningTime="2026-09-10 04:55:05.11800256 +0000 UTC m=+844.780460309"
Sep 10 04:55:09.901628 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:09.901601    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 04:55:09.984846 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:09.984787    2560 patch_prober.go:28] interesting pod/e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": read tcp 10.132.0.2:33206->10.132.0.56:15021: read: connection reset by peer" start-of-body=
Sep 10 04:55:09.985192 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:09.985141    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj" podUID="36df3522-93d4-4e24-80c4-68752d6e395d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": read tcp 10.132.0.2:33206->10.132.0.56:15021: read: connection reset by peer"
Sep 10 04:55:10.133734 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:10.133660    2560 generic.go:356] "Generic (PLEG): container finished" podID="36df3522-93d4-4e24-80c4-68752d6e395d" containerID="2f4587f8bcf737c5fa7bd835f545210ae4ba4904f1b9710a6add1e27603db557" exitCode=0
Sep 10 04:55:10.133886 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:10.133733    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj" event={"ID":"36df3522-93d4-4e24-80c4-68752d6e395d","Type":"ContainerDied","Data":"2f4587f8bcf737c5fa7bd835f545210ae4ba4904f1b9710a6add1e27603db557"}
Sep 10 04:55:10.134170 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:10.134156    2560 scope.go:117] "RemoveContainer" containerID="2f4587f8bcf737c5fa7bd835f545210ae4ba4904f1b9710a6add1e27603db557"
Sep 10 04:55:10.135306 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:10.135278    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 04:55:10.135420 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:10.135390    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 04:55:10.135487 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:10.135437    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 04:55:11.113589 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:11.113560    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-53c734-7d4fb5594f-gc5xr"
Sep 10 04:55:11.143915 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:11.143872    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj" event={"ID":"36df3522-93d4-4e24-80c4-68752d6e395d","Type":"ContainerStarted","Data":"7e3372a2f29721d3944a4e84f3a3877a0dfaaf59246d8e2d269c54ed81b43403"}
Sep 10 04:55:11.271130 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:11.271089    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj"
Sep 10 04:55:11.271376 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:11.271353    2560 patch_prober.go:28] interesting pod/e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Sep 10 04:55:11.271424 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:11.271401    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj" podUID="36df3522-93d4-4e24-80c4-68752d6e395d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Sep 10 04:55:12.272205 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:12.272159    2560 patch_prober.go:28] interesting pod/e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Sep 10 04:55:12.272699 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:12.272245    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj" podUID="36df3522-93d4-4e24-80c4-68752d6e395d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Sep 10 04:55:13.272842 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:13.272799    2560 patch_prober.go:28] interesting pod/e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Sep 10 04:55:13.273454 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:13.273417    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj" podUID="36df3522-93d4-4e24-80c4-68752d6e395d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Sep 10 04:55:14.271989 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:14.271948    2560 patch_prober.go:28] interesting pod/e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Sep 10 04:55:14.272281 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:14.272252    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj" podUID="36df3522-93d4-4e24-80c4-68752d6e395d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Sep 10 04:55:15.272206 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:15.271716    2560 patch_prober.go:28] interesting pod/e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Sep 10 04:55:15.272206 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:15.271781    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj" podUID="36df3522-93d4-4e24-80c4-68752d6e395d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Sep 10 04:55:16.272305 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:16.272262    2560 patch_prober.go:28] interesting pod/e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Sep 10 04:55:16.272699 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:16.272333    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj" podUID="36df3522-93d4-4e24-80c4-68752d6e395d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Sep 10 04:55:17.275313 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:17.275279    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj"
Sep 10 04:55:17.275691 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:17.275670    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj"
Sep 10 04:55:17.276387 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:17.276364    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj"
Sep 10 04:55:19.632136 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:19.632103    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg"]
Sep 10 04:55:19.702311 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:19.702279    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg"]
Sep 10 04:55:19.702461 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:19.702408    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg"
Sep 10 04:55:19.704721 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:19.704701    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-c9a840-openshift-default-dockercfg-s8zcr\""
Sep 10 04:55:19.803579 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:19.803552    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4-istio-data\") pod \"e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg\" (UID: \"2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4\") " pod="openshift-ingress/e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg"
Sep 10 04:55:19.803752 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:19.803595    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4-istio-envoy\") pod \"e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg\" (UID: \"2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4\") " pod="openshift-ingress/e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg"
Sep 10 04:55:19.803752 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:19.803625    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4-credential-socket\") pod \"e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg\" (UID: \"2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4\") " pod="openshift-ingress/e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg"
Sep 10 04:55:19.803752 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:19.803675    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4-istio-podinfo\") pod \"e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg\" (UID: \"2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4\") " pod="openshift-ingress/e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg"
Sep 10 04:55:19.803752 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:19.803696    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcl5n\" (UniqueName: \"kubernetes.io/projected/2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4-kube-api-access-tcl5n\") pod \"e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg\" (UID: \"2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4\") " pod="openshift-ingress/e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg"
Sep 10 04:55:19.803752 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:19.803731    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4-istio-token\") pod \"e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg\" (UID: \"2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4\") " pod="openshift-ingress/e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg"
Sep 10 04:55:19.803993 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:19.803773    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4-istiod-ca-cert\") pod \"e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg\" (UID: \"2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4\") " pod="openshift-ingress/e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg"
Sep 10 04:55:19.803993 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:19.803861    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4-workload-certs\") pod \"e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg\" (UID: \"2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4\") " pod="openshift-ingress/e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg"
Sep 10 04:55:19.803993 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:19.803897    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4-workload-socket\") pod \"e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg\" (UID: \"2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4\") " pod="openshift-ingress/e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg"
Sep 10 04:55:19.905119 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:19.905043    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4-istio-envoy\") pod \"e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg\" (UID: \"2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4\") " pod="openshift-ingress/e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg"
Sep 10 04:55:19.905119 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:19.905091    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4-credential-socket\") pod \"e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg\" (UID: \"2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4\") " pod="openshift-ingress/e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg"
Sep 10 04:55:19.905344 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:19.905131    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4-istio-podinfo\") pod \"e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg\" (UID: \"2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4\") " pod="openshift-ingress/e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg"
Sep 10 04:55:19.905344 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:19.905163    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcl5n\" (UniqueName: \"kubernetes.io/projected/2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4-kube-api-access-tcl5n\") pod \"e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg\" (UID: \"2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4\") " pod="openshift-ingress/e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg"
Sep 10 04:55:19.905344 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:19.905187    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4-istio-token\") pod \"e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg\" (UID: \"2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4\") " pod="openshift-ingress/e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg"
Sep 10 04:55:19.905344 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:19.905212    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4-istiod-ca-cert\") pod \"e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg\" (UID: \"2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4\") " pod="openshift-ingress/e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg"
Sep 10 04:55:19.905344 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:19.905275    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4-workload-certs\") pod \"e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg\" (UID: \"2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4\") " pod="openshift-ingress/e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg"
Sep 10 04:55:19.905535 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:19.905360    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4-workload-socket\") pod \"e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg\" (UID: \"2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4\") " pod="openshift-ingress/e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg"
Sep 10 04:55:19.905535 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:19.905433    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4-istio-data\") pod \"e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg\" (UID: \"2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4\") " pod="openshift-ingress/e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg"
Sep 10 04:55:19.905779 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:19.905751    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4-workload-certs\") pod \"e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg\" (UID: \"2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4\") " pod="openshift-ingress/e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg"
Sep 10 04:55:19.905898 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:19.905793    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4-workload-socket\") pod \"e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg\" (UID: \"2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4\") " pod="openshift-ingress/e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg"
Sep 10 04:55:19.906038 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:19.906016    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4-credential-socket\") pod \"e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg\" (UID: \"2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4\") " pod="openshift-ingress/e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg"
Sep 10 04:55:19.906401 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:19.906376    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4-istio-data\") pod \"e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg\" (UID: \"2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4\") " pod="openshift-ingress/e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg"
Sep 10 04:55:19.906783 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:19.906760    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4-istiod-ca-cert\") pod \"e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg\" (UID: \"2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4\") " pod="openshift-ingress/e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg"
Sep 10 04:55:19.907936 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:19.907914    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4-istio-envoy\") pod \"e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg\" (UID: \"2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4\") " pod="openshift-ingress/e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg"
Sep 10 04:55:19.908169 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:19.908150    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4-istio-podinfo\") pod \"e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg\" (UID: \"2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4\") " pod="openshift-ingress/e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg"
Sep 10 04:55:19.915123 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:19.915100    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4-istio-token\") pod \"e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg\" (UID: \"2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4\") " pod="openshift-ingress/e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg"
Sep 10 04:55:19.915514 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:19.915493    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcl5n\" (UniqueName: \"kubernetes.io/projected/2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4-kube-api-access-tcl5n\") pod \"e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg\" (UID: \"2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4\") " pod="openshift-ingress/e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg"
Sep 10 04:55:20.013543 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:20.013508    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg"
Sep 10 04:55:20.324020 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:20.323997    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg"]
Sep 10 04:55:20.325649 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:55:20.325623    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b4bc7a5_b25d_4539_8f8b_f2d5c1b403a4.slice/crio-9d9f4b5997ffeb8f79d15cae6a2bc811627e2918973909fef0bdf3d5ff36a9a5 WatchSource:0}: Error finding container 9d9f4b5997ffeb8f79d15cae6a2bc811627e2918973909fef0bdf3d5ff36a9a5: Status 404 returned error can't find the container with id 9d9f4b5997ffeb8f79d15cae6a2bc811627e2918973909fef0bdf3d5ff36a9a5
Sep 10 04:55:20.328092 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:20.328054    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 04:55:20.328172 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:20.328139    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 04:55:20.328210 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:20.328190    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 04:55:21.225720 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:21.225634    2560 generic.go:356] "Generic (PLEG): container finished" podID="25b2ee13-7792-46e0-a085-8c2c06b3b825" containerID="6be4f1c279c65b0bce2479c94b65c2245d50ea8d98916a803da5420949509b0c" exitCode=0
Sep 10 04:55:21.226237 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:21.225708    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-53c734-openshift-default-67d97c479b-wxvzk" event={"ID":"25b2ee13-7792-46e0-a085-8c2c06b3b825","Type":"ContainerDied","Data":"6be4f1c279c65b0bce2479c94b65c2245d50ea8d98916a803da5420949509b0c"}
Sep 10 04:55:21.226237 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:21.226210    2560 scope.go:117] "RemoveContainer" containerID="6be4f1c279c65b0bce2479c94b65c2245d50ea8d98916a803da5420949509b0c"
Sep 10 04:55:21.227442 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:21.227411    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 04:55:21.227537 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:21.227497    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 04:55:21.227537 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:21.227531    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 04:55:21.227704 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:21.227678    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg" event={"ID":"2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4","Type":"ContainerStarted","Data":"1572e2956c4af38ed80964484fcbbce8581c0e109f8abbf63d04529e8048af85"}
Sep 10 04:55:21.227768 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:21.227719    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg" event={"ID":"2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4","Type":"ContainerStarted","Data":"9d9f4b5997ffeb8f79d15cae6a2bc811627e2918973909fef0bdf3d5ff36a9a5"}
Sep 10 04:55:21.267116 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:21.267070    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg" podStartSLOduration=2.267054275 podStartE2EDuration="2.267054275s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:55:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:55:21.265021683 +0000 UTC m=+860.927479430" watchObservedRunningTime="2026-09-10 04:55:21.267054275 +0000 UTC m=+860.929512021"
Sep 10 04:55:22.014650 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:22.014618    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg"
Sep 10 04:55:22.019809 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:22.019778    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg"
Sep 10 04:55:22.236715 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:22.236682    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-53c734-openshift-default-67d97c479b-wxvzk" event={"ID":"25b2ee13-7792-46e0-a085-8c2c06b3b825","Type":"ContainerStarted","Data":"434a83b76e09b6584637a8fb4f429fa3c1761a86a6f12e593b8595afc2085cd8"}
Sep 10 04:55:22.237445 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:22.237416    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg"
Sep 10 04:55:22.242100 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:22.242059    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg"
Sep 10 04:55:22.809951 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:22.809910    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-53c734-openshift-default-67d97c479b-wxvzk"
Sep 10 04:55:22.810165 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:22.810137    2560 patch_prober.go:28] interesting pod/e2e-autores-53c734-openshift-default-67d97c479b-wxvzk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 10 04:55:22.810252 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:22.810216    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-53c734-openshift-default-67d97c479b-wxvzk" podUID="25b2ee13-7792-46e0-a085-8c2c06b3b825" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 10 04:55:23.810424 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:23.810385    2560 patch_prober.go:28] interesting pod/e2e-autores-53c734-openshift-default-67d97c479b-wxvzk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 10 04:55:23.810816 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:23.810440    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-53c734-openshift-default-67d97c479b-wxvzk" podUID="25b2ee13-7792-46e0-a085-8c2c06b3b825" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 10 04:55:24.810010 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:24.809969    2560 patch_prober.go:28] interesting pod/e2e-autores-53c734-openshift-default-67d97c479b-wxvzk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 10 04:55:24.810207 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:24.810043    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-53c734-openshift-default-67d97c479b-wxvzk" podUID="25b2ee13-7792-46e0-a085-8c2c06b3b825" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 10 04:55:25.118425 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:25.118340    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c9a840-696ddcd674-xxzg4"]
Sep 10 04:55:25.121389 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:25.121364    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c9a840-696ddcd674-xxzg4"
Sep 10 04:55:25.123874 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:25.123827    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-c9a840-serving-cert\""
Sep 10 04:55:25.162873 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:25.161916    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c9a840-696ddcd674-xxzg4"]
Sep 10 04:55:25.264167 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:25.264132    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c235613a-1bb2-4a3b-85f6-fdd1c3dc3b36-metrics-certs\") pod \"maas-api-e2e-inf-b-c9a840-696ddcd674-xxzg4\" (UID: \"c235613a-1bb2-4a3b-85f6-fdd1c3dc3b36\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c9a840-696ddcd674-xxzg4"
Sep 10 04:55:25.264475 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:25.264434    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27cjx\" (UniqueName: \"kubernetes.io/projected/c235613a-1bb2-4a3b-85f6-fdd1c3dc3b36-kube-api-access-27cjx\") pod \"maas-api-e2e-inf-b-c9a840-696ddcd674-xxzg4\" (UID: \"c235613a-1bb2-4a3b-85f6-fdd1c3dc3b36\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c9a840-696ddcd674-xxzg4"
Sep 10 04:55:25.264705 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:25.264688    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c235613a-1bb2-4a3b-85f6-fdd1c3dc3b36-maas-api-tls\") pod \"maas-api-e2e-inf-b-c9a840-696ddcd674-xxzg4\" (UID: \"c235613a-1bb2-4a3b-85f6-fdd1c3dc3b36\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c9a840-696ddcd674-xxzg4"
Sep 10 04:55:25.264910 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:25.264892    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c235613a-1bb2-4a3b-85f6-fdd1c3dc3b36-openshift-service-ca\") pod \"maas-api-e2e-inf-b-c9a840-696ddcd674-xxzg4\" (UID: \"c235613a-1bb2-4a3b-85f6-fdd1c3dc3b36\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c9a840-696ddcd674-xxzg4"
Sep 10 04:55:25.366563 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:25.366530    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c235613a-1bb2-4a3b-85f6-fdd1c3dc3b36-maas-api-tls\") pod \"maas-api-e2e-inf-b-c9a840-696ddcd674-xxzg4\" (UID: \"c235613a-1bb2-4a3b-85f6-fdd1c3dc3b36\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c9a840-696ddcd674-xxzg4"
Sep 10 04:55:25.366723 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:25.366584    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c235613a-1bb2-4a3b-85f6-fdd1c3dc3b36-openshift-service-ca\") pod \"maas-api-e2e-inf-b-c9a840-696ddcd674-xxzg4\" (UID: \"c235613a-1bb2-4a3b-85f6-fdd1c3dc3b36\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c9a840-696ddcd674-xxzg4"
Sep 10 04:55:25.366723 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:25.366647    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c235613a-1bb2-4a3b-85f6-fdd1c3dc3b36-metrics-certs\") pod \"maas-api-e2e-inf-b-c9a840-696ddcd674-xxzg4\" (UID: \"c235613a-1bb2-4a3b-85f6-fdd1c3dc3b36\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c9a840-696ddcd674-xxzg4"
Sep 10 04:55:25.366723 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:25.366671    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27cjx\" (UniqueName: \"kubernetes.io/projected/c235613a-1bb2-4a3b-85f6-fdd1c3dc3b36-kube-api-access-27cjx\") pod \"maas-api-e2e-inf-b-c9a840-696ddcd674-xxzg4\" (UID: \"c235613a-1bb2-4a3b-85f6-fdd1c3dc3b36\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c9a840-696ddcd674-xxzg4"
Sep 10 04:55:25.367562 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:25.367542    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c235613a-1bb2-4a3b-85f6-fdd1c3dc3b36-openshift-service-ca\") pod \"maas-api-e2e-inf-b-c9a840-696ddcd674-xxzg4\" (UID: \"c235613a-1bb2-4a3b-85f6-fdd1c3dc3b36\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c9a840-696ddcd674-xxzg4"
Sep 10 04:55:25.369616 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:25.369440    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c235613a-1bb2-4a3b-85f6-fdd1c3dc3b36-metrics-certs\") pod \"maas-api-e2e-inf-b-c9a840-696ddcd674-xxzg4\" (UID: \"c235613a-1bb2-4a3b-85f6-fdd1c3dc3b36\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c9a840-696ddcd674-xxzg4"
Sep 10 04:55:25.369616 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:25.369462    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c235613a-1bb2-4a3b-85f6-fdd1c3dc3b36-maas-api-tls\") pod \"maas-api-e2e-inf-b-c9a840-696ddcd674-xxzg4\" (UID: \"c235613a-1bb2-4a3b-85f6-fdd1c3dc3b36\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c9a840-696ddcd674-xxzg4"
Sep 10 04:55:25.375195 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:25.375172    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27cjx\" (UniqueName: \"kubernetes.io/projected/c235613a-1bb2-4a3b-85f6-fdd1c3dc3b36-kube-api-access-27cjx\") pod \"maas-api-e2e-inf-b-c9a840-696ddcd674-xxzg4\" (UID: \"c235613a-1bb2-4a3b-85f6-fdd1c3dc3b36\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c9a840-696ddcd674-xxzg4"
Sep 10 04:55:25.435812 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:25.435772    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c9a840-696ddcd674-xxzg4"
Sep 10 04:55:25.729102 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:25.729069    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c9a840-696ddcd674-xxzg4"]
Sep 10 04:55:25.810594 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:25.810564    2560 patch_prober.go:28] interesting pod/e2e-autores-53c734-openshift-default-67d97c479b-wxvzk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 10 04:55:25.810741 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:25.810630    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-53c734-openshift-default-67d97c479b-wxvzk" podUID="25b2ee13-7792-46e0-a085-8c2c06b3b825" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 10 04:55:26.280400 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:26.280299    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c9a840-696ddcd674-xxzg4" event={"ID":"c235613a-1bb2-4a3b-85f6-fdd1c3dc3b36","Type":"ContainerStarted","Data":"ade4caf9829bce7a5a089b6a060994feb293c540ee58986fc30aab4835670fcb"}
Sep 10 04:55:26.280400 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:26.280362    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c9a840-696ddcd674-xxzg4" event={"ID":"c235613a-1bb2-4a3b-85f6-fdd1c3dc3b36","Type":"ContainerStarted","Data":"ed984b11a2cd956e1351efcdf497190561012d1dfce8bbf925c9b3140023ab20"}
Sep 10 04:55:26.280969 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:26.280496    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c9a840-696ddcd674-xxzg4"
Sep 10 04:55:26.298242 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:26.298059    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c9a840-696ddcd674-xxzg4" podStartSLOduration=0.986676661 podStartE2EDuration="1.298041127s" totalImagesPullingTime="311.364466ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:55:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:55:26.296080937 +0000 UTC m=+865.958538684" watchObservedRunningTime="2026-09-10 04:55:26.298041127 +0000 UTC m=+865.960498876"
Sep 10 04:55:26.810717 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:26.810682    2560 patch_prober.go:28] interesting pod/e2e-autores-53c734-openshift-default-67d97c479b-wxvzk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 10 04:55:26.810914 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:26.810746    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-53c734-openshift-default-67d97c479b-wxvzk" podUID="25b2ee13-7792-46e0-a085-8c2c06b3b825" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 10 04:55:27.992995 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:27.992950    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-53c734-openshift-default-67d97c479b-wxvzk"
Sep 10 04:55:27.993508 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:27.993394    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-53c734-openshift-default-67d97c479b-wxvzk"
Sep 10 04:55:27.994731 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:27.994707    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-53c734-openshift-default-67d97c479b-wxvzk"
Sep 10 04:55:31.505709 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:31.505678    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 04:55:32.291494 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:32.291464    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c9a840-696ddcd674-xxzg4"
Sep 10 04:55:41.382009 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:41.381978    2560 generic.go:356] "Generic (PLEG): container finished" podID="2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4" containerID="1572e2956c4af38ed80964484fcbbce8581c0e109f8abbf63d04529e8048af85" exitCode=0
Sep 10 04:55:41.382437 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:41.382059    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg" event={"ID":"2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4","Type":"ContainerDied","Data":"1572e2956c4af38ed80964484fcbbce8581c0e109f8abbf63d04529e8048af85"}
Sep 10 04:55:41.382564 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:41.382547    2560 scope.go:117] "RemoveContainer" containerID="1572e2956c4af38ed80964484fcbbce8581c0e109f8abbf63d04529e8048af85"
Sep 10 04:55:41.383691 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:41.383665    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 04:55:41.383795 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:41.383745    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 04:55:41.383883 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:41.383800    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 04:55:41.981577 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:41.981545    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn"]
Sep 10 04:55:41.995135 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:41.994002    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn"
Sep 10 04:55:41.996617 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:41.996593    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-d778192d-gw-openshift-default-dockercfg-wmc6c\""
Sep 10 04:55:41.998499 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:41.998476    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn"]
Sep 10 04:55:42.043063 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:42.043022    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/539fe443-da0e-4aab-a38b-cab6029883b5-workload-socket\") pod \"e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn\" (UID: \"539fe443-da0e-4aab-a38b-cab6029883b5\") " pod="openshift-ingress/e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn"
Sep 10 04:55:42.043217 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:42.043066    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/539fe443-da0e-4aab-a38b-cab6029883b5-istio-data\") pod \"e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn\" (UID: \"539fe443-da0e-4aab-a38b-cab6029883b5\") " pod="openshift-ingress/e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn"
Sep 10 04:55:42.043217 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:42.043145    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbjkn\" (UniqueName: \"kubernetes.io/projected/539fe443-da0e-4aab-a38b-cab6029883b5-kube-api-access-qbjkn\") pod \"e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn\" (UID: \"539fe443-da0e-4aab-a38b-cab6029883b5\") " pod="openshift-ingress/e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn"
Sep 10 04:55:42.043399 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:42.043228    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/539fe443-da0e-4aab-a38b-cab6029883b5-workload-certs\") pod \"e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn\" (UID: \"539fe443-da0e-4aab-a38b-cab6029883b5\") " pod="openshift-ingress/e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn"
Sep 10 04:55:42.043399 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:42.043286    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/539fe443-da0e-4aab-a38b-cab6029883b5-istio-token\") pod \"e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn\" (UID: \"539fe443-da0e-4aab-a38b-cab6029883b5\") " pod="openshift-ingress/e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn"
Sep 10 04:55:42.043399 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:42.043324    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/539fe443-da0e-4aab-a38b-cab6029883b5-credential-socket\") pod \"e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn\" (UID: \"539fe443-da0e-4aab-a38b-cab6029883b5\") " pod="openshift-ingress/e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn"
Sep 10 04:55:42.043399 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:42.043362    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/539fe443-da0e-4aab-a38b-cab6029883b5-istio-podinfo\") pod \"e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn\" (UID: \"539fe443-da0e-4aab-a38b-cab6029883b5\") " pod="openshift-ingress/e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn"
Sep 10 04:55:42.043615 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:42.043435    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/539fe443-da0e-4aab-a38b-cab6029883b5-istiod-ca-cert\") pod \"e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn\" (UID: \"539fe443-da0e-4aab-a38b-cab6029883b5\") " pod="openshift-ingress/e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn"
Sep 10 04:55:42.043615 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:42.043466    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/539fe443-da0e-4aab-a38b-cab6029883b5-istio-envoy\") pod \"e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn\" (UID: \"539fe443-da0e-4aab-a38b-cab6029883b5\") " pod="openshift-ingress/e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn"
Sep 10 04:55:42.144138 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:42.144100    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbjkn\" (UniqueName: \"kubernetes.io/projected/539fe443-da0e-4aab-a38b-cab6029883b5-kube-api-access-qbjkn\") pod \"e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn\" (UID: \"539fe443-da0e-4aab-a38b-cab6029883b5\") " pod="openshift-ingress/e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn"
Sep 10 04:55:42.144304 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:42.144184    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/539fe443-da0e-4aab-a38b-cab6029883b5-workload-certs\") pod \"e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn\" (UID: \"539fe443-da0e-4aab-a38b-cab6029883b5\") " pod="openshift-ingress/e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn"
Sep 10 04:55:42.144304 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:42.144224    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/539fe443-da0e-4aab-a38b-cab6029883b5-istio-token\") pod \"e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn\" (UID: \"539fe443-da0e-4aab-a38b-cab6029883b5\") " pod="openshift-ingress/e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn"
Sep 10 04:55:42.144304 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:42.144259    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/539fe443-da0e-4aab-a38b-cab6029883b5-credential-socket\") pod \"e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn\" (UID: \"539fe443-da0e-4aab-a38b-cab6029883b5\") " pod="openshift-ingress/e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn"
Sep 10 04:55:42.144304 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:42.144292    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/539fe443-da0e-4aab-a38b-cab6029883b5-istio-podinfo\") pod \"e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn\" (UID: \"539fe443-da0e-4aab-a38b-cab6029883b5\") " pod="openshift-ingress/e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn"
Sep 10 04:55:42.144435 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:42.144359    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/539fe443-da0e-4aab-a38b-cab6029883b5-istiod-ca-cert\") pod \"e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn\" (UID: \"539fe443-da0e-4aab-a38b-cab6029883b5\") " pod="openshift-ingress/e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn"
Sep 10 04:55:42.144435 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:42.144391    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/539fe443-da0e-4aab-a38b-cab6029883b5-istio-envoy\") pod \"e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn\" (UID: \"539fe443-da0e-4aab-a38b-cab6029883b5\") " pod="openshift-ingress/e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn"
Sep 10 04:55:42.144502 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:42.144455    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/539fe443-da0e-4aab-a38b-cab6029883b5-workload-socket\") pod \"e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn\" (UID: \"539fe443-da0e-4aab-a38b-cab6029883b5\") " pod="openshift-ingress/e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn"
Sep 10 04:55:42.144502 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:42.144479    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/539fe443-da0e-4aab-a38b-cab6029883b5-istio-data\") pod \"e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn\" (UID: \"539fe443-da0e-4aab-a38b-cab6029883b5\") " pod="openshift-ingress/e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn"
Sep 10 04:55:42.144815 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:42.144788    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/539fe443-da0e-4aab-a38b-cab6029883b5-credential-socket\") pod \"e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn\" (UID: \"539fe443-da0e-4aab-a38b-cab6029883b5\") " pod="openshift-ingress/e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn"
Sep 10 04:55:42.144970 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:42.144931    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/539fe443-da0e-4aab-a38b-cab6029883b5-workload-certs\") pod \"e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn\" (UID: \"539fe443-da0e-4aab-a38b-cab6029883b5\") " pod="openshift-ingress/e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn"
Sep 10 04:55:42.145145 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:42.145121    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/539fe443-da0e-4aab-a38b-cab6029883b5-istio-data\") pod \"e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn\" (UID: \"539fe443-da0e-4aab-a38b-cab6029883b5\") " pod="openshift-ingress/e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn"
Sep 10 04:55:42.145232 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:42.145209    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/539fe443-da0e-4aab-a38b-cab6029883b5-workload-socket\") pod \"e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn\" (UID: \"539fe443-da0e-4aab-a38b-cab6029883b5\") " pod="openshift-ingress/e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn"
Sep 10 04:55:42.145716 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:42.145689    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/539fe443-da0e-4aab-a38b-cab6029883b5-istiod-ca-cert\") pod \"e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn\" (UID: \"539fe443-da0e-4aab-a38b-cab6029883b5\") " pod="openshift-ingress/e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn"
Sep 10 04:55:42.147213 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:42.147189    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/539fe443-da0e-4aab-a38b-cab6029883b5-istio-envoy\") pod \"e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn\" (UID: \"539fe443-da0e-4aab-a38b-cab6029883b5\") " pod="openshift-ingress/e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn"
Sep 10 04:55:42.147332 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:42.147311    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/539fe443-da0e-4aab-a38b-cab6029883b5-istio-podinfo\") pod \"e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn\" (UID: \"539fe443-da0e-4aab-a38b-cab6029883b5\") " pod="openshift-ingress/e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn"
Sep 10 04:55:42.151819 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:42.151788    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/539fe443-da0e-4aab-a38b-cab6029883b5-istio-token\") pod \"e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn\" (UID: \"539fe443-da0e-4aab-a38b-cab6029883b5\") " pod="openshift-ingress/e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn"
Sep 10 04:55:42.152082 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:42.152064    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbjkn\" (UniqueName: \"kubernetes.io/projected/539fe443-da0e-4aab-a38b-cab6029883b5-kube-api-access-qbjkn\") pod \"e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn\" (UID: \"539fe443-da0e-4aab-a38b-cab6029883b5\") " pod="openshift-ingress/e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn"
Sep 10 04:55:42.307422 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:42.307339    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn"
Sep 10 04:55:42.394109 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:42.393547    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg" event={"ID":"2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4","Type":"ContainerStarted","Data":"5f9c0d5d3251e0f73a0815fc53f0fdcd0792ccb8657e1047409600e7fcafedd2"}
Sep 10 04:55:42.609602 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:42.609574    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn"]
Sep 10 04:55:42.610646 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:55:42.610619    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod539fe443_da0e_4aab_a38b_cab6029883b5.slice/crio-3c9d07b636377d5fc29cb388aee275598a49e77f35081da1853085df5f9e39db WatchSource:0}: Error finding container 3c9d07b636377d5fc29cb388aee275598a49e77f35081da1853085df5f9e39db: Status 404 returned error can't find the container with id 3c9d07b636377d5fc29cb388aee275598a49e77f35081da1853085df5f9e39db
Sep 10 04:55:42.613124 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:42.613088    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 04:55:42.613215 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:42.613153    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 04:55:42.613215 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:42.613179    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 04:55:43.014202 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:43.014166    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg"
Sep 10 04:55:43.014367 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:43.014290    2560 patch_prober.go:28] interesting pod/e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Sep 10 04:55:43.014367 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:43.014334    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg" podUID="2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Sep 10 04:55:43.402706 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:43.402669    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn" event={"ID":"539fe443-da0e-4aab-a38b-cab6029883b5","Type":"ContainerStarted","Data":"a1c20f96355777ef6bca17bfa8a98eff70e7799ff61e5b32b8515232c6463002"}
Sep 10 04:55:43.403132 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:43.402732    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn" event={"ID":"539fe443-da0e-4aab-a38b-cab6029883b5","Type":"ContainerStarted","Data":"3c9d07b636377d5fc29cb388aee275598a49e77f35081da1853085df5f9e39db"}
Sep 10 04:55:43.421313 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:43.421266    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn" podStartSLOduration=2.42125142 podStartE2EDuration="2.42125142s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:55:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:55:43.420661132 +0000 UTC m=+883.083118881" watchObservedRunningTime="2026-09-10 04:55:43.42125142 +0000 UTC m=+883.083709169"
Sep 10 04:55:44.014398 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:44.014359    2560 patch_prober.go:28] interesting pod/e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Sep 10 04:55:44.014542 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:44.014416    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg" podUID="2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Sep 10 04:55:44.307819 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:44.307740    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn"
Sep 10 04:55:44.312864 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:44.312827    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn"
Sep 10 04:55:44.409003 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:44.408970    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn"
Sep 10 04:55:44.409940 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:44.409918    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn"
Sep 10 04:55:45.014612 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:45.014575    2560 patch_prober.go:28] interesting pod/e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Sep 10 04:55:45.014777 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:45.014634    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg" podUID="2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Sep 10 04:55:46.014365 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:46.014330    2560 patch_prober.go:28] interesting pod/e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Sep 10 04:55:46.014816 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:46.014391    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg" podUID="2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Sep 10 04:55:47.013863 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:47.013815    2560 patch_prober.go:28] interesting pod/e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Sep 10 04:55:47.014096 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:47.014070    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg" podUID="2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Sep 10 04:55:48.018346 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:48.018312    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg"
Sep 10 04:55:48.018868 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:48.018735    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg"
Sep 10 04:55:48.019358 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:48.019339    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg"
Sep 10 04:55:51.499634 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:55:51.499600    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 04:56:00.451031 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:00.450986    2560 patch_prober.go:28] interesting pod/e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 04:56:00.451445 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:00.451051    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn" podUID="539fe443-da0e-4aab-a38b-cab6029883b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 04:56:00.851433 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:00.851353    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-p5zjp_8b3ec8dc-1508-4537-8dc3-b9de1ff22d03/console-operator/1.log"
Sep 10 04:56:00.852435 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:00.852411    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-p5zjp_8b3ec8dc-1508-4537-8dc3-b9de1ff22d03/console-operator/1.log"
Sep 10 04:56:01.517542 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:01.517509    2560 generic.go:356] "Generic (PLEG): container finished" podID="539fe443-da0e-4aab-a38b-cab6029883b5" containerID="a1c20f96355777ef6bca17bfa8a98eff70e7799ff61e5b32b8515232c6463002" exitCode=0
Sep 10 04:56:01.517936 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:01.517580    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn" event={"ID":"539fe443-da0e-4aab-a38b-cab6029883b5","Type":"ContainerDied","Data":"a1c20f96355777ef6bca17bfa8a98eff70e7799ff61e5b32b8515232c6463002"}
Sep 10 04:56:01.518040 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:01.518026    2560 scope.go:117] "RemoveContainer" containerID="a1c20f96355777ef6bca17bfa8a98eff70e7799ff61e5b32b8515232c6463002"
Sep 10 04:56:01.519227 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:01.519200    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 04:56:01.519301 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:01.519267    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 04:56:01.519339 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:01.519319    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 04:56:02.525181 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:02.525143    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn" event={"ID":"539fe443-da0e-4aab-a38b-cab6029883b5","Type":"ContainerStarted","Data":"e5e138402baf7e426079d1bc708fa42e75e2d1d75ce694e117d3549b98f7ca9e"}
Sep 10 04:56:03.308376 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:03.308335    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn"
Sep 10 04:56:03.308588 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:03.308559    2560 patch_prober.go:28] interesting pod/e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Sep 10 04:56:03.308672 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:03.308625    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn" podUID="539fe443-da0e-4aab-a38b-cab6029883b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Sep 10 04:56:04.308480 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:04.308447    2560 patch_prober.go:28] interesting pod/e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Sep 10 04:56:04.308872 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:04.308499    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn" podUID="539fe443-da0e-4aab-a38b-cab6029883b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Sep 10 04:56:05.308504 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:05.308468    2560 patch_prober.go:28] interesting pod/e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Sep 10 04:56:05.308910 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:05.308553    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn" podUID="539fe443-da0e-4aab-a38b-cab6029883b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Sep 10 04:56:06.308496 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:06.308458    2560 patch_prober.go:28] interesting pod/e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Sep 10 04:56:06.308664 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:06.308511    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn" podUID="539fe443-da0e-4aab-a38b-cab6029883b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Sep 10 04:56:07.308116 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:07.308084    2560 patch_prober.go:28] interesting pod/e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Sep 10 04:56:07.308291 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:07.308135    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn" podUID="539fe443-da0e-4aab-a38b-cab6029883b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Sep 10 04:56:08.307763 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:08.307724    2560 patch_prober.go:28] interesting pod/e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Sep 10 04:56:08.308168 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:08.307805    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn" podUID="539fe443-da0e-4aab-a38b-cab6029883b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Sep 10 04:56:09.311334 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:09.311300    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn"
Sep 10 04:56:09.311802 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:09.311676    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn"
Sep 10 04:56:09.312408 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:09.312386    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn"
Sep 10 04:56:15.695478 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:15.695443    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 04:56:16.742400 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:16.742364    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn"]
Sep 10 04:56:16.743259 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:16.743230    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn" podUID="539fe443-da0e-4aab-a38b-cab6029883b5" containerName="istio-proxy" containerID="cri-o://e5e138402baf7e426079d1bc708fa42e75e2d1d75ce694e117d3549b98f7ca9e" gracePeriod=30
Sep 10 04:56:21.476600 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:21.476558    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-eb4df850-6855489c7f-t7vsx"]
Sep 10 04:56:21.481973 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:21.481946    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eb4df850-6855489c7f-t7vsx"
Sep 10 04:56:21.484041 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:21.484017    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-eb4df850-serving-cert\""
Sep 10 04:56:21.493122 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:21.493099    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-eb4df850-6855489c7f-t7vsx"]
Sep 10 04:56:21.553048 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:21.553012    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82mnz\" (UniqueName: \"kubernetes.io/projected/6e377154-baed-480e-9af7-87da5d946393-kube-api-access-82mnz\") pod \"maas-api-e2e-ait-eb4df850-6855489c7f-t7vsx\" (UID: \"6e377154-baed-480e-9af7-87da5d946393\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-eb4df850-6855489c7f-t7vsx"
Sep 10 04:56:21.553048 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:21.553047    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6e377154-baed-480e-9af7-87da5d946393-maas-api-tls\") pod \"maas-api-e2e-ait-eb4df850-6855489c7f-t7vsx\" (UID: \"6e377154-baed-480e-9af7-87da5d946393\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-eb4df850-6855489c7f-t7vsx"
Sep 10 04:56:21.553236 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:21.553185    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6e377154-baed-480e-9af7-87da5d946393-metrics-certs\") pod \"maas-api-e2e-ait-eb4df850-6855489c7f-t7vsx\" (UID: \"6e377154-baed-480e-9af7-87da5d946393\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-eb4df850-6855489c7f-t7vsx"
Sep 10 04:56:21.553236 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:21.553226    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e377154-baed-480e-9af7-87da5d946393-openshift-service-ca\") pod \"maas-api-e2e-ait-eb4df850-6855489c7f-t7vsx\" (UID: \"6e377154-baed-480e-9af7-87da5d946393\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-eb4df850-6855489c7f-t7vsx"
Sep 10 04:56:21.654010 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:21.653972    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6e377154-baed-480e-9af7-87da5d946393-metrics-certs\") pod \"maas-api-e2e-ait-eb4df850-6855489c7f-t7vsx\" (UID: \"6e377154-baed-480e-9af7-87da5d946393\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-eb4df850-6855489c7f-t7vsx"
Sep 10 04:56:21.654192 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:21.654028    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e377154-baed-480e-9af7-87da5d946393-openshift-service-ca\") pod \"maas-api-e2e-ait-eb4df850-6855489c7f-t7vsx\" (UID: \"6e377154-baed-480e-9af7-87da5d946393\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-eb4df850-6855489c7f-t7vsx"
Sep 10 04:56:21.654192 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:21.654063    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82mnz\" (UniqueName: \"kubernetes.io/projected/6e377154-baed-480e-9af7-87da5d946393-kube-api-access-82mnz\") pod \"maas-api-e2e-ait-eb4df850-6855489c7f-t7vsx\" (UID: \"6e377154-baed-480e-9af7-87da5d946393\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-eb4df850-6855489c7f-t7vsx"
Sep 10 04:56:21.654192 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:21.654090    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6e377154-baed-480e-9af7-87da5d946393-maas-api-tls\") pod \"maas-api-e2e-ait-eb4df850-6855489c7f-t7vsx\" (UID: \"6e377154-baed-480e-9af7-87da5d946393\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-eb4df850-6855489c7f-t7vsx"
Sep 10 04:56:21.654367 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:56:21.654272    2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-eb4df850-serving-cert: secret "maas-api-e2e-ait-eb4df850-serving-cert" not found
Sep 10 04:56:21.654367 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:56:21.654358    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e377154-baed-480e-9af7-87da5d946393-maas-api-tls podName:6e377154-baed-480e-9af7-87da5d946393 nodeName:}" failed. No retries permitted until 2026-09-10 04:56:22.1543402 +0000 UTC m=+921.816797948 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6e377154-baed-480e-9af7-87da5d946393-maas-api-tls") pod "maas-api-e2e-ait-eb4df850-6855489c7f-t7vsx" (UID: "6e377154-baed-480e-9af7-87da5d946393") : secret "maas-api-e2e-ait-eb4df850-serving-cert" not found
Sep 10 04:56:21.655054 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:21.655031    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e377154-baed-480e-9af7-87da5d946393-openshift-service-ca\") pod \"maas-api-e2e-ait-eb4df850-6855489c7f-t7vsx\" (UID: \"6e377154-baed-480e-9af7-87da5d946393\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-eb4df850-6855489c7f-t7vsx"
Sep 10 04:56:21.656500 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:21.656480    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6e377154-baed-480e-9af7-87da5d946393-metrics-certs\") pod \"maas-api-e2e-ait-eb4df850-6855489c7f-t7vsx\" (UID: \"6e377154-baed-480e-9af7-87da5d946393\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-eb4df850-6855489c7f-t7vsx"
Sep 10 04:56:21.661913 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:21.661890    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82mnz\" (UniqueName: \"kubernetes.io/projected/6e377154-baed-480e-9af7-87da5d946393-kube-api-access-82mnz\") pod \"maas-api-e2e-ait-eb4df850-6855489c7f-t7vsx\" (UID: \"6e377154-baed-480e-9af7-87da5d946393\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-eb4df850-6855489c7f-t7vsx"
Sep 10 04:56:22.021563 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:22.021503    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn"
Sep 10 04:56:22.057240 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:22.057214    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/539fe443-da0e-4aab-a38b-cab6029883b5-workload-certs\") pod \"539fe443-da0e-4aab-a38b-cab6029883b5\" (UID: \"539fe443-da0e-4aab-a38b-cab6029883b5\") "
Sep 10 04:56:22.057402 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:22.057263    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/539fe443-da0e-4aab-a38b-cab6029883b5-istio-envoy\") pod \"539fe443-da0e-4aab-a38b-cab6029883b5\" (UID: \"539fe443-da0e-4aab-a38b-cab6029883b5\") "
Sep 10 04:56:22.057402 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:22.057290    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/539fe443-da0e-4aab-a38b-cab6029883b5-istio-data\") pod \"539fe443-da0e-4aab-a38b-cab6029883b5\" (UID: \"539fe443-da0e-4aab-a38b-cab6029883b5\") "
Sep 10 04:56:22.057402 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:22.057317    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/539fe443-da0e-4aab-a38b-cab6029883b5-workload-socket\") pod \"539fe443-da0e-4aab-a38b-cab6029883b5\" (UID: \"539fe443-da0e-4aab-a38b-cab6029883b5\") "
Sep 10 04:56:22.057402 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:22.057339    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/539fe443-da0e-4aab-a38b-cab6029883b5-credential-socket\") pod \"539fe443-da0e-4aab-a38b-cab6029883b5\" (UID: \"539fe443-da0e-4aab-a38b-cab6029883b5\") "
Sep 10 04:56:22.057402 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:22.057372    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/539fe443-da0e-4aab-a38b-cab6029883b5-istiod-ca-cert\") pod \"539fe443-da0e-4aab-a38b-cab6029883b5\" (UID: \"539fe443-da0e-4aab-a38b-cab6029883b5\") "
Sep 10 04:56:22.057402 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:22.057404    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/539fe443-da0e-4aab-a38b-cab6029883b5-istio-podinfo\") pod \"539fe443-da0e-4aab-a38b-cab6029883b5\" (UID: \"539fe443-da0e-4aab-a38b-cab6029883b5\") "
Sep 10 04:56:22.057767 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:22.057526    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/539fe443-da0e-4aab-a38b-cab6029883b5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "539fe443-da0e-4aab-a38b-cab6029883b5" (UID: "539fe443-da0e-4aab-a38b-cab6029883b5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 04:56:22.057767 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:22.057599    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/539fe443-da0e-4aab-a38b-cab6029883b5-istio-token\") pod \"539fe443-da0e-4aab-a38b-cab6029883b5\" (UID: \"539fe443-da0e-4aab-a38b-cab6029883b5\") "
Sep 10 04:56:22.057767 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:22.057599    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/539fe443-da0e-4aab-a38b-cab6029883b5-istio-data" (OuterVolumeSpecName: "istio-data") pod "539fe443-da0e-4aab-a38b-cab6029883b5" (UID: "539fe443-da0e-4aab-a38b-cab6029883b5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 04:56:22.057767 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:22.057645    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/539fe443-da0e-4aab-a38b-cab6029883b5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "539fe443-da0e-4aab-a38b-cab6029883b5" (UID: "539fe443-da0e-4aab-a38b-cab6029883b5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 04:56:22.057767 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:22.057626    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/539fe443-da0e-4aab-a38b-cab6029883b5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "539fe443-da0e-4aab-a38b-cab6029883b5" (UID: "539fe443-da0e-4aab-a38b-cab6029883b5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 04:56:22.057767 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:22.057693    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qbjkn\" (UniqueName: \"kubernetes.io/projected/539fe443-da0e-4aab-a38b-cab6029883b5-kube-api-access-qbjkn\") pod \"539fe443-da0e-4aab-a38b-cab6029883b5\" (UID: \"539fe443-da0e-4aab-a38b-cab6029883b5\") "
Sep 10 04:56:22.058087 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:22.057979    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/539fe443-da0e-4aab-a38b-cab6029883b5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "539fe443-da0e-4aab-a38b-cab6029883b5" (UID: "539fe443-da0e-4aab-a38b-cab6029883b5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 04:56:22.058154 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:22.058126    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/539fe443-da0e-4aab-a38b-cab6029883b5-istiod-ca-cert\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:56:22.058154 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:22.058146    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/539fe443-da0e-4aab-a38b-cab6029883b5-workload-certs\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:56:22.058270 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:22.058160    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/539fe443-da0e-4aab-a38b-cab6029883b5-istio-data\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:56:22.058270 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:22.058172    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/539fe443-da0e-4aab-a38b-cab6029883b5-workload-socket\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:56:22.058270 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:22.058185    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/539fe443-da0e-4aab-a38b-cab6029883b5-credential-socket\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:56:22.059763 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:22.059730    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/539fe443-da0e-4aab-a38b-cab6029883b5-istio-token" (OuterVolumeSpecName: "istio-token") pod "539fe443-da0e-4aab-a38b-cab6029883b5" (UID: "539fe443-da0e-4aab-a38b-cab6029883b5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 04:56:22.059914 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:22.059814    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/539fe443-da0e-4aab-a38b-cab6029883b5-kube-api-access-qbjkn" (OuterVolumeSpecName: "kube-api-access-qbjkn") pod "539fe443-da0e-4aab-a38b-cab6029883b5" (UID: "539fe443-da0e-4aab-a38b-cab6029883b5"). InnerVolumeSpecName "kube-api-access-qbjkn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 04:56:22.059914 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:22.059873    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/539fe443-da0e-4aab-a38b-cab6029883b5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "539fe443-da0e-4aab-a38b-cab6029883b5" (UID: "539fe443-da0e-4aab-a38b-cab6029883b5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 04:56:22.060062 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:22.060042    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/539fe443-da0e-4aab-a38b-cab6029883b5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "539fe443-da0e-4aab-a38b-cab6029883b5" (UID: "539fe443-da0e-4aab-a38b-cab6029883b5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 04:56:22.158660 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:22.158625    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6e377154-baed-480e-9af7-87da5d946393-maas-api-tls\") pod \"maas-api-e2e-ait-eb4df850-6855489c7f-t7vsx\" (UID: \"6e377154-baed-480e-9af7-87da5d946393\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-eb4df850-6855489c7f-t7vsx"
Sep 10 04:56:22.158837 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:22.158725    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qbjkn\" (UniqueName: \"kubernetes.io/projected/539fe443-da0e-4aab-a38b-cab6029883b5-kube-api-access-qbjkn\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:56:22.158837 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:22.158738    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/539fe443-da0e-4aab-a38b-cab6029883b5-istio-envoy\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:56:22.158837 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:22.158747    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/539fe443-da0e-4aab-a38b-cab6029883b5-istio-podinfo\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:56:22.158837 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:22.158755    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/539fe443-da0e-4aab-a38b-cab6029883b5-istio-token\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:56:22.161044 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:22.161020    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6e377154-baed-480e-9af7-87da5d946393-maas-api-tls\") pod \"maas-api-e2e-ait-eb4df850-6855489c7f-t7vsx\" (UID: \"6e377154-baed-480e-9af7-87da5d946393\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-eb4df850-6855489c7f-t7vsx"
Sep 10 04:56:22.397580 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:22.397549    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eb4df850-6855489c7f-t7vsx"
Sep 10 04:56:22.669779 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:22.669744    2560 generic.go:356] "Generic (PLEG): container finished" podID="539fe443-da0e-4aab-a38b-cab6029883b5" containerID="e5e138402baf7e426079d1bc708fa42e75e2d1d75ce694e117d3549b98f7ca9e" exitCode=0
Sep 10 04:56:22.670097 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:22.669801    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn"
Sep 10 04:56:22.670097 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:22.669821    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn" event={"ID":"539fe443-da0e-4aab-a38b-cab6029883b5","Type":"ContainerDied","Data":"e5e138402baf7e426079d1bc708fa42e75e2d1d75ce694e117d3549b98f7ca9e"}
Sep 10 04:56:22.670097 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:22.669897    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn" event={"ID":"539fe443-da0e-4aab-a38b-cab6029883b5","Type":"ContainerDied","Data":"3c9d07b636377d5fc29cb388aee275598a49e77f35081da1853085df5f9e39db"}
Sep 10 04:56:22.670097 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:22.669920    2560 scope.go:117] "RemoveContainer" containerID="e5e138402baf7e426079d1bc708fa42e75e2d1d75ce694e117d3549b98f7ca9e"
Sep 10 04:56:22.674879 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:22.674845    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-eb4df850-6855489c7f-t7vsx"]
Sep 10 04:56:22.676003 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:56:22.675976    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e377154_baed_480e_9af7_87da5d946393.slice/crio-658ca699df4abd1860e68a93d8418f45d096153534d124025508b1416fbf3e93 WatchSource:0}: Error finding container 658ca699df4abd1860e68a93d8418f45d096153534d124025508b1416fbf3e93: Status 404 returned error can't find the container with id 658ca699df4abd1860e68a93d8418f45d096153534d124025508b1416fbf3e93
Sep 10 04:56:22.688417 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:22.688393    2560 scope.go:117] "RemoveContainer" containerID="a1c20f96355777ef6bca17bfa8a98eff70e7799ff61e5b32b8515232c6463002"
Sep 10 04:56:22.697404 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:22.697381    2560 scope.go:117] "RemoveContainer" containerID="e5e138402baf7e426079d1bc708fa42e75e2d1d75ce694e117d3549b98f7ca9e"
Sep 10 04:56:22.697684 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:56:22.697664    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5e138402baf7e426079d1bc708fa42e75e2d1d75ce694e117d3549b98f7ca9e\": container with ID starting with e5e138402baf7e426079d1bc708fa42e75e2d1d75ce694e117d3549b98f7ca9e not found: ID does not exist" containerID="e5e138402baf7e426079d1bc708fa42e75e2d1d75ce694e117d3549b98f7ca9e"
Sep 10 04:56:22.697774 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:22.697692    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5e138402baf7e426079d1bc708fa42e75e2d1d75ce694e117d3549b98f7ca9e"} err="failed to get container status \"e5e138402baf7e426079d1bc708fa42e75e2d1d75ce694e117d3549b98f7ca9e\": rpc error: code = NotFound desc = could not find container \"e5e138402baf7e426079d1bc708fa42e75e2d1d75ce694e117d3549b98f7ca9e\": container with ID starting with e5e138402baf7e426079d1bc708fa42e75e2d1d75ce694e117d3549b98f7ca9e not found: ID does not exist"
Sep 10 04:56:22.697774 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:22.697709    2560 scope.go:117] "RemoveContainer" containerID="a1c20f96355777ef6bca17bfa8a98eff70e7799ff61e5b32b8515232c6463002"
Sep 10 04:56:22.698358 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:56:22.698199    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1c20f96355777ef6bca17bfa8a98eff70e7799ff61e5b32b8515232c6463002\": container with ID starting with a1c20f96355777ef6bca17bfa8a98eff70e7799ff61e5b32b8515232c6463002 not found: ID does not exist" containerID="a1c20f96355777ef6bca17bfa8a98eff70e7799ff61e5b32b8515232c6463002"
Sep 10 04:56:22.698358 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:22.698237    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1c20f96355777ef6bca17bfa8a98eff70e7799ff61e5b32b8515232c6463002"} err="failed to get container status \"a1c20f96355777ef6bca17bfa8a98eff70e7799ff61e5b32b8515232c6463002\": rpc error: code = NotFound desc = could not find container \"a1c20f96355777ef6bca17bfa8a98eff70e7799ff61e5b32b8515232c6463002\": container with ID starting with a1c20f96355777ef6bca17bfa8a98eff70e7799ff61e5b32b8515232c6463002 not found: ID does not exist"
Sep 10 04:56:22.701128 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:22.701108    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn"]
Sep 10 04:56:22.704440 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:22.704420    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-d778192d-gw-openshift-default-5794d79b84-rrvhn"]
Sep 10 04:56:22.825740 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:22.825709    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="539fe443-da0e-4aab-a38b-cab6029883b5" path="/var/lib/kubelet/pods/539fe443-da0e-4aab-a38b-cab6029883b5/volumes"
Sep 10 04:56:23.677497 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:23.677464    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eb4df850-6855489c7f-t7vsx" event={"ID":"6e377154-baed-480e-9af7-87da5d946393","Type":"ContainerStarted","Data":"f88785bd438a99e86b4254a526018a18ec7fb7638b19e693027287715b55bd11"}
Sep 10 04:56:23.677927 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:23.677566    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eb4df850-6855489c7f-t7vsx"
Sep 10 04:56:23.677927 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:23.677591    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eb4df850-6855489c7f-t7vsx" event={"ID":"6e377154-baed-480e-9af7-87da5d946393","Type":"ContainerStarted","Data":"658ca699df4abd1860e68a93d8418f45d096153534d124025508b1416fbf3e93"}
Sep 10 04:56:23.692900 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:23.692841    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eb4df850-6855489c7f-t7vsx" podStartSLOduration=2.238670692 podStartE2EDuration="2.692827343s" totalImagesPullingTime="454.156651ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:56:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:56:23.691841217 +0000 UTC m=+923.354298963" watchObservedRunningTime="2026-09-10 04:56:23.692827343 +0000 UTC m=+923.355285089"
Sep 10 04:56:29.692359 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:29.692330    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eb4df850-6855489c7f-t7vsx"
Sep 10 04:56:32.906017 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:32.905984    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 04:56:51.293035 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:51.293002    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 04:56:52.078019 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:52.077984    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-eb4df850-6855489c7f-t7vsx"]
Sep 10 04:56:52.078233 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:52.078207    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eb4df850-6855489c7f-t7vsx" podUID="6e377154-baed-480e-9af7-87da5d946393" containerName="maas-api" containerID="cri-o://f88785bd438a99e86b4254a526018a18ec7fb7638b19e693027287715b55bd11" gracePeriod=30
Sep 10 04:56:52.338024 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:52.337963    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eb4df850-6855489c7f-t7vsx"
Sep 10 04:56:52.441424 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:52.441392    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-82mnz\" (UniqueName: \"kubernetes.io/projected/6e377154-baed-480e-9af7-87da5d946393-kube-api-access-82mnz\") pod \"6e377154-baed-480e-9af7-87da5d946393\" (UID: \"6e377154-baed-480e-9af7-87da5d946393\") "
Sep 10 04:56:52.441612 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:52.441432    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e377154-baed-480e-9af7-87da5d946393-openshift-service-ca\") pod \"6e377154-baed-480e-9af7-87da5d946393\" (UID: \"6e377154-baed-480e-9af7-87da5d946393\") "
Sep 10 04:56:52.441612 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:52.441495    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6e377154-baed-480e-9af7-87da5d946393-maas-api-tls\") pod \"6e377154-baed-480e-9af7-87da5d946393\" (UID: \"6e377154-baed-480e-9af7-87da5d946393\") "
Sep 10 04:56:52.441612 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:52.441512    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6e377154-baed-480e-9af7-87da5d946393-metrics-certs\") pod \"6e377154-baed-480e-9af7-87da5d946393\" (UID: \"6e377154-baed-480e-9af7-87da5d946393\") "
Sep 10 04:56:52.441966 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:52.441937    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e377154-baed-480e-9af7-87da5d946393-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6e377154-baed-480e-9af7-87da5d946393" (UID: "6e377154-baed-480e-9af7-87da5d946393"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 04:56:52.443883 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:52.443833    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e377154-baed-480e-9af7-87da5d946393-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6e377154-baed-480e-9af7-87da5d946393" (UID: "6e377154-baed-480e-9af7-87da5d946393"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 04:56:52.444012 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:52.443892    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e377154-baed-480e-9af7-87da5d946393-kube-api-access-82mnz" (OuterVolumeSpecName: "kube-api-access-82mnz") pod "6e377154-baed-480e-9af7-87da5d946393" (UID: "6e377154-baed-480e-9af7-87da5d946393"). InnerVolumeSpecName "kube-api-access-82mnz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 04:56:52.444012 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:52.443895    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e377154-baed-480e-9af7-87da5d946393-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "6e377154-baed-480e-9af7-87da5d946393" (UID: "6e377154-baed-480e-9af7-87da5d946393"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 04:56:52.543343 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:52.543306    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-82mnz\" (UniqueName: \"kubernetes.io/projected/6e377154-baed-480e-9af7-87da5d946393-kube-api-access-82mnz\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:56:52.543343 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:52.543341    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e377154-baed-480e-9af7-87da5d946393-openshift-service-ca\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:56:52.543518 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:52.543356    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6e377154-baed-480e-9af7-87da5d946393-maas-api-tls\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:56:52.543518 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:52.543369    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6e377154-baed-480e-9af7-87da5d946393-metrics-certs\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:56:52.857799 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:52.857762    2560 generic.go:356] "Generic (PLEG): container finished" podID="6e377154-baed-480e-9af7-87da5d946393" containerID="f88785bd438a99e86b4254a526018a18ec7fb7638b19e693027287715b55bd11" exitCode=0
Sep 10 04:56:52.857965 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:52.857817    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eb4df850-6855489c7f-t7vsx"
Sep 10 04:56:52.857965 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:52.857859    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eb4df850-6855489c7f-t7vsx" event={"ID":"6e377154-baed-480e-9af7-87da5d946393","Type":"ContainerDied","Data":"f88785bd438a99e86b4254a526018a18ec7fb7638b19e693027287715b55bd11"}
Sep 10 04:56:52.857965 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:52.857929    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eb4df850-6855489c7f-t7vsx" event={"ID":"6e377154-baed-480e-9af7-87da5d946393","Type":"ContainerDied","Data":"658ca699df4abd1860e68a93d8418f45d096153534d124025508b1416fbf3e93"}
Sep 10 04:56:52.857965 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:52.857952    2560 scope.go:117] "RemoveContainer" containerID="f88785bd438a99e86b4254a526018a18ec7fb7638b19e693027287715b55bd11"
Sep 10 04:56:52.867535 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:52.867518    2560 scope.go:117] "RemoveContainer" containerID="f88785bd438a99e86b4254a526018a18ec7fb7638b19e693027287715b55bd11"
Sep 10 04:56:52.867824 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:56:52.867805    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f88785bd438a99e86b4254a526018a18ec7fb7638b19e693027287715b55bd11\": container with ID starting with f88785bd438a99e86b4254a526018a18ec7fb7638b19e693027287715b55bd11 not found: ID does not exist" containerID="f88785bd438a99e86b4254a526018a18ec7fb7638b19e693027287715b55bd11"
Sep 10 04:56:52.867900 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:52.867831    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f88785bd438a99e86b4254a526018a18ec7fb7638b19e693027287715b55bd11"} err="failed to get container status \"f88785bd438a99e86b4254a526018a18ec7fb7638b19e693027287715b55bd11\": rpc error: code = NotFound desc = could not find container \"f88785bd438a99e86b4254a526018a18ec7fb7638b19e693027287715b55bd11\": container with ID starting with f88785bd438a99e86b4254a526018a18ec7fb7638b19e693027287715b55bd11 not found: ID does not exist"
Sep 10 04:56:52.879349 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:52.879327    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-eb4df850-6855489c7f-t7vsx"]
Sep 10 04:56:52.884413 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:52.884393    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-eb4df850-6855489c7f-t7vsx"]
Sep 10 04:56:54.197297 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:54.197264    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f"]
Sep 10 04:56:54.197937 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:54.197912    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="539fe443-da0e-4aab-a38b-cab6029883b5" containerName="istio-proxy"
Sep 10 04:56:54.197937 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:54.197937    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="539fe443-da0e-4aab-a38b-cab6029883b5" containerName="istio-proxy"
Sep 10 04:56:54.198106 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:54.197970    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e377154-baed-480e-9af7-87da5d946393" containerName="maas-api"
Sep 10 04:56:54.198106 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:54.197978    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e377154-baed-480e-9af7-87da5d946393" containerName="maas-api"
Sep 10 04:56:54.198106 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:54.197993    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="539fe443-da0e-4aab-a38b-cab6029883b5" containerName="istio-proxy"
Sep 10 04:56:54.198106 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:54.198001    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="539fe443-da0e-4aab-a38b-cab6029883b5" containerName="istio-proxy"
Sep 10 04:56:54.198298 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:54.198108    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e377154-baed-480e-9af7-87da5d946393" containerName="maas-api"
Sep 10 04:56:54.198298 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:54.198124    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="539fe443-da0e-4aab-a38b-cab6029883b5" containerName="istio-proxy"
Sep 10 04:56:54.198298 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:54.198137    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="539fe443-da0e-4aab-a38b-cab6029883b5" containerName="istio-proxy"
Sep 10 04:56:54.202790 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:54.202768    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f"
Sep 10 04:56:54.204799 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:54.204781    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-ead8c2c2-openshift-default-dockercfg-4xlzz\""
Sep 10 04:56:54.213687 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:54.213662    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f"]
Sep 10 04:56:54.362182 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:54.362151    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/badace30-329c-44f6-b244-f553758c955f-credential-socket\") pod \"e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f\" (UID: \"badace30-329c-44f6-b244-f553758c955f\") " pod="openshift-ingress/e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f"
Sep 10 04:56:54.362359 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:54.362188    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/badace30-329c-44f6-b244-f553758c955f-istio-token\") pod \"e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f\" (UID: \"badace30-329c-44f6-b244-f553758c955f\") " pod="openshift-ingress/e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f"
Sep 10 04:56:54.362359 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:54.362238    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/badace30-329c-44f6-b244-f553758c955f-workload-certs\") pod \"e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f\" (UID: \"badace30-329c-44f6-b244-f553758c955f\") " pod="openshift-ingress/e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f"
Sep 10 04:56:54.362359 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:54.362257    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/badace30-329c-44f6-b244-f553758c955f-istio-data\") pod \"e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f\" (UID: \"badace30-329c-44f6-b244-f553758c955f\") " pod="openshift-ingress/e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f"
Sep 10 04:56:54.362359 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:54.362317    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rx68s\" (UniqueName: \"kubernetes.io/projected/badace30-329c-44f6-b244-f553758c955f-kube-api-access-rx68s\") pod \"e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f\" (UID: \"badace30-329c-44f6-b244-f553758c955f\") " pod="openshift-ingress/e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f"
Sep 10 04:56:54.362582 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:54.362364    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/badace30-329c-44f6-b244-f553758c955f-istio-podinfo\") pod \"e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f\" (UID: \"badace30-329c-44f6-b244-f553758c955f\") " pod="openshift-ingress/e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f"
Sep 10 04:56:54.362582 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:54.362391    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/badace30-329c-44f6-b244-f553758c955f-workload-socket\") pod \"e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f\" (UID: \"badace30-329c-44f6-b244-f553758c955f\") " pod="openshift-ingress/e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f"
Sep 10 04:56:54.362582 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:54.362508    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/badace30-329c-44f6-b244-f553758c955f-istio-envoy\") pod \"e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f\" (UID: \"badace30-329c-44f6-b244-f553758c955f\") " pod="openshift-ingress/e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f"
Sep 10 04:56:54.362712 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:54.362578    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/badace30-329c-44f6-b244-f553758c955f-istiod-ca-cert\") pod \"e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f\" (UID: \"badace30-329c-44f6-b244-f553758c955f\") " pod="openshift-ingress/e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f"
Sep 10 04:56:54.463665 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:54.463583    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/badace30-329c-44f6-b244-f553758c955f-istio-envoy\") pod \"e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f\" (UID: \"badace30-329c-44f6-b244-f553758c955f\") " pod="openshift-ingress/e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f"
Sep 10 04:56:54.463665 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:54.463637    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/badace30-329c-44f6-b244-f553758c955f-istiod-ca-cert\") pod \"e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f\" (UID: \"badace30-329c-44f6-b244-f553758c955f\") " pod="openshift-ingress/e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f"
Sep 10 04:56:54.463911 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:54.463679    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/badace30-329c-44f6-b244-f553758c955f-credential-socket\") pod \"e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f\" (UID: \"badace30-329c-44f6-b244-f553758c955f\") " pod="openshift-ingress/e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f"
Sep 10 04:56:54.463911 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:54.463704    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/badace30-329c-44f6-b244-f553758c955f-istio-token\") pod \"e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f\" (UID: \"badace30-329c-44f6-b244-f553758c955f\") " pod="openshift-ingress/e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f"
Sep 10 04:56:54.463911 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:54.463760    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/badace30-329c-44f6-b244-f553758c955f-workload-certs\") pod \"e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f\" (UID: \"badace30-329c-44f6-b244-f553758c955f\") " pod="openshift-ingress/e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f"
Sep 10 04:56:54.463911 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:54.463795    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/badace30-329c-44f6-b244-f553758c955f-istio-data\") pod \"e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f\" (UID: \"badace30-329c-44f6-b244-f553758c955f\") " pod="openshift-ingress/e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f"
Sep 10 04:56:54.463911 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:54.463838    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rx68s\" (UniqueName: \"kubernetes.io/projected/badace30-329c-44f6-b244-f553758c955f-kube-api-access-rx68s\") pod \"e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f\" (UID: \"badace30-329c-44f6-b244-f553758c955f\") " pod="openshift-ingress/e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f"
Sep 10 04:56:54.464178 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:54.463911    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/badace30-329c-44f6-b244-f553758c955f-istio-podinfo\") pod \"e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f\" (UID: \"badace30-329c-44f6-b244-f553758c955f\") " pod="openshift-ingress/e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f"
Sep 10 04:56:54.464178 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:54.463938    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/badace30-329c-44f6-b244-f553758c955f-workload-socket\") pod \"e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f\" (UID: \"badace30-329c-44f6-b244-f553758c955f\") " pod="openshift-ingress/e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f"
Sep 10 04:56:54.464178 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:54.464052    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/badace30-329c-44f6-b244-f553758c955f-credential-socket\") pod \"e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f\" (UID: \"badace30-329c-44f6-b244-f553758c955f\") " pod="openshift-ingress/e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f"
Sep 10 04:56:54.464178 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:54.464107    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/badace30-329c-44f6-b244-f553758c955f-workload-certs\") pod \"e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f\" (UID: \"badace30-329c-44f6-b244-f553758c955f\") " pod="openshift-ingress/e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f"
Sep 10 04:56:54.464376 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:54.464306    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/badace30-329c-44f6-b244-f553758c955f-workload-socket\") pod \"e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f\" (UID: \"badace30-329c-44f6-b244-f553758c955f\") " pod="openshift-ingress/e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f"
Sep 10 04:56:54.464430 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:54.464412    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/badace30-329c-44f6-b244-f553758c955f-istio-data\") pod \"e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f\" (UID: \"badace30-329c-44f6-b244-f553758c955f\") " pod="openshift-ingress/e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f"
Sep 10 04:56:54.464485 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:54.464459    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/badace30-329c-44f6-b244-f553758c955f-istiod-ca-cert\") pod \"e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f\" (UID: \"badace30-329c-44f6-b244-f553758c955f\") " pod="openshift-ingress/e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f"
Sep 10 04:56:54.466286 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:54.466265    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/badace30-329c-44f6-b244-f553758c955f-istio-envoy\") pod \"e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f\" (UID: \"badace30-329c-44f6-b244-f553758c955f\") " pod="openshift-ingress/e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f"
Sep 10 04:56:54.466724 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:54.466701    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/badace30-329c-44f6-b244-f553758c955f-istio-podinfo\") pod \"e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f\" (UID: \"badace30-329c-44f6-b244-f553758c955f\") " pod="openshift-ingress/e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f"
Sep 10 04:56:54.471784 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:54.471750    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/badace30-329c-44f6-b244-f553758c955f-istio-token\") pod \"e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f\" (UID: \"badace30-329c-44f6-b244-f553758c955f\") " pod="openshift-ingress/e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f"
Sep 10 04:56:54.471909 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:54.471820    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rx68s\" (UniqueName: \"kubernetes.io/projected/badace30-329c-44f6-b244-f553758c955f-kube-api-access-rx68s\") pod \"e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f\" (UID: \"badace30-329c-44f6-b244-f553758c955f\") " pod="openshift-ingress/e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f"
Sep 10 04:56:54.514994 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:54.514969    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f"
Sep 10 04:56:54.790640 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:54.790610    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f"]
Sep 10 04:56:54.791396 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:56:54.791365    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbadace30_329c_44f6_b244_f553758c955f.slice/crio-c362b5a417c45fa35a8646a9ff8e37222764c83ed1153ae5964496f1add88783 WatchSource:0}: Error finding container c362b5a417c45fa35a8646a9ff8e37222764c83ed1153ae5964496f1add88783: Status 404 returned error can't find the container with id c362b5a417c45fa35a8646a9ff8e37222764c83ed1153ae5964496f1add88783
Sep 10 04:56:54.793563 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:54.793535    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 04:56:54.793634 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:54.793597    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 04:56:54.793634 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:54.793626    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 04:56:54.826629 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:54.826601    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e377154-baed-480e-9af7-87da5d946393" path="/var/lib/kubelet/pods/6e377154-baed-480e-9af7-87da5d946393/volumes"
Sep 10 04:56:54.873162 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:54.873138    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f" event={"ID":"badace30-329c-44f6-b244-f553758c955f","Type":"ContainerStarted","Data":"c362b5a417c45fa35a8646a9ff8e37222764c83ed1153ae5964496f1add88783"}
Sep 10 04:56:55.881763 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:55.881730    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f" event={"ID":"badace30-329c-44f6-b244-f553758c955f","Type":"ContainerStarted","Data":"0afa44591443fca6ffda6c86be4686a098fe104e20268cff982d56ff27903b2a"}
Sep 10 04:56:55.900200 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:55.900155    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f" podStartSLOduration=1.900140604 podStartE2EDuration="1.900140604s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:56:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:56:55.898669238 +0000 UTC m=+955.561126986" watchObservedRunningTime="2026-09-10 04:56:55.900140604 +0000 UTC m=+955.562598350"
Sep 10 04:56:56.515732 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:56.515698    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f"
Sep 10 04:56:56.520756 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:56.520731    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f"
Sep 10 04:56:56.887840 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:56.887812    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f"
Sep 10 04:56:56.888672 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:56.888653    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f"
Sep 10 04:56:58.387024 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:58.386989    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ead8c2c2-75d5f965c6-ng6ds"]
Sep 10 04:56:58.391302 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:58.391281    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ead8c2c2-75d5f965c6-ng6ds"
Sep 10 04:56:58.393340 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:58.393320    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-ead8c2c2-serving-cert\""
Sep 10 04:56:58.404286 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:58.404265    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ead8c2c2-75d5f965c6-ng6ds"]
Sep 10 04:56:58.499108 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:58.499078    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e4e2ffd-fa31-486a-8265-4102409d8543-maas-api-tls\") pod \"maas-api-e2e-derive-ead8c2c2-75d5f965c6-ng6ds\" (UID: \"1e4e2ffd-fa31-486a-8265-4102409d8543\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ead8c2c2-75d5f965c6-ng6ds"
Sep 10 04:56:58.499242 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:58.499173    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e4e2ffd-fa31-486a-8265-4102409d8543-metrics-certs\") pod \"maas-api-e2e-derive-ead8c2c2-75d5f965c6-ng6ds\" (UID: \"1e4e2ffd-fa31-486a-8265-4102409d8543\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ead8c2c2-75d5f965c6-ng6ds"
Sep 10 04:56:58.499242 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:58.499210    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e4e2ffd-fa31-486a-8265-4102409d8543-openshift-service-ca\") pod \"maas-api-e2e-derive-ead8c2c2-75d5f965c6-ng6ds\" (UID: \"1e4e2ffd-fa31-486a-8265-4102409d8543\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ead8c2c2-75d5f965c6-ng6ds"
Sep 10 04:56:58.499321 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:58.499249    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdj9s\" (UniqueName: \"kubernetes.io/projected/1e4e2ffd-fa31-486a-8265-4102409d8543-kube-api-access-fdj9s\") pod \"maas-api-e2e-derive-ead8c2c2-75d5f965c6-ng6ds\" (UID: \"1e4e2ffd-fa31-486a-8265-4102409d8543\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ead8c2c2-75d5f965c6-ng6ds"
Sep 10 04:56:58.599931 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:58.599903    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e4e2ffd-fa31-486a-8265-4102409d8543-metrics-certs\") pod \"maas-api-e2e-derive-ead8c2c2-75d5f965c6-ng6ds\" (UID: \"1e4e2ffd-fa31-486a-8265-4102409d8543\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ead8c2c2-75d5f965c6-ng6ds"
Sep 10 04:56:58.600084 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:58.599948    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e4e2ffd-fa31-486a-8265-4102409d8543-openshift-service-ca\") pod \"maas-api-e2e-derive-ead8c2c2-75d5f965c6-ng6ds\" (UID: \"1e4e2ffd-fa31-486a-8265-4102409d8543\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ead8c2c2-75d5f965c6-ng6ds"
Sep 10 04:56:58.600084 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:58.600003    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdj9s\" (UniqueName: \"kubernetes.io/projected/1e4e2ffd-fa31-486a-8265-4102409d8543-kube-api-access-fdj9s\") pod \"maas-api-e2e-derive-ead8c2c2-75d5f965c6-ng6ds\" (UID: \"1e4e2ffd-fa31-486a-8265-4102409d8543\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ead8c2c2-75d5f965c6-ng6ds"
Sep 10 04:56:58.600084 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:58.600077    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e4e2ffd-fa31-486a-8265-4102409d8543-maas-api-tls\") pod \"maas-api-e2e-derive-ead8c2c2-75d5f965c6-ng6ds\" (UID: \"1e4e2ffd-fa31-486a-8265-4102409d8543\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ead8c2c2-75d5f965c6-ng6ds"
Sep 10 04:56:58.600208 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:56:58.600194    2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-ead8c2c2-serving-cert: secret "maas-api-e2e-derive-ead8c2c2-serving-cert" not found
Sep 10 04:56:58.600275 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:56:58.600264    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e4e2ffd-fa31-486a-8265-4102409d8543-maas-api-tls podName:1e4e2ffd-fa31-486a-8265-4102409d8543 nodeName:}" failed. No retries permitted until 2026-09-10 04:56:59.100243501 +0000 UTC m=+958.762701244 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1e4e2ffd-fa31-486a-8265-4102409d8543-maas-api-tls") pod "maas-api-e2e-derive-ead8c2c2-75d5f965c6-ng6ds" (UID: "1e4e2ffd-fa31-486a-8265-4102409d8543") : secret "maas-api-e2e-derive-ead8c2c2-serving-cert" not found
Sep 10 04:56:58.600649 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:58.600624    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e4e2ffd-fa31-486a-8265-4102409d8543-openshift-service-ca\") pod \"maas-api-e2e-derive-ead8c2c2-75d5f965c6-ng6ds\" (UID: \"1e4e2ffd-fa31-486a-8265-4102409d8543\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ead8c2c2-75d5f965c6-ng6ds"
Sep 10 04:56:58.602387 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:58.602367    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e4e2ffd-fa31-486a-8265-4102409d8543-metrics-certs\") pod \"maas-api-e2e-derive-ead8c2c2-75d5f965c6-ng6ds\" (UID: \"1e4e2ffd-fa31-486a-8265-4102409d8543\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ead8c2c2-75d5f965c6-ng6ds"
Sep 10 04:56:58.607832 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:58.607806    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdj9s\" (UniqueName: \"kubernetes.io/projected/1e4e2ffd-fa31-486a-8265-4102409d8543-kube-api-access-fdj9s\") pod \"maas-api-e2e-derive-ead8c2c2-75d5f965c6-ng6ds\" (UID: \"1e4e2ffd-fa31-486a-8265-4102409d8543\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ead8c2c2-75d5f965c6-ng6ds"
Sep 10 04:56:59.105917 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:59.105846    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e4e2ffd-fa31-486a-8265-4102409d8543-maas-api-tls\") pod \"maas-api-e2e-derive-ead8c2c2-75d5f965c6-ng6ds\" (UID: \"1e4e2ffd-fa31-486a-8265-4102409d8543\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ead8c2c2-75d5f965c6-ng6ds"
Sep 10 04:56:59.108379 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:59.108346    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e4e2ffd-fa31-486a-8265-4102409d8543-maas-api-tls\") pod \"maas-api-e2e-derive-ead8c2c2-75d5f965c6-ng6ds\" (UID: \"1e4e2ffd-fa31-486a-8265-4102409d8543\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ead8c2c2-75d5f965c6-ng6ds"
Sep 10 04:56:59.305506 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:59.305468    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ead8c2c2-75d5f965c6-ng6ds"
Sep 10 04:56:59.579662 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:59.579635    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ead8c2c2-75d5f965c6-ng6ds"]
Sep 10 04:56:59.580927 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:56:59.580904    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e4e2ffd_fa31_486a_8265_4102409d8543.slice/crio-400ebf1e6087989e09062675b7a673ad6dba88e038bf13eab4069c599a2d5f9a WatchSource:0}: Error finding container 400ebf1e6087989e09062675b7a673ad6dba88e038bf13eab4069c599a2d5f9a: Status 404 returned error can't find the container with id 400ebf1e6087989e09062675b7a673ad6dba88e038bf13eab4069c599a2d5f9a
Sep 10 04:56:59.907225 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:56:59.907188    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ead8c2c2-75d5f965c6-ng6ds" event={"ID":"1e4e2ffd-fa31-486a-8265-4102409d8543","Type":"ContainerStarted","Data":"400ebf1e6087989e09062675b7a673ad6dba88e038bf13eab4069c599a2d5f9a"}
Sep 10 04:57:00.921991 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:00.921960    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ead8c2c2-75d5f965c6-ng6ds" event={"ID":"1e4e2ffd-fa31-486a-8265-4102409d8543","Type":"ContainerStarted","Data":"6914e153fae73ef31adf4ee9a9cfc22c8ed992478b73da79897332ca7eda8071"}
Sep 10 04:57:00.922314 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:00.922043    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ead8c2c2-75d5f965c6-ng6ds"
Sep 10 04:57:00.939645 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:00.939583    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ead8c2c2-75d5f965c6-ng6ds" podStartSLOduration=2.497085377 podStartE2EDuration="2.939563811s" totalImagesPullingTime="442.478434ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:56:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:57:00.937644308 +0000 UTC m=+960.600102081" watchObservedRunningTime="2026-09-10 04:57:00.939563811 +0000 UTC m=+960.602021558"
Sep 10 04:57:06.933779 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:06.933749    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ead8c2c2-75d5f965c6-ng6ds"
Sep 10 04:57:11.103499 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:11.103466    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 04:57:21.058122 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:21.058093    2560 generic.go:356] "Generic (PLEG): container finished" podID="badace30-329c-44f6-b244-f553758c955f" containerID="0afa44591443fca6ffda6c86be4686a098fe104e20268cff982d56ff27903b2a" exitCode=0
Sep 10 04:57:21.058471 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:21.058163    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f" event={"ID":"badace30-329c-44f6-b244-f553758c955f","Type":"ContainerDied","Data":"0afa44591443fca6ffda6c86be4686a098fe104e20268cff982d56ff27903b2a"}
Sep 10 04:57:21.058591 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:21.058575    2560 scope.go:117] "RemoveContainer" containerID="0afa44591443fca6ffda6c86be4686a098fe104e20268cff982d56ff27903b2a"
Sep 10 04:57:21.059779 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:21.059742    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 04:57:21.059882 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:21.059819    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 04:57:21.059882 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:21.059876    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 04:57:22.069970 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:22.069934    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f" event={"ID":"badace30-329c-44f6-b244-f553758c955f","Type":"ContainerStarted","Data":"93fcb738fc9c2c29aea6c5e9e7c828684b137b5315c8c809ec8fd3dc0cf29d9b"}
Sep 10 04:57:22.516000 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:22.515968    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f"
Sep 10 04:57:22.517253 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:22.517226    2560 patch_prober.go:28] interesting pod/e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Sep 10 04:57:22.517377 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:22.517287    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f" podUID="badace30-329c-44f6-b244-f553758c955f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Sep 10 04:57:23.516042 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:23.515953    2560 patch_prober.go:28] interesting pod/e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Sep 10 04:57:23.516042 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:23.516011    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f" podUID="badace30-329c-44f6-b244-f553758c955f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Sep 10 04:57:24.516153 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:24.516120    2560 patch_prober.go:28] interesting pod/e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Sep 10 04:57:24.516527 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:24.516184    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f" podUID="badace30-329c-44f6-b244-f553758c955f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Sep 10 04:57:25.515617 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:25.515583    2560 patch_prober.go:28] interesting pod/e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Sep 10 04:57:25.515807 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:25.515636    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f" podUID="badace30-329c-44f6-b244-f553758c955f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Sep 10 04:57:26.516144 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:26.516111    2560 patch_prober.go:28] interesting pod/e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Sep 10 04:57:26.516539 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:26.516166    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f" podUID="badace30-329c-44f6-b244-f553758c955f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Sep 10 04:57:26.888526 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:26.888480    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f"
Sep 10 04:57:27.520439 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:27.520403    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f"
Sep 10 04:57:27.521506 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:27.521477    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f"
Sep 10 04:57:28.855380 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:28.855345    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ead8c2c2-75d5f965c6-ng6ds"]
Sep 10 04:57:28.855953 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:28.855891    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ead8c2c2-75d5f965c6-ng6ds" podUID="1e4e2ffd-fa31-486a-8265-4102409d8543" containerName="maas-api" containerID="cri-o://6914e153fae73ef31adf4ee9a9cfc22c8ed992478b73da79897332ca7eda8071" gracePeriod=30
Sep 10 04:57:29.100565 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:29.100541    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ead8c2c2-75d5f965c6-ng6ds"
Sep 10 04:57:29.114192 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:29.114129    2560 generic.go:356] "Generic (PLEG): container finished" podID="1e4e2ffd-fa31-486a-8265-4102409d8543" containerID="6914e153fae73ef31adf4ee9a9cfc22c8ed992478b73da79897332ca7eda8071" exitCode=0
Sep 10 04:57:29.114192 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:29.114168    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ead8c2c2-75d5f965c6-ng6ds"
Sep 10 04:57:29.114328 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:29.114215    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ead8c2c2-75d5f965c6-ng6ds" event={"ID":"1e4e2ffd-fa31-486a-8265-4102409d8543","Type":"ContainerDied","Data":"6914e153fae73ef31adf4ee9a9cfc22c8ed992478b73da79897332ca7eda8071"}
Sep 10 04:57:29.114328 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:29.114266    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ead8c2c2-75d5f965c6-ng6ds" event={"ID":"1e4e2ffd-fa31-486a-8265-4102409d8543","Type":"ContainerDied","Data":"400ebf1e6087989e09062675b7a673ad6dba88e038bf13eab4069c599a2d5f9a"}
Sep 10 04:57:29.114328 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:29.114295    2560 scope.go:117] "RemoveContainer" containerID="6914e153fae73ef31adf4ee9a9cfc22c8ed992478b73da79897332ca7eda8071"
Sep 10 04:57:29.127386 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:29.127369    2560 scope.go:117] "RemoveContainer" containerID="6914e153fae73ef31adf4ee9a9cfc22c8ed992478b73da79897332ca7eda8071"
Sep 10 04:57:29.127718 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:57:29.127694    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6914e153fae73ef31adf4ee9a9cfc22c8ed992478b73da79897332ca7eda8071\": container with ID starting with 6914e153fae73ef31adf4ee9a9cfc22c8ed992478b73da79897332ca7eda8071 not found: ID does not exist" containerID="6914e153fae73ef31adf4ee9a9cfc22c8ed992478b73da79897332ca7eda8071"
Sep 10 04:57:29.127798 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:29.127731    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6914e153fae73ef31adf4ee9a9cfc22c8ed992478b73da79897332ca7eda8071"} err="failed to get container status \"6914e153fae73ef31adf4ee9a9cfc22c8ed992478b73da79897332ca7eda8071\": rpc error: code = NotFound desc = could not find container \"6914e153fae73ef31adf4ee9a9cfc22c8ed992478b73da79897332ca7eda8071\": container with ID starting with 6914e153fae73ef31adf4ee9a9cfc22c8ed992478b73da79897332ca7eda8071 not found: ID does not exist"
Sep 10 04:57:29.205749 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:29.205723    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e4e2ffd-fa31-486a-8265-4102409d8543-maas-api-tls\") pod \"1e4e2ffd-fa31-486a-8265-4102409d8543\" (UID: \"1e4e2ffd-fa31-486a-8265-4102409d8543\") "
Sep 10 04:57:29.205928 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:29.205802    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e4e2ffd-fa31-486a-8265-4102409d8543-metrics-certs\") pod \"1e4e2ffd-fa31-486a-8265-4102409d8543\" (UID: \"1e4e2ffd-fa31-486a-8265-4102409d8543\") "
Sep 10 04:57:29.205928 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:29.205843    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e4e2ffd-fa31-486a-8265-4102409d8543-openshift-service-ca\") pod \"1e4e2ffd-fa31-486a-8265-4102409d8543\" (UID: \"1e4e2ffd-fa31-486a-8265-4102409d8543\") "
Sep 10 04:57:29.205928 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:29.205894    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fdj9s\" (UniqueName: \"kubernetes.io/projected/1e4e2ffd-fa31-486a-8265-4102409d8543-kube-api-access-fdj9s\") pod \"1e4e2ffd-fa31-486a-8265-4102409d8543\" (UID: \"1e4e2ffd-fa31-486a-8265-4102409d8543\") "
Sep 10 04:57:29.206251 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:29.206222    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e4e2ffd-fa31-486a-8265-4102409d8543-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1e4e2ffd-fa31-486a-8265-4102409d8543" (UID: "1e4e2ffd-fa31-486a-8265-4102409d8543"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 04:57:29.208895 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:29.208845    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e4e2ffd-fa31-486a-8265-4102409d8543-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "1e4e2ffd-fa31-486a-8265-4102409d8543" (UID: "1e4e2ffd-fa31-486a-8265-4102409d8543"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 04:57:29.209608 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:29.209583    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e4e2ffd-fa31-486a-8265-4102409d8543-kube-api-access-fdj9s" (OuterVolumeSpecName: "kube-api-access-fdj9s") pod "1e4e2ffd-fa31-486a-8265-4102409d8543" (UID: "1e4e2ffd-fa31-486a-8265-4102409d8543"). InnerVolumeSpecName "kube-api-access-fdj9s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 04:57:29.210840 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:29.210811    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e4e2ffd-fa31-486a-8265-4102409d8543-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1e4e2ffd-fa31-486a-8265-4102409d8543" (UID: "1e4e2ffd-fa31-486a-8265-4102409d8543"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 04:57:29.211618 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:29.211585    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f"]
Sep 10 04:57:29.211824 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:29.211787    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f" podUID="badace30-329c-44f6-b244-f553758c955f" containerName="istio-proxy" containerID="cri-o://93fcb738fc9c2c29aea6c5e9e7c828684b137b5315c8c809ec8fd3dc0cf29d9b" gracePeriod=30
Sep 10 04:57:29.307674 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:29.307642    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e4e2ffd-fa31-486a-8265-4102409d8543-metrics-certs\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:57:29.307674 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:29.307673    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e4e2ffd-fa31-486a-8265-4102409d8543-openshift-service-ca\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:57:29.307962 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:29.307685    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fdj9s\" (UniqueName: \"kubernetes.io/projected/1e4e2ffd-fa31-486a-8265-4102409d8543-kube-api-access-fdj9s\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:57:29.307962 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:29.307695    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e4e2ffd-fa31-486a-8265-4102409d8543-maas-api-tls\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:57:29.435589 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:29.435558    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ead8c2c2-75d5f965c6-ng6ds"]
Sep 10 04:57:29.439056 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:29.439032    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ead8c2c2-75d5f965c6-ng6ds"]
Sep 10 04:57:30.826616 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:30.826584    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e4e2ffd-fa31-486a-8265-4102409d8543" path="/var/lib/kubelet/pods/1e4e2ffd-fa31-486a-8265-4102409d8543/volumes"
Sep 10 04:57:34.475152 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:34.475097    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f"
Sep 10 04:57:34.653922 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:34.653886    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/badace30-329c-44f6-b244-f553758c955f-workload-socket\") pod \"badace30-329c-44f6-b244-f553758c955f\" (UID: \"badace30-329c-44f6-b244-f553758c955f\") "
Sep 10 04:57:34.654103 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:34.653932    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/badace30-329c-44f6-b244-f553758c955f-istio-data\") pod \"badace30-329c-44f6-b244-f553758c955f\" (UID: \"badace30-329c-44f6-b244-f553758c955f\") "
Sep 10 04:57:34.654103 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:34.653970    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/badace30-329c-44f6-b244-f553758c955f-workload-certs\") pod \"badace30-329c-44f6-b244-f553758c955f\" (UID: \"badace30-329c-44f6-b244-f553758c955f\") "
Sep 10 04:57:34.654103 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:34.654003    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rx68s\" (UniqueName: \"kubernetes.io/projected/badace30-329c-44f6-b244-f553758c955f-kube-api-access-rx68s\") pod \"badace30-329c-44f6-b244-f553758c955f\" (UID: \"badace30-329c-44f6-b244-f553758c955f\") "
Sep 10 04:57:34.654103 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:34.654038    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/badace30-329c-44f6-b244-f553758c955f-istio-token\") pod \"badace30-329c-44f6-b244-f553758c955f\" (UID: \"badace30-329c-44f6-b244-f553758c955f\") "
Sep 10 04:57:34.654337 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:34.654180    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/badace30-329c-44f6-b244-f553758c955f-credential-socket\") pod \"badace30-329c-44f6-b244-f553758c955f\" (UID: \"badace30-329c-44f6-b244-f553758c955f\") "
Sep 10 04:57:34.654337 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:34.654201    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/badace30-329c-44f6-b244-f553758c955f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "badace30-329c-44f6-b244-f553758c955f" (UID: "badace30-329c-44f6-b244-f553758c955f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 04:57:34.654337 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:34.654311    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/badace30-329c-44f6-b244-f553758c955f-istio-envoy\") pod \"badace30-329c-44f6-b244-f553758c955f\" (UID: \"badace30-329c-44f6-b244-f553758c955f\") "
Sep 10 04:57:34.654518 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:34.654338    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/badace30-329c-44f6-b244-f553758c955f-istiod-ca-cert\") pod \"badace30-329c-44f6-b244-f553758c955f\" (UID: \"badace30-329c-44f6-b244-f553758c955f\") "
Sep 10 04:57:34.654518 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:34.654287    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/badace30-329c-44f6-b244-f553758c955f-istio-data" (OuterVolumeSpecName: "istio-data") pod "badace30-329c-44f6-b244-f553758c955f" (UID: "badace30-329c-44f6-b244-f553758c955f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 04:57:34.654518 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:34.654359    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/badace30-329c-44f6-b244-f553758c955f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "badace30-329c-44f6-b244-f553758c955f" (UID: "badace30-329c-44f6-b244-f553758c955f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 04:57:34.654518 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:34.654390    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/badace30-329c-44f6-b244-f553758c955f-istio-podinfo\") pod \"badace30-329c-44f6-b244-f553758c955f\" (UID: \"badace30-329c-44f6-b244-f553758c955f\") "
Sep 10 04:57:34.654518 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:34.654431    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/badace30-329c-44f6-b244-f553758c955f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "badace30-329c-44f6-b244-f553758c955f" (UID: "badace30-329c-44f6-b244-f553758c955f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 04:57:34.654775 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:34.654675    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/badace30-329c-44f6-b244-f553758c955f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "badace30-329c-44f6-b244-f553758c955f" (UID: "badace30-329c-44f6-b244-f553758c955f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 04:57:34.654775 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:34.654746    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/badace30-329c-44f6-b244-f553758c955f-credential-socket\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:57:34.654775 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:34.654764    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/badace30-329c-44f6-b244-f553758c955f-istiod-ca-cert\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:57:34.654959 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:34.654778    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/badace30-329c-44f6-b244-f553758c955f-workload-socket\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:57:34.654959 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:34.654789    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/badace30-329c-44f6-b244-f553758c955f-istio-data\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:57:34.654959 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:34.654802    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/badace30-329c-44f6-b244-f553758c955f-workload-certs\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:57:34.656445 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:34.656406    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/badace30-329c-44f6-b244-f553758c955f-istio-token" (OuterVolumeSpecName: "istio-token") pod "badace30-329c-44f6-b244-f553758c955f" (UID: "badace30-329c-44f6-b244-f553758c955f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 04:57:34.656630 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:34.656609    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/badace30-329c-44f6-b244-f553758c955f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "badace30-329c-44f6-b244-f553758c955f" (UID: "badace30-329c-44f6-b244-f553758c955f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 04:57:34.656749 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:34.656729    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/badace30-329c-44f6-b244-f553758c955f-kube-api-access-rx68s" (OuterVolumeSpecName: "kube-api-access-rx68s") pod "badace30-329c-44f6-b244-f553758c955f" (UID: "badace30-329c-44f6-b244-f553758c955f"). InnerVolumeSpecName "kube-api-access-rx68s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 04:57:34.656749 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:34.656741    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/badace30-329c-44f6-b244-f553758c955f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "badace30-329c-44f6-b244-f553758c955f" (UID: "badace30-329c-44f6-b244-f553758c955f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 04:57:34.755806 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:34.755730    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/badace30-329c-44f6-b244-f553758c955f-istio-envoy\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:57:34.755806 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:34.755757    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/badace30-329c-44f6-b244-f553758c955f-istio-podinfo\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:57:34.755806 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:34.755766    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rx68s\" (UniqueName: \"kubernetes.io/projected/badace30-329c-44f6-b244-f553758c955f-kube-api-access-rx68s\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:57:34.755806 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:34.755783    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/badace30-329c-44f6-b244-f553758c955f-istio-token\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:57:35.154338 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:35.154300    2560 generic.go:356] "Generic (PLEG): container finished" podID="badace30-329c-44f6-b244-f553758c955f" containerID="93fcb738fc9c2c29aea6c5e9e7c828684b137b5315c8c809ec8fd3dc0cf29d9b" exitCode=0
Sep 10 04:57:35.154523 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:35.154345    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f"
Sep 10 04:57:35.154523 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:35.154375    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f" event={"ID":"badace30-329c-44f6-b244-f553758c955f","Type":"ContainerDied","Data":"93fcb738fc9c2c29aea6c5e9e7c828684b137b5315c8c809ec8fd3dc0cf29d9b"}
Sep 10 04:57:35.154523 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:35.154433    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f" event={"ID":"badace30-329c-44f6-b244-f553758c955f","Type":"ContainerDied","Data":"c362b5a417c45fa35a8646a9ff8e37222764c83ed1153ae5964496f1add88783"}
Sep 10 04:57:35.154523 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:35.154456    2560 scope.go:117] "RemoveContainer" containerID="93fcb738fc9c2c29aea6c5e9e7c828684b137b5315c8c809ec8fd3dc0cf29d9b"
Sep 10 04:57:35.164315 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:35.164296    2560 scope.go:117] "RemoveContainer" containerID="0afa44591443fca6ffda6c86be4686a098fe104e20268cff982d56ff27903b2a"
Sep 10 04:57:35.171888 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:35.171865    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f"]
Sep 10 04:57:35.176258 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:35.176235    2560 scope.go:117] "RemoveContainer" containerID="93fcb738fc9c2c29aea6c5e9e7c828684b137b5315c8c809ec8fd3dc0cf29d9b"
Sep 10 04:57:35.176764 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:57:35.176735    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93fcb738fc9c2c29aea6c5e9e7c828684b137b5315c8c809ec8fd3dc0cf29d9b\": container with ID starting with 93fcb738fc9c2c29aea6c5e9e7c828684b137b5315c8c809ec8fd3dc0cf29d9b not found: ID does not exist" containerID="93fcb738fc9c2c29aea6c5e9e7c828684b137b5315c8c809ec8fd3dc0cf29d9b"
Sep 10 04:57:35.176912 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:35.176762    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93fcb738fc9c2c29aea6c5e9e7c828684b137b5315c8c809ec8fd3dc0cf29d9b"} err="failed to get container status \"93fcb738fc9c2c29aea6c5e9e7c828684b137b5315c8c809ec8fd3dc0cf29d9b\": rpc error: code = NotFound desc = could not find container \"93fcb738fc9c2c29aea6c5e9e7c828684b137b5315c8c809ec8fd3dc0cf29d9b\": container with ID starting with 93fcb738fc9c2c29aea6c5e9e7c828684b137b5315c8c809ec8fd3dc0cf29d9b not found: ID does not exist"
Sep 10 04:57:35.176912 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:35.176781    2560 scope.go:117] "RemoveContainer" containerID="0afa44591443fca6ffda6c86be4686a098fe104e20268cff982d56ff27903b2a"
Sep 10 04:57:35.176912 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:35.176791    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-ead8c2c2-openshift-default-776c85d596-4lr7f"]
Sep 10 04:57:35.177089 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:57:35.177068    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0afa44591443fca6ffda6c86be4686a098fe104e20268cff982d56ff27903b2a\": container with ID starting with 0afa44591443fca6ffda6c86be4686a098fe104e20268cff982d56ff27903b2a not found: ID does not exist" containerID="0afa44591443fca6ffda6c86be4686a098fe104e20268cff982d56ff27903b2a"
Sep 10 04:57:35.177140 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:35.177089    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0afa44591443fca6ffda6c86be4686a098fe104e20268cff982d56ff27903b2a"} err="failed to get container status \"0afa44591443fca6ffda6c86be4686a098fe104e20268cff982d56ff27903b2a\": rpc error: code = NotFound desc = could not find container \"0afa44591443fca6ffda6c86be4686a098fe104e20268cff982d56ff27903b2a\": container with ID starting with 0afa44591443fca6ffda6c86be4686a098fe104e20268cff982d56ff27903b2a not found: ID does not exist"
Sep 10 04:57:36.825772 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:36.825739    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="badace30-329c-44f6-b244-f553758c955f" path="/var/lib/kubelet/pods/badace30-329c-44f6-b244-f553758c955f/volumes"
Sep 10 04:57:38.195912 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:38.195878    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 04:57:45.526651 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:45.526615    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-53c734-7d4fb5594f-gc5xr"]
Sep 10 04:57:45.527115 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:45.526921    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-autores-53c734-7d4fb5594f-gc5xr" podUID="a63d1621-8256-40d6-ae7c-8e1aa1e88777" containerName="maas-api" containerID="cri-o://ce1411ae04577e3c9093b905af4525458c58e725fa05052c84b33b5f1affbb02" gracePeriod=30
Sep 10 04:57:45.788073 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:45.788021    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-53c734-7d4fb5594f-gc5xr"
Sep 10 04:57:45.849813 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:45.849779    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a63d1621-8256-40d6-ae7c-8e1aa1e88777-maas-api-tls\") pod \"a63d1621-8256-40d6-ae7c-8e1aa1e88777\" (UID: \"a63d1621-8256-40d6-ae7c-8e1aa1e88777\") "
Sep 10 04:57:45.850072 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:45.849918    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tdlt8\" (UniqueName: \"kubernetes.io/projected/a63d1621-8256-40d6-ae7c-8e1aa1e88777-kube-api-access-tdlt8\") pod \"a63d1621-8256-40d6-ae7c-8e1aa1e88777\" (UID: \"a63d1621-8256-40d6-ae7c-8e1aa1e88777\") "
Sep 10 04:57:45.850072 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:45.849974    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a63d1621-8256-40d6-ae7c-8e1aa1e88777-openshift-service-ca\") pod \"a63d1621-8256-40d6-ae7c-8e1aa1e88777\" (UID: \"a63d1621-8256-40d6-ae7c-8e1aa1e88777\") "
Sep 10 04:57:45.850072 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:45.849997    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a63d1621-8256-40d6-ae7c-8e1aa1e88777-metrics-certs\") pod \"a63d1621-8256-40d6-ae7c-8e1aa1e88777\" (UID: \"a63d1621-8256-40d6-ae7c-8e1aa1e88777\") "
Sep 10 04:57:45.850567 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:45.850530    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a63d1621-8256-40d6-ae7c-8e1aa1e88777-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a63d1621-8256-40d6-ae7c-8e1aa1e88777" (UID: "a63d1621-8256-40d6-ae7c-8e1aa1e88777"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 04:57:45.852598 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:45.852565    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a63d1621-8256-40d6-ae7c-8e1aa1e88777-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a63d1621-8256-40d6-ae7c-8e1aa1e88777" (UID: "a63d1621-8256-40d6-ae7c-8e1aa1e88777"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 04:57:45.852598 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:45.852584    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a63d1621-8256-40d6-ae7c-8e1aa1e88777-kube-api-access-tdlt8" (OuterVolumeSpecName: "kube-api-access-tdlt8") pod "a63d1621-8256-40d6-ae7c-8e1aa1e88777" (UID: "a63d1621-8256-40d6-ae7c-8e1aa1e88777"). InnerVolumeSpecName "kube-api-access-tdlt8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 04:57:45.853199 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:45.853179    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a63d1621-8256-40d6-ae7c-8e1aa1e88777-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a63d1621-8256-40d6-ae7c-8e1aa1e88777" (UID: "a63d1621-8256-40d6-ae7c-8e1aa1e88777"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 04:57:45.951754 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:45.951722    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tdlt8\" (UniqueName: \"kubernetes.io/projected/a63d1621-8256-40d6-ae7c-8e1aa1e88777-kube-api-access-tdlt8\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:57:45.951754 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:45.951752    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a63d1621-8256-40d6-ae7c-8e1aa1e88777-openshift-service-ca\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:57:45.951957 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:45.951762    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a63d1621-8256-40d6-ae7c-8e1aa1e88777-metrics-certs\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:57:45.951957 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:45.951771    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a63d1621-8256-40d6-ae7c-8e1aa1e88777-maas-api-tls\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:57:46.219623 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:46.219593    2560 generic.go:356] "Generic (PLEG): container finished" podID="a63d1621-8256-40d6-ae7c-8e1aa1e88777" containerID="ce1411ae04577e3c9093b905af4525458c58e725fa05052c84b33b5f1affbb02" exitCode=0
Sep 10 04:57:46.219792 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:46.219637    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-53c734-7d4fb5594f-gc5xr" event={"ID":"a63d1621-8256-40d6-ae7c-8e1aa1e88777","Type":"ContainerDied","Data":"ce1411ae04577e3c9093b905af4525458c58e725fa05052c84b33b5f1affbb02"}
Sep 10 04:57:46.219792 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:46.219675    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-53c734-7d4fb5594f-gc5xr" event={"ID":"a63d1621-8256-40d6-ae7c-8e1aa1e88777","Type":"ContainerDied","Data":"4ab9d5977e7bc4b185aa2434a9aabdd59068aa82ca0fd21890c530f288875b6e"}
Sep 10 04:57:46.219792 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:46.219696    2560 scope.go:117] "RemoveContainer" containerID="ce1411ae04577e3c9093b905af4525458c58e725fa05052c84b33b5f1affbb02"
Sep 10 04:57:46.219792 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:46.219640    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-53c734-7d4fb5594f-gc5xr"
Sep 10 04:57:46.229599 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:46.229584    2560 scope.go:117] "RemoveContainer" containerID="ce1411ae04577e3c9093b905af4525458c58e725fa05052c84b33b5f1affbb02"
Sep 10 04:57:46.229900 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:57:46.229861    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce1411ae04577e3c9093b905af4525458c58e725fa05052c84b33b5f1affbb02\": container with ID starting with ce1411ae04577e3c9093b905af4525458c58e725fa05052c84b33b5f1affbb02 not found: ID does not exist" containerID="ce1411ae04577e3c9093b905af4525458c58e725fa05052c84b33b5f1affbb02"
Sep 10 04:57:46.229984 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:46.229896    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce1411ae04577e3c9093b905af4525458c58e725fa05052c84b33b5f1affbb02"} err="failed to get container status \"ce1411ae04577e3c9093b905af4525458c58e725fa05052c84b33b5f1affbb02\": rpc error: code = NotFound desc = could not find container \"ce1411ae04577e3c9093b905af4525458c58e725fa05052c84b33b5f1affbb02\": container with ID starting with ce1411ae04577e3c9093b905af4525458c58e725fa05052c84b33b5f1affbb02 not found: ID does not exist"
Sep 10 04:57:46.240241 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:46.240219    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-53c734-7d4fb5594f-gc5xr"]
Sep 10 04:57:46.242783 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:46.242763    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-53c734-7d4fb5594f-gc5xr"]
Sep 10 04:57:46.826782 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:57:46.826748    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a63d1621-8256-40d6-ae7c-8e1aa1e88777" path="/var/lib/kubelet/pods/a63d1621-8256-40d6-ae7c-8e1aa1e88777/volumes"
Sep 10 04:58:01.200257 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:01.200179    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 04:58:28.163318 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:28.163281    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-53c734-openshift-default-67d97c479b-wxvzk"]
Sep 10 04:58:28.163797 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:28.163601    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-autores-53c734-openshift-default-67d97c479b-wxvzk" podUID="25b2ee13-7792-46e0-a085-8c2c06b3b825" containerName="istio-proxy" containerID="cri-o://434a83b76e09b6584637a8fb4f429fa3c1761a86a6f12e593b8595afc2085cd8" gracePeriod=30
Sep 10 04:58:28.928481 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:28.928449    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm"]
Sep 10 04:58:28.928917 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:28.928903    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a63d1621-8256-40d6-ae7c-8e1aa1e88777" containerName="maas-api"
Sep 10 04:58:28.928974 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:28.928918    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a63d1621-8256-40d6-ae7c-8e1aa1e88777" containerName="maas-api"
Sep 10 04:58:28.928974 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:28.928928    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="badace30-329c-44f6-b244-f553758c955f" containerName="istio-proxy"
Sep 10 04:58:28.928974 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:28.928935    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="badace30-329c-44f6-b244-f553758c955f" containerName="istio-proxy"
Sep 10 04:58:28.928974 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:28.928947    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="badace30-329c-44f6-b244-f553758c955f" containerName="istio-proxy"
Sep 10 04:58:28.928974 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:28.928954    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="badace30-329c-44f6-b244-f553758c955f" containerName="istio-proxy"
Sep 10 04:58:28.929122 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:28.928978    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e4e2ffd-fa31-486a-8265-4102409d8543" containerName="maas-api"
Sep 10 04:58:28.929122 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:28.928983    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e4e2ffd-fa31-486a-8265-4102409d8543" containerName="maas-api"
Sep 10 04:58:28.929122 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:28.929057    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a63d1621-8256-40d6-ae7c-8e1aa1e88777" containerName="maas-api"
Sep 10 04:58:28.929122 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:28.929066    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="badace30-329c-44f6-b244-f553758c955f" containerName="istio-proxy"
Sep 10 04:58:28.929122 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:28.929072    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="badace30-329c-44f6-b244-f553758c955f" containerName="istio-proxy"
Sep 10 04:58:28.929122 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:28.929079    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e4e2ffd-fa31-486a-8265-4102409d8543" containerName="maas-api"
Sep 10 04:58:28.932306 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:28.932288    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm"
Sep 10 04:58:28.934491 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:28.934470    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-ea9ba2-openshift-default-dockercfg-ks42p\""
Sep 10 04:58:28.948280 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:28.948256    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm"]
Sep 10 04:58:29.018009 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:29.017961    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d9c78cc-0ac6-4e37-a8f3-60197d4002d2-istio-data\") pod \"e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm\" (UID: \"0d9c78cc-0ac6-4e37-a8f3-60197d4002d2\") " pod="openshift-ingress/e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm"
Sep 10 04:58:29.018009 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:29.018008    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d9c78cc-0ac6-4e37-a8f3-60197d4002d2-istiod-ca-cert\") pod \"e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm\" (UID: \"0d9c78cc-0ac6-4e37-a8f3-60197d4002d2\") " pod="openshift-ingress/e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm"
Sep 10 04:58:29.018225 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:29.018119    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d9c78cc-0ac6-4e37-a8f3-60197d4002d2-istio-envoy\") pod \"e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm\" (UID: \"0d9c78cc-0ac6-4e37-a8f3-60197d4002d2\") " pod="openshift-ingress/e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm"
Sep 10 04:58:29.018225 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:29.018148    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pg7kn\" (UniqueName: \"kubernetes.io/projected/0d9c78cc-0ac6-4e37-a8f3-60197d4002d2-kube-api-access-pg7kn\") pod \"e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm\" (UID: \"0d9c78cc-0ac6-4e37-a8f3-60197d4002d2\") " pod="openshift-ingress/e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm"
Sep 10 04:58:29.018350 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:29.018251    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d9c78cc-0ac6-4e37-a8f3-60197d4002d2-credential-socket\") pod \"e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm\" (UID: \"0d9c78cc-0ac6-4e37-a8f3-60197d4002d2\") " pod="openshift-ingress/e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm"
Sep 10 04:58:29.018350 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:29.018313    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d9c78cc-0ac6-4e37-a8f3-60197d4002d2-istio-token\") pod \"e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm\" (UID: \"0d9c78cc-0ac6-4e37-a8f3-60197d4002d2\") " pod="openshift-ingress/e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm"
Sep 10 04:58:29.018443 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:29.018358    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d9c78cc-0ac6-4e37-a8f3-60197d4002d2-workload-certs\") pod \"e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm\" (UID: \"0d9c78cc-0ac6-4e37-a8f3-60197d4002d2\") " pod="openshift-ingress/e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm"
Sep 10 04:58:29.018443 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:29.018384    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d9c78cc-0ac6-4e37-a8f3-60197d4002d2-istio-podinfo\") pod \"e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm\" (UID: \"0d9c78cc-0ac6-4e37-a8f3-60197d4002d2\") " pod="openshift-ingress/e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm"
Sep 10 04:58:29.018443 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:29.018418    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d9c78cc-0ac6-4e37-a8f3-60197d4002d2-workload-socket\") pod \"e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm\" (UID: \"0d9c78cc-0ac6-4e37-a8f3-60197d4002d2\") " pod="openshift-ingress/e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm"
Sep 10 04:58:29.119229 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:29.119197    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d9c78cc-0ac6-4e37-a8f3-60197d4002d2-istio-envoy\") pod \"e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm\" (UID: \"0d9c78cc-0ac6-4e37-a8f3-60197d4002d2\") " pod="openshift-ingress/e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm"
Sep 10 04:58:29.119395 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:29.119232    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pg7kn\" (UniqueName: \"kubernetes.io/projected/0d9c78cc-0ac6-4e37-a8f3-60197d4002d2-kube-api-access-pg7kn\") pod \"e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm\" (UID: \"0d9c78cc-0ac6-4e37-a8f3-60197d4002d2\") " pod="openshift-ingress/e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm"
Sep 10 04:58:29.119395 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:29.119276    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d9c78cc-0ac6-4e37-a8f3-60197d4002d2-credential-socket\") pod \"e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm\" (UID: \"0d9c78cc-0ac6-4e37-a8f3-60197d4002d2\") " pod="openshift-ingress/e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm"
Sep 10 04:58:29.119395 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:29.119373    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d9c78cc-0ac6-4e37-a8f3-60197d4002d2-istio-token\") pod \"e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm\" (UID: \"0d9c78cc-0ac6-4e37-a8f3-60197d4002d2\") " pod="openshift-ingress/e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm"
Sep 10 04:58:29.119595 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:29.119423    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d9c78cc-0ac6-4e37-a8f3-60197d4002d2-workload-certs\") pod \"e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm\" (UID: \"0d9c78cc-0ac6-4e37-a8f3-60197d4002d2\") " pod="openshift-ingress/e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm"
Sep 10 04:58:29.119595 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:29.119454    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d9c78cc-0ac6-4e37-a8f3-60197d4002d2-istio-podinfo\") pod \"e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm\" (UID: \"0d9c78cc-0ac6-4e37-a8f3-60197d4002d2\") " pod="openshift-ingress/e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm"
Sep 10 04:58:29.119595 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:29.119486    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d9c78cc-0ac6-4e37-a8f3-60197d4002d2-workload-socket\") pod \"e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm\" (UID: \"0d9c78cc-0ac6-4e37-a8f3-60197d4002d2\") " pod="openshift-ingress/e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm"
Sep 10 04:58:29.119595 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:29.119566    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d9c78cc-0ac6-4e37-a8f3-60197d4002d2-istio-data\") pod \"e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm\" (UID: \"0d9c78cc-0ac6-4e37-a8f3-60197d4002d2\") " pod="openshift-ingress/e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm"
Sep 10 04:58:29.119595 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:29.119589    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d9c78cc-0ac6-4e37-a8f3-60197d4002d2-istiod-ca-cert\") pod \"e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm\" (UID: \"0d9c78cc-0ac6-4e37-a8f3-60197d4002d2\") " pod="openshift-ingress/e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm"
Sep 10 04:58:29.119893 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:29.119624    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d9c78cc-0ac6-4e37-a8f3-60197d4002d2-credential-socket\") pod \"e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm\" (UID: \"0d9c78cc-0ac6-4e37-a8f3-60197d4002d2\") " pod="openshift-ingress/e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm"
Sep 10 04:58:29.119893 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:29.119796    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d9c78cc-0ac6-4e37-a8f3-60197d4002d2-workload-certs\") pod \"e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm\" (UID: \"0d9c78cc-0ac6-4e37-a8f3-60197d4002d2\") " pod="openshift-ingress/e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm"
Sep 10 04:58:29.120016 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:29.119930    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d9c78cc-0ac6-4e37-a8f3-60197d4002d2-workload-socket\") pod \"e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm\" (UID: \"0d9c78cc-0ac6-4e37-a8f3-60197d4002d2\") " pod="openshift-ingress/e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm"
Sep 10 04:58:29.120016 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:29.119953    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d9c78cc-0ac6-4e37-a8f3-60197d4002d2-istio-data\") pod \"e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm\" (UID: \"0d9c78cc-0ac6-4e37-a8f3-60197d4002d2\") " pod="openshift-ingress/e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm"
Sep 10 04:58:29.120390 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:29.120362    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d9c78cc-0ac6-4e37-a8f3-60197d4002d2-istiod-ca-cert\") pod \"e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm\" (UID: \"0d9c78cc-0ac6-4e37-a8f3-60197d4002d2\") " pod="openshift-ingress/e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm"
Sep 10 04:58:29.121795 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:29.121771    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d9c78cc-0ac6-4e37-a8f3-60197d4002d2-istio-envoy\") pod \"e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm\" (UID: \"0d9c78cc-0ac6-4e37-a8f3-60197d4002d2\") " pod="openshift-ingress/e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm"
Sep 10 04:58:29.121950 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:29.121929    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d9c78cc-0ac6-4e37-a8f3-60197d4002d2-istio-podinfo\") pod \"e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm\" (UID: \"0d9c78cc-0ac6-4e37-a8f3-60197d4002d2\") " pod="openshift-ingress/e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm"
Sep 10 04:58:29.126973 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:29.126954    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pg7kn\" (UniqueName: \"kubernetes.io/projected/0d9c78cc-0ac6-4e37-a8f3-60197d4002d2-kube-api-access-pg7kn\") pod \"e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm\" (UID: \"0d9c78cc-0ac6-4e37-a8f3-60197d4002d2\") " pod="openshift-ingress/e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm"
Sep 10 04:58:29.127066 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:29.126958    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d9c78cc-0ac6-4e37-a8f3-60197d4002d2-istio-token\") pod \"e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm\" (UID: \"0d9c78cc-0ac6-4e37-a8f3-60197d4002d2\") " pod="openshift-ingress/e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm"
Sep 10 04:58:29.242874 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:29.242794    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm"
Sep 10 04:58:29.520341 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:29.520315    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm"]
Sep 10 04:58:29.522590 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:58:29.522565    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d9c78cc_0ac6_4e37_a8f3_60197d4002d2.slice/crio-9e4af9c1d94cfccafa16e4ae43d675350d70ad56924372651d986e119ac834ae WatchSource:0}: Error finding container 9e4af9c1d94cfccafa16e4ae43d675350d70ad56924372651d986e119ac834ae: Status 404 returned error can't find the container with id 9e4af9c1d94cfccafa16e4ae43d675350d70ad56924372651d986e119ac834ae
Sep 10 04:58:29.524689 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:29.524655    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 04:58:29.524788 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:29.524717    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 04:58:29.524788 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:29.524776    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 04:58:30.493316 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:30.493279    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm" event={"ID":"0d9c78cc-0ac6-4e37-a8f3-60197d4002d2","Type":"ContainerStarted","Data":"a31edddd205167931ad2eea6d7a26cfb98583841a605b96eb2d69e18bee6ffc4"}
Sep 10 04:58:30.493693 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:30.493332    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm" event={"ID":"0d9c78cc-0ac6-4e37-a8f3-60197d4002d2","Type":"ContainerStarted","Data":"9e4af9c1d94cfccafa16e4ae43d675350d70ad56924372651d986e119ac834ae"}
Sep 10 04:58:30.512085 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:30.512038    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm" podStartSLOduration=2.512022618 podStartE2EDuration="2.512022618s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:58:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:58:30.51039695 +0000 UTC m=+1050.172854698" watchObservedRunningTime="2026-09-10 04:58:30.512022618 +0000 UTC m=+1050.174480364"
Sep 10 04:58:31.243293 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:31.243266    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm"
Sep 10 04:58:31.249178 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:31.249156    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm"
Sep 10 04:58:31.499638 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:31.499560    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm"
Sep 10 04:58:31.500488 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:31.500467    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm"
Sep 10 04:58:33.420593 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:33.420564    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-53c734-openshift-default-67d97c479b-wxvzk"
Sep 10 04:58:33.513078 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:33.512994    2560 generic.go:356] "Generic (PLEG): container finished" podID="25b2ee13-7792-46e0-a085-8c2c06b3b825" containerID="434a83b76e09b6584637a8fb4f429fa3c1761a86a6f12e593b8595afc2085cd8" exitCode=0
Sep 10 04:58:33.513078 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:33.513033    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-53c734-openshift-default-67d97c479b-wxvzk"
Sep 10 04:58:33.513338 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:33.513080    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-53c734-openshift-default-67d97c479b-wxvzk" event={"ID":"25b2ee13-7792-46e0-a085-8c2c06b3b825","Type":"ContainerDied","Data":"434a83b76e09b6584637a8fb4f429fa3c1761a86a6f12e593b8595afc2085cd8"}
Sep 10 04:58:33.513338 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:33.513134    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-53c734-openshift-default-67d97c479b-wxvzk" event={"ID":"25b2ee13-7792-46e0-a085-8c2c06b3b825","Type":"ContainerDied","Data":"ac125381d5ec25e3a2dba3094f7e314d6a396183f1a3dcbe9d87f0f204782b4a"}
Sep 10 04:58:33.513338 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:33.513157    2560 scope.go:117] "RemoveContainer" containerID="434a83b76e09b6584637a8fb4f429fa3c1761a86a6f12e593b8595afc2085cd8"
Sep 10 04:58:33.522283 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:33.522264    2560 scope.go:117] "RemoveContainer" containerID="6be4f1c279c65b0bce2479c94b65c2245d50ea8d98916a803da5420949509b0c"
Sep 10 04:58:33.530487 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:33.530470    2560 scope.go:117] "RemoveContainer" containerID="434a83b76e09b6584637a8fb4f429fa3c1761a86a6f12e593b8595afc2085cd8"
Sep 10 04:58:33.530742 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:58:33.530724    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"434a83b76e09b6584637a8fb4f429fa3c1761a86a6f12e593b8595afc2085cd8\": container with ID starting with 434a83b76e09b6584637a8fb4f429fa3c1761a86a6f12e593b8595afc2085cd8 not found: ID does not exist" containerID="434a83b76e09b6584637a8fb4f429fa3c1761a86a6f12e593b8595afc2085cd8"
Sep 10 04:58:33.530791 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:33.530758    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"434a83b76e09b6584637a8fb4f429fa3c1761a86a6f12e593b8595afc2085cd8"} err="failed to get container status \"434a83b76e09b6584637a8fb4f429fa3c1761a86a6f12e593b8595afc2085cd8\": rpc error: code = NotFound desc = could not find container \"434a83b76e09b6584637a8fb4f429fa3c1761a86a6f12e593b8595afc2085cd8\": container with ID starting with 434a83b76e09b6584637a8fb4f429fa3c1761a86a6f12e593b8595afc2085cd8 not found: ID does not exist"
Sep 10 04:58:33.530791 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:33.530774    2560 scope.go:117] "RemoveContainer" containerID="6be4f1c279c65b0bce2479c94b65c2245d50ea8d98916a803da5420949509b0c"
Sep 10 04:58:33.531042 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:58:33.531024    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6be4f1c279c65b0bce2479c94b65c2245d50ea8d98916a803da5420949509b0c\": container with ID starting with 6be4f1c279c65b0bce2479c94b65c2245d50ea8d98916a803da5420949509b0c not found: ID does not exist" containerID="6be4f1c279c65b0bce2479c94b65c2245d50ea8d98916a803da5420949509b0c"
Sep 10 04:58:33.531099 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:33.531046    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6be4f1c279c65b0bce2479c94b65c2245d50ea8d98916a803da5420949509b0c"} err="failed to get container status \"6be4f1c279c65b0bce2479c94b65c2245d50ea8d98916a803da5420949509b0c\": rpc error: code = NotFound desc = could not find container \"6be4f1c279c65b0bce2479c94b65c2245d50ea8d98916a803da5420949509b0c\": container with ID starting with 6be4f1c279c65b0bce2479c94b65c2245d50ea8d98916a803da5420949509b0c not found: ID does not exist"
Sep 10 04:58:33.561996 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:33.561974    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25b2ee13-7792-46e0-a085-8c2c06b3b825-credential-socket\") pod \"25b2ee13-7792-46e0-a085-8c2c06b3b825\" (UID: \"25b2ee13-7792-46e0-a085-8c2c06b3b825\") "
Sep 10 04:58:33.562109 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:33.562005    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25b2ee13-7792-46e0-a085-8c2c06b3b825-istio-data\") pod \"25b2ee13-7792-46e0-a085-8c2c06b3b825\" (UID: \"25b2ee13-7792-46e0-a085-8c2c06b3b825\") "
Sep 10 04:58:33.562109 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:33.562023    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25b2ee13-7792-46e0-a085-8c2c06b3b825-istiod-ca-cert\") pod \"25b2ee13-7792-46e0-a085-8c2c06b3b825\" (UID: \"25b2ee13-7792-46e0-a085-8c2c06b3b825\") "
Sep 10 04:58:33.562109 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:33.562066    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25b2ee13-7792-46e0-a085-8c2c06b3b825-istio-envoy\") pod \"25b2ee13-7792-46e0-a085-8c2c06b3b825\" (UID: \"25b2ee13-7792-46e0-a085-8c2c06b3b825\") "
Sep 10 04:58:33.562279 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:33.562113    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25b2ee13-7792-46e0-a085-8c2c06b3b825-istio-token\") pod \"25b2ee13-7792-46e0-a085-8c2c06b3b825\" (UID: \"25b2ee13-7792-46e0-a085-8c2c06b3b825\") "
Sep 10 04:58:33.562279 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:33.562151    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25b2ee13-7792-46e0-a085-8c2c06b3b825-istio-podinfo\") pod \"25b2ee13-7792-46e0-a085-8c2c06b3b825\" (UID: \"25b2ee13-7792-46e0-a085-8c2c06b3b825\") "
Sep 10 04:58:33.562279 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:33.562178    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25b2ee13-7792-46e0-a085-8c2c06b3b825-workload-socket\") pod \"25b2ee13-7792-46e0-a085-8c2c06b3b825\" (UID: \"25b2ee13-7792-46e0-a085-8c2c06b3b825\") "
Sep 10 04:58:33.562279 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:33.562261    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25b2ee13-7792-46e0-a085-8c2c06b3b825-workload-certs\") pod \"25b2ee13-7792-46e0-a085-8c2c06b3b825\" (UID: \"25b2ee13-7792-46e0-a085-8c2c06b3b825\") "
Sep 10 04:58:33.562471 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:33.562275    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25b2ee13-7792-46e0-a085-8c2c06b3b825-istio-data" (OuterVolumeSpecName: "istio-data") pod "25b2ee13-7792-46e0-a085-8c2c06b3b825" (UID: "25b2ee13-7792-46e0-a085-8c2c06b3b825"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 04:58:33.562471 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:33.562295    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8cpvn\" (UniqueName: \"kubernetes.io/projected/25b2ee13-7792-46e0-a085-8c2c06b3b825-kube-api-access-8cpvn\") pod \"25b2ee13-7792-46e0-a085-8c2c06b3b825\" (UID: \"25b2ee13-7792-46e0-a085-8c2c06b3b825\") "
Sep 10 04:58:33.562471 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:33.562277    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25b2ee13-7792-46e0-a085-8c2c06b3b825-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "25b2ee13-7792-46e0-a085-8c2c06b3b825" (UID: "25b2ee13-7792-46e0-a085-8c2c06b3b825"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 04:58:33.562471 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:33.562375    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25b2ee13-7792-46e0-a085-8c2c06b3b825-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "25b2ee13-7792-46e0-a085-8c2c06b3b825" (UID: "25b2ee13-7792-46e0-a085-8c2c06b3b825"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 04:58:33.562693 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:33.562479    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25b2ee13-7792-46e0-a085-8c2c06b3b825-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "25b2ee13-7792-46e0-a085-8c2c06b3b825" (UID: "25b2ee13-7792-46e0-a085-8c2c06b3b825"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 04:58:33.562693 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:33.562637    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25b2ee13-7792-46e0-a085-8c2c06b3b825-credential-socket\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:58:33.562693 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:33.562658    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25b2ee13-7792-46e0-a085-8c2c06b3b825-istio-data\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:58:33.562693 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:33.562673    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25b2ee13-7792-46e0-a085-8c2c06b3b825-istiod-ca-cert\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:58:33.562693 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:33.562686    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25b2ee13-7792-46e0-a085-8c2c06b3b825-workload-socket\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:58:33.562693 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:33.562639    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25b2ee13-7792-46e0-a085-8c2c06b3b825-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "25b2ee13-7792-46e0-a085-8c2c06b3b825" (UID: "25b2ee13-7792-46e0-a085-8c2c06b3b825"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 04:58:33.564393 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:33.564355    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25b2ee13-7792-46e0-a085-8c2c06b3b825-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "25b2ee13-7792-46e0-a085-8c2c06b3b825" (UID: "25b2ee13-7792-46e0-a085-8c2c06b3b825"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 04:58:33.564782 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:33.564752    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25b2ee13-7792-46e0-a085-8c2c06b3b825-kube-api-access-8cpvn" (OuterVolumeSpecName: "kube-api-access-8cpvn") pod "25b2ee13-7792-46e0-a085-8c2c06b3b825" (UID: "25b2ee13-7792-46e0-a085-8c2c06b3b825"). InnerVolumeSpecName "kube-api-access-8cpvn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 04:58:33.564879 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:33.564822    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25b2ee13-7792-46e0-a085-8c2c06b3b825-istio-token" (OuterVolumeSpecName: "istio-token") pod "25b2ee13-7792-46e0-a085-8c2c06b3b825" (UID: "25b2ee13-7792-46e0-a085-8c2c06b3b825"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 04:58:33.564935 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:33.564908    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/25b2ee13-7792-46e0-a085-8c2c06b3b825-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "25b2ee13-7792-46e0-a085-8c2c06b3b825" (UID: "25b2ee13-7792-46e0-a085-8c2c06b3b825"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 04:58:33.664357 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:33.664328    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8cpvn\" (UniqueName: \"kubernetes.io/projected/25b2ee13-7792-46e0-a085-8c2c06b3b825-kube-api-access-8cpvn\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:58:33.664357 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:33.664354    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25b2ee13-7792-46e0-a085-8c2c06b3b825-istio-envoy\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:58:33.664357 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:33.664364    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25b2ee13-7792-46e0-a085-8c2c06b3b825-istio-token\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:58:33.664658 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:33.664373    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25b2ee13-7792-46e0-a085-8c2c06b3b825-istio-podinfo\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:58:33.664658 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:33.664381    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25b2ee13-7792-46e0-a085-8c2c06b3b825-workload-certs\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:58:33.835757 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:33.835726    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-53c734-openshift-default-67d97c479b-wxvzk"]
Sep 10 04:58:33.842117 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:33.842087    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-autores-53c734-openshift-default-67d97c479b-wxvzk"]
Sep 10 04:58:34.825791 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:34.825761    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25b2ee13-7792-46e0-a085-8c2c06b3b825" path="/var/lib/kubelet/pods/25b2ee13-7792-46e0-a085-8c2c06b3b825/volumes"
Sep 10 04:58:43.109884 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:43.109825    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-c9a840/test-model-c9a840-kserve-8479f68cf-b5b6v"]
Sep 10 04:58:43.110465 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:43.110442    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25b2ee13-7792-46e0-a085-8c2c06b3b825" containerName="istio-proxy"
Sep 10 04:58:43.110465 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:43.110465    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="25b2ee13-7792-46e0-a085-8c2c06b3b825" containerName="istio-proxy"
Sep 10 04:58:43.110616 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:43.110478    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25b2ee13-7792-46e0-a085-8c2c06b3b825" containerName="istio-proxy"
Sep 10 04:58:43.110616 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:43.110484    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="25b2ee13-7792-46e0-a085-8c2c06b3b825" containerName="istio-proxy"
Sep 10 04:58:43.110616 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:43.110564    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="25b2ee13-7792-46e0-a085-8c2c06b3b825" containerName="istio-proxy"
Sep 10 04:58:43.110616 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:43.110574    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="25b2ee13-7792-46e0-a085-8c2c06b3b825" containerName="istio-proxy"
Sep 10 04:58:43.115129 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:43.115108    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-c9a840/test-model-c9a840-kserve-8479f68cf-b5b6v"
Sep 10 04:58:43.117929 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:43.117905    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-c9a840\"/\"default-dockercfg-k2m7m\""
Sep 10 04:58:43.117929 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:43.117910    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-c9a840\"/\"kube-root-ca.crt\""
Sep 10 04:58:43.118137 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:43.117910    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-c9a840\"/\"test-model-c9a840-kserve-self-signed-certs\""
Sep 10 04:58:43.118137 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:43.118005    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-c9a840\"/\"openshift-service-ca.crt\""
Sep 10 04:58:43.121636 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:43.121616    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-c9a840/test-model-c9a840-kserve-8479f68cf-b5b6v"]
Sep 10 04:58:43.153986 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:43.153942    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e0722ed-7800-4007-8e41-d24e2e036e8b-tmp-dir\") pod \"test-model-c9a840-kserve-8479f68cf-b5b6v\" (UID: \"7e0722ed-7800-4007-8e41-d24e2e036e8b\") " pod="ai-tenant-e2e-inf-b-c9a840/test-model-c9a840-kserve-8479f68cf-b5b6v"
Sep 10 04:58:43.153986 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:43.153978    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e0722ed-7800-4007-8e41-d24e2e036e8b-home\") pod \"test-model-c9a840-kserve-8479f68cf-b5b6v\" (UID: \"7e0722ed-7800-4007-8e41-d24e2e036e8b\") " pod="ai-tenant-e2e-inf-b-c9a840/test-model-c9a840-kserve-8479f68cf-b5b6v"
Sep 10 04:58:43.154225 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:43.154011    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e0722ed-7800-4007-8e41-d24e2e036e8b-dshm\") pod \"test-model-c9a840-kserve-8479f68cf-b5b6v\" (UID: \"7e0722ed-7800-4007-8e41-d24e2e036e8b\") " pod="ai-tenant-e2e-inf-b-c9a840/test-model-c9a840-kserve-8479f68cf-b5b6v"
Sep 10 04:58:43.154225 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:43.154116    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e0722ed-7800-4007-8e41-d24e2e036e8b-model-cache\") pod \"test-model-c9a840-kserve-8479f68cf-b5b6v\" (UID: \"7e0722ed-7800-4007-8e41-d24e2e036e8b\") " pod="ai-tenant-e2e-inf-b-c9a840/test-model-c9a840-kserve-8479f68cf-b5b6v"
Sep 10 04:58:43.154225 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:43.154164    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e0722ed-7800-4007-8e41-d24e2e036e8b-tls-certs\") pod \"test-model-c9a840-kserve-8479f68cf-b5b6v\" (UID: \"7e0722ed-7800-4007-8e41-d24e2e036e8b\") " pod="ai-tenant-e2e-inf-b-c9a840/test-model-c9a840-kserve-8479f68cf-b5b6v"
Sep 10 04:58:43.154396 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:43.154261    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkmsq\" (UniqueName: \"kubernetes.io/projected/7e0722ed-7800-4007-8e41-d24e2e036e8b-kube-api-access-pkmsq\") pod \"test-model-c9a840-kserve-8479f68cf-b5b6v\" (UID: \"7e0722ed-7800-4007-8e41-d24e2e036e8b\") " pod="ai-tenant-e2e-inf-b-c9a840/test-model-c9a840-kserve-8479f68cf-b5b6v"
Sep 10 04:58:43.255095 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:43.255063    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e0722ed-7800-4007-8e41-d24e2e036e8b-tmp-dir\") pod \"test-model-c9a840-kserve-8479f68cf-b5b6v\" (UID: \"7e0722ed-7800-4007-8e41-d24e2e036e8b\") " pod="ai-tenant-e2e-inf-b-c9a840/test-model-c9a840-kserve-8479f68cf-b5b6v"
Sep 10 04:58:43.255095 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:43.255097    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e0722ed-7800-4007-8e41-d24e2e036e8b-home\") pod \"test-model-c9a840-kserve-8479f68cf-b5b6v\" (UID: \"7e0722ed-7800-4007-8e41-d24e2e036e8b\") " pod="ai-tenant-e2e-inf-b-c9a840/test-model-c9a840-kserve-8479f68cf-b5b6v"
Sep 10 04:58:43.255329 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:43.255125    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e0722ed-7800-4007-8e41-d24e2e036e8b-dshm\") pod \"test-model-c9a840-kserve-8479f68cf-b5b6v\" (UID: \"7e0722ed-7800-4007-8e41-d24e2e036e8b\") " pod="ai-tenant-e2e-inf-b-c9a840/test-model-c9a840-kserve-8479f68cf-b5b6v"
Sep 10 04:58:43.255329 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:43.255169    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e0722ed-7800-4007-8e41-d24e2e036e8b-model-cache\") pod \"test-model-c9a840-kserve-8479f68cf-b5b6v\" (UID: \"7e0722ed-7800-4007-8e41-d24e2e036e8b\") " pod="ai-tenant-e2e-inf-b-c9a840/test-model-c9a840-kserve-8479f68cf-b5b6v"
Sep 10 04:58:43.255329 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:43.255198    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e0722ed-7800-4007-8e41-d24e2e036e8b-tls-certs\") pod \"test-model-c9a840-kserve-8479f68cf-b5b6v\" (UID: \"7e0722ed-7800-4007-8e41-d24e2e036e8b\") " pod="ai-tenant-e2e-inf-b-c9a840/test-model-c9a840-kserve-8479f68cf-b5b6v"
Sep 10 04:58:43.255329 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:43.255246    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkmsq\" (UniqueName: \"kubernetes.io/projected/7e0722ed-7800-4007-8e41-d24e2e036e8b-kube-api-access-pkmsq\") pod \"test-model-c9a840-kserve-8479f68cf-b5b6v\" (UID: \"7e0722ed-7800-4007-8e41-d24e2e036e8b\") " pod="ai-tenant-e2e-inf-b-c9a840/test-model-c9a840-kserve-8479f68cf-b5b6v"
Sep 10 04:58:43.255566 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:43.255535    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e0722ed-7800-4007-8e41-d24e2e036e8b-home\") pod \"test-model-c9a840-kserve-8479f68cf-b5b6v\" (UID: \"7e0722ed-7800-4007-8e41-d24e2e036e8b\") " pod="ai-tenant-e2e-inf-b-c9a840/test-model-c9a840-kserve-8479f68cf-b5b6v"
Sep 10 04:58:43.255633 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:43.255583    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e0722ed-7800-4007-8e41-d24e2e036e8b-tmp-dir\") pod \"test-model-c9a840-kserve-8479f68cf-b5b6v\" (UID: \"7e0722ed-7800-4007-8e41-d24e2e036e8b\") " pod="ai-tenant-e2e-inf-b-c9a840/test-model-c9a840-kserve-8479f68cf-b5b6v"
Sep 10 04:58:43.255633 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:43.255623    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e0722ed-7800-4007-8e41-d24e2e036e8b-model-cache\") pod \"test-model-c9a840-kserve-8479f68cf-b5b6v\" (UID: \"7e0722ed-7800-4007-8e41-d24e2e036e8b\") " pod="ai-tenant-e2e-inf-b-c9a840/test-model-c9a840-kserve-8479f68cf-b5b6v"
Sep 10 04:58:43.257457 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:43.257433    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e0722ed-7800-4007-8e41-d24e2e036e8b-dshm\") pod \"test-model-c9a840-kserve-8479f68cf-b5b6v\" (UID: \"7e0722ed-7800-4007-8e41-d24e2e036e8b\") " pod="ai-tenant-e2e-inf-b-c9a840/test-model-c9a840-kserve-8479f68cf-b5b6v"
Sep 10 04:58:43.257675 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:43.257657    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e0722ed-7800-4007-8e41-d24e2e036e8b-tls-certs\") pod \"test-model-c9a840-kserve-8479f68cf-b5b6v\" (UID: \"7e0722ed-7800-4007-8e41-d24e2e036e8b\") " pod="ai-tenant-e2e-inf-b-c9a840/test-model-c9a840-kserve-8479f68cf-b5b6v"
Sep 10 04:58:43.266585 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:43.266563    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkmsq\" (UniqueName: \"kubernetes.io/projected/7e0722ed-7800-4007-8e41-d24e2e036e8b-kube-api-access-pkmsq\") pod \"test-model-c9a840-kserve-8479f68cf-b5b6v\" (UID: \"7e0722ed-7800-4007-8e41-d24e2e036e8b\") " pod="ai-tenant-e2e-inf-b-c9a840/test-model-c9a840-kserve-8479f68cf-b5b6v"
Sep 10 04:58:43.425824 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:43.425796    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-c9a840/test-model-c9a840-kserve-8479f68cf-b5b6v"
Sep 10 04:58:43.699184 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:43.699153    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-c9a840/test-model-c9a840-kserve-8479f68cf-b5b6v"]
Sep 10 04:58:43.699871 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:58:43.699828    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7e0722ed_7800_4007_8e41_d24e2e036e8b.slice/crio-80a7f3b742f51900af1d270ffaf706645c99596ed4f1ec314ce5b8fd25f80f39 WatchSource:0}: Error finding container 80a7f3b742f51900af1d270ffaf706645c99596ed4f1ec314ce5b8fd25f80f39: Status 404 returned error can't find the container with id 80a7f3b742f51900af1d270ffaf706645c99596ed4f1ec314ce5b8fd25f80f39
Sep 10 04:58:44.580835 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:44.580794    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-c9a840/test-model-c9a840-kserve-8479f68cf-b5b6v" event={"ID":"7e0722ed-7800-4007-8e41-d24e2e036e8b","Type":"ContainerStarted","Data":"d79f2118de65d247ab5893587ca07785adac548a627b4669f0622fe4927e2682"}
Sep 10 04:58:44.580835 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:44.580841    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-c9a840/test-model-c9a840-kserve-8479f68cf-b5b6v" event={"ID":"7e0722ed-7800-4007-8e41-d24e2e036e8b","Type":"ContainerStarted","Data":"80a7f3b742f51900af1d270ffaf706645c99596ed4f1ec314ce5b8fd25f80f39"}
Sep 10 04:58:44.598264 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:44.598220    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-c9a840/test-model-c9a840-kserve-8479f68cf-b5b6v" podStartSLOduration=1.598204397 podStartE2EDuration="1.598204397s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:58:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:58:44.59468311 +0000 UTC m=+1064.257140857" watchObservedRunningTime="2026-09-10 04:58:44.598204397 +0000 UTC m=+1064.260662144"
Sep 10 04:58:45.397483 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:45.397452    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 04:58:53.426470 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:53.426427    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-c9a840/test-model-c9a840-kserve-8479f68cf-b5b6v"
Sep 10 04:58:53.426827 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:53.426488    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-c9a840/test-model-c9a840-kserve-8479f68cf-b5b6v"
Sep 10 04:58:53.440078 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:53.440050    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-c9a840/test-model-c9a840-kserve-8479f68cf-b5b6v"
Sep 10 04:58:53.647794 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:53.647756    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-c9a840/test-model-c9a840-kserve-8479f68cf-b5b6v"
Sep 10 04:58:56.656214 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:56.656177    2560 generic.go:356] "Generic (PLEG): container finished" podID="0d9c78cc-0ac6-4e37-a8f3-60197d4002d2" containerID="a31edddd205167931ad2eea6d7a26cfb98583841a605b96eb2d69e18bee6ffc4" exitCode=0
Sep 10 04:58:56.656618 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:56.656249    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm" event={"ID":"0d9c78cc-0ac6-4e37-a8f3-60197d4002d2","Type":"ContainerDied","Data":"a31edddd205167931ad2eea6d7a26cfb98583841a605b96eb2d69e18bee6ffc4"}
Sep 10 04:58:56.656660 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:56.656643    2560 scope.go:117] "RemoveContainer" containerID="a31edddd205167931ad2eea6d7a26cfb98583841a605b96eb2d69e18bee6ffc4"
Sep 10 04:58:56.657776 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:56.657749    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 04:58:56.657843 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:56.657816    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 04:58:56.657901 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:56.657869    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 04:58:57.668690 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:57.668656    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm" event={"ID":"0d9c78cc-0ac6-4e37-a8f3-60197d4002d2","Type":"ContainerStarted","Data":"203040a474c7a58db57085c3a6bd8328dfb3850d3ec42b56b2b5eae7aa314d6e"}
Sep 10 04:58:58.243207 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:58.243170    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm"
Sep 10 04:58:58.244480 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:58.244444    2560 patch_prober.go:28] interesting pod/e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Sep 10 04:58:58.244608 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:58.244514    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm" podUID="0d9c78cc-0ac6-4e37-a8f3-60197d4002d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Sep 10 04:58:59.244450 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:59.243987    2560 patch_prober.go:28] interesting pod/e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Sep 10 04:58:59.244450 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:58:59.244065    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm" podUID="0d9c78cc-0ac6-4e37-a8f3-60197d4002d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Sep 10 04:59:00.243268 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:00.243220    2560 patch_prober.go:28] interesting pod/e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Sep 10 04:59:00.243482 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:00.243297    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm" podUID="0d9c78cc-0ac6-4e37-a8f3-60197d4002d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Sep 10 04:59:01.244047 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:01.243928    2560 patch_prober.go:28] interesting pod/e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Sep 10 04:59:01.244522 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:01.244037    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm" podUID="0d9c78cc-0ac6-4e37-a8f3-60197d4002d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Sep 10 04:59:01.499732 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:01.499597    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm"
Sep 10 04:59:02.243712 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:02.243233    2560 patch_prober.go:28] interesting pod/e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Sep 10 04:59:02.243712 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:02.243315    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm" podUID="0d9c78cc-0ac6-4e37-a8f3-60197d4002d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Sep 10 04:59:03.248777 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:03.248737    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm"
Sep 10 04:59:03.249555 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:03.249534    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm"
Sep 10 04:59:04.164588 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:04.164557    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp"]
Sep 10 04:59:04.169404 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:04.169382    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp"
Sep 10 04:59:04.171526 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:04.171504    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-aa81ae79-openshift-default-dockercfg-wschw\""
Sep 10 04:59:04.183469 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:04.183433    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp"]
Sep 10 04:59:04.267952 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:04.267907    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f-workload-socket\") pod \"e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp\" (UID: \"c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f\") " pod="openshift-ingress/e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp"
Sep 10 04:59:04.268509 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:04.268023    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f-credential-socket\") pod \"e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp\" (UID: \"c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f\") " pod="openshift-ingress/e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp"
Sep 10 04:59:04.268509 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:04.268050    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f-istio-podinfo\") pod \"e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp\" (UID: \"c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f\") " pod="openshift-ingress/e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp"
Sep 10 04:59:04.268509 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:04.268155    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f-workload-certs\") pod \"e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp\" (UID: \"c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f\") " pod="openshift-ingress/e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp"
Sep 10 04:59:04.268509 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:04.268202    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f-istio-envoy\") pod \"e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp\" (UID: \"c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f\") " pod="openshift-ingress/e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp"
Sep 10 04:59:04.268509 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:04.268234    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f-istiod-ca-cert\") pod \"e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp\" (UID: \"c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f\") " pod="openshift-ingress/e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp"
Sep 10 04:59:04.268509 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:04.268269    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ww87m\" (UniqueName: \"kubernetes.io/projected/c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f-kube-api-access-ww87m\") pod \"e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp\" (UID: \"c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f\") " pod="openshift-ingress/e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp"
Sep 10 04:59:04.268509 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:04.268306    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f-istio-token\") pod \"e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp\" (UID: \"c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f\") " pod="openshift-ingress/e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp"
Sep 10 04:59:04.268509 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:04.268396    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f-istio-data\") pod \"e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp\" (UID: \"c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f\") " pod="openshift-ingress/e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp"
Sep 10 04:59:04.369169 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:04.369130    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f-istiod-ca-cert\") pod \"e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp\" (UID: \"c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f\") " pod="openshift-ingress/e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp"
Sep 10 04:59:04.369169 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:04.369174    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ww87m\" (UniqueName: \"kubernetes.io/projected/c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f-kube-api-access-ww87m\") pod \"e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp\" (UID: \"c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f\") " pod="openshift-ingress/e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp"
Sep 10 04:59:04.369408 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:04.369279    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f-istio-token\") pod \"e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp\" (UID: \"c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f\") " pod="openshift-ingress/e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp"
Sep 10 04:59:04.369408 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:04.369380    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f-istio-data\") pod \"e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp\" (UID: \"c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f\") " pod="openshift-ingress/e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp"
Sep 10 04:59:04.369524 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:04.369451    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f-workload-socket\") pod \"e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp\" (UID: \"c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f\") " pod="openshift-ingress/e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp"
Sep 10 04:59:04.369582 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:04.369529    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f-credential-socket\") pod \"e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp\" (UID: \"c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f\") " pod="openshift-ingress/e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp"
Sep 10 04:59:04.369582 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:04.369554    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f-istio-podinfo\") pod \"e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp\" (UID: \"c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f\") " pod="openshift-ingress/e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp"
Sep 10 04:59:04.369686 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:04.369614    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f-workload-certs\") pod \"e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp\" (UID: \"c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f\") " pod="openshift-ingress/e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp"
Sep 10 04:59:04.369686 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:04.369648    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f-istio-envoy\") pod \"e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp\" (UID: \"c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f\") " pod="openshift-ingress/e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp"
Sep 10 04:59:04.369817 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:04.369794    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f-istio-data\") pod \"e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp\" (UID: \"c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f\") " pod="openshift-ingress/e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp"
Sep 10 04:59:04.369946 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:04.369924    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f-workload-socket\") pod \"e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp\" (UID: \"c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f\") " pod="openshift-ingress/e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp"
Sep 10 04:59:04.370021 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:04.369926    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f-istiod-ca-cert\") pod \"e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp\" (UID: \"c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f\") " pod="openshift-ingress/e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp"
Sep 10 04:59:04.370021 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:04.369963    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f-workload-certs\") pod \"e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp\" (UID: \"c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f\") " pod="openshift-ingress/e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp"
Sep 10 04:59:04.370021 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:04.369992    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f-credential-socket\") pod \"e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp\" (UID: \"c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f\") " pod="openshift-ingress/e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp"
Sep 10 04:59:04.371929 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:04.371910    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f-istio-envoy\") pod \"e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp\" (UID: \"c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f\") " pod="openshift-ingress/e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp"
Sep 10 04:59:04.372184 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:04.372168    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f-istio-podinfo\") pod \"e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp\" (UID: \"c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f\") " pod="openshift-ingress/e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp"
Sep 10 04:59:04.376463 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:04.376441    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ww87m\" (UniqueName: \"kubernetes.io/projected/c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f-kube-api-access-ww87m\") pod \"e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp\" (UID: \"c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f\") " pod="openshift-ingress/e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp"
Sep 10 04:59:04.376565 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:04.376521    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f-istio-token\") pod \"e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp\" (UID: \"c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f\") " pod="openshift-ingress/e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp"
Sep 10 04:59:04.482046 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:04.481955    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp"
Sep 10 04:59:04.813923 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:59:04.813894    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2836e7e_c4eb_4e5d_bb2b_9aea5688f91f.slice/crio-d2a2553b5548bf1e253a8e123c1fa7ea5ef0fce2579865772cfdecea901964f7 WatchSource:0}: Error finding container d2a2553b5548bf1e253a8e123c1fa7ea5ef0fce2579865772cfdecea901964f7: Status 404 returned error can't find the container with id d2a2553b5548bf1e253a8e123c1fa7ea5ef0fce2579865772cfdecea901964f7
Sep 10 04:59:04.814043 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:04.813991    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp"]
Sep 10 04:59:04.816753 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:04.816721    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 04:59:04.816877 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:04.816799    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 04:59:04.816877 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:04.816841    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 04:59:05.719673 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:05.719632    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp" event={"ID":"c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f","Type":"ContainerStarted","Data":"b68db14925114fa004b65b8167b5cfac3ba689f4983eea21175e76db02d08b41"}
Sep 10 04:59:05.720112 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:05.719696    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp" event={"ID":"c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f","Type":"ContainerStarted","Data":"d2a2553b5548bf1e253a8e123c1fa7ea5ef0fce2579865772cfdecea901964f7"}
Sep 10 04:59:05.743469 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:05.743416    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp" podStartSLOduration=1.7433994080000002 podStartE2EDuration="1.743399408s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:59:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:59:05.742145947 +0000 UTC m=+1085.404603694" watchObservedRunningTime="2026-09-10 04:59:05.743399408 +0000 UTC m=+1085.405857155"
Sep 10 04:59:06.482520 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:06.482488    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp"
Sep 10 04:59:06.487450 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:06.487425    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp"
Sep 10 04:59:06.726099 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:06.726064    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp"
Sep 10 04:59:06.726972 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:06.726950    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp"
Sep 10 04:59:10.999202 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:10.999167    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 04:59:11.097749 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:11.097701    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-aa81ae79-6bf64d56cc-jqbqv"]
Sep 10 04:59:11.101271 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:11.101244    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-aa81ae79-6bf64d56cc-jqbqv"
Sep 10 04:59:11.103424 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:11.103404    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-aa81ae79-serving-cert\""
Sep 10 04:59:11.111413 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:11.111370    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-aa81ae79-6bf64d56cc-jqbqv"]
Sep 10 04:59:11.241974 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:11.241935    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/800fa0d8-6030-4106-b22d-0312c4ea18e9-metrics-certs\") pod \"maas-api-e2e-mt-aa81ae79-6bf64d56cc-jqbqv\" (UID: \"800fa0d8-6030-4106-b22d-0312c4ea18e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-aa81ae79-6bf64d56cc-jqbqv"
Sep 10 04:59:11.242146 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:11.242026    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/800fa0d8-6030-4106-b22d-0312c4ea18e9-openshift-service-ca\") pod \"maas-api-e2e-mt-aa81ae79-6bf64d56cc-jqbqv\" (UID: \"800fa0d8-6030-4106-b22d-0312c4ea18e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-aa81ae79-6bf64d56cc-jqbqv"
Sep 10 04:59:11.242146 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:11.242056    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7x4rk\" (UniqueName: \"kubernetes.io/projected/800fa0d8-6030-4106-b22d-0312c4ea18e9-kube-api-access-7x4rk\") pod \"maas-api-e2e-mt-aa81ae79-6bf64d56cc-jqbqv\" (UID: \"800fa0d8-6030-4106-b22d-0312c4ea18e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-aa81ae79-6bf64d56cc-jqbqv"
Sep 10 04:59:11.242223 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:11.242169    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/800fa0d8-6030-4106-b22d-0312c4ea18e9-maas-api-tls\") pod \"maas-api-e2e-mt-aa81ae79-6bf64d56cc-jqbqv\" (UID: \"800fa0d8-6030-4106-b22d-0312c4ea18e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-aa81ae79-6bf64d56cc-jqbqv"
Sep 10 04:59:11.343949 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:11.343835    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/800fa0d8-6030-4106-b22d-0312c4ea18e9-metrics-certs\") pod \"maas-api-e2e-mt-aa81ae79-6bf64d56cc-jqbqv\" (UID: \"800fa0d8-6030-4106-b22d-0312c4ea18e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-aa81ae79-6bf64d56cc-jqbqv"
Sep 10 04:59:11.344091 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:11.343950    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/800fa0d8-6030-4106-b22d-0312c4ea18e9-openshift-service-ca\") pod \"maas-api-e2e-mt-aa81ae79-6bf64d56cc-jqbqv\" (UID: \"800fa0d8-6030-4106-b22d-0312c4ea18e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-aa81ae79-6bf64d56cc-jqbqv"
Sep 10 04:59:11.344091 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:11.343979    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7x4rk\" (UniqueName: \"kubernetes.io/projected/800fa0d8-6030-4106-b22d-0312c4ea18e9-kube-api-access-7x4rk\") pod \"maas-api-e2e-mt-aa81ae79-6bf64d56cc-jqbqv\" (UID: \"800fa0d8-6030-4106-b22d-0312c4ea18e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-aa81ae79-6bf64d56cc-jqbqv"
Sep 10 04:59:11.344165 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:11.344089    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/800fa0d8-6030-4106-b22d-0312c4ea18e9-maas-api-tls\") pod \"maas-api-e2e-mt-aa81ae79-6bf64d56cc-jqbqv\" (UID: \"800fa0d8-6030-4106-b22d-0312c4ea18e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-aa81ae79-6bf64d56cc-jqbqv"
Sep 10 04:59:11.344651 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:11.344621    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/800fa0d8-6030-4106-b22d-0312c4ea18e9-openshift-service-ca\") pod \"maas-api-e2e-mt-aa81ae79-6bf64d56cc-jqbqv\" (UID: \"800fa0d8-6030-4106-b22d-0312c4ea18e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-aa81ae79-6bf64d56cc-jqbqv"
Sep 10 04:59:11.346264 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:11.346237    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/800fa0d8-6030-4106-b22d-0312c4ea18e9-metrics-certs\") pod \"maas-api-e2e-mt-aa81ae79-6bf64d56cc-jqbqv\" (UID: \"800fa0d8-6030-4106-b22d-0312c4ea18e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-aa81ae79-6bf64d56cc-jqbqv"
Sep 10 04:59:11.346419 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:11.346395    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/800fa0d8-6030-4106-b22d-0312c4ea18e9-maas-api-tls\") pod \"maas-api-e2e-mt-aa81ae79-6bf64d56cc-jqbqv\" (UID: \"800fa0d8-6030-4106-b22d-0312c4ea18e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-aa81ae79-6bf64d56cc-jqbqv"
Sep 10 04:59:11.351688 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:11.351665    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7x4rk\" (UniqueName: \"kubernetes.io/projected/800fa0d8-6030-4106-b22d-0312c4ea18e9-kube-api-access-7x4rk\") pod \"maas-api-e2e-mt-aa81ae79-6bf64d56cc-jqbqv\" (UID: \"800fa0d8-6030-4106-b22d-0312c4ea18e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-aa81ae79-6bf64d56cc-jqbqv"
Sep 10 04:59:11.416704 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:11.416674    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-aa81ae79-6bf64d56cc-jqbqv"
Sep 10 04:59:11.693638 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:11.693610    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-aa81ae79-6bf64d56cc-jqbqv"]
Sep 10 04:59:11.696275 ip-10-0-138-27 kubenswrapper[2560]: W0910 04:59:11.696239    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod800fa0d8_6030_4106_b22d_0312c4ea18e9.slice/crio-e38fc6ec385365fbb20dc7d320325400231bc54bfaacc0b9b11be73d9a623df7 WatchSource:0}: Error finding container e38fc6ec385365fbb20dc7d320325400231bc54bfaacc0b9b11be73d9a623df7: Status 404 returned error can't find the container with id e38fc6ec385365fbb20dc7d320325400231bc54bfaacc0b9b11be73d9a623df7
Sep 10 04:59:11.698370 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:11.698344    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 04:59:11.760451 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:11.760415    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-aa81ae79-6bf64d56cc-jqbqv" event={"ID":"800fa0d8-6030-4106-b22d-0312c4ea18e9","Type":"ContainerStarted","Data":"e38fc6ec385365fbb20dc7d320325400231bc54bfaacc0b9b11be73d9a623df7"}
Sep 10 04:59:12.768103 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:12.768068    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-aa81ae79-6bf64d56cc-jqbqv" event={"ID":"800fa0d8-6030-4106-b22d-0312c4ea18e9","Type":"ContainerStarted","Data":"fa1040de922fb325be1b07d8816f8b2a7bebcd335462cadcdcd9fb71a68ae2a0"}
Sep 10 04:59:12.768473 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:12.768132    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-aa81ae79-6bf64d56cc-jqbqv"
Sep 10 04:59:12.785588 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:12.785541    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-aa81ae79-6bf64d56cc-jqbqv" podStartSLOduration=1.370409246 podStartE2EDuration="1.785526935s" totalImagesPullingTime="415.117689ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:59:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:59:12.784299206 +0000 UTC m=+1092.446756952" watchObservedRunningTime="2026-09-10 04:59:12.785526935 +0000 UTC m=+1092.447984682"
Sep 10 04:59:18.778507 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:18.778479    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-aa81ae79-6bf64d56cc-jqbqv"
Sep 10 04:59:35.917089 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:35.917052    2560 generic.go:356] "Generic (PLEG): container finished" podID="c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f" containerID="b68db14925114fa004b65b8167b5cfac3ba689f4983eea21175e76db02d08b41" exitCode=0
Sep 10 04:59:35.917598 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:35.917115    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp" event={"ID":"c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f","Type":"ContainerDied","Data":"b68db14925114fa004b65b8167b5cfac3ba689f4983eea21175e76db02d08b41"}
Sep 10 04:59:35.917670 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:35.917626    2560 scope.go:117] "RemoveContainer" containerID="b68db14925114fa004b65b8167b5cfac3ba689f4983eea21175e76db02d08b41"
Sep 10 04:59:35.918894 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:35.918835    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 04:59:35.919015 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:35.918951    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 04:59:35.919015 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:35.919000    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 04:59:36.726337 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:36.726295    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp"
Sep 10 04:59:36.925832 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:36.925792    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp" event={"ID":"c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f","Type":"ContainerStarted","Data":"c62e6bc36c3731ae9b02d61ddee8ef62a0ce7c7648bad1b9de095fbf23d7e092"}
Sep 10 04:59:37.482561 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:37.482530    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp"
Sep 10 04:59:37.483474 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:37.483448    2560 patch_prober.go:28] interesting pod/e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Sep 10 04:59:37.483596 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:37.483519    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp" podUID="c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Sep 10 04:59:38.483370 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:38.483334    2560 patch_prober.go:28] interesting pod/e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Sep 10 04:59:38.483822 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:38.483391    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp" podUID="c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Sep 10 04:59:39.482913 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:39.482881    2560 patch_prober.go:28] interesting pod/e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Sep 10 04:59:39.483115 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:39.482953    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp" podUID="c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Sep 10 04:59:40.482787 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:40.482747    2560 patch_prober.go:28] interesting pod/e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Sep 10 04:59:40.483270 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:40.482805    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp" podUID="c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Sep 10 04:59:41.482572 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:41.482539    2560 patch_prober.go:28] interesting pod/e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Sep 10 04:59:41.482744 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:41.482590    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp" podUID="c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Sep 10 04:59:42.486774 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:42.486743    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp"
Sep 10 04:59:42.487244 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:42.487091    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp"
Sep 10 04:59:42.487747 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:42.487728    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp"
Sep 10 04:59:42.724509 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:42.724475    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm"]
Sep 10 04:59:42.724725 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:42.724686    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm" podUID="0d9c78cc-0ac6-4e37-a8f3-60197d4002d2" containerName="istio-proxy" containerID="cri-o://203040a474c7a58db57085c3a6bd8328dfb3850d3ec42b56b2b5eae7aa314d6e" gracePeriod=30
Sep 10 04:59:43.402339 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:43.402293    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 04:59:47.983624 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:47.983600    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm"
Sep 10 04:59:48.003812 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:48.003711    2560 generic.go:356] "Generic (PLEG): container finished" podID="0d9c78cc-0ac6-4e37-a8f3-60197d4002d2" containerID="203040a474c7a58db57085c3a6bd8328dfb3850d3ec42b56b2b5eae7aa314d6e" exitCode=0
Sep 10 04:59:48.003980 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:48.003844    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm" event={"ID":"0d9c78cc-0ac6-4e37-a8f3-60197d4002d2","Type":"ContainerDied","Data":"203040a474c7a58db57085c3a6bd8328dfb3850d3ec42b56b2b5eae7aa314d6e"}
Sep 10 04:59:48.003980 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:48.003887    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm"
Sep 10 04:59:48.003980 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:48.003962    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm" event={"ID":"0d9c78cc-0ac6-4e37-a8f3-60197d4002d2","Type":"ContainerDied","Data":"9e4af9c1d94cfccafa16e4ae43d675350d70ad56924372651d986e119ac834ae"}
Sep 10 04:59:48.004157 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:48.003995    2560 scope.go:117] "RemoveContainer" containerID="203040a474c7a58db57085c3a6bd8328dfb3850d3ec42b56b2b5eae7aa314d6e"
Sep 10 04:59:48.014178 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:48.014153    2560 scope.go:117] "RemoveContainer" containerID="a31edddd205167931ad2eea6d7a26cfb98583841a605b96eb2d69e18bee6ffc4"
Sep 10 04:59:48.023340 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:48.023318    2560 scope.go:117] "RemoveContainer" containerID="203040a474c7a58db57085c3a6bd8328dfb3850d3ec42b56b2b5eae7aa314d6e"
Sep 10 04:59:48.023616 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:59:48.023595    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"203040a474c7a58db57085c3a6bd8328dfb3850d3ec42b56b2b5eae7aa314d6e\": container with ID starting with 203040a474c7a58db57085c3a6bd8328dfb3850d3ec42b56b2b5eae7aa314d6e not found: ID does not exist" containerID="203040a474c7a58db57085c3a6bd8328dfb3850d3ec42b56b2b5eae7aa314d6e"
Sep 10 04:59:48.023673 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:48.023628    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"203040a474c7a58db57085c3a6bd8328dfb3850d3ec42b56b2b5eae7aa314d6e"} err="failed to get container status \"203040a474c7a58db57085c3a6bd8328dfb3850d3ec42b56b2b5eae7aa314d6e\": rpc error: code = NotFound desc = could not find container \"203040a474c7a58db57085c3a6bd8328dfb3850d3ec42b56b2b5eae7aa314d6e\": container with ID starting with 203040a474c7a58db57085c3a6bd8328dfb3850d3ec42b56b2b5eae7aa314d6e not found: ID does not exist"
Sep 10 04:59:48.023673 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:48.023651    2560 scope.go:117] "RemoveContainer" containerID="a31edddd205167931ad2eea6d7a26cfb98583841a605b96eb2d69e18bee6ffc4"
Sep 10 04:59:48.023965 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:59:48.023938    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a31edddd205167931ad2eea6d7a26cfb98583841a605b96eb2d69e18bee6ffc4\": container with ID starting with a31edddd205167931ad2eea6d7a26cfb98583841a605b96eb2d69e18bee6ffc4 not found: ID does not exist" containerID="a31edddd205167931ad2eea6d7a26cfb98583841a605b96eb2d69e18bee6ffc4"
Sep 10 04:59:48.024054 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:48.023972    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a31edddd205167931ad2eea6d7a26cfb98583841a605b96eb2d69e18bee6ffc4"} err="failed to get container status \"a31edddd205167931ad2eea6d7a26cfb98583841a605b96eb2d69e18bee6ffc4\": rpc error: code = NotFound desc = could not find container \"a31edddd205167931ad2eea6d7a26cfb98583841a605b96eb2d69e18bee6ffc4\": container with ID starting with a31edddd205167931ad2eea6d7a26cfb98583841a605b96eb2d69e18bee6ffc4 not found: ID does not exist"
Sep 10 04:59:48.109630 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:48.109601    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d9c78cc-0ac6-4e37-a8f3-60197d4002d2-istio-podinfo\") pod \"0d9c78cc-0ac6-4e37-a8f3-60197d4002d2\" (UID: \"0d9c78cc-0ac6-4e37-a8f3-60197d4002d2\") "
Sep 10 04:59:48.109768 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:48.109673    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d9c78cc-0ac6-4e37-a8f3-60197d4002d2-istiod-ca-cert\") pod \"0d9c78cc-0ac6-4e37-a8f3-60197d4002d2\" (UID: \"0d9c78cc-0ac6-4e37-a8f3-60197d4002d2\") "
Sep 10 04:59:48.109865 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:48.109830    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pg7kn\" (UniqueName: \"kubernetes.io/projected/0d9c78cc-0ac6-4e37-a8f3-60197d4002d2-kube-api-access-pg7kn\") pod \"0d9c78cc-0ac6-4e37-a8f3-60197d4002d2\" (UID: \"0d9c78cc-0ac6-4e37-a8f3-60197d4002d2\") "
Sep 10 04:59:48.109974 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:48.109893    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d9c78cc-0ac6-4e37-a8f3-60197d4002d2-istio-data\") pod \"0d9c78cc-0ac6-4e37-a8f3-60197d4002d2\" (UID: \"0d9c78cc-0ac6-4e37-a8f3-60197d4002d2\") "
Sep 10 04:59:48.109974 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:48.109944    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d9c78cc-0ac6-4e37-a8f3-60197d4002d2-workload-certs\") pod \"0d9c78cc-0ac6-4e37-a8f3-60197d4002d2\" (UID: \"0d9c78cc-0ac6-4e37-a8f3-60197d4002d2\") "
Sep 10 04:59:48.110087 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:48.110001    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d9c78cc-0ac6-4e37-a8f3-60197d4002d2-workload-socket\") pod \"0d9c78cc-0ac6-4e37-a8f3-60197d4002d2\" (UID: \"0d9c78cc-0ac6-4e37-a8f3-60197d4002d2\") "
Sep 10 04:59:48.110087 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:48.110053    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d9c78cc-0ac6-4e37-a8f3-60197d4002d2-istio-token\") pod \"0d9c78cc-0ac6-4e37-a8f3-60197d4002d2\" (UID: \"0d9c78cc-0ac6-4e37-a8f3-60197d4002d2\") "
Sep 10 04:59:48.110200 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:48.110118    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d9c78cc-0ac6-4e37-a8f3-60197d4002d2-credential-socket\") pod \"0d9c78cc-0ac6-4e37-a8f3-60197d4002d2\" (UID: \"0d9c78cc-0ac6-4e37-a8f3-60197d4002d2\") "
Sep 10 04:59:48.110200 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:48.110137    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d9c78cc-0ac6-4e37-a8f3-60197d4002d2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0d9c78cc-0ac6-4e37-a8f3-60197d4002d2" (UID: "0d9c78cc-0ac6-4e37-a8f3-60197d4002d2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 04:59:48.110200 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:48.110147    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d9c78cc-0ac6-4e37-a8f3-60197d4002d2-istio-envoy\") pod \"0d9c78cc-0ac6-4e37-a8f3-60197d4002d2\" (UID: \"0d9c78cc-0ac6-4e37-a8f3-60197d4002d2\") "
Sep 10 04:59:48.110495 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:48.110135    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d9c78cc-0ac6-4e37-a8f3-60197d4002d2-istio-data" (OuterVolumeSpecName: "istio-data") pod "0d9c78cc-0ac6-4e37-a8f3-60197d4002d2" (UID: "0d9c78cc-0ac6-4e37-a8f3-60197d4002d2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 04:59:48.110495 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:48.110226    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d9c78cc-0ac6-4e37-a8f3-60197d4002d2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0d9c78cc-0ac6-4e37-a8f3-60197d4002d2" (UID: "0d9c78cc-0ac6-4e37-a8f3-60197d4002d2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 04:59:48.110495 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:48.110389    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d9c78cc-0ac6-4e37-a8f3-60197d4002d2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0d9c78cc-0ac6-4e37-a8f3-60197d4002d2" (UID: "0d9c78cc-0ac6-4e37-a8f3-60197d4002d2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 04:59:48.110495 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:48.110430    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d9c78cc-0ac6-4e37-a8f3-60197d4002d2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0d9c78cc-0ac6-4e37-a8f3-60197d4002d2" (UID: "0d9c78cc-0ac6-4e37-a8f3-60197d4002d2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 04:59:48.110717 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:48.110620    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d9c78cc-0ac6-4e37-a8f3-60197d4002d2-istiod-ca-cert\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:59:48.110717 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:48.110636    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d9c78cc-0ac6-4e37-a8f3-60197d4002d2-istio-data\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:59:48.110717 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:48.110644    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d9c78cc-0ac6-4e37-a8f3-60197d4002d2-workload-certs\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:59:48.110717 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:48.110652    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d9c78cc-0ac6-4e37-a8f3-60197d4002d2-workload-socket\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:59:48.110717 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:48.110665    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d9c78cc-0ac6-4e37-a8f3-60197d4002d2-credential-socket\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:59:48.112302 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:48.112278    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0d9c78cc-0ac6-4e37-a8f3-60197d4002d2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0d9c78cc-0ac6-4e37-a8f3-60197d4002d2" (UID: "0d9c78cc-0ac6-4e37-a8f3-60197d4002d2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 04:59:48.112302 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:48.112292    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d9c78cc-0ac6-4e37-a8f3-60197d4002d2-kube-api-access-pg7kn" (OuterVolumeSpecName: "kube-api-access-pg7kn") pod "0d9c78cc-0ac6-4e37-a8f3-60197d4002d2" (UID: "0d9c78cc-0ac6-4e37-a8f3-60197d4002d2"). InnerVolumeSpecName "kube-api-access-pg7kn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 04:59:48.112572 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:48.112552    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d9c78cc-0ac6-4e37-a8f3-60197d4002d2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0d9c78cc-0ac6-4e37-a8f3-60197d4002d2" (UID: "0d9c78cc-0ac6-4e37-a8f3-60197d4002d2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 04:59:48.112572 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:48.112559    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d9c78cc-0ac6-4e37-a8f3-60197d4002d2-istio-token" (OuterVolumeSpecName: "istio-token") pod "0d9c78cc-0ac6-4e37-a8f3-60197d4002d2" (UID: "0d9c78cc-0ac6-4e37-a8f3-60197d4002d2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 04:59:48.212059 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:48.212016    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pg7kn\" (UniqueName: \"kubernetes.io/projected/0d9c78cc-0ac6-4e37-a8f3-60197d4002d2-kube-api-access-pg7kn\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:59:48.212059 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:48.212055    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d9c78cc-0ac6-4e37-a8f3-60197d4002d2-istio-token\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:59:48.212059 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:48.212065    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d9c78cc-0ac6-4e37-a8f3-60197d4002d2-istio-envoy\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:59:48.212059 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:48.212073    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d9c78cc-0ac6-4e37-a8f3-60197d4002d2-istio-podinfo\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:59:48.327950 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:48.327919    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm"]
Sep 10 04:59:48.331343 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:48.331316    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-ea9ba2-openshift-default-7b7677547b-bgbvm"]
Sep 10 04:59:48.825242 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:48.825199    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d9c78cc-0ac6-4e37-a8f3-60197d4002d2" path="/var/lib/kubelet/pods/0d9c78cc-0ac6-4e37-a8f3-60197d4002d2/volumes"
Sep 10 04:59:53.152273 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:53.152236    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-aa81ae79-6bf64d56cc-jqbqv"]
Sep 10 04:59:53.152762 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:53.152532    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-aa81ae79-6bf64d56cc-jqbqv" podUID="800fa0d8-6030-4106-b22d-0312c4ea18e9" containerName="maas-api" containerID="cri-o://fa1040de922fb325be1b07d8816f8b2a7bebcd335462cadcdcd9fb71a68ae2a0" gracePeriod=30
Sep 10 04:59:53.412356 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:53.412300    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-aa81ae79-6bf64d56cc-jqbqv"
Sep 10 04:59:53.462357 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:53.462140    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/800fa0d8-6030-4106-b22d-0312c4ea18e9-metrics-certs\") pod \"800fa0d8-6030-4106-b22d-0312c4ea18e9\" (UID: \"800fa0d8-6030-4106-b22d-0312c4ea18e9\") "
Sep 10 04:59:53.462357 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:53.462202    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/800fa0d8-6030-4106-b22d-0312c4ea18e9-openshift-service-ca\") pod \"800fa0d8-6030-4106-b22d-0312c4ea18e9\" (UID: \"800fa0d8-6030-4106-b22d-0312c4ea18e9\") "
Sep 10 04:59:53.462357 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:53.462294    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7x4rk\" (UniqueName: \"kubernetes.io/projected/800fa0d8-6030-4106-b22d-0312c4ea18e9-kube-api-access-7x4rk\") pod \"800fa0d8-6030-4106-b22d-0312c4ea18e9\" (UID: \"800fa0d8-6030-4106-b22d-0312c4ea18e9\") "
Sep 10 04:59:53.462357 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:53.462337    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/800fa0d8-6030-4106-b22d-0312c4ea18e9-maas-api-tls\") pod \"800fa0d8-6030-4106-b22d-0312c4ea18e9\" (UID: \"800fa0d8-6030-4106-b22d-0312c4ea18e9\") "
Sep 10 04:59:53.463354 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:53.462926    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/800fa0d8-6030-4106-b22d-0312c4ea18e9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "800fa0d8-6030-4106-b22d-0312c4ea18e9" (UID: "800fa0d8-6030-4106-b22d-0312c4ea18e9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 04:59:53.467608 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:53.466450    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/800fa0d8-6030-4106-b22d-0312c4ea18e9-kube-api-access-7x4rk" (OuterVolumeSpecName: "kube-api-access-7x4rk") pod "800fa0d8-6030-4106-b22d-0312c4ea18e9" (UID: "800fa0d8-6030-4106-b22d-0312c4ea18e9"). InnerVolumeSpecName "kube-api-access-7x4rk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 04:59:53.468696 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:53.468423    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/800fa0d8-6030-4106-b22d-0312c4ea18e9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "800fa0d8-6030-4106-b22d-0312c4ea18e9" (UID: "800fa0d8-6030-4106-b22d-0312c4ea18e9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 04:59:53.468696 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:53.468598    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/800fa0d8-6030-4106-b22d-0312c4ea18e9-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "800fa0d8-6030-4106-b22d-0312c4ea18e9" (UID: "800fa0d8-6030-4106-b22d-0312c4ea18e9"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 04:59:53.563207 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:53.563171    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7x4rk\" (UniqueName: \"kubernetes.io/projected/800fa0d8-6030-4106-b22d-0312c4ea18e9-kube-api-access-7x4rk\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:59:53.563207 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:53.563201    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/800fa0d8-6030-4106-b22d-0312c4ea18e9-maas-api-tls\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:59:53.563207 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:53.563210    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/800fa0d8-6030-4106-b22d-0312c4ea18e9-metrics-certs\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:59:53.563207 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:53.563218    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/800fa0d8-6030-4106-b22d-0312c4ea18e9-openshift-service-ca\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 04:59:54.044028 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:54.043983    2560 generic.go:356] "Generic (PLEG): container finished" podID="800fa0d8-6030-4106-b22d-0312c4ea18e9" containerID="fa1040de922fb325be1b07d8816f8b2a7bebcd335462cadcdcd9fb71a68ae2a0" exitCode=0
Sep 10 04:59:54.044028 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:54.044023    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-aa81ae79-6bf64d56cc-jqbqv"
Sep 10 04:59:54.044235 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:54.044060    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-aa81ae79-6bf64d56cc-jqbqv" event={"ID":"800fa0d8-6030-4106-b22d-0312c4ea18e9","Type":"ContainerDied","Data":"fa1040de922fb325be1b07d8816f8b2a7bebcd335462cadcdcd9fb71a68ae2a0"}
Sep 10 04:59:54.044235 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:54.044115    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-aa81ae79-6bf64d56cc-jqbqv" event={"ID":"800fa0d8-6030-4106-b22d-0312c4ea18e9","Type":"ContainerDied","Data":"e38fc6ec385365fbb20dc7d320325400231bc54bfaacc0b9b11be73d9a623df7"}
Sep 10 04:59:54.044235 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:54.044146    2560 scope.go:117] "RemoveContainer" containerID="fa1040de922fb325be1b07d8816f8b2a7bebcd335462cadcdcd9fb71a68ae2a0"
Sep 10 04:59:54.056710 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:54.056659    2560 scope.go:117] "RemoveContainer" containerID="fa1040de922fb325be1b07d8816f8b2a7bebcd335462cadcdcd9fb71a68ae2a0"
Sep 10 04:59:54.057176 ip-10-0-138-27 kubenswrapper[2560]: E0910 04:59:54.057151    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa1040de922fb325be1b07d8816f8b2a7bebcd335462cadcdcd9fb71a68ae2a0\": container with ID starting with fa1040de922fb325be1b07d8816f8b2a7bebcd335462cadcdcd9fb71a68ae2a0 not found: ID does not exist" containerID="fa1040de922fb325be1b07d8816f8b2a7bebcd335462cadcdcd9fb71a68ae2a0"
Sep 10 04:59:54.057272 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:54.057187    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa1040de922fb325be1b07d8816f8b2a7bebcd335462cadcdcd9fb71a68ae2a0"} err="failed to get container status \"fa1040de922fb325be1b07d8816f8b2a7bebcd335462cadcdcd9fb71a68ae2a0\": rpc error: code = NotFound desc = could not find container \"fa1040de922fb325be1b07d8816f8b2a7bebcd335462cadcdcd9fb71a68ae2a0\": container with ID starting with fa1040de922fb325be1b07d8816f8b2a7bebcd335462cadcdcd9fb71a68ae2a0 not found: ID does not exist"
Sep 10 04:59:54.067311 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:54.067289    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-aa81ae79-6bf64d56cc-jqbqv"]
Sep 10 04:59:54.078873 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:54.078838    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-aa81ae79-6bf64d56cc-jqbqv"]
Sep 10 04:59:54.825756 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:54.825721    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="800fa0d8-6030-4106-b22d-0312c4ea18e9" path="/var/lib/kubelet/pods/800fa0d8-6030-4106-b22d-0312c4ea18e9/volumes"
Sep 10 04:59:59.757142 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:59.757100    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp"]
Sep 10 04:59:59.757609 ip-10-0-138-27 kubenswrapper[2560]: I0910 04:59:59.757366    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp" podUID="c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f" containerName="istio-proxy" containerID="cri-o://c62e6bc36c3731ae9b02d61ddee8ef62a0ce7c7648bad1b9de095fbf23d7e092" gracePeriod=30
Sep 10 05:00:00.142532 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:00.142496    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-f3cc69-29816940-9dbph"]
Sep 10 05:00:00.143185 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:00.143167    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d9c78cc-0ac6-4e37-a8f3-60197d4002d2" containerName="istio-proxy"
Sep 10 05:00:00.143242 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:00.143189    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d9c78cc-0ac6-4e37-a8f3-60197d4002d2" containerName="istio-proxy"
Sep 10 05:00:00.143242 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:00.143231    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="800fa0d8-6030-4106-b22d-0312c4ea18e9" containerName="maas-api"
Sep 10 05:00:00.143242 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:00.143241    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="800fa0d8-6030-4106-b22d-0312c4ea18e9" containerName="maas-api"
Sep 10 05:00:00.143392 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:00.143335    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d9c78cc-0ac6-4e37-a8f3-60197d4002d2" containerName="istio-proxy"
Sep 10 05:00:00.143392 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:00.143350    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="800fa0d8-6030-4106-b22d-0312c4ea18e9" containerName="maas-api"
Sep 10 05:00:00.146908 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:00.146889    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-13af27-29816940-759v8"]
Sep 10 05:00:00.147024 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:00.147005    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-f3cc69-29816940-9dbph"
Sep 10 05:00:00.147373 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:00.147341    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d9c78cc-0ac6-4e37-a8f3-60197d4002d2" containerName="istio-proxy"
Sep 10 05:00:00.147373 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:00.147366    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d9c78cc-0ac6-4e37-a8f3-60197d4002d2" containerName="istio-proxy"
Sep 10 05:00:00.147552 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:00.147485    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d9c78cc-0ac6-4e37-a8f3-60197d4002d2" containerName="istio-proxy"
Sep 10 05:00:00.149359 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:00.149340    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-dkf6w\""
Sep 10 05:00:00.150291 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:00.150275    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-13af27-29816940-759v8"
Sep 10 05:00:00.163800 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:00.160472    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-f3cc69-29816940-9dbph"
Sep 10 05:00:00.163800 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:00.161916    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-f3cc69-29816940-9dbph"]
Sep 10 05:00:00.163800 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:00.163670    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-13af27-29816940-759v8"]
Sep 10 05:00:00.169693 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:00.169662    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-13af27-29816940-759v8"
Sep 10 05:00:00.450732 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:00.450690    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-f3cc69-29816940-9dbph"]
Sep 10 05:00:00.451454 ip-10-0-138-27 kubenswrapper[2560]: W0910 05:00:00.451427    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5742921b_9510_4804_9a19_2899bb2fec1c.slice/crio-9ef1d2b3e66f5830912481064d698c47303916e5e3cf90e72243392b452bec07 WatchSource:0}: Error finding container 9ef1d2b3e66f5830912481064d698c47303916e5e3cf90e72243392b452bec07: Status 404 returned error can't find the container with id 9ef1d2b3e66f5830912481064d698c47303916e5e3cf90e72243392b452bec07
Sep 10 05:00:00.452320 ip-10-0-138-27 kubenswrapper[2560]: W0910 05:00:00.452283    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5ebbb70_c4fa_439c_b65e_480fff500505.slice/crio-8742e94ccd994071dc0900b94f68cfae3b4bb31dc4d2e4a8e83e73abb758d113 WatchSource:0}: Error finding container 8742e94ccd994071dc0900b94f68cfae3b4bb31dc4d2e4a8e83e73abb758d113: Status 404 returned error can't find the container with id 8742e94ccd994071dc0900b94f68cfae3b4bb31dc4d2e4a8e83e73abb758d113
Sep 10 05:00:00.453795 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:00.453772    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-13af27-29816940-759v8"]
Sep 10 05:00:01.089150 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:01.089110    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-13af27-29816940-759v8" event={"ID":"f5ebbb70-c4fa-439c-b65e-480fff500505","Type":"ContainerStarted","Data":"8742e94ccd994071dc0900b94f68cfae3b4bb31dc4d2e4a8e83e73abb758d113"}
Sep 10 05:00:01.090571 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:01.090541    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-f3cc69-29816940-9dbph" event={"ID":"5742921b-9510-4804-9a19-2899bb2fec1c","Type":"ContainerStarted","Data":"9ef1d2b3e66f5830912481064d698c47303916e5e3cf90e72243392b452bec07"}
Sep 10 05:00:04.111911 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:04.111879    2560 generic.go:356] "Generic (PLEG): container finished" podID="f5ebbb70-c4fa-439c-b65e-480fff500505" containerID="1b446ab24b0d0e8b3ec1c7a4fcd663c906743c09ab8ab011bebaea803bed28c0" exitCode=0
Sep 10 05:00:04.112342 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:04.111962    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-13af27-29816940-759v8" event={"ID":"f5ebbb70-c4fa-439c-b65e-480fff500505","Type":"ContainerDied","Data":"1b446ab24b0d0e8b3ec1c7a4fcd663c906743c09ab8ab011bebaea803bed28c0"}
Sep 10 05:00:04.113471 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:04.113450    2560 generic.go:356] "Generic (PLEG): container finished" podID="5742921b-9510-4804-9a19-2899bb2fec1c" containerID="105b4c822f86fc59a47cf56714089c174b2cc8d0067a6f952944c71dca644383" exitCode=0
Sep 10 05:00:04.113566 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:04.113518    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-f3cc69-29816940-9dbph" event={"ID":"5742921b-9510-4804-9a19-2899bb2fec1c","Type":"ContainerDied","Data":"105b4c822f86fc59a47cf56714089c174b2cc8d0067a6f952944c71dca644383"}
Sep 10 05:00:04.999938 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:04.999912    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp"
Sep 10 05:00:05.066016 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:05.065919    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f-workload-socket\") pod \"c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f\" (UID: \"c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f\") "
Sep 10 05:00:05.066016 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:05.065963    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f-istio-token\") pod \"c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f\" (UID: \"c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f\") "
Sep 10 05:00:05.066016 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:05.065990    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f-istio-data\") pod \"c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f\" (UID: \"c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f\") "
Sep 10 05:00:05.066309 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:05.066058    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f-istio-podinfo\") pod \"c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f\" (UID: \"c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f\") "
Sep 10 05:00:05.066309 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:05.066089    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f-credential-socket\") pod \"c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f\" (UID: \"c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f\") "
Sep 10 05:00:05.066309 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:05.066151    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f-workload-certs\") pod \"c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f\" (UID: \"c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f\") "
Sep 10 05:00:05.066309 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:05.066205    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f-istio-envoy\") pod \"c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f\" (UID: \"c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f\") "
Sep 10 05:00:05.066309 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:05.066214    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f" (UID: "c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 05:00:05.066309 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:05.066256    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f-istiod-ca-cert\") pod \"c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f\" (UID: \"c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f\") "
Sep 10 05:00:05.066309 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:05.066289    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ww87m\" (UniqueName: \"kubernetes.io/projected/c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f-kube-api-access-ww87m\") pod \"c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f\" (UID: \"c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f\") "
Sep 10 05:00:05.066667 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:05.066421    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f" (UID: "c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 05:00:05.066667 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:05.066467    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f" (UID: "c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 05:00:05.066667 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:05.066653    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f-workload-certs\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:00:05.066667 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:05.066657    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f-istio-data" (OuterVolumeSpecName: "istio-data") pod "c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f" (UID: "c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 05:00:05.066903 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:05.066673    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f-workload-socket\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:00:05.066903 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:05.066691    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f-credential-socket\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:00:05.067076 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:05.067052    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f" (UID: "c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 05:00:05.068812 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:05.068785    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f" (UID: "c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 05:00:05.068934 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:05.068875    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f" (UID: "c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 05:00:05.069101 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:05.069078    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f-istio-token" (OuterVolumeSpecName: "istio-token") pod "c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f" (UID: "c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 05:00:05.069173 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:05.069107    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f-kube-api-access-ww87m" (OuterVolumeSpecName: "kube-api-access-ww87m") pod "c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f" (UID: "c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f"). InnerVolumeSpecName "kube-api-access-ww87m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 05:00:05.121133 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:05.121095    2560 generic.go:356] "Generic (PLEG): container finished" podID="c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f" containerID="c62e6bc36c3731ae9b02d61ddee8ef62a0ce7c7648bad1b9de095fbf23d7e092" exitCode=0
Sep 10 05:00:05.121519 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:05.121154    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp"
Sep 10 05:00:05.121519 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:05.121187    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp" event={"ID":"c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f","Type":"ContainerDied","Data":"c62e6bc36c3731ae9b02d61ddee8ef62a0ce7c7648bad1b9de095fbf23d7e092"}
Sep 10 05:00:05.121519 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:05.121257    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp" event={"ID":"c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f","Type":"ContainerDied","Data":"d2a2553b5548bf1e253a8e123c1fa7ea5ef0fce2579865772cfdecea901964f7"}
Sep 10 05:00:05.121519 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:05.121291    2560 scope.go:117] "RemoveContainer" containerID="c62e6bc36c3731ae9b02d61ddee8ef62a0ce7c7648bad1b9de095fbf23d7e092"
Sep 10 05:00:05.132486 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:05.132457    2560 scope.go:117] "RemoveContainer" containerID="b68db14925114fa004b65b8167b5cfac3ba689f4983eea21175e76db02d08b41"
Sep 10 05:00:05.146486 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:05.146180    2560 scope.go:117] "RemoveContainer" containerID="c62e6bc36c3731ae9b02d61ddee8ef62a0ce7c7648bad1b9de095fbf23d7e092"
Sep 10 05:00:05.147203 ip-10-0-138-27 kubenswrapper[2560]: E0910 05:00:05.146745    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c62e6bc36c3731ae9b02d61ddee8ef62a0ce7c7648bad1b9de095fbf23d7e092\": container with ID starting with c62e6bc36c3731ae9b02d61ddee8ef62a0ce7c7648bad1b9de095fbf23d7e092 not found: ID does not exist" containerID="c62e6bc36c3731ae9b02d61ddee8ef62a0ce7c7648bad1b9de095fbf23d7e092"
Sep 10 05:00:05.147203 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:05.146788    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c62e6bc36c3731ae9b02d61ddee8ef62a0ce7c7648bad1b9de095fbf23d7e092"} err="failed to get container status \"c62e6bc36c3731ae9b02d61ddee8ef62a0ce7c7648bad1b9de095fbf23d7e092\": rpc error: code = NotFound desc = could not find container \"c62e6bc36c3731ae9b02d61ddee8ef62a0ce7c7648bad1b9de095fbf23d7e092\": container with ID starting with c62e6bc36c3731ae9b02d61ddee8ef62a0ce7c7648bad1b9de095fbf23d7e092 not found: ID does not exist"
Sep 10 05:00:05.147203 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:05.146812    2560 scope.go:117] "RemoveContainer" containerID="b68db14925114fa004b65b8167b5cfac3ba689f4983eea21175e76db02d08b41"
Sep 10 05:00:05.147688 ip-10-0-138-27 kubenswrapper[2560]: E0910 05:00:05.147662    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b68db14925114fa004b65b8167b5cfac3ba689f4983eea21175e76db02d08b41\": container with ID starting with b68db14925114fa004b65b8167b5cfac3ba689f4983eea21175e76db02d08b41 not found: ID does not exist" containerID="b68db14925114fa004b65b8167b5cfac3ba689f4983eea21175e76db02d08b41"
Sep 10 05:00:05.147775 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:05.147695    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b68db14925114fa004b65b8167b5cfac3ba689f4983eea21175e76db02d08b41"} err="failed to get container status \"b68db14925114fa004b65b8167b5cfac3ba689f4983eea21175e76db02d08b41\": rpc error: code = NotFound desc = could not find container \"b68db14925114fa004b65b8167b5cfac3ba689f4983eea21175e76db02d08b41\": container with ID starting with b68db14925114fa004b65b8167b5cfac3ba689f4983eea21175e76db02d08b41 not found: ID does not exist"
Sep 10 05:00:05.148091 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:05.148039    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp"]
Sep 10 05:00:05.151154 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:05.151134    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-aa81ae79-openshift-default-5f84fb4ccb-wrzhp"]
Sep 10 05:00:05.167350 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:05.167324    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f-istio-podinfo\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:00:05.167350 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:05.167350    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f-istio-envoy\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:00:05.167544 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:05.167359    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f-istiod-ca-cert\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:00:05.167544 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:05.167368    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ww87m\" (UniqueName: \"kubernetes.io/projected/c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f-kube-api-access-ww87m\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:00:05.167544 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:05.167379    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f-istio-token\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:00:05.167544 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:05.167389    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f-istio-data\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:00:05.293761 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:05.293735    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-13af27-29816940-759v8"
Sep 10 05:00:05.296004 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:05.295984    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-f3cc69-29816940-9dbph"
Sep 10 05:00:06.128906 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:06.128876    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-13af27-29816940-759v8"
Sep 10 05:00:06.128906 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:06.128893    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-13af27-29816940-759v8" event={"ID":"f5ebbb70-c4fa-439c-b65e-480fff500505","Type":"ContainerDied","Data":"8742e94ccd994071dc0900b94f68cfae3b4bb31dc4d2e4a8e83e73abb758d113"}
Sep 10 05:00:06.129447 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:06.128962    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8742e94ccd994071dc0900b94f68cfae3b4bb31dc4d2e4a8e83e73abb758d113"
Sep 10 05:00:06.130266 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:06.130242    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-f3cc69-29816940-9dbph"
Sep 10 05:00:06.130383 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:06.130259    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-f3cc69-29816940-9dbph" event={"ID":"5742921b-9510-4804-9a19-2899bb2fec1c","Type":"ContainerDied","Data":"9ef1d2b3e66f5830912481064d698c47303916e5e3cf90e72243392b452bec07"}
Sep 10 05:00:06.130383 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:06.130302    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9ef1d2b3e66f5830912481064d698c47303916e5e3cf90e72243392b452bec07"
Sep 10 05:00:06.197774 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:06.197741    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 05:00:06.588417 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:06.588330    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-noten-3e5c28/noten-model-3e5c28-kserve-bc6bc4947-dz92d"]
Sep 10 05:00:06.588967 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:06.588941    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f" containerName="istio-proxy"
Sep 10 05:00:06.589123 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:06.588998    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f" containerName="istio-proxy"
Sep 10 05:00:06.589123 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:06.589018    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f" containerName="istio-proxy"
Sep 10 05:00:06.589123 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:06.589027    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f" containerName="istio-proxy"
Sep 10 05:00:06.589123 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:06.589039    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5ebbb70-c4fa-439c-b65e-480fff500505" containerName="cleanup"
Sep 10 05:00:06.589123 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:06.589046    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5ebbb70-c4fa-439c-b65e-480fff500505" containerName="cleanup"
Sep 10 05:00:06.589123 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:06.589074    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5742921b-9510-4804-9a19-2899bb2fec1c" containerName="cleanup"
Sep 10 05:00:06.589123 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:06.589082    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="5742921b-9510-4804-9a19-2899bb2fec1c" containerName="cleanup"
Sep 10 05:00:06.589474 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:06.589250    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="5742921b-9510-4804-9a19-2899bb2fec1c" containerName="cleanup"
Sep 10 05:00:06.589474 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:06.589269    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f" containerName="istio-proxy"
Sep 10 05:00:06.589474 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:06.589281    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f" containerName="istio-proxy"
Sep 10 05:00:06.589474 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:06.589289    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5ebbb70-c4fa-439c-b65e-480fff500505" containerName="cleanup"
Sep 10 05:00:06.592757 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:06.592730    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-3e5c28/noten-model-3e5c28-kserve-bc6bc4947-dz92d"
Sep 10 05:00:06.595644 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:06.595622    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-noten-3e5c28\"/\"kube-root-ca.crt\""
Sep 10 05:00:06.595771 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:06.595621    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-noten-3e5c28\"/\"noten-model-3e5c28-kserve-self-signed-certs\""
Sep 10 05:00:06.595771 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:06.595622    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-noten-3e5c28\"/\"default-dockercfg-67j7g\""
Sep 10 05:00:06.595771 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:06.595629    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-noten-3e5c28\"/\"openshift-service-ca.crt\""
Sep 10 05:00:06.600436 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:06.600411    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-noten-3e5c28/noten-model-3e5c28-kserve-bc6bc4947-dz92d"]
Sep 10 05:00:06.681358 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:06.681320    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/89bc5505-7be7-4fad-b85b-746df06d7ead-model-cache\") pod \"noten-model-3e5c28-kserve-bc6bc4947-dz92d\" (UID: \"89bc5505-7be7-4fad-b85b-746df06d7ead\") " pod="ai-tenant-e2e-noten-3e5c28/noten-model-3e5c28-kserve-bc6bc4947-dz92d"
Sep 10 05:00:06.681358 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:06.681360    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/89bc5505-7be7-4fad-b85b-746df06d7ead-dshm\") pod \"noten-model-3e5c28-kserve-bc6bc4947-dz92d\" (UID: \"89bc5505-7be7-4fad-b85b-746df06d7ead\") " pod="ai-tenant-e2e-noten-3e5c28/noten-model-3e5c28-kserve-bc6bc4947-dz92d"
Sep 10 05:00:06.681590 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:06.681486    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsnw2\" (UniqueName: \"kubernetes.io/projected/89bc5505-7be7-4fad-b85b-746df06d7ead-kube-api-access-rsnw2\") pod \"noten-model-3e5c28-kserve-bc6bc4947-dz92d\" (UID: \"89bc5505-7be7-4fad-b85b-746df06d7ead\") " pod="ai-tenant-e2e-noten-3e5c28/noten-model-3e5c28-kserve-bc6bc4947-dz92d"
Sep 10 05:00:06.681590 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:06.681527    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/89bc5505-7be7-4fad-b85b-746df06d7ead-tmp-dir\") pod \"noten-model-3e5c28-kserve-bc6bc4947-dz92d\" (UID: \"89bc5505-7be7-4fad-b85b-746df06d7ead\") " pod="ai-tenant-e2e-noten-3e5c28/noten-model-3e5c28-kserve-bc6bc4947-dz92d"
Sep 10 05:00:06.681590 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:06.681550    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/89bc5505-7be7-4fad-b85b-746df06d7ead-home\") pod \"noten-model-3e5c28-kserve-bc6bc4947-dz92d\" (UID: \"89bc5505-7be7-4fad-b85b-746df06d7ead\") " pod="ai-tenant-e2e-noten-3e5c28/noten-model-3e5c28-kserve-bc6bc4947-dz92d"
Sep 10 05:00:06.681716 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:06.681619    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/89bc5505-7be7-4fad-b85b-746df06d7ead-tls-certs\") pod \"noten-model-3e5c28-kserve-bc6bc4947-dz92d\" (UID: \"89bc5505-7be7-4fad-b85b-746df06d7ead\") " pod="ai-tenant-e2e-noten-3e5c28/noten-model-3e5c28-kserve-bc6bc4947-dz92d"
Sep 10 05:00:06.782375 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:06.782335    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsnw2\" (UniqueName: \"kubernetes.io/projected/89bc5505-7be7-4fad-b85b-746df06d7ead-kube-api-access-rsnw2\") pod \"noten-model-3e5c28-kserve-bc6bc4947-dz92d\" (UID: \"89bc5505-7be7-4fad-b85b-746df06d7ead\") " pod="ai-tenant-e2e-noten-3e5c28/noten-model-3e5c28-kserve-bc6bc4947-dz92d"
Sep 10 05:00:06.782375 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:06.782378    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/89bc5505-7be7-4fad-b85b-746df06d7ead-tmp-dir\") pod \"noten-model-3e5c28-kserve-bc6bc4947-dz92d\" (UID: \"89bc5505-7be7-4fad-b85b-746df06d7ead\") " pod="ai-tenant-e2e-noten-3e5c28/noten-model-3e5c28-kserve-bc6bc4947-dz92d"
Sep 10 05:00:06.782637 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:06.782397    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/89bc5505-7be7-4fad-b85b-746df06d7ead-home\") pod \"noten-model-3e5c28-kserve-bc6bc4947-dz92d\" (UID: \"89bc5505-7be7-4fad-b85b-746df06d7ead\") " pod="ai-tenant-e2e-noten-3e5c28/noten-model-3e5c28-kserve-bc6bc4947-dz92d"
Sep 10 05:00:06.782637 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:06.782420    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/89bc5505-7be7-4fad-b85b-746df06d7ead-tls-certs\") pod \"noten-model-3e5c28-kserve-bc6bc4947-dz92d\" (UID: \"89bc5505-7be7-4fad-b85b-746df06d7ead\") " pod="ai-tenant-e2e-noten-3e5c28/noten-model-3e5c28-kserve-bc6bc4947-dz92d"
Sep 10 05:00:06.782637 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:06.782455    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/89bc5505-7be7-4fad-b85b-746df06d7ead-model-cache\") pod \"noten-model-3e5c28-kserve-bc6bc4947-dz92d\" (UID: \"89bc5505-7be7-4fad-b85b-746df06d7ead\") " pod="ai-tenant-e2e-noten-3e5c28/noten-model-3e5c28-kserve-bc6bc4947-dz92d"
Sep 10 05:00:06.782637 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:06.782471    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/89bc5505-7be7-4fad-b85b-746df06d7ead-dshm\") pod \"noten-model-3e5c28-kserve-bc6bc4947-dz92d\" (UID: \"89bc5505-7be7-4fad-b85b-746df06d7ead\") " pod="ai-tenant-e2e-noten-3e5c28/noten-model-3e5c28-kserve-bc6bc4947-dz92d"
Sep 10 05:00:06.782871 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:06.782830    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/89bc5505-7be7-4fad-b85b-746df06d7ead-tmp-dir\") pod \"noten-model-3e5c28-kserve-bc6bc4947-dz92d\" (UID: \"89bc5505-7be7-4fad-b85b-746df06d7ead\") " pod="ai-tenant-e2e-noten-3e5c28/noten-model-3e5c28-kserve-bc6bc4947-dz92d"
Sep 10 05:00:06.782942 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:06.782896    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/89bc5505-7be7-4fad-b85b-746df06d7ead-home\") pod \"noten-model-3e5c28-kserve-bc6bc4947-dz92d\" (UID: \"89bc5505-7be7-4fad-b85b-746df06d7ead\") " pod="ai-tenant-e2e-noten-3e5c28/noten-model-3e5c28-kserve-bc6bc4947-dz92d"
Sep 10 05:00:06.782942 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:06.782915    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/89bc5505-7be7-4fad-b85b-746df06d7ead-model-cache\") pod \"noten-model-3e5c28-kserve-bc6bc4947-dz92d\" (UID: \"89bc5505-7be7-4fad-b85b-746df06d7ead\") " pod="ai-tenant-e2e-noten-3e5c28/noten-model-3e5c28-kserve-bc6bc4947-dz92d"
Sep 10 05:00:06.784675 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:06.784655    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/89bc5505-7be7-4fad-b85b-746df06d7ead-dshm\") pod \"noten-model-3e5c28-kserve-bc6bc4947-dz92d\" (UID: \"89bc5505-7be7-4fad-b85b-746df06d7ead\") " pod="ai-tenant-e2e-noten-3e5c28/noten-model-3e5c28-kserve-bc6bc4947-dz92d"
Sep 10 05:00:06.785012 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:06.784995    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/89bc5505-7be7-4fad-b85b-746df06d7ead-tls-certs\") pod \"noten-model-3e5c28-kserve-bc6bc4947-dz92d\" (UID: \"89bc5505-7be7-4fad-b85b-746df06d7ead\") " pod="ai-tenant-e2e-noten-3e5c28/noten-model-3e5c28-kserve-bc6bc4947-dz92d"
Sep 10 05:00:06.789395 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:06.789377    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsnw2\" (UniqueName: \"kubernetes.io/projected/89bc5505-7be7-4fad-b85b-746df06d7ead-kube-api-access-rsnw2\") pod \"noten-model-3e5c28-kserve-bc6bc4947-dz92d\" (UID: \"89bc5505-7be7-4fad-b85b-746df06d7ead\") " pod="ai-tenant-e2e-noten-3e5c28/noten-model-3e5c28-kserve-bc6bc4947-dz92d"
Sep 10 05:00:06.826248 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:06.826207    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f" path="/var/lib/kubelet/pods/c2836e7e-c4eb-4e5d-bb2b-9aea5688f91f/volumes"
Sep 10 05:00:06.903595 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:06.903566    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-3e5c28/noten-model-3e5c28-kserve-bc6bc4947-dz92d"
Sep 10 05:00:07.178582 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:07.178556    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-noten-3e5c28/noten-model-3e5c28-kserve-bc6bc4947-dz92d"]
Sep 10 05:00:07.179727 ip-10-0-138-27 kubenswrapper[2560]: W0910 05:00:07.179697    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod89bc5505_7be7_4fad_b85b_746df06d7ead.slice/crio-7be4a896e1ffdd83dfdb99c98b97e7392e55b8753eeb8c8607c1b0f09768ef1c WatchSource:0}: Error finding container 7be4a896e1ffdd83dfdb99c98b97e7392e55b8753eeb8c8607c1b0f09768ef1c: Status 404 returned error can't find the container with id 7be4a896e1ffdd83dfdb99c98b97e7392e55b8753eeb8c8607c1b0f09768ef1c
Sep 10 05:00:08.146669 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:08.146625    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-3e5c28/noten-model-3e5c28-kserve-bc6bc4947-dz92d" event={"ID":"89bc5505-7be7-4fad-b85b-746df06d7ead","Type":"ContainerStarted","Data":"5243bc17f0fdf0c2198ff74a520b6fa86346c7bc559b72578f47c9dc8095ea06"}
Sep 10 05:00:08.146885 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:08.146677    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-3e5c28/noten-model-3e5c28-kserve-bc6bc4947-dz92d" event={"ID":"89bc5505-7be7-4fad-b85b-746df06d7ead","Type":"ContainerStarted","Data":"7be4a896e1ffdd83dfdb99c98b97e7392e55b8753eeb8c8607c1b0f09768ef1c"}
Sep 10 05:00:08.163570 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:08.163523    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-noten-3e5c28/noten-model-3e5c28-kserve-bc6bc4947-dz92d" podStartSLOduration=2.163508331 podStartE2EDuration="2.163508331s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 05:00:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 05:00:08.16200554 +0000 UTC m=+1147.824463288" watchObservedRunningTime="2026-09-10 05:00:08.163508331 +0000 UTC m=+1147.825966077"
Sep 10 05:00:13.104876 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:13.104809    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4"]
Sep 10 05:00:13.108813 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:13.108790    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4"
Sep 10 05:00:13.110908 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:13.110882    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-25bd47-openshift-default-dockercfg-sgl25\""
Sep 10 05:00:13.120553 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:13.120531    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4"]
Sep 10 05:00:13.145896 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:13.145838    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/deb10655-be47-4f62-97f8-82ddddf7d3a7-istio-envoy\") pod \"e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4\" (UID: \"deb10655-be47-4f62-97f8-82ddddf7d3a7\") " pod="openshift-ingress/e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4"
Sep 10 05:00:13.146030 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:13.145925    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/deb10655-be47-4f62-97f8-82ddddf7d3a7-credential-socket\") pod \"e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4\" (UID: \"deb10655-be47-4f62-97f8-82ddddf7d3a7\") " pod="openshift-ingress/e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4"
Sep 10 05:00:13.146030 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:13.145956    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/deb10655-be47-4f62-97f8-82ddddf7d3a7-workload-certs\") pod \"e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4\" (UID: \"deb10655-be47-4f62-97f8-82ddddf7d3a7\") " pod="openshift-ingress/e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4"
Sep 10 05:00:13.146030 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:13.146018    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/deb10655-be47-4f62-97f8-82ddddf7d3a7-istio-data\") pod \"e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4\" (UID: \"deb10655-be47-4f62-97f8-82ddddf7d3a7\") " pod="openshift-ingress/e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4"
Sep 10 05:00:13.146137 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:13.146041    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/deb10655-be47-4f62-97f8-82ddddf7d3a7-istiod-ca-cert\") pod \"e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4\" (UID: \"deb10655-be47-4f62-97f8-82ddddf7d3a7\") " pod="openshift-ingress/e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4"
Sep 10 05:00:13.146176 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:13.146132    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/deb10655-be47-4f62-97f8-82ddddf7d3a7-istio-podinfo\") pod \"e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4\" (UID: \"deb10655-be47-4f62-97f8-82ddddf7d3a7\") " pod="openshift-ingress/e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4"
Sep 10 05:00:13.146176 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:13.146172    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/deb10655-be47-4f62-97f8-82ddddf7d3a7-istio-token\") pod \"e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4\" (UID: \"deb10655-be47-4f62-97f8-82ddddf7d3a7\") " pod="openshift-ingress/e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4"
Sep 10 05:00:13.146237 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:13.146195    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/deb10655-be47-4f62-97f8-82ddddf7d3a7-workload-socket\") pod \"e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4\" (UID: \"deb10655-be47-4f62-97f8-82ddddf7d3a7\") " pod="openshift-ingress/e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4"
Sep 10 05:00:13.146237 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:13.146221    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bpns\" (UniqueName: \"kubernetes.io/projected/deb10655-be47-4f62-97f8-82ddddf7d3a7-kube-api-access-8bpns\") pod \"e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4\" (UID: \"deb10655-be47-4f62-97f8-82ddddf7d3a7\") " pod="openshift-ingress/e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4"
Sep 10 05:00:13.246947 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:13.246913    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/deb10655-be47-4f62-97f8-82ddddf7d3a7-istio-data\") pod \"e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4\" (UID: \"deb10655-be47-4f62-97f8-82ddddf7d3a7\") " pod="openshift-ingress/e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4"
Sep 10 05:00:13.247121 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:13.246955    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/deb10655-be47-4f62-97f8-82ddddf7d3a7-istiod-ca-cert\") pod \"e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4\" (UID: \"deb10655-be47-4f62-97f8-82ddddf7d3a7\") " pod="openshift-ingress/e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4"
Sep 10 05:00:13.247121 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:13.247019    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/deb10655-be47-4f62-97f8-82ddddf7d3a7-istio-podinfo\") pod \"e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4\" (UID: \"deb10655-be47-4f62-97f8-82ddddf7d3a7\") " pod="openshift-ingress/e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4"
Sep 10 05:00:13.247121 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:13.247059    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/deb10655-be47-4f62-97f8-82ddddf7d3a7-istio-token\") pod \"e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4\" (UID: \"deb10655-be47-4f62-97f8-82ddddf7d3a7\") " pod="openshift-ingress/e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4"
Sep 10 05:00:13.247121 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:13.247090    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/deb10655-be47-4f62-97f8-82ddddf7d3a7-workload-socket\") pod \"e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4\" (UID: \"deb10655-be47-4f62-97f8-82ddddf7d3a7\") " pod="openshift-ingress/e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4"
Sep 10 05:00:13.247121 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:13.247116    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bpns\" (UniqueName: \"kubernetes.io/projected/deb10655-be47-4f62-97f8-82ddddf7d3a7-kube-api-access-8bpns\") pod \"e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4\" (UID: \"deb10655-be47-4f62-97f8-82ddddf7d3a7\") " pod="openshift-ingress/e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4"
Sep 10 05:00:13.247373 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:13.247166    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/deb10655-be47-4f62-97f8-82ddddf7d3a7-istio-envoy\") pod \"e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4\" (UID: \"deb10655-be47-4f62-97f8-82ddddf7d3a7\") " pod="openshift-ingress/e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4"
Sep 10 05:00:13.247373 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:13.247208    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/deb10655-be47-4f62-97f8-82ddddf7d3a7-credential-socket\") pod \"e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4\" (UID: \"deb10655-be47-4f62-97f8-82ddddf7d3a7\") " pod="openshift-ingress/e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4"
Sep 10 05:00:13.247373 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:13.247250    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/deb10655-be47-4f62-97f8-82ddddf7d3a7-workload-certs\") pod \"e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4\" (UID: \"deb10655-be47-4f62-97f8-82ddddf7d3a7\") " pod="openshift-ingress/e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4"
Sep 10 05:00:13.247531 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:13.247369    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/deb10655-be47-4f62-97f8-82ddddf7d3a7-istio-data\") pod \"e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4\" (UID: \"deb10655-be47-4f62-97f8-82ddddf7d3a7\") " pod="openshift-ingress/e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4"
Sep 10 05:00:13.247531 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:13.247471    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/deb10655-be47-4f62-97f8-82ddddf7d3a7-workload-socket\") pod \"e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4\" (UID: \"deb10655-be47-4f62-97f8-82ddddf7d3a7\") " pod="openshift-ingress/e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4"
Sep 10 05:00:13.247636 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:13.247559    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/deb10655-be47-4f62-97f8-82ddddf7d3a7-workload-certs\") pod \"e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4\" (UID: \"deb10655-be47-4f62-97f8-82ddddf7d3a7\") " pod="openshift-ingress/e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4"
Sep 10 05:00:13.247770 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:13.247744    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/deb10655-be47-4f62-97f8-82ddddf7d3a7-credential-socket\") pod \"e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4\" (UID: \"deb10655-be47-4f62-97f8-82ddddf7d3a7\") " pod="openshift-ingress/e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4"
Sep 10 05:00:13.247820 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:13.247807    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/deb10655-be47-4f62-97f8-82ddddf7d3a7-istiod-ca-cert\") pod \"e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4\" (UID: \"deb10655-be47-4f62-97f8-82ddddf7d3a7\") " pod="openshift-ingress/e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4"
Sep 10 05:00:13.249538 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:13.249518    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/deb10655-be47-4f62-97f8-82ddddf7d3a7-istio-envoy\") pod \"e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4\" (UID: \"deb10655-be47-4f62-97f8-82ddddf7d3a7\") " pod="openshift-ingress/e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4"
Sep 10 05:00:13.249801 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:13.249785    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/deb10655-be47-4f62-97f8-82ddddf7d3a7-istio-podinfo\") pod \"e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4\" (UID: \"deb10655-be47-4f62-97f8-82ddddf7d3a7\") " pod="openshift-ingress/e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4"
Sep 10 05:00:13.254233 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:13.254213    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/deb10655-be47-4f62-97f8-82ddddf7d3a7-istio-token\") pod \"e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4\" (UID: \"deb10655-be47-4f62-97f8-82ddddf7d3a7\") " pod="openshift-ingress/e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4"
Sep 10 05:00:13.254310 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:13.254276    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bpns\" (UniqueName: \"kubernetes.io/projected/deb10655-be47-4f62-97f8-82ddddf7d3a7-kube-api-access-8bpns\") pod \"e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4\" (UID: \"deb10655-be47-4f62-97f8-82ddddf7d3a7\") " pod="openshift-ingress/e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4"
Sep 10 05:00:13.421435 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:13.421400    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4"
Sep 10 05:00:13.702489 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:13.702456    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4"]
Sep 10 05:00:13.703604 ip-10-0-138-27 kubenswrapper[2560]: W0910 05:00:13.703573    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddeb10655_be47_4f62_97f8_82ddddf7d3a7.slice/crio-9484cf94f2302f2ee49a2ce74f3cd782bd32cdf0a21571b49780e1416e860f77 WatchSource:0}: Error finding container 9484cf94f2302f2ee49a2ce74f3cd782bd32cdf0a21571b49780e1416e860f77: Status 404 returned error can't find the container with id 9484cf94f2302f2ee49a2ce74f3cd782bd32cdf0a21571b49780e1416e860f77
Sep 10 05:00:13.705914 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:13.705884    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 05:00:13.706001 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:13.705944    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 05:00:13.706001 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:13.705975    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 05:00:14.186497 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:14.186465    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4" event={"ID":"deb10655-be47-4f62-97f8-82ddddf7d3a7","Type":"ContainerStarted","Data":"915fbef53dd9b7a0c0522d7d86d567ab60e5bdf1e0a1d3e96f2106280dfc7587"}
Sep 10 05:00:14.186907 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:14.186519    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4" event={"ID":"deb10655-be47-4f62-97f8-82ddddf7d3a7","Type":"ContainerStarted","Data":"9484cf94f2302f2ee49a2ce74f3cd782bd32cdf0a21571b49780e1416e860f77"}
Sep 10 05:00:14.209086 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:14.209026    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4" podStartSLOduration=1.2090064680000001 podStartE2EDuration="1.209006468s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 05:00:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 05:00:14.203334692 +0000 UTC m=+1153.865792439" watchObservedRunningTime="2026-09-10 05:00:14.209006468 +0000 UTC m=+1153.871464216"
Sep 10 05:00:14.421761 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:14.421724    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4"
Sep 10 05:00:14.427362 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:14.427336    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4"
Sep 10 05:00:15.192654 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:15.192618    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4"
Sep 10 05:00:15.193573 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:15.193550    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4"
Sep 10 05:00:16.904305 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:16.904273    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-noten-3e5c28/noten-model-3e5c28-kserve-bc6bc4947-dz92d"
Sep 10 05:00:16.904757 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:16.904320    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-noten-3e5c28/noten-model-3e5c28-kserve-bc6bc4947-dz92d"
Sep 10 05:00:16.916703 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:16.916676    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-noten-3e5c28/noten-model-3e5c28-kserve-bc6bc4947-dz92d"
Sep 10 05:00:17.216907 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:17.216803    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-noten-3e5c28/noten-model-3e5c28-kserve-bc6bc4947-dz92d"
Sep 10 05:00:30.099389 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:30.099300    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 05:00:41.363817 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:41.363773    2560 generic.go:356] "Generic (PLEG): container finished" podID="deb10655-be47-4f62-97f8-82ddddf7d3a7" containerID="915fbef53dd9b7a0c0522d7d86d567ab60e5bdf1e0a1d3e96f2106280dfc7587" exitCode=0
Sep 10 05:00:41.364260 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:41.363827    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4" event={"ID":"deb10655-be47-4f62-97f8-82ddddf7d3a7","Type":"ContainerDied","Data":"915fbef53dd9b7a0c0522d7d86d567ab60e5bdf1e0a1d3e96f2106280dfc7587"}
Sep 10 05:00:41.364346 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:41.364331    2560 scope.go:117] "RemoveContainer" containerID="915fbef53dd9b7a0c0522d7d86d567ab60e5bdf1e0a1d3e96f2106280dfc7587"
Sep 10 05:00:41.365532 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:41.365502    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 05:00:41.365635 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:41.365585    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 05:00:41.365698 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:41.365633    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 05:00:41.795868 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:41.795803    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr"]
Sep 10 05:00:41.798483 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:41.798461    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr"
Sep 10 05:00:41.800687 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:41.800663    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-97ffde-openshift-default-dockercfg-6fjvq\""
Sep 10 05:00:41.811838 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:41.811814    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr"]
Sep 10 05:00:41.850832 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:41.850802    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/231145e0-7b08-4465-ae64-2da3aaee4529-istio-token\") pod \"e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr\" (UID: \"231145e0-7b08-4465-ae64-2da3aaee4529\") " pod="openshift-ingress/e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr"
Sep 10 05:00:41.851013 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:41.850839    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjlx4\" (UniqueName: \"kubernetes.io/projected/231145e0-7b08-4465-ae64-2da3aaee4529-kube-api-access-wjlx4\") pod \"e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr\" (UID: \"231145e0-7b08-4465-ae64-2da3aaee4529\") " pod="openshift-ingress/e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr"
Sep 10 05:00:41.851013 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:41.850911    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/231145e0-7b08-4465-ae64-2da3aaee4529-istio-data\") pod \"e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr\" (UID: \"231145e0-7b08-4465-ae64-2da3aaee4529\") " pod="openshift-ingress/e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr"
Sep 10 05:00:41.851013 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:41.850933    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/231145e0-7b08-4465-ae64-2da3aaee4529-workload-socket\") pod \"e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr\" (UID: \"231145e0-7b08-4465-ae64-2da3aaee4529\") " pod="openshift-ingress/e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr"
Sep 10 05:00:41.851013 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:41.850984    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/231145e0-7b08-4465-ae64-2da3aaee4529-istio-envoy\") pod \"e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr\" (UID: \"231145e0-7b08-4465-ae64-2da3aaee4529\") " pod="openshift-ingress/e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr"
Sep 10 05:00:41.851161 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:41.851040    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/231145e0-7b08-4465-ae64-2da3aaee4529-workload-certs\") pod \"e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr\" (UID: \"231145e0-7b08-4465-ae64-2da3aaee4529\") " pod="openshift-ingress/e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr"
Sep 10 05:00:41.851161 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:41.851114    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/231145e0-7b08-4465-ae64-2da3aaee4529-credential-socket\") pod \"e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr\" (UID: \"231145e0-7b08-4465-ae64-2da3aaee4529\") " pod="openshift-ingress/e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr"
Sep 10 05:00:41.851227 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:41.851178    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/231145e0-7b08-4465-ae64-2da3aaee4529-istiod-ca-cert\") pod \"e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr\" (UID: \"231145e0-7b08-4465-ae64-2da3aaee4529\") " pod="openshift-ingress/e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr"
Sep 10 05:00:41.851262 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:41.851245    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/231145e0-7b08-4465-ae64-2da3aaee4529-istio-podinfo\") pod \"e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr\" (UID: \"231145e0-7b08-4465-ae64-2da3aaee4529\") " pod="openshift-ingress/e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr"
Sep 10 05:00:41.952109 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:41.952075    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/231145e0-7b08-4465-ae64-2da3aaee4529-workload-certs\") pod \"e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr\" (UID: \"231145e0-7b08-4465-ae64-2da3aaee4529\") " pod="openshift-ingress/e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr"
Sep 10 05:00:41.952275 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:41.952138    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/231145e0-7b08-4465-ae64-2da3aaee4529-credential-socket\") pod \"e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr\" (UID: \"231145e0-7b08-4465-ae64-2da3aaee4529\") " pod="openshift-ingress/e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr"
Sep 10 05:00:41.952275 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:41.952171    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/231145e0-7b08-4465-ae64-2da3aaee4529-istiod-ca-cert\") pod \"e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr\" (UID: \"231145e0-7b08-4465-ae64-2da3aaee4529\") " pod="openshift-ingress/e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr"
Sep 10 05:00:41.952275 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:41.952215    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/231145e0-7b08-4465-ae64-2da3aaee4529-istio-podinfo\") pod \"e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr\" (UID: \"231145e0-7b08-4465-ae64-2da3aaee4529\") " pod="openshift-ingress/e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr"
Sep 10 05:00:41.952399 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:41.952351    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/231145e0-7b08-4465-ae64-2da3aaee4529-istio-token\") pod \"e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr\" (UID: \"231145e0-7b08-4465-ae64-2da3aaee4529\") " pod="openshift-ingress/e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr"
Sep 10 05:00:41.952459 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:41.952408    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjlx4\" (UniqueName: \"kubernetes.io/projected/231145e0-7b08-4465-ae64-2da3aaee4529-kube-api-access-wjlx4\") pod \"e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr\" (UID: \"231145e0-7b08-4465-ae64-2da3aaee4529\") " pod="openshift-ingress/e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr"
Sep 10 05:00:41.952509 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:41.952476    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/231145e0-7b08-4465-ae64-2da3aaee4529-istio-data\") pod \"e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr\" (UID: \"231145e0-7b08-4465-ae64-2da3aaee4529\") " pod="openshift-ingress/e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr"
Sep 10 05:00:41.952559 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:41.952516    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/231145e0-7b08-4465-ae64-2da3aaee4529-workload-socket\") pod \"e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr\" (UID: \"231145e0-7b08-4465-ae64-2da3aaee4529\") " pod="openshift-ingress/e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr"
Sep 10 05:00:41.952559 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:41.952547    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/231145e0-7b08-4465-ae64-2da3aaee4529-istio-envoy\") pod \"e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr\" (UID: \"231145e0-7b08-4465-ae64-2da3aaee4529\") " pod="openshift-ingress/e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr"
Sep 10 05:00:41.952663 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:41.952572    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/231145e0-7b08-4465-ae64-2da3aaee4529-credential-socket\") pod \"e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr\" (UID: \"231145e0-7b08-4465-ae64-2da3aaee4529\") " pod="openshift-ingress/e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr"
Sep 10 05:00:41.952663 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:41.952516    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/231145e0-7b08-4465-ae64-2da3aaee4529-workload-certs\") pod \"e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr\" (UID: \"231145e0-7b08-4465-ae64-2da3aaee4529\") " pod="openshift-ingress/e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr"
Sep 10 05:00:41.952766 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:41.952743    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/231145e0-7b08-4465-ae64-2da3aaee4529-istio-data\") pod \"e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr\" (UID: \"231145e0-7b08-4465-ae64-2da3aaee4529\") " pod="openshift-ingress/e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr"
Sep 10 05:00:41.952875 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:41.952842    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/231145e0-7b08-4465-ae64-2da3aaee4529-istiod-ca-cert\") pod \"e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr\" (UID: \"231145e0-7b08-4465-ae64-2da3aaee4529\") " pod="openshift-ingress/e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr"
Sep 10 05:00:41.952919 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:41.952884    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/231145e0-7b08-4465-ae64-2da3aaee4529-workload-socket\") pod \"e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr\" (UID: \"231145e0-7b08-4465-ae64-2da3aaee4529\") " pod="openshift-ingress/e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr"
Sep 10 05:00:41.954699 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:41.954679    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/231145e0-7b08-4465-ae64-2da3aaee4529-istio-envoy\") pod \"e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr\" (UID: \"231145e0-7b08-4465-ae64-2da3aaee4529\") " pod="openshift-ingress/e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr"
Sep 10 05:00:41.954785 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:41.954764    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/231145e0-7b08-4465-ae64-2da3aaee4529-istio-podinfo\") pod \"e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr\" (UID: \"231145e0-7b08-4465-ae64-2da3aaee4529\") " pod="openshift-ingress/e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr"
Sep 10 05:00:41.959496 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:41.959474    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/231145e0-7b08-4465-ae64-2da3aaee4529-istio-token\") pod \"e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr\" (UID: \"231145e0-7b08-4465-ae64-2da3aaee4529\") " pod="openshift-ingress/e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr"
Sep 10 05:00:41.959603 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:41.959567    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjlx4\" (UniqueName: \"kubernetes.io/projected/231145e0-7b08-4465-ae64-2da3aaee4529-kube-api-access-wjlx4\") pod \"e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr\" (UID: \"231145e0-7b08-4465-ae64-2da3aaee4529\") " pod="openshift-ingress/e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr"
Sep 10 05:00:42.111951 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:42.111825    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr"
Sep 10 05:00:42.375743 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:42.375709    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4" event={"ID":"deb10655-be47-4f62-97f8-82ddddf7d3a7","Type":"ContainerStarted","Data":"029ee704f8ad3dc74e86b681a23c45ea3a47bb19fff0e83932cd57afa2218aff"}
Sep 10 05:00:42.422142 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:42.422108    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr"]
Sep 10 05:00:42.422267 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:42.422219    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4"
Sep 10 05:00:42.423266 ip-10-0-138-27 kubenswrapper[2560]: W0910 05:00:42.423233    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod231145e0_7b08_4465_ae64_2da3aaee4529.slice/crio-e002540d53aee91d954ae63179097890e6c71a44d3523e415afce66ea80081e1 WatchSource:0}: Error finding container e002540d53aee91d954ae63179097890e6c71a44d3523e415afce66ea80081e1: Status 404 returned error can't find the container with id e002540d53aee91d954ae63179097890e6c71a44d3523e415afce66ea80081e1
Sep 10 05:00:42.423555 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:42.423522    2560 patch_prober.go:28] interesting pod/e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Sep 10 05:00:42.423659 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:42.423576    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4" podUID="deb10655-be47-4f62-97f8-82ddddf7d3a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Sep 10 05:00:42.425869 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:42.425822    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 05:00:42.425968 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:42.425940    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 05:00:42.426034 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:42.425993    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 05:00:43.383694 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:43.383661    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr" event={"ID":"231145e0-7b08-4465-ae64-2da3aaee4529","Type":"ContainerStarted","Data":"7c410bc117d2fb9f339cee0d1f55f372444911f1da5b5964dafef9edead2db3c"}
Sep 10 05:00:43.384311 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:43.384285    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr" event={"ID":"231145e0-7b08-4465-ae64-2da3aaee4529","Type":"ContainerStarted","Data":"e002540d53aee91d954ae63179097890e6c71a44d3523e415afce66ea80081e1"}
Sep 10 05:00:43.404341 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:43.404288    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr" podStartSLOduration=2.404272 podStartE2EDuration="2.404272s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 05:00:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 05:00:43.401347638 +0000 UTC m=+1183.063805386" watchObservedRunningTime="2026-09-10 05:00:43.404272 +0000 UTC m=+1183.066729746"
Sep 10 05:00:43.422645 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:43.422612    2560 patch_prober.go:28] interesting pod/e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Sep 10 05:00:43.422774 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:43.422661    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4" podUID="deb10655-be47-4f62-97f8-82ddddf7d3a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Sep 10 05:00:44.112893 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:44.112830    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr"
Sep 10 05:00:44.118423 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:44.118397    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr"
Sep 10 05:00:44.389747 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:44.389723    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr"
Sep 10 05:00:44.390782 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:44.390761    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr"
Sep 10 05:00:44.422163 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:44.422128    2560 patch_prober.go:28] interesting pod/e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Sep 10 05:00:44.422316 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:44.422194    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4" podUID="deb10655-be47-4f62-97f8-82ddddf7d3a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Sep 10 05:00:45.193235 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:45.193202    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4"
Sep 10 05:00:45.422419 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:45.422375    2560 patch_prober.go:28] interesting pod/e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Sep 10 05:00:45.422818 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:45.422444    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4" podUID="deb10655-be47-4f62-97f8-82ddddf7d3a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Sep 10 05:00:46.422410 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:46.422371    2560 patch_prober.go:28] interesting pod/e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Sep 10 05:00:46.422608 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:46.422450    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4" podUID="deb10655-be47-4f62-97f8-82ddddf7d3a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Sep 10 05:00:46.516720 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:46.516680    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-97ffde-6845fd6ff6-l86v9"]
Sep 10 05:00:46.519622 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:46.519601    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-97ffde-6845fd6ff6-l86v9"
Sep 10 05:00:46.521767 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:46.521742    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-97ffde-serving-cert\""
Sep 10 05:00:46.530320 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:46.530298    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-97ffde-6845fd6ff6-l86v9"]
Sep 10 05:00:46.606561 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:46.606530    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e7487ffa-b740-459e-9023-1aaf7437bbe8-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-97ffde-6845fd6ff6-l86v9\" (UID: \"e7487ffa-b740-459e-9023-1aaf7437bbe8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-97ffde-6845fd6ff6-l86v9"
Sep 10 05:00:46.606727 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:46.606593    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7487ffa-b740-459e-9023-1aaf7437bbe8-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-97ffde-6845fd6ff6-l86v9\" (UID: \"e7487ffa-b740-459e-9023-1aaf7437bbe8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-97ffde-6845fd6ff6-l86v9"
Sep 10 05:00:46.606727 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:46.606663    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7487ffa-b740-459e-9023-1aaf7437bbe8-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-97ffde-6845fd6ff6-l86v9\" (UID: \"e7487ffa-b740-459e-9023-1aaf7437bbe8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-97ffde-6845fd6ff6-l86v9"
Sep 10 05:00:46.606806 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:46.606727    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gf9qr\" (UniqueName: \"kubernetes.io/projected/e7487ffa-b740-459e-9023-1aaf7437bbe8-kube-api-access-gf9qr\") pod \"maas-api-e2e-shared-b-w2-97ffde-6845fd6ff6-l86v9\" (UID: \"e7487ffa-b740-459e-9023-1aaf7437bbe8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-97ffde-6845fd6ff6-l86v9"
Sep 10 05:00:46.708084 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:46.707987    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7487ffa-b740-459e-9023-1aaf7437bbe8-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-97ffde-6845fd6ff6-l86v9\" (UID: \"e7487ffa-b740-459e-9023-1aaf7437bbe8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-97ffde-6845fd6ff6-l86v9"
Sep 10 05:00:46.708084 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:46.708080    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gf9qr\" (UniqueName: \"kubernetes.io/projected/e7487ffa-b740-459e-9023-1aaf7437bbe8-kube-api-access-gf9qr\") pod \"maas-api-e2e-shared-b-w2-97ffde-6845fd6ff6-l86v9\" (UID: \"e7487ffa-b740-459e-9023-1aaf7437bbe8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-97ffde-6845fd6ff6-l86v9"
Sep 10 05:00:46.708271 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:46.708117    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e7487ffa-b740-459e-9023-1aaf7437bbe8-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-97ffde-6845fd6ff6-l86v9\" (UID: \"e7487ffa-b740-459e-9023-1aaf7437bbe8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-97ffde-6845fd6ff6-l86v9"
Sep 10 05:00:46.708271 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:46.708261    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7487ffa-b740-459e-9023-1aaf7437bbe8-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-97ffde-6845fd6ff6-l86v9\" (UID: \"e7487ffa-b740-459e-9023-1aaf7437bbe8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-97ffde-6845fd6ff6-l86v9"
Sep 10 05:00:46.708524 ip-10-0-138-27 kubenswrapper[2560]: E0910 05:00:46.708503    2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-97ffde-serving-cert: secret "maas-api-e2e-shared-b-w2-97ffde-serving-cert" not found
Sep 10 05:00:46.708601 ip-10-0-138-27 kubenswrapper[2560]: E0910 05:00:46.708590    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7487ffa-b740-459e-9023-1aaf7437bbe8-maas-api-tls podName:e7487ffa-b740-459e-9023-1aaf7437bbe8 nodeName:}" failed. No retries permitted until 2026-09-10 05:00:47.208570543 +0000 UTC m=+1186.871028285 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e7487ffa-b740-459e-9023-1aaf7437bbe8-maas-api-tls") pod "maas-api-e2e-shared-b-w2-97ffde-6845fd6ff6-l86v9" (UID: "e7487ffa-b740-459e-9023-1aaf7437bbe8") : secret "maas-api-e2e-shared-b-w2-97ffde-serving-cert" not found
Sep 10 05:00:46.708675 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:46.708653    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7487ffa-b740-459e-9023-1aaf7437bbe8-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-97ffde-6845fd6ff6-l86v9\" (UID: \"e7487ffa-b740-459e-9023-1aaf7437bbe8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-97ffde-6845fd6ff6-l86v9"
Sep 10 05:00:46.712621 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:46.712600    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7487ffa-b740-459e-9023-1aaf7437bbe8-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-97ffde-6845fd6ff6-l86v9\" (UID: \"e7487ffa-b740-459e-9023-1aaf7437bbe8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-97ffde-6845fd6ff6-l86v9"
Sep 10 05:00:46.717804 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:46.717776    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gf9qr\" (UniqueName: \"kubernetes.io/projected/e7487ffa-b740-459e-9023-1aaf7437bbe8-kube-api-access-gf9qr\") pod \"maas-api-e2e-shared-b-w2-97ffde-6845fd6ff6-l86v9\" (UID: \"e7487ffa-b740-459e-9023-1aaf7437bbe8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-97ffde-6845fd6ff6-l86v9"
Sep 10 05:00:47.225268 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:47.225220    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e7487ffa-b740-459e-9023-1aaf7437bbe8-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-97ffde-6845fd6ff6-l86v9\" (UID: \"e7487ffa-b740-459e-9023-1aaf7437bbe8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-97ffde-6845fd6ff6-l86v9"
Sep 10 05:00:47.227732 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:47.227706    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e7487ffa-b740-459e-9023-1aaf7437bbe8-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-97ffde-6845fd6ff6-l86v9\" (UID: \"e7487ffa-b740-459e-9023-1aaf7437bbe8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-97ffde-6845fd6ff6-l86v9"
Sep 10 05:00:47.422616 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:47.422582    2560 patch_prober.go:28] interesting pod/e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Sep 10 05:00:47.423057 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:47.422636    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4" podUID="deb10655-be47-4f62-97f8-82ddddf7d3a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Sep 10 05:00:47.432906 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:47.432883    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-97ffde-6845fd6ff6-l86v9"
Sep 10 05:00:47.735097 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:47.735069    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-97ffde-6845fd6ff6-l86v9"]
Sep 10 05:00:47.736874 ip-10-0-138-27 kubenswrapper[2560]: W0910 05:00:47.736828    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7487ffa_b740_459e_9023_1aaf7437bbe8.slice/crio-db81ec102aeee6b8adad31d7098d50d290479b2d54ee1afd7faa561e5a2aa452 WatchSource:0}: Error finding container db81ec102aeee6b8adad31d7098d50d290479b2d54ee1afd7faa561e5a2aa452: Status 404 returned error can't find the container with id db81ec102aeee6b8adad31d7098d50d290479b2d54ee1afd7faa561e5a2aa452
Sep 10 05:00:47.872636 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:47.872607    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-noten-3e5c28/noten-model-3e5c28-kserve-bc6bc4947-dz92d"]
Sep 10 05:00:48.423495 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:48.423453    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-97ffde-6845fd6ff6-l86v9" event={"ID":"e7487ffa-b740-459e-9023-1aaf7437bbe8","Type":"ContainerStarted","Data":"db81ec102aeee6b8adad31d7098d50d290479b2d54ee1afd7faa561e5a2aa452"}
Sep 10 05:00:48.426062 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:48.426028    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4"
Sep 10 05:00:48.427381 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:48.427363    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4"
Sep 10 05:00:49.431336 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:49.431305    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-97ffde-6845fd6ff6-l86v9" event={"ID":"e7487ffa-b740-459e-9023-1aaf7437bbe8","Type":"ContainerStarted","Data":"4d76755a25ee59df3140ff580ff35a137a9f0b8dda100125acedc95978d7bd2b"}
Sep 10 05:00:49.431741 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:49.431500    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-97ffde-6845fd6ff6-l86v9"
Sep 10 05:00:49.447220 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:49.447176    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-97ffde-6845fd6ff6-l86v9" podStartSLOduration=2.369992364 podStartE2EDuration="3.447160439s" totalImagesPullingTime="1.077168075s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 05:00:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 05:00:49.446751101 +0000 UTC m=+1189.109208849" watchObservedRunningTime="2026-09-10 05:00:49.447160439 +0000 UTC m=+1189.109618185"
Sep 10 05:00:50.885915 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:50.885874    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-f3cc69-6bb7995f88-fkfnd"]
Sep 10 05:00:50.886348 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:50.886155    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f3cc69-6bb7995f88-fkfnd" podUID="4b7a8b05-05bf-4c07-97a5-e7f20f687eee" containerName="maas-api" containerID="cri-o://c535e01867f03fa893d11699493e1003f5b6c677a5ebcf5287ef786511d68243" gracePeriod=30
Sep 10 05:00:50.913091 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:50.913058    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-f3cc69-29816940-9dbph"]
Sep 10 05:00:50.916170 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:50.916145    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-f3cc69-29816940-9dbph"]
Sep 10 05:00:51.156501 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:51.156476    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f3cc69-6bb7995f88-fkfnd"
Sep 10 05:00:51.270876 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:51.270832    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b7a8b05-05bf-4c07-97a5-e7f20f687eee-openshift-service-ca\") pod \"4b7a8b05-05bf-4c07-97a5-e7f20f687eee\" (UID: \"4b7a8b05-05bf-4c07-97a5-e7f20f687eee\") "
Sep 10 05:00:51.271063 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:51.270900    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b7a8b05-05bf-4c07-97a5-e7f20f687eee-maas-api-tls\") pod \"4b7a8b05-05bf-4c07-97a5-e7f20f687eee\" (UID: \"4b7a8b05-05bf-4c07-97a5-e7f20f687eee\") "
Sep 10 05:00:51.271063 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:51.270941    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-58ktf\" (UniqueName: \"kubernetes.io/projected/4b7a8b05-05bf-4c07-97a5-e7f20f687eee-kube-api-access-58ktf\") pod \"4b7a8b05-05bf-4c07-97a5-e7f20f687eee\" (UID: \"4b7a8b05-05bf-4c07-97a5-e7f20f687eee\") "
Sep 10 05:00:51.271189 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:51.271069    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b7a8b05-05bf-4c07-97a5-e7f20f687eee-metrics-certs\") pod \"4b7a8b05-05bf-4c07-97a5-e7f20f687eee\" (UID: \"4b7a8b05-05bf-4c07-97a5-e7f20f687eee\") "
Sep 10 05:00:51.271283 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:51.271254    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b7a8b05-05bf-4c07-97a5-e7f20f687eee-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4b7a8b05-05bf-4c07-97a5-e7f20f687eee" (UID: "4b7a8b05-05bf-4c07-97a5-e7f20f687eee"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 05:00:51.271418 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:51.271401    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b7a8b05-05bf-4c07-97a5-e7f20f687eee-openshift-service-ca\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:00:51.273085 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:51.273056    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b7a8b05-05bf-4c07-97a5-e7f20f687eee-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4b7a8b05-05bf-4c07-97a5-e7f20f687eee" (UID: "4b7a8b05-05bf-4c07-97a5-e7f20f687eee"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 05:00:51.273230 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:51.273125    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b7a8b05-05bf-4c07-97a5-e7f20f687eee-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "4b7a8b05-05bf-4c07-97a5-e7f20f687eee" (UID: "4b7a8b05-05bf-4c07-97a5-e7f20f687eee"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 05:00:51.273230 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:51.273147    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b7a8b05-05bf-4c07-97a5-e7f20f687eee-kube-api-access-58ktf" (OuterVolumeSpecName: "kube-api-access-58ktf") pod "4b7a8b05-05bf-4c07-97a5-e7f20f687eee" (UID: "4b7a8b05-05bf-4c07-97a5-e7f20f687eee"). InnerVolumeSpecName "kube-api-access-58ktf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 05:00:51.372168 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:51.372129    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b7a8b05-05bf-4c07-97a5-e7f20f687eee-maas-api-tls\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:00:51.372168 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:51.372161    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-58ktf\" (UniqueName: \"kubernetes.io/projected/4b7a8b05-05bf-4c07-97a5-e7f20f687eee-kube-api-access-58ktf\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:00:51.372168 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:51.372176    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b7a8b05-05bf-4c07-97a5-e7f20f687eee-metrics-certs\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:00:51.445465 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:51.445382    2560 generic.go:356] "Generic (PLEG): container finished" podID="4b7a8b05-05bf-4c07-97a5-e7f20f687eee" containerID="c535e01867f03fa893d11699493e1003f5b6c677a5ebcf5287ef786511d68243" exitCode=0
Sep 10 05:00:51.445465 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:51.445424    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f3cc69-6bb7995f88-fkfnd"
Sep 10 05:00:51.445638 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:51.445467    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f3cc69-6bb7995f88-fkfnd" event={"ID":"4b7a8b05-05bf-4c07-97a5-e7f20f687eee","Type":"ContainerDied","Data":"c535e01867f03fa893d11699493e1003f5b6c677a5ebcf5287ef786511d68243"}
Sep 10 05:00:51.445638 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:51.445521    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-f3cc69-6bb7995f88-fkfnd" event={"ID":"4b7a8b05-05bf-4c07-97a5-e7f20f687eee","Type":"ContainerDied","Data":"7cab1dee6027b8ecff3763312481a267bdd78f4104d93555c81d7721a74faa5a"}
Sep 10 05:00:51.445638 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:51.445548    2560 scope.go:117] "RemoveContainer" containerID="c535e01867f03fa893d11699493e1003f5b6c677a5ebcf5287ef786511d68243"
Sep 10 05:00:51.456060 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:51.456043    2560 scope.go:117] "RemoveContainer" containerID="c535e01867f03fa893d11699493e1003f5b6c677a5ebcf5287ef786511d68243"
Sep 10 05:00:51.456355 ip-10-0-138-27 kubenswrapper[2560]: E0910 05:00:51.456335    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c535e01867f03fa893d11699493e1003f5b6c677a5ebcf5287ef786511d68243\": container with ID starting with c535e01867f03fa893d11699493e1003f5b6c677a5ebcf5287ef786511d68243 not found: ID does not exist" containerID="c535e01867f03fa893d11699493e1003f5b6c677a5ebcf5287ef786511d68243"
Sep 10 05:00:51.456406 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:51.456364    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c535e01867f03fa893d11699493e1003f5b6c677a5ebcf5287ef786511d68243"} err="failed to get container status \"c535e01867f03fa893d11699493e1003f5b6c677a5ebcf5287ef786511d68243\": rpc error: code = NotFound desc = could not find container \"c535e01867f03fa893d11699493e1003f5b6c677a5ebcf5287ef786511d68243\": container with ID starting with c535e01867f03fa893d11699493e1003f5b6c677a5ebcf5287ef786511d68243 not found: ID does not exist"
Sep 10 05:00:51.466560 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:51.466536    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-f3cc69-6bb7995f88-fkfnd"]
Sep 10 05:00:51.470542 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:51.470519    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-f3cc69-6bb7995f88-fkfnd"]
Sep 10 05:00:52.825692 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:52.825651    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b7a8b05-05bf-4c07-97a5-e7f20f687eee" path="/var/lib/kubelet/pods/4b7a8b05-05bf-4c07-97a5-e7f20f687eee/volumes"
Sep 10 05:00:52.826181 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:52.826119    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5742921b-9510-4804-9a19-2899bb2fec1c" path="/var/lib/kubelet/pods/5742921b-9510-4804-9a19-2899bb2fec1c/volumes"
Sep 10 05:00:55.444490 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:55.444464    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-97ffde-6845fd6ff6-l86v9"
Sep 10 05:00:57.383169 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:57.383134    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj"]
Sep 10 05:00:57.383533 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:00:57.383428    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj" podUID="36df3522-93d4-4e24-80c4-68752d6e395d" containerName="istio-proxy" containerID="cri-o://7e3372a2f29721d3944a4e84f3a3877a0dfaaf59246d8e2d269c54ed81b43403" gracePeriod=30
Sep 10 05:01:00.910674 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:00.910645    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-p5zjp_8b3ec8dc-1508-4537-8dc3-b9de1ff22d03/console-operator/1.log"
Sep 10 05:01:00.911065 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:00.910871    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-p5zjp_8b3ec8dc-1508-4537-8dc3-b9de1ff22d03/console-operator/1.log"
Sep 10 05:01:02.201261 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:02.201225    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 05:01:02.277512 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:02.277473    2560 patch_prober.go:28] interesting pod/e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 05:01:02.277696 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:02.277537    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj" podUID="36df3522-93d4-4e24-80c4-68752d6e395d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 05:01:02.343184 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:02.343149    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-c9a840/test-model-c9a840-kserve-8479f68cf-b5b6v"]
Sep 10 05:01:02.525370 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:02.525341    2560 generic.go:356] "Generic (PLEG): container finished" podID="36df3522-93d4-4e24-80c4-68752d6e395d" containerID="7e3372a2f29721d3944a4e84f3a3877a0dfaaf59246d8e2d269c54ed81b43403" exitCode=0
Sep 10 05:01:02.525537 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:02.525412    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj" event={"ID":"36df3522-93d4-4e24-80c4-68752d6e395d","Type":"ContainerDied","Data":"7e3372a2f29721d3944a4e84f3a3877a0dfaaf59246d8e2d269c54ed81b43403"}
Sep 10 05:01:02.525537 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:02.525473    2560 scope.go:117] "RemoveContainer" containerID="2f4587f8bcf737c5fa7bd835f545210ae4ba4904f1b9710a6add1e27603db557"
Sep 10 05:01:02.649091 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:02.649067    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj"
Sep 10 05:01:02.680822 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:02.680795    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36df3522-93d4-4e24-80c4-68752d6e395d-istio-podinfo\") pod \"36df3522-93d4-4e24-80c4-68752d6e395d\" (UID: \"36df3522-93d4-4e24-80c4-68752d6e395d\") "
Sep 10 05:01:02.681007 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:02.680845    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36df3522-93d4-4e24-80c4-68752d6e395d-credential-socket\") pod \"36df3522-93d4-4e24-80c4-68752d6e395d\" (UID: \"36df3522-93d4-4e24-80c4-68752d6e395d\") "
Sep 10 05:01:02.681007 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:02.680882    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36df3522-93d4-4e24-80c4-68752d6e395d-workload-certs\") pod \"36df3522-93d4-4e24-80c4-68752d6e395d\" (UID: \"36df3522-93d4-4e24-80c4-68752d6e395d\") "
Sep 10 05:01:02.681139 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:02.681051    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36df3522-93d4-4e24-80c4-68752d6e395d-istio-envoy\") pod \"36df3522-93d4-4e24-80c4-68752d6e395d\" (UID: \"36df3522-93d4-4e24-80c4-68752d6e395d\") "
Sep 10 05:01:02.681139 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:02.681106    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zlf6h\" (UniqueName: \"kubernetes.io/projected/36df3522-93d4-4e24-80c4-68752d6e395d-kube-api-access-zlf6h\") pod \"36df3522-93d4-4e24-80c4-68752d6e395d\" (UID: \"36df3522-93d4-4e24-80c4-68752d6e395d\") "
Sep 10 05:01:02.681139 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:02.681114    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36df3522-93d4-4e24-80c4-68752d6e395d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "36df3522-93d4-4e24-80c4-68752d6e395d" (UID: "36df3522-93d4-4e24-80c4-68752d6e395d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 05:01:02.681139 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:02.681129    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36df3522-93d4-4e24-80c4-68752d6e395d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "36df3522-93d4-4e24-80c4-68752d6e395d" (UID: "36df3522-93d4-4e24-80c4-68752d6e395d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 05:01:02.681351 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:02.681147    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36df3522-93d4-4e24-80c4-68752d6e395d-istio-token\") pod \"36df3522-93d4-4e24-80c4-68752d6e395d\" (UID: \"36df3522-93d4-4e24-80c4-68752d6e395d\") "
Sep 10 05:01:02.681351 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:02.681180    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36df3522-93d4-4e24-80c4-68752d6e395d-workload-socket\") pod \"36df3522-93d4-4e24-80c4-68752d6e395d\" (UID: \"36df3522-93d4-4e24-80c4-68752d6e395d\") "
Sep 10 05:01:02.681351 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:02.681210    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36df3522-93d4-4e24-80c4-68752d6e395d-istiod-ca-cert\") pod \"36df3522-93d4-4e24-80c4-68752d6e395d\" (UID: \"36df3522-93d4-4e24-80c4-68752d6e395d\") "
Sep 10 05:01:02.681351 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:02.681236    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36df3522-93d4-4e24-80c4-68752d6e395d-istio-data\") pod \"36df3522-93d4-4e24-80c4-68752d6e395d\" (UID: \"36df3522-93d4-4e24-80c4-68752d6e395d\") "
Sep 10 05:01:02.681565 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:02.681472    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36df3522-93d4-4e24-80c4-68752d6e395d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "36df3522-93d4-4e24-80c4-68752d6e395d" (UID: "36df3522-93d4-4e24-80c4-68752d6e395d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 05:01:02.681565 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:02.681545    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36df3522-93d4-4e24-80c4-68752d6e395d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "36df3522-93d4-4e24-80c4-68752d6e395d" (UID: "36df3522-93d4-4e24-80c4-68752d6e395d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 05:01:02.681675 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:02.681640    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36df3522-93d4-4e24-80c4-68752d6e395d-workload-socket\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:01:02.681675 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:02.681658    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36df3522-93d4-4e24-80c4-68752d6e395d-credential-socket\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:01:02.681675 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:02.681659    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36df3522-93d4-4e24-80c4-68752d6e395d-istio-data" (OuterVolumeSpecName: "istio-data") pod "36df3522-93d4-4e24-80c4-68752d6e395d" (UID: "36df3522-93d4-4e24-80c4-68752d6e395d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 05:01:02.681675 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:02.681674    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36df3522-93d4-4e24-80c4-68752d6e395d-workload-certs\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:01:02.683393 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:02.683372    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/36df3522-93d4-4e24-80c4-68752d6e395d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "36df3522-93d4-4e24-80c4-68752d6e395d" (UID: "36df3522-93d4-4e24-80c4-68752d6e395d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 05:01:02.683693 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:02.683669    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36df3522-93d4-4e24-80c4-68752d6e395d-istio-token" (OuterVolumeSpecName: "istio-token") pod "36df3522-93d4-4e24-80c4-68752d6e395d" (UID: "36df3522-93d4-4e24-80c4-68752d6e395d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 05:01:02.683769 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:02.683699    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36df3522-93d4-4e24-80c4-68752d6e395d-kube-api-access-zlf6h" (OuterVolumeSpecName: "kube-api-access-zlf6h") pod "36df3522-93d4-4e24-80c4-68752d6e395d" (UID: "36df3522-93d4-4e24-80c4-68752d6e395d"). InnerVolumeSpecName "kube-api-access-zlf6h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 05:01:02.683818 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:02.683767    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36df3522-93d4-4e24-80c4-68752d6e395d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "36df3522-93d4-4e24-80c4-68752d6e395d" (UID: "36df3522-93d4-4e24-80c4-68752d6e395d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 05:01:02.782685 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:02.782610    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36df3522-93d4-4e24-80c4-68752d6e395d-istio-envoy\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:01:02.782685 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:02.782635    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zlf6h\" (UniqueName: \"kubernetes.io/projected/36df3522-93d4-4e24-80c4-68752d6e395d-kube-api-access-zlf6h\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:01:02.782685 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:02.782647    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36df3522-93d4-4e24-80c4-68752d6e395d-istio-token\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:01:02.782685 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:02.782656    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36df3522-93d4-4e24-80c4-68752d6e395d-istiod-ca-cert\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:01:02.782685 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:02.782663    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36df3522-93d4-4e24-80c4-68752d6e395d-istio-data\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:01:02.782685 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:02.782672    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36df3522-93d4-4e24-80c4-68752d6e395d-istio-podinfo\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:01:02.892674 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:02.892622    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-noten-3e5c28/noten-model-3e5c28-kserve-bc6bc4947-dz92d" podUID="89bc5505-7be7-4fad-b85b-746df06d7ead" containerName="main" containerID="cri-o://5243bc17f0fdf0c2198ff74a520b6fa86346c7bc559b72578f47c9dc8095ea06" gracePeriod=45
Sep 10 05:01:03.140181 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:03.140154    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-3e5c28/noten-model-3e5c28-kserve-bc6bc4947-dz92d"
Sep 10 05:01:03.187197 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:03.187164    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/89bc5505-7be7-4fad-b85b-746df06d7ead-model-cache\") pod \"89bc5505-7be7-4fad-b85b-746df06d7ead\" (UID: \"89bc5505-7be7-4fad-b85b-746df06d7ead\") "
Sep 10 05:01:03.187389 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:03.187217    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/89bc5505-7be7-4fad-b85b-746df06d7ead-dshm\") pod \"89bc5505-7be7-4fad-b85b-746df06d7ead\" (UID: \"89bc5505-7be7-4fad-b85b-746df06d7ead\") "
Sep 10 05:01:03.187389 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:03.187255    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/89bc5505-7be7-4fad-b85b-746df06d7ead-home\") pod \"89bc5505-7be7-4fad-b85b-746df06d7ead\" (UID: \"89bc5505-7be7-4fad-b85b-746df06d7ead\") "
Sep 10 05:01:03.187389 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:03.187312    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/89bc5505-7be7-4fad-b85b-746df06d7ead-tmp-dir\") pod \"89bc5505-7be7-4fad-b85b-746df06d7ead\" (UID: \"89bc5505-7be7-4fad-b85b-746df06d7ead\") "
Sep 10 05:01:03.187389 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:03.187346    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rsnw2\" (UniqueName: \"kubernetes.io/projected/89bc5505-7be7-4fad-b85b-746df06d7ead-kube-api-access-rsnw2\") pod \"89bc5505-7be7-4fad-b85b-746df06d7ead\" (UID: \"89bc5505-7be7-4fad-b85b-746df06d7ead\") "
Sep 10 05:01:03.187628 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:03.187406    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/89bc5505-7be7-4fad-b85b-746df06d7ead-tls-certs\") pod \"89bc5505-7be7-4fad-b85b-746df06d7ead\" (UID: \"89bc5505-7be7-4fad-b85b-746df06d7ead\") "
Sep 10 05:01:03.187628 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:03.187449    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89bc5505-7be7-4fad-b85b-746df06d7ead-model-cache" (OuterVolumeSpecName: "model-cache") pod "89bc5505-7be7-4fad-b85b-746df06d7ead" (UID: "89bc5505-7be7-4fad-b85b-746df06d7ead"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 05:01:03.187717 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:03.187641    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/89bc5505-7be7-4fad-b85b-746df06d7ead-model-cache\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:01:03.187717 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:03.187659    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89bc5505-7be7-4fad-b85b-746df06d7ead-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "89bc5505-7be7-4fad-b85b-746df06d7ead" (UID: "89bc5505-7be7-4fad-b85b-746df06d7ead"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 05:01:03.187803 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:03.187721    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89bc5505-7be7-4fad-b85b-746df06d7ead-home" (OuterVolumeSpecName: "home") pod "89bc5505-7be7-4fad-b85b-746df06d7ead" (UID: "89bc5505-7be7-4fad-b85b-746df06d7ead"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 05:01:03.189730 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:03.189698    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89bc5505-7be7-4fad-b85b-746df06d7ead-kube-api-access-rsnw2" (OuterVolumeSpecName: "kube-api-access-rsnw2") pod "89bc5505-7be7-4fad-b85b-746df06d7ead" (UID: "89bc5505-7be7-4fad-b85b-746df06d7ead"). InnerVolumeSpecName "kube-api-access-rsnw2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 05:01:03.189862 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:03.189739    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89bc5505-7be7-4fad-b85b-746df06d7ead-dshm" (OuterVolumeSpecName: "dshm") pod "89bc5505-7be7-4fad-b85b-746df06d7ead" (UID: "89bc5505-7be7-4fad-b85b-746df06d7ead"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 05:01:03.189862 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:03.189742    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89bc5505-7be7-4fad-b85b-746df06d7ead-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "89bc5505-7be7-4fad-b85b-746df06d7ead" (UID: "89bc5505-7be7-4fad-b85b-746df06d7ead"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 05:01:03.289135 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:03.289101    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/89bc5505-7be7-4fad-b85b-746df06d7ead-tmp-dir\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:01:03.289135 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:03.289130    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rsnw2\" (UniqueName: \"kubernetes.io/projected/89bc5505-7be7-4fad-b85b-746df06d7ead-kube-api-access-rsnw2\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:01:03.289135 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:03.289141    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/89bc5505-7be7-4fad-b85b-746df06d7ead-tls-certs\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:01:03.289570 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:03.289148    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/89bc5505-7be7-4fad-b85b-746df06d7ead-dshm\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:01:03.289570 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:03.289156    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/89bc5505-7be7-4fad-b85b-746df06d7ead-home\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:01:03.532823 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:03.532795    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj"
Sep 10 05:01:03.533025 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:03.532828    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj" event={"ID":"36df3522-93d4-4e24-80c4-68752d6e395d","Type":"ContainerDied","Data":"e5d8ecbd5db100fab01ea88ecd24bb16d6b98e64941a1a648b760ef70077b306"}
Sep 10 05:01:03.533025 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:03.532903    2560 scope.go:117] "RemoveContainer" containerID="7e3372a2f29721d3944a4e84f3a3877a0dfaaf59246d8e2d269c54ed81b43403"
Sep 10 05:01:03.534460 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:03.534424    2560 generic.go:356] "Generic (PLEG): container finished" podID="89bc5505-7be7-4fad-b85b-746df06d7ead" containerID="5243bc17f0fdf0c2198ff74a520b6fa86346c7bc559b72578f47c9dc8095ea06" exitCode=0
Sep 10 05:01:03.534569 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:03.534469    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-3e5c28/noten-model-3e5c28-kserve-bc6bc4947-dz92d"
Sep 10 05:01:03.534569 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:03.534463    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-3e5c28/noten-model-3e5c28-kserve-bc6bc4947-dz92d" event={"ID":"89bc5505-7be7-4fad-b85b-746df06d7ead","Type":"ContainerDied","Data":"5243bc17f0fdf0c2198ff74a520b6fa86346c7bc559b72578f47c9dc8095ea06"}
Sep 10 05:01:03.534645 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:03.534573    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-3e5c28/noten-model-3e5c28-kserve-bc6bc4947-dz92d" event={"ID":"89bc5505-7be7-4fad-b85b-746df06d7ead","Type":"ContainerDied","Data":"7be4a896e1ffdd83dfdb99c98b97e7392e55b8753eeb8c8607c1b0f09768ef1c"}
Sep 10 05:01:03.544703 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:03.544687    2560 scope.go:117] "RemoveContainer" containerID="5243bc17f0fdf0c2198ff74a520b6fa86346c7bc559b72578f47c9dc8095ea06"
Sep 10 05:01:03.553937 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:03.553913    2560 scope.go:117] "RemoveContainer" containerID="5243bc17f0fdf0c2198ff74a520b6fa86346c7bc559b72578f47c9dc8095ea06"
Sep 10 05:01:03.554276 ip-10-0-138-27 kubenswrapper[2560]: E0910 05:01:03.554217    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5243bc17f0fdf0c2198ff74a520b6fa86346c7bc559b72578f47c9dc8095ea06\": container with ID starting with 5243bc17f0fdf0c2198ff74a520b6fa86346c7bc559b72578f47c9dc8095ea06 not found: ID does not exist" containerID="5243bc17f0fdf0c2198ff74a520b6fa86346c7bc559b72578f47c9dc8095ea06"
Sep 10 05:01:03.554276 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:03.554249    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5243bc17f0fdf0c2198ff74a520b6fa86346c7bc559b72578f47c9dc8095ea06"} err="failed to get container status \"5243bc17f0fdf0c2198ff74a520b6fa86346c7bc559b72578f47c9dc8095ea06\": rpc error: code = NotFound desc = could not find container \"5243bc17f0fdf0c2198ff74a520b6fa86346c7bc559b72578f47c9dc8095ea06\": container with ID starting with 5243bc17f0fdf0c2198ff74a520b6fa86346c7bc559b72578f47c9dc8095ea06 not found: ID does not exist"
Sep 10 05:01:03.554725 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:03.554707    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj"]
Sep 10 05:01:03.557395 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:03.557375    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-f3cc69-openshift-default-58d744668b-tt6fj"]
Sep 10 05:01:03.565038 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:03.565019    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-noten-3e5c28/noten-model-3e5c28-kserve-bc6bc4947-dz92d"]
Sep 10 05:01:03.569310 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:03.569290    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-noten-3e5c28/noten-model-3e5c28-kserve-bc6bc4947-dz92d"]
Sep 10 05:01:04.828458 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:04.828422    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36df3522-93d4-4e24-80c4-68752d6e395d" path="/var/lib/kubelet/pods/36df3522-93d4-4e24-80c4-68752d6e395d/volumes"
Sep 10 05:01:04.828924 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:04.828817    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89bc5505-7be7-4fad-b85b-746df06d7ead" path="/var/lib/kubelet/pods/89bc5505-7be7-4fad-b85b-746df06d7ead/volumes"
Sep 10 05:01:08.179434 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:08.173593    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c9a840-696ddcd674-xxzg4"]
Sep 10 05:01:08.179434 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:08.173898    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c9a840-696ddcd674-xxzg4" podUID="c235613a-1bb2-4a3b-85f6-fdd1c3dc3b36" containerName="maas-api" containerID="cri-o://ade4caf9829bce7a5a089b6a060994feb293c540ee58986fc30aab4835670fcb" gracePeriod=30
Sep 10 05:01:08.498165 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:08.498136    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c9a840-696ddcd674-xxzg4"
Sep 10 05:01:08.570780 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:08.570505    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c235613a-1bb2-4a3b-85f6-fdd1c3dc3b36-openshift-service-ca\") pod \"c235613a-1bb2-4a3b-85f6-fdd1c3dc3b36\" (UID: \"c235613a-1bb2-4a3b-85f6-fdd1c3dc3b36\") "
Sep 10 05:01:08.570780 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:08.570544    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c235613a-1bb2-4a3b-85f6-fdd1c3dc3b36-metrics-certs\") pod \"c235613a-1bb2-4a3b-85f6-fdd1c3dc3b36\" (UID: \"c235613a-1bb2-4a3b-85f6-fdd1c3dc3b36\") "
Sep 10 05:01:08.570780 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:08.570588    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c235613a-1bb2-4a3b-85f6-fdd1c3dc3b36-maas-api-tls\") pod \"c235613a-1bb2-4a3b-85f6-fdd1c3dc3b36\" (UID: \"c235613a-1bb2-4a3b-85f6-fdd1c3dc3b36\") "
Sep 10 05:01:08.570780 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:08.570727    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-27cjx\" (UniqueName: \"kubernetes.io/projected/c235613a-1bb2-4a3b-85f6-fdd1c3dc3b36-kube-api-access-27cjx\") pod \"c235613a-1bb2-4a3b-85f6-fdd1c3dc3b36\" (UID: \"c235613a-1bb2-4a3b-85f6-fdd1c3dc3b36\") "
Sep 10 05:01:08.571168 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:08.570980    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c235613a-1bb2-4a3b-85f6-fdd1c3dc3b36-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c235613a-1bb2-4a3b-85f6-fdd1c3dc3b36" (UID: "c235613a-1bb2-4a3b-85f6-fdd1c3dc3b36"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 05:01:08.571168 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:08.571154    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c235613a-1bb2-4a3b-85f6-fdd1c3dc3b36-openshift-service-ca\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:01:08.573913 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:08.573828    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c235613a-1bb2-4a3b-85f6-fdd1c3dc3b36-kube-api-access-27cjx" (OuterVolumeSpecName: "kube-api-access-27cjx") pod "c235613a-1bb2-4a3b-85f6-fdd1c3dc3b36" (UID: "c235613a-1bb2-4a3b-85f6-fdd1c3dc3b36"). InnerVolumeSpecName "kube-api-access-27cjx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 05:01:08.574069 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:08.574021    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c235613a-1bb2-4a3b-85f6-fdd1c3dc3b36-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c235613a-1bb2-4a3b-85f6-fdd1c3dc3b36" (UID: "c235613a-1bb2-4a3b-85f6-fdd1c3dc3b36"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 05:01:08.574199 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:08.574180    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c235613a-1bb2-4a3b-85f6-fdd1c3dc3b36-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c235613a-1bb2-4a3b-85f6-fdd1c3dc3b36" (UID: "c235613a-1bb2-4a3b-85f6-fdd1c3dc3b36"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 05:01:08.584250 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:08.584218    2560 generic.go:356] "Generic (PLEG): container finished" podID="c235613a-1bb2-4a3b-85f6-fdd1c3dc3b36" containerID="ade4caf9829bce7a5a089b6a060994feb293c540ee58986fc30aab4835670fcb" exitCode=0
Sep 10 05:01:08.584966 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:08.584275    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c9a840-696ddcd674-xxzg4" event={"ID":"c235613a-1bb2-4a3b-85f6-fdd1c3dc3b36","Type":"ContainerDied","Data":"ade4caf9829bce7a5a089b6a060994feb293c540ee58986fc30aab4835670fcb"}
Sep 10 05:01:08.584966 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:08.584304    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c9a840-696ddcd674-xxzg4"
Sep 10 05:01:08.584966 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:08.584333    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c9a840-696ddcd674-xxzg4" event={"ID":"c235613a-1bb2-4a3b-85f6-fdd1c3dc3b36","Type":"ContainerDied","Data":"ed984b11a2cd956e1351efcdf497190561012d1dfce8bbf925c9b3140023ab20"}
Sep 10 05:01:08.584966 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:08.584365    2560 scope.go:117] "RemoveContainer" containerID="ade4caf9829bce7a5a089b6a060994feb293c540ee58986fc30aab4835670fcb"
Sep 10 05:01:08.596377 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:08.596359    2560 scope.go:117] "RemoveContainer" containerID="ade4caf9829bce7a5a089b6a060994feb293c540ee58986fc30aab4835670fcb"
Sep 10 05:01:08.596660 ip-10-0-138-27 kubenswrapper[2560]: E0910 05:01:08.596641    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ade4caf9829bce7a5a089b6a060994feb293c540ee58986fc30aab4835670fcb\": container with ID starting with ade4caf9829bce7a5a089b6a060994feb293c540ee58986fc30aab4835670fcb not found: ID does not exist" containerID="ade4caf9829bce7a5a089b6a060994feb293c540ee58986fc30aab4835670fcb"
Sep 10 05:01:08.596723 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:08.596669    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ade4caf9829bce7a5a089b6a060994feb293c540ee58986fc30aab4835670fcb"} err="failed to get container status \"ade4caf9829bce7a5a089b6a060994feb293c540ee58986fc30aab4835670fcb\": rpc error: code = NotFound desc = could not find container \"ade4caf9829bce7a5a089b6a060994feb293c540ee58986fc30aab4835670fcb\": container with ID starting with ade4caf9829bce7a5a089b6a060994feb293c540ee58986fc30aab4835670fcb not found: ID does not exist"
Sep 10 05:01:08.607694 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:08.607673    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c9a840-696ddcd674-xxzg4"]
Sep 10 05:01:08.611179 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:08.611161    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c9a840-696ddcd674-xxzg4"]
Sep 10 05:01:08.675476 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:08.675377    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c235613a-1bb2-4a3b-85f6-fdd1c3dc3b36-metrics-certs\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:01:08.675476 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:08.675407    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c235613a-1bb2-4a3b-85f6-fdd1c3dc3b36-maas-api-tls\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:01:08.675476 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:08.675422    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-27cjx\" (UniqueName: \"kubernetes.io/projected/c235613a-1bb2-4a3b-85f6-fdd1c3dc3b36-kube-api-access-27cjx\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:01:08.826630 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:08.826547    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c235613a-1bb2-4a3b-85f6-fdd1c3dc3b36" path="/var/lib/kubelet/pods/c235613a-1bb2-4a3b-85f6-fdd1c3dc3b36/volumes"
Sep 10 05:01:11.092134 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:11.092058    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7858-bbf18e"]
Sep 10 05:01:11.092641 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:11.092617    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89bc5505-7be7-4fad-b85b-746df06d7ead" containerName="main"
Sep 10 05:01:11.092641 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:11.092638    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="89bc5505-7be7-4fad-b85b-746df06d7ead" containerName="main"
Sep 10 05:01:11.092823 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:11.092657    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36df3522-93d4-4e24-80c4-68752d6e395d" containerName="istio-proxy"
Sep 10 05:01:11.092823 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:11.092665    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="36df3522-93d4-4e24-80c4-68752d6e395d" containerName="istio-proxy"
Sep 10 05:01:11.092823 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:11.092693    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b7a8b05-05bf-4c07-97a5-e7f20f687eee" containerName="maas-api"
Sep 10 05:01:11.092823 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:11.092701    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b7a8b05-05bf-4c07-97a5-e7f20f687eee" containerName="maas-api"
Sep 10 05:01:11.092823 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:11.092726    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c235613a-1bb2-4a3b-85f6-fdd1c3dc3b36" containerName="maas-api"
Sep 10 05:01:11.092823 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:11.092735    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c235613a-1bb2-4a3b-85f6-fdd1c3dc3b36" containerName="maas-api"
Sep 10 05:01:11.098098 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:11.098066    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="36df3522-93d4-4e24-80c4-68752d6e395d" containerName="istio-proxy"
Sep 10 05:01:11.098098 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:11.098100    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="36df3522-93d4-4e24-80c4-68752d6e395d" containerName="istio-proxy"
Sep 10 05:01:11.098277 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:11.098128    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c235613a-1bb2-4a3b-85f6-fdd1c3dc3b36" containerName="maas-api"
Sep 10 05:01:11.098277 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:11.098137    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="89bc5505-7be7-4fad-b85b-746df06d7ead" containerName="main"
Sep 10 05:01:11.098277 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:11.098155    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b7a8b05-05bf-4c07-97a5-e7f20f687eee" containerName="maas-api"
Sep 10 05:01:11.104625 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:11.104599    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7858-bbf18e"]
Sep 10 05:01:11.104766 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:11.104702    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7858-bbf18e"
Sep 10 05:01:11.107039 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:11.107014    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-6n9j9\""
Sep 10 05:01:11.204145 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:11.204113    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xj4q\" (UniqueName: \"kubernetes.io/projected/71f0673f-99fa-4f54-8181-7c702a74f549-kube-api-access-9xj4q\") pod \"test-curl-7858-bbf18e\" (UID: \"71f0673f-99fa-4f54-8181-7c702a74f549\") " pod="opendatahub/test-curl-7858-bbf18e"
Sep 10 05:01:11.305912 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:11.305845    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xj4q\" (UniqueName: \"kubernetes.io/projected/71f0673f-99fa-4f54-8181-7c702a74f549-kube-api-access-9xj4q\") pod \"test-curl-7858-bbf18e\" (UID: \"71f0673f-99fa-4f54-8181-7c702a74f549\") " pod="opendatahub/test-curl-7858-bbf18e"
Sep 10 05:01:11.313774 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:11.313738    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xj4q\" (UniqueName: \"kubernetes.io/projected/71f0673f-99fa-4f54-8181-7c702a74f549-kube-api-access-9xj4q\") pod \"test-curl-7858-bbf18e\" (UID: \"71f0673f-99fa-4f54-8181-7c702a74f549\") " pod="opendatahub/test-curl-7858-bbf18e"
Sep 10 05:01:11.415361 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:11.415322    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7858-bbf18e"
Sep 10 05:01:11.690008 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:11.689983    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7858-bbf18e"]
Sep 10 05:01:11.692252 ip-10-0-138-27 kubenswrapper[2560]: W0910 05:01:11.692225    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod71f0673f_99fa_4f54_8181_7c702a74f549.slice/crio-463e772de9fe67d5870a5f899739a4f6fe379fa28f788c2cf433917cd5ec4d38 WatchSource:0}: Error finding container 463e772de9fe67d5870a5f899739a4f6fe379fa28f788c2cf433917cd5ec4d38: Status 404 returned error can't find the container with id 463e772de9fe67d5870a5f899739a4f6fe379fa28f788c2cf433917cd5ec4d38
Sep 10 05:01:12.611651 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:12.611614    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7858-bbf18e" event={"ID":"71f0673f-99fa-4f54-8181-7c702a74f549","Type":"ContainerStarted","Data":"384e7acf94d531711e84931c671efe7d6a3cfbdae97082d488b52ac0e6bae221"}
Sep 10 05:01:12.612052 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:12.611664    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7858-bbf18e" event={"ID":"71f0673f-99fa-4f54-8181-7c702a74f549","Type":"ContainerStarted","Data":"463e772de9fe67d5870a5f899739a4f6fe379fa28f788c2cf433917cd5ec4d38"}
Sep 10 05:01:12.627981 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:12.627929    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7858-bbf18e" podStartSLOduration=1.627914144 podStartE2EDuration="1.627914144s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 05:01:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 05:01:12.625406149 +0000 UTC m=+1212.287863898" watchObservedRunningTime="2026-09-10 05:01:12.627914144 +0000 UTC m=+1212.290371890"
Sep 10 05:01:13.237839 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:13.237800    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7858-bbf18e"]
Sep 10 05:01:13.244982 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:13.244949    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7858-bbf18e"]
Sep 10 05:01:13.368248 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:13.368161    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7858-b8097d"]
Sep 10 05:01:13.368884 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:13.368861    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71f0673f-99fa-4f54-8181-7c702a74f549" containerName="test-curl-7858-bbf18e"
Sep 10 05:01:13.368935 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:13.368889    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="71f0673f-99fa-4f54-8181-7c702a74f549" containerName="test-curl-7858-bbf18e"
Sep 10 05:01:13.368935 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:13.368914    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36df3522-93d4-4e24-80c4-68752d6e395d" containerName="istio-proxy"
Sep 10 05:01:13.368935 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:13.368923    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="36df3522-93d4-4e24-80c4-68752d6e395d" containerName="istio-proxy"
Sep 10 05:01:13.369092 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:13.369078    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="71f0673f-99fa-4f54-8181-7c702a74f549" containerName="test-curl-7858-bbf18e"
Sep 10 05:01:13.371772 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:13.371746    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7858-b8097d"
Sep 10 05:01:13.377454 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:13.377426    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7858-b8097d"]
Sep 10 05:01:13.529217 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:13.529185    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dr2pf\" (UniqueName: \"kubernetes.io/projected/48f0b2f0-1f83-4f24-9f5a-3a8406023213-kube-api-access-dr2pf\") pod \"test-curl-7858-b8097d\" (UID: \"48f0b2f0-1f83-4f24-9f5a-3a8406023213\") " pod="opendatahub/test-curl-7858-b8097d"
Sep 10 05:01:13.618637 ip-10-0-138-27 kubenswrapper[2560]: E0910 05:01:13.618564    2560 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7858-bbf18e" container="test-curl-7858-bbf18e"
Sep 10 05:01:13.630499 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:13.630469    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dr2pf\" (UniqueName: \"kubernetes.io/projected/48f0b2f0-1f83-4f24-9f5a-3a8406023213-kube-api-access-dr2pf\") pod \"test-curl-7858-b8097d\" (UID: \"48f0b2f0-1f83-4f24-9f5a-3a8406023213\") " pod="opendatahub/test-curl-7858-b8097d"
Sep 10 05:01:13.649900 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:13.649573    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dr2pf\" (UniqueName: \"kubernetes.io/projected/48f0b2f0-1f83-4f24-9f5a-3a8406023213-kube-api-access-dr2pf\") pod \"test-curl-7858-b8097d\" (UID: \"48f0b2f0-1f83-4f24-9f5a-3a8406023213\") " pod="opendatahub/test-curl-7858-b8097d"
Sep 10 05:01:13.685671 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:13.685641    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7858-b8097d"
Sep 10 05:01:13.967631 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:13.967598    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7858-b8097d"]
Sep 10 05:01:14.391526 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:14.391486    2560 patch_prober.go:28] interesting pod/e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Sep 10 05:01:14.391702 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:14.391545    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr" podUID="231145e0-7b08-4465-ae64-2da3aaee4529" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Sep 10 05:01:14.625189 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:14.625149    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7858-b8097d" event={"ID":"48f0b2f0-1f83-4f24-9f5a-3a8406023213","Type":"ContainerStarted","Data":"d8484afce92547c725b42ad472a3651961d53de3601300c4e100c11bd761a819"}
Sep 10 05:01:14.625189 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:14.625192    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7858-b8097d" event={"ID":"48f0b2f0-1f83-4f24-9f5a-3a8406023213","Type":"ContainerStarted","Data":"8647a58a57299cdb1079e31fddf5d44f7a9a23c58a4c7ec8697e20aa65e2eae0"}
Sep 10 05:01:14.626804 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:14.626783    2560 generic.go:356] "Generic (PLEG): container finished" podID="231145e0-7b08-4465-ae64-2da3aaee4529" containerID="7c410bc117d2fb9f339cee0d1f55f372444911f1da5b5964dafef9edead2db3c" exitCode=0
Sep 10 05:01:14.626903 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:14.626866    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr" event={"ID":"231145e0-7b08-4465-ae64-2da3aaee4529","Type":"ContainerDied","Data":"7c410bc117d2fb9f339cee0d1f55f372444911f1da5b5964dafef9edead2db3c"}
Sep 10 05:01:14.627014 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:14.626995    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7858-bbf18e" podUID="71f0673f-99fa-4f54-8181-7c702a74f549" containerName="test-curl-7858-bbf18e" containerID="cri-o://384e7acf94d531711e84931c671efe7d6a3cfbdae97082d488b52ac0e6bae221" gracePeriod=2
Sep 10 05:01:14.627390 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:14.627371    2560 scope.go:117] "RemoveContainer" containerID="7c410bc117d2fb9f339cee0d1f55f372444911f1da5b5964dafef9edead2db3c"
Sep 10 05:01:14.628568 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:14.628532    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 05:01:14.628666 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:14.628610    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 05:01:14.628666 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:14.628661    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 05:01:14.640614 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:14.640528    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7858-b8097d" podStartSLOduration=1.640510672 podStartE2EDuration="1.640510672s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 05:01:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 05:01:14.639138204 +0000 UTC m=+1214.301595951" watchObservedRunningTime="2026-09-10 05:01:14.640510672 +0000 UTC m=+1214.302968419"
Sep 10 05:01:14.640752 ip-10-0-138-27 kubenswrapper[2560]: E0910 05:01:14.640729    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7858-bbf18e\" is forbidden: User \"system:node:ip-10-0-138-27.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-27.ec2.internal' and this object" podUID="71f0673f-99fa-4f54-8181-7c702a74f549" pod="opendatahub/test-curl-7858-bbf18e"
Sep 10 05:01:15.253249 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:15.253203    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7858-b8097d"]
Sep 10 05:01:15.257317 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:15.257283    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7858-b8097d"]
Sep 10 05:01:15.377441 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:15.377409    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7858-cf2dcb"]
Sep 10 05:01:15.377830 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:15.377813    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48f0b2f0-1f83-4f24-9f5a-3a8406023213" containerName="test-curl-7858-b8097d"
Sep 10 05:01:15.377919 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:15.377834    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="48f0b2f0-1f83-4f24-9f5a-3a8406023213" containerName="test-curl-7858-b8097d"
Sep 10 05:01:15.377982 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:15.377942    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="48f0b2f0-1f83-4f24-9f5a-3a8406023213" containerName="test-curl-7858-b8097d"
Sep 10 05:01:15.380336 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:15.380319    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7858-cf2dcb"
Sep 10 05:01:15.389105 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:15.389068    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7858-cf2dcb"]
Sep 10 05:01:15.550176 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:15.550139    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w58lr\" (UniqueName: \"kubernetes.io/projected/5cefc79c-be9f-40ee-b341-8b3791924f19-kube-api-access-w58lr\") pod \"test-curl-7858-cf2dcb\" (UID: \"5cefc79c-be9f-40ee-b341-8b3791924f19\") " pod="opendatahub/test-curl-7858-cf2dcb"
Sep 10 05:01:15.636051 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:15.635961    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr" event={"ID":"231145e0-7b08-4465-ae64-2da3aaee4529","Type":"ContainerStarted","Data":"b912022b57203a07600d819bd9cf4ec587f54ffac2ee8618013e0a47bc6fc004"}
Sep 10 05:01:15.636482 ip-10-0-138-27 kubenswrapper[2560]: E0910 05:01:15.636277    2560 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7858-b8097d" container="test-curl-7858-b8097d"
Sep 10 05:01:15.651306 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:15.651280    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w58lr\" (UniqueName: \"kubernetes.io/projected/5cefc79c-be9f-40ee-b341-8b3791924f19-kube-api-access-w58lr\") pod \"test-curl-7858-cf2dcb\" (UID: \"5cefc79c-be9f-40ee-b341-8b3791924f19\") " pod="opendatahub/test-curl-7858-cf2dcb"
Sep 10 05:01:15.659363 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:15.659329    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w58lr\" (UniqueName: \"kubernetes.io/projected/5cefc79c-be9f-40ee-b341-8b3791924f19-kube-api-access-w58lr\") pod \"test-curl-7858-cf2dcb\" (UID: \"5cefc79c-be9f-40ee-b341-8b3791924f19\") " pod="opendatahub/test-curl-7858-cf2dcb"
Sep 10 05:01:15.692276 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:15.691981    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7858-cf2dcb"
Sep 10 05:01:15.991195 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:15.991167    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7858-cf2dcb"]
Sep 10 05:01:15.993606 ip-10-0-138-27 kubenswrapper[2560]: W0910 05:01:15.993566    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5cefc79c_be9f_40ee_b341_8b3791924f19.slice/crio-f7a464103c30ee8eaa130d17690ad30a0b09943a73b1e69c331e2156746d91f6 WatchSource:0}: Error finding container f7a464103c30ee8eaa130d17690ad30a0b09943a73b1e69c331e2156746d91f6: Status 404 returned error can't find the container with id f7a464103c30ee8eaa130d17690ad30a0b09943a73b1e69c331e2156746d91f6
Sep 10 05:01:16.112191 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:16.112160    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr"
Sep 10 05:01:16.112476 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:16.112455    2560 patch_prober.go:28] interesting pod/e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Sep 10 05:01:16.112533 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:16.112499    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr" podUID="231145e0-7b08-4465-ae64-2da3aaee4529" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Sep 10 05:01:16.648672 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:16.648621    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7858-b8097d" podUID="48f0b2f0-1f83-4f24-9f5a-3a8406023213" containerName="test-curl-7858-b8097d" containerID="cri-o://d8484afce92547c725b42ad472a3651961d53de3601300c4e100c11bd761a819" gracePeriod=2
Sep 10 05:01:16.649527 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:16.649495    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7858-cf2dcb" event={"ID":"5cefc79c-be9f-40ee-b341-8b3791924f19","Type":"ContainerStarted","Data":"f7aa0f95bcbf4562cb176bce815adc0524a06eab7119635c85cdd292da20263b"}
Sep 10 05:01:16.649614 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:16.649543    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7858-cf2dcb" event={"ID":"5cefc79c-be9f-40ee-b341-8b3791924f19","Type":"ContainerStarted","Data":"f7a464103c30ee8eaa130d17690ad30a0b09943a73b1e69c331e2156746d91f6"}
Sep 10 05:01:16.686602 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:16.686551    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7858-cf2dcb" podStartSLOduration=1.6865340020000001 podStartE2EDuration="1.686534002s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 05:01:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 05:01:16.684230334 +0000 UTC m=+1216.346688082" watchObservedRunningTime="2026-09-10 05:01:16.686534002 +0000 UTC m=+1216.348991748"
Sep 10 05:01:16.686776 ip-10-0-138-27 kubenswrapper[2560]: E0910 05:01:16.686646    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7858-b8097d\" is forbidden: User \"system:node:ip-10-0-138-27.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-27.ec2.internal' and this object" podUID="48f0b2f0-1f83-4f24-9f5a-3a8406023213" pod="opendatahub/test-curl-7858-b8097d"
Sep 10 05:01:16.688870 ip-10-0-138-27 kubenswrapper[2560]: E0910 05:01:16.688821    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7858-b8097d\" is forbidden: User \"system:node:ip-10-0-138-27.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-27.ec2.internal' and this object" podUID="48f0b2f0-1f83-4f24-9f5a-3a8406023213" pod="opendatahub/test-curl-7858-b8097d"
Sep 10 05:01:16.870682 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:16.870655    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7858-bbf18e"
Sep 10 05:01:16.977346 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:16.977243    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9xj4q\" (UniqueName: \"kubernetes.io/projected/71f0673f-99fa-4f54-8181-7c702a74f549-kube-api-access-9xj4q\") pod \"71f0673f-99fa-4f54-8181-7c702a74f549\" (UID: \"71f0673f-99fa-4f54-8181-7c702a74f549\") "
Sep 10 05:01:16.979469 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:16.979442    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71f0673f-99fa-4f54-8181-7c702a74f549-kube-api-access-9xj4q" (OuterVolumeSpecName: "kube-api-access-9xj4q") pod "71f0673f-99fa-4f54-8181-7c702a74f549" (UID: "71f0673f-99fa-4f54-8181-7c702a74f549"). InnerVolumeSpecName "kube-api-access-9xj4q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 05:01:17.078916 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:17.078891    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9xj4q\" (UniqueName: \"kubernetes.io/projected/71f0673f-99fa-4f54-8181-7c702a74f549-kube-api-access-9xj4q\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:01:17.112645 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:17.112610    2560 patch_prober.go:28] interesting pod/e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Sep 10 05:01:17.112830 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:17.112663    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr" podUID="231145e0-7b08-4465-ae64-2da3aaee4529" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Sep 10 05:01:17.310757 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:17.310668    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7858-cf2dcb"]
Sep 10 05:01:17.315503 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:17.315466    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7858-cf2dcb"]
Sep 10 05:01:17.369905 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:17.369198    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-c9a840/test-model-c9a840-kserve-8479f68cf-b5b6v" podUID="7e0722ed-7800-4007-8e41-d24e2e036e8b" containerName="main" containerID="cri-o://d79f2118de65d247ab5893587ca07785adac548a627b4669f0622fe4927e2682" gracePeriod=45
Sep 10 05:01:17.431389 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:17.431350    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7858-0ab4ce"]
Sep 10 05:01:17.431908 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:17.431886    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cefc79c-be9f-40ee-b341-8b3791924f19" containerName="test-curl-7858-cf2dcb"
Sep 10 05:01:17.431908 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:17.431908    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cefc79c-be9f-40ee-b341-8b3791924f19" containerName="test-curl-7858-cf2dcb"
Sep 10 05:01:17.432067 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:17.432024    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="5cefc79c-be9f-40ee-b341-8b3791924f19" containerName="test-curl-7858-cf2dcb"
Sep 10 05:01:17.434204 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:17.434185    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7858-0ab4ce"
Sep 10 05:01:17.454869 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:17.446382    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7858-0ab4ce"]
Sep 10 05:01:17.584728 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:17.584558    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pbm6\" (UniqueName: \"kubernetes.io/projected/7b2287ef-cf38-4c56-8265-1b3e6c46a6e9-kube-api-access-5pbm6\") pod \"test-curl-7858-0ab4ce\" (UID: \"7b2287ef-cf38-4c56-8265-1b3e6c46a6e9\") " pod="opendatahub/test-curl-7858-0ab4ce"
Sep 10 05:01:17.617131 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:17.617107    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-c9a840/test-model-c9a840-kserve-8479f68cf-b5b6v"
Sep 10 05:01:17.670894 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:17.669877    2560 generic.go:356] "Generic (PLEG): container finished" podID="7e0722ed-7800-4007-8e41-d24e2e036e8b" containerID="d79f2118de65d247ab5893587ca07785adac548a627b4669f0622fe4927e2682" exitCode=0
Sep 10 05:01:17.670894 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:17.669989    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-c9a840/test-model-c9a840-kserve-8479f68cf-b5b6v" event={"ID":"7e0722ed-7800-4007-8e41-d24e2e036e8b","Type":"ContainerDied","Data":"d79f2118de65d247ab5893587ca07785adac548a627b4669f0622fe4927e2682"}
Sep 10 05:01:17.670894 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:17.670028    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-c9a840/test-model-c9a840-kserve-8479f68cf-b5b6v" event={"ID":"7e0722ed-7800-4007-8e41-d24e2e036e8b","Type":"ContainerDied","Data":"80a7f3b742f51900af1d270ffaf706645c99596ed4f1ec314ce5b8fd25f80f39"}
Sep 10 05:01:17.670894 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:17.670052    2560 scope.go:117] "RemoveContainer" containerID="d79f2118de65d247ab5893587ca07785adac548a627b4669f0622fe4927e2682"
Sep 10 05:01:17.670894 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:17.670202    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-c9a840/test-model-c9a840-kserve-8479f68cf-b5b6v"
Sep 10 05:01:17.673954 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:17.673352    2560 generic.go:356] "Generic (PLEG): container finished" podID="71f0673f-99fa-4f54-8181-7c702a74f549" containerID="384e7acf94d531711e84931c671efe7d6a3cfbdae97082d488b52ac0e6bae221" exitCode=137
Sep 10 05:01:17.673954 ip-10-0-138-27 kubenswrapper[2560]: E0910 05:01:17.673719    2560 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7858-cf2dcb" container="test-curl-7858-cf2dcb"
Sep 10 05:01:17.673954 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:17.673745    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7858-bbf18e"
Sep 10 05:01:17.682156 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:17.682131    2560 scope.go:117] "RemoveContainer" containerID="d79f2118de65d247ab5893587ca07785adac548a627b4669f0622fe4927e2682"
Sep 10 05:01:17.682552 ip-10-0-138-27 kubenswrapper[2560]: E0910 05:01:17.682432    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d79f2118de65d247ab5893587ca07785adac548a627b4669f0622fe4927e2682\": container with ID starting with d79f2118de65d247ab5893587ca07785adac548a627b4669f0622fe4927e2682 not found: ID does not exist" containerID="d79f2118de65d247ab5893587ca07785adac548a627b4669f0622fe4927e2682"
Sep 10 05:01:17.682552 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:17.682464    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d79f2118de65d247ab5893587ca07785adac548a627b4669f0622fe4927e2682"} err="failed to get container status \"d79f2118de65d247ab5893587ca07785adac548a627b4669f0622fe4927e2682\": rpc error: code = NotFound desc = could not find container \"d79f2118de65d247ab5893587ca07785adac548a627b4669f0622fe4927e2682\": container with ID starting with d79f2118de65d247ab5893587ca07785adac548a627b4669f0622fe4927e2682 not found: ID does not exist"
Sep 10 05:01:17.682552 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:17.682481    2560 scope.go:117] "RemoveContainer" containerID="384e7acf94d531711e84931c671efe7d6a3cfbdae97082d488b52ac0e6bae221"
Sep 10 05:01:17.686564 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:17.685670    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pbm6\" (UniqueName: \"kubernetes.io/projected/7b2287ef-cf38-4c56-8265-1b3e6c46a6e9-kube-api-access-5pbm6\") pod \"test-curl-7858-0ab4ce\" (UID: \"7b2287ef-cf38-4c56-8265-1b3e6c46a6e9\") " pod="opendatahub/test-curl-7858-0ab4ce"
Sep 10 05:01:17.689281 ip-10-0-138-27 kubenswrapper[2560]: E0910 05:01:17.689257    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7858-bbf18e\" is forbidden: User \"system:node:ip-10-0-138-27.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-27.ec2.internal' and this object" podUID="71f0673f-99fa-4f54-8181-7c702a74f549" pod="opendatahub/test-curl-7858-bbf18e"
Sep 10 05:01:17.692838 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:17.692776    2560 scope.go:117] "RemoveContainer" containerID="384e7acf94d531711e84931c671efe7d6a3cfbdae97082d488b52ac0e6bae221"
Sep 10 05:01:17.693153 ip-10-0-138-27 kubenswrapper[2560]: E0910 05:01:17.693133    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"384e7acf94d531711e84931c671efe7d6a3cfbdae97082d488b52ac0e6bae221\": container with ID starting with 384e7acf94d531711e84931c671efe7d6a3cfbdae97082d488b52ac0e6bae221 not found: ID does not exist" containerID="384e7acf94d531711e84931c671efe7d6a3cfbdae97082d488b52ac0e6bae221"
Sep 10 05:01:17.693233 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:17.693161    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"384e7acf94d531711e84931c671efe7d6a3cfbdae97082d488b52ac0e6bae221"} err="failed to get container status \"384e7acf94d531711e84931c671efe7d6a3cfbdae97082d488b52ac0e6bae221\": rpc error: code = NotFound desc = could not find container \"384e7acf94d531711e84931c671efe7d6a3cfbdae97082d488b52ac0e6bae221\": container with ID starting with 384e7acf94d531711e84931c671efe7d6a3cfbdae97082d488b52ac0e6bae221 not found: ID does not exist"
Sep 10 05:01:17.698061 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:17.698043    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pbm6\" (UniqueName: \"kubernetes.io/projected/7b2287ef-cf38-4c56-8265-1b3e6c46a6e9-kube-api-access-5pbm6\") pod \"test-curl-7858-0ab4ce\" (UID: \"7b2287ef-cf38-4c56-8265-1b3e6c46a6e9\") " pod="opendatahub/test-curl-7858-0ab4ce"
Sep 10 05:01:17.763054 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:17.763013    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7858-0ab4ce"
Sep 10 05:01:17.786347 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:17.786197    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e0722ed-7800-4007-8e41-d24e2e036e8b-dshm\") pod \"7e0722ed-7800-4007-8e41-d24e2e036e8b\" (UID: \"7e0722ed-7800-4007-8e41-d24e2e036e8b\") "
Sep 10 05:01:17.786347 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:17.786258    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e0722ed-7800-4007-8e41-d24e2e036e8b-model-cache\") pod \"7e0722ed-7800-4007-8e41-d24e2e036e8b\" (UID: \"7e0722ed-7800-4007-8e41-d24e2e036e8b\") "
Sep 10 05:01:17.786347 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:17.786284    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e0722ed-7800-4007-8e41-d24e2e036e8b-tmp-dir\") pod \"7e0722ed-7800-4007-8e41-d24e2e036e8b\" (UID: \"7e0722ed-7800-4007-8e41-d24e2e036e8b\") "
Sep 10 05:01:17.786347 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:17.786308    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e0722ed-7800-4007-8e41-d24e2e036e8b-home\") pod \"7e0722ed-7800-4007-8e41-d24e2e036e8b\" (UID: \"7e0722ed-7800-4007-8e41-d24e2e036e8b\") "
Sep 10 05:01:17.786639 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:17.786448    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e0722ed-7800-4007-8e41-d24e2e036e8b-tls-certs\") pod \"7e0722ed-7800-4007-8e41-d24e2e036e8b\" (UID: \"7e0722ed-7800-4007-8e41-d24e2e036e8b\") "
Sep 10 05:01:17.786639 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:17.786478    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pkmsq\" (UniqueName: \"kubernetes.io/projected/7e0722ed-7800-4007-8e41-d24e2e036e8b-kube-api-access-pkmsq\") pod \"7e0722ed-7800-4007-8e41-d24e2e036e8b\" (UID: \"7e0722ed-7800-4007-8e41-d24e2e036e8b\") "
Sep 10 05:01:17.786639 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:17.786622    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e0722ed-7800-4007-8e41-d24e2e036e8b-model-cache" (OuterVolumeSpecName: "model-cache") pod "7e0722ed-7800-4007-8e41-d24e2e036e8b" (UID: "7e0722ed-7800-4007-8e41-d24e2e036e8b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 05:01:17.786803 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:17.786696    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e0722ed-7800-4007-8e41-d24e2e036e8b-home" (OuterVolumeSpecName: "home") pod "7e0722ed-7800-4007-8e41-d24e2e036e8b" (UID: "7e0722ed-7800-4007-8e41-d24e2e036e8b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 05:01:17.786887 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:17.786874    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e0722ed-7800-4007-8e41-d24e2e036e8b-model-cache\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:01:17.786953 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:17.786895    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e0722ed-7800-4007-8e41-d24e2e036e8b-home\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:01:17.787213 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:17.787190    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e0722ed-7800-4007-8e41-d24e2e036e8b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7e0722ed-7800-4007-8e41-d24e2e036e8b" (UID: "7e0722ed-7800-4007-8e41-d24e2e036e8b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 05:01:17.789318 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:17.789289    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e0722ed-7800-4007-8e41-d24e2e036e8b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7e0722ed-7800-4007-8e41-d24e2e036e8b" (UID: "7e0722ed-7800-4007-8e41-d24e2e036e8b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 05:01:17.789625 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:17.789603    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e0722ed-7800-4007-8e41-d24e2e036e8b-kube-api-access-pkmsq" (OuterVolumeSpecName: "kube-api-access-pkmsq") pod "7e0722ed-7800-4007-8e41-d24e2e036e8b" (UID: "7e0722ed-7800-4007-8e41-d24e2e036e8b"). InnerVolumeSpecName "kube-api-access-pkmsq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 05:01:17.789748 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:17.789729    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e0722ed-7800-4007-8e41-d24e2e036e8b-dshm" (OuterVolumeSpecName: "dshm") pod "7e0722ed-7800-4007-8e41-d24e2e036e8b" (UID: "7e0722ed-7800-4007-8e41-d24e2e036e8b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 05:01:17.888038 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:17.888000    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e0722ed-7800-4007-8e41-d24e2e036e8b-tls-certs\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:01:17.888038 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:17.888027    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pkmsq\" (UniqueName: \"kubernetes.io/projected/7e0722ed-7800-4007-8e41-d24e2e036e8b-kube-api-access-pkmsq\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:01:17.888038 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:17.888038    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e0722ed-7800-4007-8e41-d24e2e036e8b-dshm\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:01:17.888038 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:17.888046    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e0722ed-7800-4007-8e41-d24e2e036e8b-tmp-dir\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:01:17.981041 ip-10-0-138-27 kubenswrapper[2560]: E0910 05:01:17.981001    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7858-bbf18e\" is forbidden: User \"system:node:ip-10-0-138-27.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-27.ec2.internal' and this object" podUID="71f0673f-99fa-4f54-8181-7c702a74f549" pod="opendatahub/test-curl-7858-bbf18e"
Sep 10 05:01:17.994238 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:17.994189    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-c9a840/test-model-c9a840-kserve-8479f68cf-b5b6v"]
Sep 10 05:01:17.997243 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:17.997218    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-c9a840/test-model-c9a840-kserve-8479f68cf-b5b6v"]
Sep 10 05:01:18.051208 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:18.048548    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7858-0ab4ce"]
Sep 10 05:01:18.051531 ip-10-0-138-27 kubenswrapper[2560]: W0910 05:01:18.051490    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7b2287ef_cf38_4c56_8265_1b3e6c46a6e9.slice/crio-dde691a05984fd23b2d41b816dc635c522b1ba56f6d651eb70ed8b578f97dd6e WatchSource:0}: Error finding container dde691a05984fd23b2d41b816dc635c522b1ba56f6d651eb70ed8b578f97dd6e: Status 404 returned error can't find the container with id dde691a05984fd23b2d41b816dc635c522b1ba56f6d651eb70ed8b578f97dd6e
Sep 10 05:01:18.112818 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:18.112734    2560 patch_prober.go:28] interesting pod/e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Sep 10 05:01:18.112818 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:18.112790    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr" podUID="231145e0-7b08-4465-ae64-2da3aaee4529" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Sep 10 05:01:18.684171 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:18.684138    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7858-0ab4ce" event={"ID":"7b2287ef-cf38-4c56-8265-1b3e6c46a6e9","Type":"ContainerStarted","Data":"1609c2c584bfbc5870ab89f32dd2ec2ecfbff51fdd11177b0db50a0d02f11dfe"}
Sep 10 05:01:18.684560 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:18.684179    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7858-0ab4ce" event={"ID":"7b2287ef-cf38-4c56-8265-1b3e6c46a6e9","Type":"ContainerStarted","Data":"dde691a05984fd23b2d41b816dc635c522b1ba56f6d651eb70ed8b578f97dd6e"}
Sep 10 05:01:18.684560 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:18.684361    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7858-cf2dcb" podUID="5cefc79c-be9f-40ee-b341-8b3791924f19" containerName="test-curl-7858-cf2dcb" containerID="cri-o://f7aa0f95bcbf4562cb176bce815adc0524a06eab7119635c85cdd292da20263b" gracePeriod=2
Sep 10 05:01:18.685844 ip-10-0-138-27 kubenswrapper[2560]: E0910 05:01:18.685820    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7858-bbf18e\" is forbidden: User \"system:node:ip-10-0-138-27.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-27.ec2.internal' and this object" podUID="71f0673f-99fa-4f54-8181-7c702a74f549" pod="opendatahub/test-curl-7858-bbf18e"
Sep 10 05:01:18.699032 ip-10-0-138-27 kubenswrapper[2560]: E0910 05:01:18.698962    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7858-cf2dcb\" is forbidden: User \"system:node:ip-10-0-138-27.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-27.ec2.internal' and this object" podUID="5cefc79c-be9f-40ee-b341-8b3791924f19" pod="opendatahub/test-curl-7858-cf2dcb"
Sep 10 05:01:18.699561 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:18.699519    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7858-0ab4ce" podStartSLOduration=1.699504474 podStartE2EDuration="1.699504474s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 05:01:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 05:01:18.697330812 +0000 UTC m=+1218.359788560" watchObservedRunningTime="2026-09-10 05:01:18.699504474 +0000 UTC m=+1218.361962220"
Sep 10 05:01:18.700316 ip-10-0-138-27 kubenswrapper[2560]: E0910 05:01:18.700288    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7858-bbf18e\" is forbidden: User \"system:node:ip-10-0-138-27.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-27.ec2.internal' and this object" podUID="71f0673f-99fa-4f54-8181-7c702a74f549" pod="opendatahub/test-curl-7858-bbf18e"
Sep 10 05:01:18.827364 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:18.827335    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71f0673f-99fa-4f54-8181-7c702a74f549" path="/var/lib/kubelet/pods/71f0673f-99fa-4f54-8181-7c702a74f549/volumes"
Sep 10 05:01:18.827950 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:18.827932    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e0722ed-7800-4007-8e41-d24e2e036e8b" path="/var/lib/kubelet/pods/7e0722ed-7800-4007-8e41-d24e2e036e8b/volumes"
Sep 10 05:01:18.874647 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:18.874622    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7858-b8097d"
Sep 10 05:01:18.999015 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:18.998931    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dr2pf\" (UniqueName: \"kubernetes.io/projected/48f0b2f0-1f83-4f24-9f5a-3a8406023213-kube-api-access-dr2pf\") pod \"48f0b2f0-1f83-4f24-9f5a-3a8406023213\" (UID: \"48f0b2f0-1f83-4f24-9f5a-3a8406023213\") "
Sep 10 05:01:19.000870 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:19.000830    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48f0b2f0-1f83-4f24-9f5a-3a8406023213-kube-api-access-dr2pf" (OuterVolumeSpecName: "kube-api-access-dr2pf") pod "48f0b2f0-1f83-4f24-9f5a-3a8406023213" (UID: "48f0b2f0-1f83-4f24-9f5a-3a8406023213"). InnerVolumeSpecName "kube-api-access-dr2pf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 05:01:19.100630 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:19.100586    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dr2pf\" (UniqueName: \"kubernetes.io/projected/48f0b2f0-1f83-4f24-9f5a-3a8406023213-kube-api-access-dr2pf\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:01:19.113265 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:19.113187    2560 patch_prober.go:28] interesting pod/e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Sep 10 05:01:19.113466 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:19.113248    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr" podUID="231145e0-7b08-4465-ae64-2da3aaee4529" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Sep 10 05:01:19.346080 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:19.345978    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7858-0ab4ce"]
Sep 10 05:01:19.350936 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:19.350892    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7858-0ab4ce"]
Sep 10 05:01:19.691929 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:19.691894    2560 generic.go:356] "Generic (PLEG): container finished" podID="48f0b2f0-1f83-4f24-9f5a-3a8406023213" containerID="d8484afce92547c725b42ad472a3651961d53de3601300c4e100c11bd761a819" exitCode=137
Sep 10 05:01:19.692399 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:19.691941    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7858-b8097d"
Sep 10 05:01:19.692399 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:19.691993    2560 scope.go:117] "RemoveContainer" containerID="d8484afce92547c725b42ad472a3651961d53de3601300c4e100c11bd761a819"
Sep 10 05:01:19.692399 ip-10-0-138-27 kubenswrapper[2560]: E0910 05:01:19.692281    2560 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7858-0ab4ce" container="test-curl-7858-0ab4ce"
Sep 10 05:01:19.701670 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:19.701652    2560 scope.go:117] "RemoveContainer" containerID="d8484afce92547c725b42ad472a3651961d53de3601300c4e100c11bd761a819"
Sep 10 05:01:19.701875 ip-10-0-138-27 kubenswrapper[2560]: E0910 05:01:19.701841    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8484afce92547c725b42ad472a3651961d53de3601300c4e100c11bd761a819\": container with ID starting with d8484afce92547c725b42ad472a3651961d53de3601300c4e100c11bd761a819 not found: ID does not exist" containerID="d8484afce92547c725b42ad472a3651961d53de3601300c4e100c11bd761a819"
Sep 10 05:01:19.701954 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:19.701885    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8484afce92547c725b42ad472a3651961d53de3601300c4e100c11bd761a819"} err="failed to get container status \"d8484afce92547c725b42ad472a3651961d53de3601300c4e100c11bd761a819\": rpc error: code = NotFound desc = could not find container \"d8484afce92547c725b42ad472a3651961d53de3601300c4e100c11bd761a819\": container with ID starting with d8484afce92547c725b42ad472a3651961d53de3601300c4e100c11bd761a819 not found: ID does not exist"
Sep 10 05:01:19.702319 ip-10-0-138-27 kubenswrapper[2560]: E0910 05:01:19.702296    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7858-b8097d\" is forbidden: User \"system:node:ip-10-0-138-27.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-27.ec2.internal' and this object" podUID="48f0b2f0-1f83-4f24-9f5a-3a8406023213" pod="opendatahub/test-curl-7858-b8097d"
Sep 10 05:01:19.880905 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:19.880694    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg"]
Sep 10 05:01:19.881815 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:19.881297    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg" podUID="2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4" containerName="istio-proxy" containerID="cri-o://5f9c0d5d3251e0f73a0815fc53f0fdcd0792ccb8657e1047409600e7fcafedd2" gracePeriod=30
Sep 10 05:01:19.908935 ip-10-0-138-27 kubenswrapper[2560]: E0910 05:01:19.908901    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7858-b8097d\" is forbidden: User \"system:node:ip-10-0-138-27.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-27.ec2.internal' and this object" podUID="48f0b2f0-1f83-4f24-9f5a-3a8406023213" pod="opendatahub/test-curl-7858-b8097d"
Sep 10 05:01:20.112866 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:20.112761    2560 patch_prober.go:28] interesting pod/e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Sep 10 05:01:20.112866 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:20.112816    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr" podUID="231145e0-7b08-4465-ae64-2da3aaee4529" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Sep 10 05:01:20.225484 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:20.225452    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn"]
Sep 10 05:01:20.226309 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:20.226286    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b2287ef-cf38-4c56-8265-1b3e6c46a6e9" containerName="test-curl-7858-0ab4ce"
Sep 10 05:01:20.226455 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:20.226444    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b2287ef-cf38-4c56-8265-1b3e6c46a6e9" containerName="test-curl-7858-0ab4ce"
Sep 10 05:01:20.226539 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:20.226530    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e0722ed-7800-4007-8e41-d24e2e036e8b" containerName="main"
Sep 10 05:01:20.226618 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:20.226609    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e0722ed-7800-4007-8e41-d24e2e036e8b" containerName="main"
Sep 10 05:01:20.226805 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:20.226794    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b2287ef-cf38-4c56-8265-1b3e6c46a6e9" containerName="test-curl-7858-0ab4ce"
Sep 10 05:01:20.226914 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:20.226904    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e0722ed-7800-4007-8e41-d24e2e036e8b" containerName="main"
Sep 10 05:01:20.230430 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:20.230410    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn"
Sep 10 05:01:20.232381 ip-10-0-138-27 kubenswrapper[2560]: E0910 05:01:20.232284    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7858-b8097d\" is forbidden: User \"system:node:ip-10-0-138-27.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-27.ec2.internal' and this object" podUID="48f0b2f0-1f83-4f24-9f5a-3a8406023213" pod="opendatahub/test-curl-7858-b8097d"
Sep 10 05:01:20.232614 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:20.232598    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-8fcf3f8b-openshift-default-dockercfg-4qnw2\""
Sep 10 05:01:20.247871 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:20.246412    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn"]
Sep 10 05:01:20.414887 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:20.414839    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d30b8fb8-1f34-4f87-84c2-35430dd823d9-istio-token\") pod \"e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn\" (UID: \"d30b8fb8-1f34-4f87-84c2-35430dd823d9\") " pod="openshift-ingress/e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn"
Sep 10 05:01:20.415062 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:20.414906    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d30b8fb8-1f34-4f87-84c2-35430dd823d9-istio-envoy\") pod \"e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn\" (UID: \"d30b8fb8-1f34-4f87-84c2-35430dd823d9\") " pod="openshift-ingress/e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn"
Sep 10 05:01:20.415062 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:20.414954    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d30b8fb8-1f34-4f87-84c2-35430dd823d9-istio-data\") pod \"e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn\" (UID: \"d30b8fb8-1f34-4f87-84c2-35430dd823d9\") " pod="openshift-ingress/e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn"
Sep 10 05:01:20.415062 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:20.414970    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d30b8fb8-1f34-4f87-84c2-35430dd823d9-istio-podinfo\") pod \"e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn\" (UID: \"d30b8fb8-1f34-4f87-84c2-35430dd823d9\") " pod="openshift-ingress/e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn"
Sep 10 05:01:20.415170 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:20.415063    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlvqc\" (UniqueName: \"kubernetes.io/projected/d30b8fb8-1f34-4f87-84c2-35430dd823d9-kube-api-access-tlvqc\") pod \"e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn\" (UID: \"d30b8fb8-1f34-4f87-84c2-35430dd823d9\") " pod="openshift-ingress/e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn"
Sep 10 05:01:20.415170 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:20.415111    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d30b8fb8-1f34-4f87-84c2-35430dd823d9-istiod-ca-cert\") pod \"e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn\" (UID: \"d30b8fb8-1f34-4f87-84c2-35430dd823d9\") " pod="openshift-ingress/e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn"
Sep 10 05:01:20.415170 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:20.415135    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d30b8fb8-1f34-4f87-84c2-35430dd823d9-credential-socket\") pod \"e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn\" (UID: \"d30b8fb8-1f34-4f87-84c2-35430dd823d9\") " pod="openshift-ingress/e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn"
Sep 10 05:01:20.415307 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:20.415170    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d30b8fb8-1f34-4f87-84c2-35430dd823d9-workload-certs\") pod \"e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn\" (UID: \"d30b8fb8-1f34-4f87-84c2-35430dd823d9\") " pod="openshift-ingress/e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn"
Sep 10 05:01:20.415307 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:20.415188    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d30b8fb8-1f34-4f87-84c2-35430dd823d9-workload-socket\") pod \"e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn\" (UID: \"d30b8fb8-1f34-4f87-84c2-35430dd823d9\") " pod="openshift-ingress/e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn"
Sep 10 05:01:20.515873 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:20.515820    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d30b8fb8-1f34-4f87-84c2-35430dd823d9-workload-certs\") pod \"e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn\" (UID: \"d30b8fb8-1f34-4f87-84c2-35430dd823d9\") " pod="openshift-ingress/e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn"
Sep 10 05:01:20.515873 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:20.515878    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d30b8fb8-1f34-4f87-84c2-35430dd823d9-workload-socket\") pod \"e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn\" (UID: \"d30b8fb8-1f34-4f87-84c2-35430dd823d9\") " pod="openshift-ingress/e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn"
Sep 10 05:01:20.516087 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:20.515912    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d30b8fb8-1f34-4f87-84c2-35430dd823d9-istio-token\") pod \"e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn\" (UID: \"d30b8fb8-1f34-4f87-84c2-35430dd823d9\") " pod="openshift-ingress/e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn"
Sep 10 05:01:20.516087 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:20.515941    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d30b8fb8-1f34-4f87-84c2-35430dd823d9-istio-envoy\") pod \"e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn\" (UID: \"d30b8fb8-1f34-4f87-84c2-35430dd823d9\") " pod="openshift-ingress/e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn"
Sep 10 05:01:20.516087 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:20.515972    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d30b8fb8-1f34-4f87-84c2-35430dd823d9-istio-data\") pod \"e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn\" (UID: \"d30b8fb8-1f34-4f87-84c2-35430dd823d9\") " pod="openshift-ingress/e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn"
Sep 10 05:01:20.516087 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:20.515988    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d30b8fb8-1f34-4f87-84c2-35430dd823d9-istio-podinfo\") pod \"e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn\" (UID: \"d30b8fb8-1f34-4f87-84c2-35430dd823d9\") " pod="openshift-ingress/e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn"
Sep 10 05:01:20.516221 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:20.516141    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlvqc\" (UniqueName: \"kubernetes.io/projected/d30b8fb8-1f34-4f87-84c2-35430dd823d9-kube-api-access-tlvqc\") pod \"e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn\" (UID: \"d30b8fb8-1f34-4f87-84c2-35430dd823d9\") " pod="openshift-ingress/e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn"
Sep 10 05:01:20.516253 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:20.516228    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d30b8fb8-1f34-4f87-84c2-35430dd823d9-istiod-ca-cert\") pod \"e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn\" (UID: \"d30b8fb8-1f34-4f87-84c2-35430dd823d9\") " pod="openshift-ingress/e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn"
Sep 10 05:01:20.516285 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:20.516271    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d30b8fb8-1f34-4f87-84c2-35430dd823d9-credential-socket\") pod \"e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn\" (UID: \"d30b8fb8-1f34-4f87-84c2-35430dd823d9\") " pod="openshift-ingress/e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn"
Sep 10 05:01:20.516607 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:20.516567    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d30b8fb8-1f34-4f87-84c2-35430dd823d9-workload-socket\") pod \"e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn\" (UID: \"d30b8fb8-1f34-4f87-84c2-35430dd823d9\") " pod="openshift-ingress/e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn"
Sep 10 05:01:20.516765 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:20.516640    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d30b8fb8-1f34-4f87-84c2-35430dd823d9-istio-data\") pod \"e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn\" (UID: \"d30b8fb8-1f34-4f87-84c2-35430dd823d9\") " pod="openshift-ingress/e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn"
Sep 10 05:01:20.516833 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:20.516781    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d30b8fb8-1f34-4f87-84c2-35430dd823d9-credential-socket\") pod \"e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn\" (UID: \"d30b8fb8-1f34-4f87-84c2-35430dd823d9\") " pod="openshift-ingress/e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn"
Sep 10 05:01:20.516915 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:20.516828    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d30b8fb8-1f34-4f87-84c2-35430dd823d9-workload-certs\") pod \"e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn\" (UID: \"d30b8fb8-1f34-4f87-84c2-35430dd823d9\") " pod="openshift-ingress/e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn"
Sep 10 05:01:20.516984 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:20.516944    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d30b8fb8-1f34-4f87-84c2-35430dd823d9-istiod-ca-cert\") pod \"e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn\" (UID: \"d30b8fb8-1f34-4f87-84c2-35430dd823d9\") " pod="openshift-ingress/e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn"
Sep 10 05:01:20.518388 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:20.518368    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d30b8fb8-1f34-4f87-84c2-35430dd823d9-istio-podinfo\") pod \"e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn\" (UID: \"d30b8fb8-1f34-4f87-84c2-35430dd823d9\") " pod="openshift-ingress/e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn"
Sep 10 05:01:20.518613 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:20.518594    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d30b8fb8-1f34-4f87-84c2-35430dd823d9-istio-envoy\") pod \"e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn\" (UID: \"d30b8fb8-1f34-4f87-84c2-35430dd823d9\") " pod="openshift-ingress/e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn"
Sep 10 05:01:20.525899 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:20.525878    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d30b8fb8-1f34-4f87-84c2-35430dd823d9-istio-token\") pod \"e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn\" (UID: \"d30b8fb8-1f34-4f87-84c2-35430dd823d9\") " pod="openshift-ingress/e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn"
Sep 10 05:01:20.525995 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:20.525975    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlvqc\" (UniqueName: \"kubernetes.io/projected/d30b8fb8-1f34-4f87-84c2-35430dd823d9-kube-api-access-tlvqc\") pod \"e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn\" (UID: \"d30b8fb8-1f34-4f87-84c2-35430dd823d9\") " pod="openshift-ingress/e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn"
Sep 10 05:01:20.572674 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:20.572639    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn"
Sep 10 05:01:20.700004 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:20.699975    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7858-0ab4ce" podUID="7b2287ef-cf38-4c56-8265-1b3e6c46a6e9" containerName="test-curl-7858-0ab4ce" containerID="cri-o://1609c2c584bfbc5870ab89f32dd2ec2ecfbff51fdd11177b0db50a0d02f11dfe" gracePeriod=2
Sep 10 05:01:20.701845 ip-10-0-138-27 kubenswrapper[2560]: E0910 05:01:20.701820    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7858-0ab4ce\" is forbidden: User \"system:node:ip-10-0-138-27.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-27.ec2.internal' and this object" podUID="7b2287ef-cf38-4c56-8265-1b3e6c46a6e9" pod="opendatahub/test-curl-7858-0ab4ce"
Sep 10 05:01:20.703276 ip-10-0-138-27 kubenswrapper[2560]: E0910 05:01:20.703254    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7858-b8097d\" is forbidden: User \"system:node:ip-10-0-138-27.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-27.ec2.internal' and this object" podUID="48f0b2f0-1f83-4f24-9f5a-3a8406023213" pod="opendatahub/test-curl-7858-b8097d"
Sep 10 05:01:20.754761 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:20.754717    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s"]
Sep 10 05:01:20.767737 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:20.767713    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s"
Sep 10 05:01:20.777636 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:20.777613    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-4bfef6-openshift-default-dockercfg-xgc6s\""
Sep 10 05:01:20.778708 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:20.778254    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s"]
Sep 10 05:01:20.792249 ip-10-0-138-27 kubenswrapper[2560]: E0910 05:01:20.792127    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7858-b8097d\" is forbidden: User \"system:node:ip-10-0-138-27.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-27.ec2.internal' and this object" podUID="48f0b2f0-1f83-4f24-9f5a-3a8406023213" pod="opendatahub/test-curl-7858-b8097d"
Sep 10 05:01:20.793607 ip-10-0-138-27 kubenswrapper[2560]: E0910 05:01:20.793581    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7858-0ab4ce\" is forbidden: User \"system:node:ip-10-0-138-27.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-27.ec2.internal' and this object" podUID="7b2287ef-cf38-4c56-8265-1b3e6c46a6e9" pod="opendatahub/test-curl-7858-0ab4ce"
Sep 10 05:01:20.824061 ip-10-0-138-27 kubenswrapper[2560]: E0910 05:01:20.824030    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7858-b8097d\" is forbidden: User \"system:node:ip-10-0-138-27.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-27.ec2.internal' and this object" podUID="48f0b2f0-1f83-4f24-9f5a-3a8406023213" pod="opendatahub/test-curl-7858-b8097d"
Sep 10 05:01:20.825423 ip-10-0-138-27 kubenswrapper[2560]: E0910 05:01:20.825395    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7858-0ab4ce\" is forbidden: User \"system:node:ip-10-0-138-27.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-27.ec2.internal' and this object" podUID="7b2287ef-cf38-4c56-8265-1b3e6c46a6e9" pod="opendatahub/test-curl-7858-0ab4ce"
Sep 10 05:01:20.826258 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:20.826238    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48f0b2f0-1f83-4f24-9f5a-3a8406023213" path="/var/lib/kubelet/pods/48f0b2f0-1f83-4f24-9f5a-3a8406023213/volumes"
Sep 10 05:01:20.867888 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:20.867028    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn"]
Sep 10 05:01:20.868031 ip-10-0-138-27 kubenswrapper[2560]: W0910 05:01:20.868000    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd30b8fb8_1f34_4f87_84c2_35430dd823d9.slice/crio-c7c9dee185cd365a65ad2076ba0c5ddded7690193f8734b40b34f7b38fce8177 WatchSource:0}: Error finding container c7c9dee185cd365a65ad2076ba0c5ddded7690193f8734b40b34f7b38fce8177: Status 404 returned error can't find the container with id c7c9dee185cd365a65ad2076ba0c5ddded7690193f8734b40b34f7b38fce8177
Sep 10 05:01:20.882603 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:20.882554    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 05:01:20.882710 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:20.882668    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 05:01:20.882759 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:20.882712    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 05:01:20.921366 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:20.921337    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9d58812-4328-4d41-b9ee-99a876f5f6e4-istiod-ca-cert\") pod \"e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s\" (UID: \"c9d58812-4328-4d41-b9ee-99a876f5f6e4\") " pod="openshift-ingress/e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s"
Sep 10 05:01:20.921469 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:20.921384    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9d58812-4328-4d41-b9ee-99a876f5f6e4-credential-socket\") pod \"e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s\" (UID: \"c9d58812-4328-4d41-b9ee-99a876f5f6e4\") " pod="openshift-ingress/e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s"
Sep 10 05:01:20.921469 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:20.921414    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9d58812-4328-4d41-b9ee-99a876f5f6e4-workload-socket\") pod \"e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s\" (UID: \"c9d58812-4328-4d41-b9ee-99a876f5f6e4\") " pod="openshift-ingress/e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s"
Sep 10 05:01:20.921469 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:20.921439    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9d58812-4328-4d41-b9ee-99a876f5f6e4-istio-data\") pod \"e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s\" (UID: \"c9d58812-4328-4d41-b9ee-99a876f5f6e4\") " pod="openshift-ingress/e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s"
Sep 10 05:01:20.921570 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:20.921526    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9d58812-4328-4d41-b9ee-99a876f5f6e4-istio-token\") pod \"e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s\" (UID: \"c9d58812-4328-4d41-b9ee-99a876f5f6e4\") " pod="openshift-ingress/e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s"
Sep 10 05:01:20.921608 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:20.921569    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjrtx\" (UniqueName: \"kubernetes.io/projected/c9d58812-4328-4d41-b9ee-99a876f5f6e4-kube-api-access-gjrtx\") pod \"e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s\" (UID: \"c9d58812-4328-4d41-b9ee-99a876f5f6e4\") " pod="openshift-ingress/e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s"
Sep 10 05:01:20.921608 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:20.921595    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9d58812-4328-4d41-b9ee-99a876f5f6e4-istio-podinfo\") pod \"e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s\" (UID: \"c9d58812-4328-4d41-b9ee-99a876f5f6e4\") " pod="openshift-ingress/e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s"
Sep 10 05:01:20.921689 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:20.921624    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9d58812-4328-4d41-b9ee-99a876f5f6e4-istio-envoy\") pod \"e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s\" (UID: \"c9d58812-4328-4d41-b9ee-99a876f5f6e4\") " pod="openshift-ingress/e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s"
Sep 10 05:01:20.921747 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:20.921719    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9d58812-4328-4d41-b9ee-99a876f5f6e4-workload-certs\") pod \"e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s\" (UID: \"c9d58812-4328-4d41-b9ee-99a876f5f6e4\") " pod="openshift-ingress/e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s"
Sep 10 05:01:20.931540 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:20.931522    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7858-cf2dcb"
Sep 10 05:01:20.933520 ip-10-0-138-27 kubenswrapper[2560]: E0910 05:01:20.933496    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7858-cf2dcb\" is forbidden: User \"system:node:ip-10-0-138-27.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-27.ec2.internal' and this object" podUID="5cefc79c-be9f-40ee-b341-8b3791924f19" pod="opendatahub/test-curl-7858-cf2dcb"
Sep 10 05:01:21.022615 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:21.022577    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w58lr\" (UniqueName: \"kubernetes.io/projected/5cefc79c-be9f-40ee-b341-8b3791924f19-kube-api-access-w58lr\") pod \"5cefc79c-be9f-40ee-b341-8b3791924f19\" (UID: \"5cefc79c-be9f-40ee-b341-8b3791924f19\") "
Sep 10 05:01:21.022808 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:21.022791    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9d58812-4328-4d41-b9ee-99a876f5f6e4-istio-data\") pod \"e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s\" (UID: \"c9d58812-4328-4d41-b9ee-99a876f5f6e4\") " pod="openshift-ingress/e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s"
Sep 10 05:01:21.022891 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:21.022876    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9d58812-4328-4d41-b9ee-99a876f5f6e4-istio-token\") pod \"e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s\" (UID: \"c9d58812-4328-4d41-b9ee-99a876f5f6e4\") " pod="openshift-ingress/e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s"
Sep 10 05:01:21.022934 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:21.022911    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjrtx\" (UniqueName: \"kubernetes.io/projected/c9d58812-4328-4d41-b9ee-99a876f5f6e4-kube-api-access-gjrtx\") pod \"e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s\" (UID: \"c9d58812-4328-4d41-b9ee-99a876f5f6e4\") " pod="openshift-ingress/e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s"
Sep 10 05:01:21.023005 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:21.022944    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9d58812-4328-4d41-b9ee-99a876f5f6e4-istio-podinfo\") pod \"e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s\" (UID: \"c9d58812-4328-4d41-b9ee-99a876f5f6e4\") " pod="openshift-ingress/e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s"
Sep 10 05:01:21.023005 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:21.022986    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9d58812-4328-4d41-b9ee-99a876f5f6e4-istio-envoy\") pod \"e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s\" (UID: \"c9d58812-4328-4d41-b9ee-99a876f5f6e4\") " pod="openshift-ingress/e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s"
Sep 10 05:01:21.023120 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:21.023024    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9d58812-4328-4d41-b9ee-99a876f5f6e4-workload-certs\") pod \"e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s\" (UID: \"c9d58812-4328-4d41-b9ee-99a876f5f6e4\") " pod="openshift-ingress/e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s"
Sep 10 05:01:21.023120 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:21.023101    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9d58812-4328-4d41-b9ee-99a876f5f6e4-istiod-ca-cert\") pod \"e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s\" (UID: \"c9d58812-4328-4d41-b9ee-99a876f5f6e4\") " pod="openshift-ingress/e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s"
Sep 10 05:01:21.023230 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:21.023135    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9d58812-4328-4d41-b9ee-99a876f5f6e4-credential-socket\") pod \"e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s\" (UID: \"c9d58812-4328-4d41-b9ee-99a876f5f6e4\") " pod="openshift-ingress/e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s"
Sep 10 05:01:21.023230 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:21.023144    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9d58812-4328-4d41-b9ee-99a876f5f6e4-istio-data\") pod \"e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s\" (UID: \"c9d58812-4328-4d41-b9ee-99a876f5f6e4\") " pod="openshift-ingress/e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s"
Sep 10 05:01:21.023230 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:21.023161    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9d58812-4328-4d41-b9ee-99a876f5f6e4-workload-socket\") pod \"e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s\" (UID: \"c9d58812-4328-4d41-b9ee-99a876f5f6e4\") " pod="openshift-ingress/e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s"
Sep 10 05:01:21.024051 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:21.023908    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9d58812-4328-4d41-b9ee-99a876f5f6e4-istiod-ca-cert\") pod \"e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s\" (UID: \"c9d58812-4328-4d41-b9ee-99a876f5f6e4\") " pod="openshift-ingress/e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s"
Sep 10 05:01:21.024277 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:21.024089    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9d58812-4328-4d41-b9ee-99a876f5f6e4-credential-socket\") pod \"e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s\" (UID: \"c9d58812-4328-4d41-b9ee-99a876f5f6e4\") " pod="openshift-ingress/e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s"
Sep 10 05:01:21.024277 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:21.024134    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9d58812-4328-4d41-b9ee-99a876f5f6e4-workload-certs\") pod \"e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s\" (UID: \"c9d58812-4328-4d41-b9ee-99a876f5f6e4\") " pod="openshift-ingress/e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s"
Sep 10 05:01:21.024277 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:21.024221    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9d58812-4328-4d41-b9ee-99a876f5f6e4-workload-socket\") pod \"e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s\" (UID: \"c9d58812-4328-4d41-b9ee-99a876f5f6e4\") " pod="openshift-ingress/e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s"
Sep 10 05:01:21.025281 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:21.025256    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9d58812-4328-4d41-b9ee-99a876f5f6e4-istio-envoy\") pod \"e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s\" (UID: \"c9d58812-4328-4d41-b9ee-99a876f5f6e4\") " pod="openshift-ingress/e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s"
Sep 10 05:01:21.025404 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:21.025378    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5cefc79c-be9f-40ee-b341-8b3791924f19-kube-api-access-w58lr" (OuterVolumeSpecName: "kube-api-access-w58lr") pod "5cefc79c-be9f-40ee-b341-8b3791924f19" (UID: "5cefc79c-be9f-40ee-b341-8b3791924f19"). InnerVolumeSpecName "kube-api-access-w58lr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 05:01:21.026266 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:21.026244    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9d58812-4328-4d41-b9ee-99a876f5f6e4-istio-podinfo\") pod \"e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s\" (UID: \"c9d58812-4328-4d41-b9ee-99a876f5f6e4\") " pod="openshift-ingress/e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s"
Sep 10 05:01:21.030501 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:21.030473    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9d58812-4328-4d41-b9ee-99a876f5f6e4-istio-token\") pod \"e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s\" (UID: \"c9d58812-4328-4d41-b9ee-99a876f5f6e4\") " pod="openshift-ingress/e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s"
Sep 10 05:01:21.030601 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:21.030482    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjrtx\" (UniqueName: \"kubernetes.io/projected/c9d58812-4328-4d41-b9ee-99a876f5f6e4-kube-api-access-gjrtx\") pod \"e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s\" (UID: \"c9d58812-4328-4d41-b9ee-99a876f5f6e4\") " pod="openshift-ingress/e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s"
Sep 10 05:01:21.092461 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:21.092421    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s"
Sep 10 05:01:21.113085 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:21.113045    2560 patch_prober.go:28] interesting pod/e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Sep 10 05:01:21.113224 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:21.113130    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr" podUID="231145e0-7b08-4465-ae64-2da3aaee4529" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Sep 10 05:01:21.123660 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:21.123625    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w58lr\" (UniqueName: \"kubernetes.io/projected/5cefc79c-be9f-40ee-b341-8b3791924f19-kube-api-access-w58lr\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:01:21.406254 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:21.406222    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s"]
Sep 10 05:01:21.407240 ip-10-0-138-27 kubenswrapper[2560]: W0910 05:01:21.407217    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9d58812_4328_4d41_b9ee_99a876f5f6e4.slice/crio-b5b15c00d9e3c9a1edaabb5afaf2234ba637958b701e481765bd507d41e617c9 WatchSource:0}: Error finding container b5b15c00d9e3c9a1edaabb5afaf2234ba637958b701e481765bd507d41e617c9: Status 404 returned error can't find the container with id b5b15c00d9e3c9a1edaabb5afaf2234ba637958b701e481765bd507d41e617c9
Sep 10 05:01:21.409599 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:21.409570    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 05:01:21.409670 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:21.409633    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 05:01:21.409670 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:21.409663    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 05:01:21.709502 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:21.709415    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn" event={"ID":"d30b8fb8-1f34-4f87-84c2-35430dd823d9","Type":"ContainerStarted","Data":"8bc6ea68f868ec7080bbda023a83cce669dca68e1a7400c5e5054d63d6611a35"}
Sep 10 05:01:21.709502 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:21.709475    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn" event={"ID":"d30b8fb8-1f34-4f87-84c2-35430dd823d9","Type":"ContainerStarted","Data":"c7c9dee185cd365a65ad2076ba0c5ddded7690193f8734b40b34f7b38fce8177"}
Sep 10 05:01:21.710788 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:21.710763    2560 generic.go:356] "Generic (PLEG): container finished" podID="5cefc79c-be9f-40ee-b341-8b3791924f19" containerID="f7aa0f95bcbf4562cb176bce815adc0524a06eab7119635c85cdd292da20263b" exitCode=137
Sep 10 05:01:21.710876 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:21.710796    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7858-cf2dcb"
Sep 10 05:01:21.710941 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:21.710881    2560 scope.go:117] "RemoveContainer" containerID="f7aa0f95bcbf4562cb176bce815adc0524a06eab7119635c85cdd292da20263b"
Sep 10 05:01:21.712846 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:21.712822    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s" event={"ID":"c9d58812-4328-4d41-b9ee-99a876f5f6e4","Type":"ContainerStarted","Data":"815f84a3a5ec166e5e18fa3762f7cd9d2406f2ef9ea201a0986fa82bb4283dd1"}
Sep 10 05:01:21.712976 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:21.712902    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s" event={"ID":"c9d58812-4328-4d41-b9ee-99a876f5f6e4","Type":"ContainerStarted","Data":"b5b15c00d9e3c9a1edaabb5afaf2234ba637958b701e481765bd507d41e617c9"}
Sep 10 05:01:21.722876 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:21.722844    2560 scope.go:117] "RemoveContainer" containerID="f7aa0f95bcbf4562cb176bce815adc0524a06eab7119635c85cdd292da20263b"
Sep 10 05:01:21.723139 ip-10-0-138-27 kubenswrapper[2560]: E0910 05:01:21.723122    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7aa0f95bcbf4562cb176bce815adc0524a06eab7119635c85cdd292da20263b\": container with ID starting with f7aa0f95bcbf4562cb176bce815adc0524a06eab7119635c85cdd292da20263b not found: ID does not exist" containerID="f7aa0f95bcbf4562cb176bce815adc0524a06eab7119635c85cdd292da20263b"
Sep 10 05:01:21.723204 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:21.723149    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7aa0f95bcbf4562cb176bce815adc0524a06eab7119635c85cdd292da20263b"} err="failed to get container status \"f7aa0f95bcbf4562cb176bce815adc0524a06eab7119635c85cdd292da20263b\": rpc error: code = NotFound desc = could not find container \"f7aa0f95bcbf4562cb176bce815adc0524a06eab7119635c85cdd292da20263b\": container with ID starting with f7aa0f95bcbf4562cb176bce815adc0524a06eab7119635c85cdd292da20263b not found: ID does not exist"
Sep 10 05:01:21.727469 ip-10-0-138-27 kubenswrapper[2560]: E0910 05:01:21.727443    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7858-cf2dcb\" is forbidden: User \"system:node:ip-10-0-138-27.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-27.ec2.internal' and this object" podUID="5cefc79c-be9f-40ee-b341-8b3791924f19" pod="opendatahub/test-curl-7858-cf2dcb"
Sep 10 05:01:21.728805 ip-10-0-138-27 kubenswrapper[2560]: E0910 05:01:21.728781    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7858-cf2dcb\" is forbidden: User \"system:node:ip-10-0-138-27.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-27.ec2.internal' and this object" podUID="5cefc79c-be9f-40ee-b341-8b3791924f19" pod="opendatahub/test-curl-7858-cf2dcb"
Sep 10 05:01:21.729940 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:21.729895    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn" podStartSLOduration=1.729878712 podStartE2EDuration="1.729878712s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 05:01:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 05:01:21.725940826 +0000 UTC m=+1221.388398573" watchObservedRunningTime="2026-09-10 05:01:21.729878712 +0000 UTC m=+1221.392336460"
Sep 10 05:01:21.751434 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:21.751390    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s" podStartSLOduration=1.751376104 podStartE2EDuration="1.751376104s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 05:01:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 05:01:21.7499728 +0000 UTC m=+1221.412430546" watchObservedRunningTime="2026-09-10 05:01:21.751376104 +0000 UTC m=+1221.413833850"
Sep 10 05:01:22.092882 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:22.092754    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s"
Sep 10 05:01:22.098237 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:22.098211    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s"
Sep 10 05:01:22.100494 ip-10-0-138-27 kubenswrapper[2560]: E0910 05:01:22.100460    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7858-cf2dcb\" is forbidden: User \"system:node:ip-10-0-138-27.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-27.ec2.internal' and this object" podUID="5cefc79c-be9f-40ee-b341-8b3791924f19" pod="opendatahub/test-curl-7858-cf2dcb"
Sep 10 05:01:22.115890 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:22.115867    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr"
Sep 10 05:01:22.116175 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:22.116153    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr"
Sep 10 05:01:22.116985 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:22.116965    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr"
Sep 10 05:01:22.179891 ip-10-0-138-27 kubenswrapper[2560]: E0910 05:01:22.179838    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7858-cf2dcb\" is forbidden: User \"system:node:ip-10-0-138-27.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-27.ec2.internal' and this object" podUID="5cefc79c-be9f-40ee-b341-8b3791924f19" pod="opendatahub/test-curl-7858-cf2dcb"
Sep 10 05:01:22.573926 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:22.573880    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn"
Sep 10 05:01:22.579104 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:22.579078    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn"
Sep 10 05:01:22.600899 ip-10-0-138-27 kubenswrapper[2560]: E0910 05:01:22.600845    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7858-cf2dcb\" is forbidden: User \"system:node:ip-10-0-138-27.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-27.ec2.internal' and this object" podUID="5cefc79c-be9f-40ee-b341-8b3791924f19" pod="opendatahub/test-curl-7858-cf2dcb"
Sep 10 05:01:22.721728 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:22.721700    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn"
Sep 10 05:01:22.722102 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:22.721829    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s"
Sep 10 05:01:22.722486 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:22.722465    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn"
Sep 10 05:01:22.722810 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:22.722795    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s"
Sep 10 05:01:22.744229 ip-10-0-138-27 kubenswrapper[2560]: E0910 05:01:22.744196    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7858-cf2dcb\" is forbidden: User \"system:node:ip-10-0-138-27.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-27.ec2.internal' and this object" podUID="5cefc79c-be9f-40ee-b341-8b3791924f19" pod="opendatahub/test-curl-7858-cf2dcb"
Sep 10 05:01:22.745709 ip-10-0-138-27 kubenswrapper[2560]: E0910 05:01:22.745676    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7858-cf2dcb\" is forbidden: User \"system:node:ip-10-0-138-27.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-27.ec2.internal' and this object" podUID="5cefc79c-be9f-40ee-b341-8b3791924f19" pod="opendatahub/test-curl-7858-cf2dcb"
Sep 10 05:01:22.827674 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:22.827583    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5cefc79c-be9f-40ee-b341-8b3791924f19" path="/var/lib/kubelet/pods/5cefc79c-be9f-40ee-b341-8b3791924f19/volumes"
Sep 10 05:01:22.906129 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:22.906102    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7858-0ab4ce"
Sep 10 05:01:22.945173 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:22.945135    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5pbm6\" (UniqueName: \"kubernetes.io/projected/7b2287ef-cf38-4c56-8265-1b3e6c46a6e9-kube-api-access-5pbm6\") pod \"7b2287ef-cf38-4c56-8265-1b3e6c46a6e9\" (UID: \"7b2287ef-cf38-4c56-8265-1b3e6c46a6e9\") "
Sep 10 05:01:22.947098 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:22.947071    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b2287ef-cf38-4c56-8265-1b3e6c46a6e9-kube-api-access-5pbm6" (OuterVolumeSpecName: "kube-api-access-5pbm6") pod "7b2287ef-cf38-4c56-8265-1b3e6c46a6e9" (UID: "7b2287ef-cf38-4c56-8265-1b3e6c46a6e9"). InnerVolumeSpecName "kube-api-access-5pbm6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 05:01:23.046861 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:23.046810    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5pbm6\" (UniqueName: \"kubernetes.io/projected/7b2287ef-cf38-4c56-8265-1b3e6c46a6e9-kube-api-access-5pbm6\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:01:23.729088 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:23.729055    2560 generic.go:356] "Generic (PLEG): container finished" podID="7b2287ef-cf38-4c56-8265-1b3e6c46a6e9" containerID="1609c2c584bfbc5870ab89f32dd2ec2ecfbff51fdd11177b0db50a0d02f11dfe" exitCode=137
Sep 10 05:01:23.729526 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:23.729109    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7858-0ab4ce"
Sep 10 05:01:23.729526 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:23.729168    2560 scope.go:117] "RemoveContainer" containerID="1609c2c584bfbc5870ab89f32dd2ec2ecfbff51fdd11177b0db50a0d02f11dfe"
Sep 10 05:01:23.732398 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:23.732376    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-13af27-29816940-759v8"]
Sep 10 05:01:23.737552 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:23.737530    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-13af27-29816940-759v8"]
Sep 10 05:01:23.741558 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:23.741539    2560 scope.go:117] "RemoveContainer" containerID="1609c2c584bfbc5870ab89f32dd2ec2ecfbff51fdd11177b0db50a0d02f11dfe"
Sep 10 05:01:23.742399 ip-10-0-138-27 kubenswrapper[2560]: E0910 05:01:23.742221    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1609c2c584bfbc5870ab89f32dd2ec2ecfbff51fdd11177b0db50a0d02f11dfe\": container with ID starting with 1609c2c584bfbc5870ab89f32dd2ec2ecfbff51fdd11177b0db50a0d02f11dfe not found: ID does not exist" containerID="1609c2c584bfbc5870ab89f32dd2ec2ecfbff51fdd11177b0db50a0d02f11dfe"
Sep 10 05:01:23.742399 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:23.742255    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1609c2c584bfbc5870ab89f32dd2ec2ecfbff51fdd11177b0db50a0d02f11dfe"} err="failed to get container status \"1609c2c584bfbc5870ab89f32dd2ec2ecfbff51fdd11177b0db50a0d02f11dfe\": rpc error: code = NotFound desc = could not find container \"1609c2c584bfbc5870ab89f32dd2ec2ecfbff51fdd11177b0db50a0d02f11dfe\": container with ID starting with 1609c2c584bfbc5870ab89f32dd2ec2ecfbff51fdd11177b0db50a0d02f11dfe not found: ID does not exist"
Sep 10 05:01:23.744485 ip-10-0-138-27 kubenswrapper[2560]: E0910 05:01:23.744461    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7858-0ab4ce\" is forbidden: User \"system:node:ip-10-0-138-27.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-27.ec2.internal' and this object" podUID="7b2287ef-cf38-4c56-8265-1b3e6c46a6e9" pod="opendatahub/test-curl-7858-0ab4ce"
Sep 10 05:01:24.826314 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:24.826283    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b2287ef-cf38-4c56-8265-1b3e6c46a6e9" path="/var/lib/kubelet/pods/7b2287ef-cf38-4c56-8265-1b3e6c46a6e9/volumes"
Sep 10 05:01:24.826648 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:24.826546    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5ebbb70-c4fa-439c-b65e-480fff500505" path="/var/lib/kubelet/pods/f5ebbb70-c4fa-439c-b65e-480fff500505/volumes"
Sep 10 05:01:25.137138 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:25.137110    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg"
Sep 10 05:01:25.167389 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:25.167356    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tcl5n\" (UniqueName: \"kubernetes.io/projected/2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4-kube-api-access-tcl5n\") pod \"2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4\" (UID: \"2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4\") "
Sep 10 05:01:25.167516 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:25.167430    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4-credential-socket\") pod \"2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4\" (UID: \"2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4\") "
Sep 10 05:01:25.167516 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:25.167499    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4-istiod-ca-cert\") pod \"2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4\" (UID: \"2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4\") "
Sep 10 05:01:25.167635 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:25.167558    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4-istio-podinfo\") pod \"2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4\" (UID: \"2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4\") "
Sep 10 05:01:25.167635 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:25.167594    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4-istio-envoy\") pod \"2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4\" (UID: \"2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4\") "
Sep 10 05:01:25.167635 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:25.167628    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4-istio-token\") pod \"2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4\" (UID: \"2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4\") "
Sep 10 05:01:25.167783 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:25.167679    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4-workload-socket\") pod \"2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4\" (UID: \"2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4\") "
Sep 10 05:01:25.167783 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:25.167712    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4-workload-certs\") pod \"2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4\" (UID: \"2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4\") "
Sep 10 05:01:25.167783 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:25.167737    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4-istio-data\") pod \"2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4\" (UID: \"2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4\") "
Sep 10 05:01:25.168005 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:25.167743    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4" (UID: "2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 05:01:25.168005 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:25.167930    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4" (UID: "2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 05:01:25.168180 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:25.168151    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4-istio-data" (OuterVolumeSpecName: "istio-data") pod "2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4" (UID: "2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 05:01:25.168290 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:25.168266    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4-istio-data\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:01:25.168362 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:25.168296    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4-credential-socket\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:01:25.168362 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:25.168311    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4-istiod-ca-cert\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:01:25.168362 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:25.168338    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4" (UID: "2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 05:01:25.168538 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:25.168511    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4" (UID: "2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 05:01:25.171706 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:25.171613    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4" (UID: "2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 05:01:25.172111 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:25.172078    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4-kube-api-access-tcl5n" (OuterVolumeSpecName: "kube-api-access-tcl5n") pod "2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4" (UID: "2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4"). InnerVolumeSpecName "kube-api-access-tcl5n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 05:01:25.172215 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:25.172083    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4" (UID: "2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 05:01:25.172280 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:25.172263    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4-istio-token" (OuterVolumeSpecName: "istio-token") pod "2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4" (UID: "2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 05:01:25.269576 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:25.269549    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4-istio-podinfo\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:01:25.269576 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:25.269572    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4-istio-envoy\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:01:25.269576 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:25.269580    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4-istio-token\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:01:25.269754 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:25.269588    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4-workload-socket\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:01:25.269754 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:25.269596    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4-workload-certs\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:01:25.269754 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:25.269605    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tcl5n\" (UniqueName: \"kubernetes.io/projected/2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4-kube-api-access-tcl5n\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:01:25.409543 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:25.409516    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 05:01:25.747069 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:25.746981    2560 generic.go:356] "Generic (PLEG): container finished" podID="2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4" containerID="5f9c0d5d3251e0f73a0815fc53f0fdcd0792ccb8657e1047409600e7fcafedd2" exitCode=0
Sep 10 05:01:25.747069 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:25.747045    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg"
Sep 10 05:01:25.747286 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:25.747060    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg" event={"ID":"2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4","Type":"ContainerDied","Data":"5f9c0d5d3251e0f73a0815fc53f0fdcd0792ccb8657e1047409600e7fcafedd2"}
Sep 10 05:01:25.747286 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:25.747145    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg" event={"ID":"2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4","Type":"ContainerDied","Data":"9d9f4b5997ffeb8f79d15cae6a2bc811627e2918973909fef0bdf3d5ff36a9a5"}
Sep 10 05:01:25.747286 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:25.747169    2560 scope.go:117] "RemoveContainer" containerID="5f9c0d5d3251e0f73a0815fc53f0fdcd0792ccb8657e1047409600e7fcafedd2"
Sep 10 05:01:25.759206 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:25.759181    2560 scope.go:117] "RemoveContainer" containerID="1572e2956c4af38ed80964484fcbbce8581c0e109f8abbf63d04529e8048af85"
Sep 10 05:01:25.768141 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:25.768122    2560 scope.go:117] "RemoveContainer" containerID="5f9c0d5d3251e0f73a0815fc53f0fdcd0792ccb8657e1047409600e7fcafedd2"
Sep 10 05:01:25.768430 ip-10-0-138-27 kubenswrapper[2560]: E0910 05:01:25.768400    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f9c0d5d3251e0f73a0815fc53f0fdcd0792ccb8657e1047409600e7fcafedd2\": container with ID starting with 5f9c0d5d3251e0f73a0815fc53f0fdcd0792ccb8657e1047409600e7fcafedd2 not found: ID does not exist" containerID="5f9c0d5d3251e0f73a0815fc53f0fdcd0792ccb8657e1047409600e7fcafedd2"
Sep 10 05:01:25.768486 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:25.768437    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f9c0d5d3251e0f73a0815fc53f0fdcd0792ccb8657e1047409600e7fcafedd2"} err="failed to get container status \"5f9c0d5d3251e0f73a0815fc53f0fdcd0792ccb8657e1047409600e7fcafedd2\": rpc error: code = NotFound desc = could not find container \"5f9c0d5d3251e0f73a0815fc53f0fdcd0792ccb8657e1047409600e7fcafedd2\": container with ID starting with 5f9c0d5d3251e0f73a0815fc53f0fdcd0792ccb8657e1047409600e7fcafedd2 not found: ID does not exist"
Sep 10 05:01:25.768486 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:25.768455    2560 scope.go:117] "RemoveContainer" containerID="1572e2956c4af38ed80964484fcbbce8581c0e109f8abbf63d04529e8048af85"
Sep 10 05:01:25.768775 ip-10-0-138-27 kubenswrapper[2560]: E0910 05:01:25.768753    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1572e2956c4af38ed80964484fcbbce8581c0e109f8abbf63d04529e8048af85\": container with ID starting with 1572e2956c4af38ed80964484fcbbce8581c0e109f8abbf63d04529e8048af85 not found: ID does not exist" containerID="1572e2956c4af38ed80964484fcbbce8581c0e109f8abbf63d04529e8048af85"
Sep 10 05:01:25.768841 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:25.768784    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1572e2956c4af38ed80964484fcbbce8581c0e109f8abbf63d04529e8048af85"} err="failed to get container status \"1572e2956c4af38ed80964484fcbbce8581c0e109f8abbf63d04529e8048af85\": rpc error: code = NotFound desc = could not find container \"1572e2956c4af38ed80964484fcbbce8581c0e109f8abbf63d04529e8048af85\": container with ID starting with 1572e2956c4af38ed80964484fcbbce8581c0e109f8abbf63d04529e8048af85 not found: ID does not exist"
Sep 10 05:01:25.769922 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:25.769902    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg"]
Sep 10 05:01:25.773537 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:25.773516    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-c9a840-openshift-default-7bbf97fd94-dknvg"]
Sep 10 05:01:26.826082 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:26.826030    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4" path="/var/lib/kubelet/pods/2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4/volumes"
Sep 10 05:01:43.878204 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:43.878172    2560 generic.go:356] "Generic (PLEG): container finished" podID="d30b8fb8-1f34-4f87-84c2-35430dd823d9" containerID="8bc6ea68f868ec7080bbda023a83cce669dca68e1a7400c5e5054d63d6611a35" exitCode=0
Sep 10 05:01:43.878710 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:43.878251    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn" event={"ID":"d30b8fb8-1f34-4f87-84c2-35430dd823d9","Type":"ContainerDied","Data":"8bc6ea68f868ec7080bbda023a83cce669dca68e1a7400c5e5054d63d6611a35"}
Sep 10 05:01:43.878710 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:43.878707    2560 scope.go:117] "RemoveContainer" containerID="8bc6ea68f868ec7080bbda023a83cce669dca68e1a7400c5e5054d63d6611a35"
Sep 10 05:01:43.879970 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:43.879942    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 05:01:43.880084 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:43.880012    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 05:01:43.880084 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:43.880048    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 05:01:43.880166 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:43.880130    2560 generic.go:356] "Generic (PLEG): container finished" podID="c9d58812-4328-4d41-b9ee-99a876f5f6e4" containerID="815f84a3a5ec166e5e18fa3762f7cd9d2406f2ef9ea201a0986fa82bb4283dd1" exitCode=0
Sep 10 05:01:43.880221 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:43.880202    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s" event={"ID":"c9d58812-4328-4d41-b9ee-99a876f5f6e4","Type":"ContainerDied","Data":"815f84a3a5ec166e5e18fa3762f7cd9d2406f2ef9ea201a0986fa82bb4283dd1"}
Sep 10 05:01:43.880580 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:43.880567    2560 scope.go:117] "RemoveContainer" containerID="815f84a3a5ec166e5e18fa3762f7cd9d2406f2ef9ea201a0986fa82bb4283dd1"
Sep 10 05:01:43.881585 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:43.881561    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 05:01:43.881680 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:43.881633    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 05:01:43.881742 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:43.881678    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 05:01:44.008902 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:44.006565    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 05:01:44.894224 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:44.894181    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn" event={"ID":"d30b8fb8-1f34-4f87-84c2-35430dd823d9","Type":"ContainerStarted","Data":"e59524850aa2b3ddca541b44c100b8a1c87841f467c9b6df9055ce5f064a1d99"}
Sep 10 05:01:44.896418 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:44.896393    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s" event={"ID":"c9d58812-4328-4d41-b9ee-99a876f5f6e4","Type":"ContainerStarted","Data":"4e856dc94f039f124159f44439a16b93d63643f9bee9f3583e4d6f513469bd0d"}
Sep 10 05:01:45.093608 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:45.093579    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s"
Sep 10 05:01:45.093930 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:45.093836    2560 patch_prober.go:28] interesting pod/e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Sep 10 05:01:45.094059 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:45.094041    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s" podUID="c9d58812-4328-4d41-b9ee-99a876f5f6e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Sep 10 05:01:45.573323 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:45.573276    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn"
Sep 10 05:01:45.573542 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:45.573419    2560 patch_prober.go:28] interesting pod/e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Sep 10 05:01:45.573542 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:45.573463    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn" podUID="d30b8fb8-1f34-4f87-84c2-35430dd823d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Sep 10 05:01:46.092838 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:46.092800    2560 patch_prober.go:28] interesting pod/e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Sep 10 05:01:46.093261 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:46.092885    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s" podUID="c9d58812-4328-4d41-b9ee-99a876f5f6e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Sep 10 05:01:46.574058 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:46.573559    2560 patch_prober.go:28] interesting pod/e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Sep 10 05:01:46.574058 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:46.573639    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn" podUID="d30b8fb8-1f34-4f87-84c2-35430dd823d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Sep 10 05:01:47.092824 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:47.092786    2560 patch_prober.go:28] interesting pod/e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Sep 10 05:01:47.093163 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:47.093113    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s" podUID="c9d58812-4328-4d41-b9ee-99a876f5f6e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Sep 10 05:01:47.573314 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:47.573270    2560 patch_prober.go:28] interesting pod/e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Sep 10 05:01:47.573535 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:47.573351    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn" podUID="d30b8fb8-1f34-4f87-84c2-35430dd823d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Sep 10 05:01:48.093542 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:48.093503    2560 patch_prober.go:28] interesting pod/e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Sep 10 05:01:48.093921 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:48.093575    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s" podUID="c9d58812-4328-4d41-b9ee-99a876f5f6e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Sep 10 05:01:48.573256 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:48.573217    2560 patch_prober.go:28] interesting pod/e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Sep 10 05:01:48.573489 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:48.573297    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn" podUID="d30b8fb8-1f34-4f87-84c2-35430dd823d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Sep 10 05:01:49.093526 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:49.093489    2560 patch_prober.go:28] interesting pod/e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Sep 10 05:01:49.093728 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:49.093549    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s" podUID="c9d58812-4328-4d41-b9ee-99a876f5f6e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Sep 10 05:01:49.573450 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:49.573389    2560 patch_prober.go:28] interesting pod/e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Sep 10 05:01:49.573653 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:49.573464    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn" podUID="d30b8fb8-1f34-4f87-84c2-35430dd823d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Sep 10 05:01:50.371369 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:50.371336    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s"
Sep 10 05:01:50.372395 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:50.372370    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s"
Sep 10 05:01:50.374154 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:50.374128    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s"
Sep 10 05:01:50.631565 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:50.631458    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn"
Sep 10 05:01:50.631985 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:50.631963    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn"
Sep 10 05:01:50.633140 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:50.633108    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn"
Sep 10 05:01:53.989390 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:53.989297    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3b702d-7bc8469c7d-lkbvp"]
Sep 10 05:01:53.989964 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:53.989941    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4" containerName="istio-proxy"
Sep 10 05:01:53.989964 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:53.989964    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4" containerName="istio-proxy"
Sep 10 05:01:53.990143 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:53.989991    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4" containerName="istio-proxy"
Sep 10 05:01:53.990143 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:53.990022    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4" containerName="istio-proxy"
Sep 10 05:01:53.990143 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:53.990103    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4" containerName="istio-proxy"
Sep 10 05:01:53.990143 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:53.990115    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b4bc7a5-b25d-4539-8f8b-f2d5c1b403a4" containerName="istio-proxy"
Sep 10 05:01:53.992956 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:53.992931    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3b702d-7bc8469c7d-lkbvp"
Sep 10 05:01:53.995078 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:53.995056    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w3-3b702d-serving-cert\""
Sep 10 05:01:54.005063 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:54.005043    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3b702d-7bc8469c7d-lkbvp"]
Sep 10 05:01:54.176793 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:54.176760    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9db96\" (UniqueName: \"kubernetes.io/projected/f41e86ac-ee6c-469e-a002-c7cd15a3bf7d-kube-api-access-9db96\") pod \"maas-api-e2e-shared-b-w3-3b702d-7bc8469c7d-lkbvp\" (UID: \"f41e86ac-ee6c-469e-a002-c7cd15a3bf7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3b702d-7bc8469c7d-lkbvp"
Sep 10 05:01:54.176978 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:54.176822    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f41e86ac-ee6c-469e-a002-c7cd15a3bf7d-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-3b702d-7bc8469c7d-lkbvp\" (UID: \"f41e86ac-ee6c-469e-a002-c7cd15a3bf7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3b702d-7bc8469c7d-lkbvp"
Sep 10 05:01:54.176978 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:54.176963    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f41e86ac-ee6c-469e-a002-c7cd15a3bf7d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-3b702d-7bc8469c7d-lkbvp\" (UID: \"f41e86ac-ee6c-469e-a002-c7cd15a3bf7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3b702d-7bc8469c7d-lkbvp"
Sep 10 05:01:54.177060 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:54.177012    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f41e86ac-ee6c-469e-a002-c7cd15a3bf7d-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-3b702d-7bc8469c7d-lkbvp\" (UID: \"f41e86ac-ee6c-469e-a002-c7cd15a3bf7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3b702d-7bc8469c7d-lkbvp"
Sep 10 05:01:54.278604 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:54.278523    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f41e86ac-ee6c-469e-a002-c7cd15a3bf7d-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-3b702d-7bc8469c7d-lkbvp\" (UID: \"f41e86ac-ee6c-469e-a002-c7cd15a3bf7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3b702d-7bc8469c7d-lkbvp"
Sep 10 05:01:54.278604 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:54.278588    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f41e86ac-ee6c-469e-a002-c7cd15a3bf7d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-3b702d-7bc8469c7d-lkbvp\" (UID: \"f41e86ac-ee6c-469e-a002-c7cd15a3bf7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3b702d-7bc8469c7d-lkbvp"
Sep 10 05:01:54.278802 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:54.278622    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f41e86ac-ee6c-469e-a002-c7cd15a3bf7d-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-3b702d-7bc8469c7d-lkbvp\" (UID: \"f41e86ac-ee6c-469e-a002-c7cd15a3bf7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3b702d-7bc8469c7d-lkbvp"
Sep 10 05:01:54.278802 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:54.278663    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9db96\" (UniqueName: \"kubernetes.io/projected/f41e86ac-ee6c-469e-a002-c7cd15a3bf7d-kube-api-access-9db96\") pod \"maas-api-e2e-shared-b-w3-3b702d-7bc8469c7d-lkbvp\" (UID: \"f41e86ac-ee6c-469e-a002-c7cd15a3bf7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3b702d-7bc8469c7d-lkbvp"
Sep 10 05:01:54.279218 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:54.279196    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f41e86ac-ee6c-469e-a002-c7cd15a3bf7d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-3b702d-7bc8469c7d-lkbvp\" (UID: \"f41e86ac-ee6c-469e-a002-c7cd15a3bf7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3b702d-7bc8469c7d-lkbvp"
Sep 10 05:01:54.281157 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:54.281131    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f41e86ac-ee6c-469e-a002-c7cd15a3bf7d-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-3b702d-7bc8469c7d-lkbvp\" (UID: \"f41e86ac-ee6c-469e-a002-c7cd15a3bf7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3b702d-7bc8469c7d-lkbvp"
Sep 10 05:01:54.281157 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:54.281152    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f41e86ac-ee6c-469e-a002-c7cd15a3bf7d-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-3b702d-7bc8469c7d-lkbvp\" (UID: \"f41e86ac-ee6c-469e-a002-c7cd15a3bf7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3b702d-7bc8469c7d-lkbvp"
Sep 10 05:01:54.286413 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:54.286391    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9db96\" (UniqueName: \"kubernetes.io/projected/f41e86ac-ee6c-469e-a002-c7cd15a3bf7d-kube-api-access-9db96\") pod \"maas-api-e2e-shared-b-w3-3b702d-7bc8469c7d-lkbvp\" (UID: \"f41e86ac-ee6c-469e-a002-c7cd15a3bf7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3b702d-7bc8469c7d-lkbvp"
Sep 10 05:01:54.304190 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:54.304163    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3b702d-7bc8469c7d-lkbvp"
Sep 10 05:01:54.589845 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:54.589818    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3b702d-7bc8469c7d-lkbvp"]
Sep 10 05:01:54.591529 ip-10-0-138-27 kubenswrapper[2560]: W0910 05:01:54.591504    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf41e86ac_ee6c_469e_a002_c7cd15a3bf7d.slice/crio-d5f5966b9b889aa1d4530b1bc33f5c01890cb2dabdd7fb2968b10fb6f53a9b28 WatchSource:0}: Error finding container d5f5966b9b889aa1d4530b1bc33f5c01890cb2dabdd7fb2968b10fb6f53a9b28: Status 404 returned error can't find the container with id d5f5966b9b889aa1d4530b1bc33f5c01890cb2dabdd7fb2968b10fb6f53a9b28
Sep 10 05:01:54.961695 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:54.961663    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3b702d-7bc8469c7d-lkbvp" event={"ID":"f41e86ac-ee6c-469e-a002-c7cd15a3bf7d","Type":"ContainerStarted","Data":"d5f5966b9b889aa1d4530b1bc33f5c01890cb2dabdd7fb2968b10fb6f53a9b28"}
Sep 10 05:01:55.969771 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:55.969728    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3b702d-7bc8469c7d-lkbvp" event={"ID":"f41e86ac-ee6c-469e-a002-c7cd15a3bf7d","Type":"ContainerStarted","Data":"d44b9c7ecb47edc5bc858b864964286b85039d0d8211dcf8d5b1433dacbcef6c"}
Sep 10 05:01:55.970284 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:55.969919    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3b702d-7bc8469c7d-lkbvp"
Sep 10 05:01:55.988041 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:55.987992    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3b702d-7bc8469c7d-lkbvp" podStartSLOduration=2.469321269 podStartE2EDuration="2.987976886s" totalImagesPullingTime="518.655617ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 05:01:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 05:01:55.985823191 +0000 UTC m=+1255.648280938" watchObservedRunningTime="2026-09-10 05:01:55.987976886 +0000 UTC m=+1255.650434633"
Sep 10 05:01:58.597051 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:01:58.597016    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 05:02:01.981540 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:02:01.981509    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3b702d-7bc8469c7d-lkbvp"
Sep 10 05:02:30.192241 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:02:30.192210    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 05:02:46.687182 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:02:46.687148    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 05:03:05.292295 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:03:05.292250    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 05:03:18.991233 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:03:18.991201    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 05:03:35.489088 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:03:35.489046    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 05:03:51.087788 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:03:51.087758    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 05:04:07.300082 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:04:07.300045    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 05:04:09.960622 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:04:09.960590    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn"]
Sep 10 05:04:09.961117 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:04:09.960815    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn" podUID="d30b8fb8-1f34-4f87-84c2-35430dd823d9" containerName="istio-proxy" containerID="cri-o://e59524850aa2b3ddca541b44c100b8a1c87841f467c9b6df9055ce5f064a1d99" gracePeriod=30
Sep 10 05:04:15.210726 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:04:15.210701    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn"
Sep 10 05:04:15.341547 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:04:15.341455    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d30b8fb8-1f34-4f87-84c2-35430dd823d9-credential-socket\") pod \"d30b8fb8-1f34-4f87-84c2-35430dd823d9\" (UID: \"d30b8fb8-1f34-4f87-84c2-35430dd823d9\") "
Sep 10 05:04:15.341547 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:04:15.341514    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d30b8fb8-1f34-4f87-84c2-35430dd823d9-istiod-ca-cert\") pod \"d30b8fb8-1f34-4f87-84c2-35430dd823d9\" (UID: \"d30b8fb8-1f34-4f87-84c2-35430dd823d9\") "
Sep 10 05:04:15.341547 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:04:15.341536    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d30b8fb8-1f34-4f87-84c2-35430dd823d9-istio-data\") pod \"d30b8fb8-1f34-4f87-84c2-35430dd823d9\" (UID: \"d30b8fb8-1f34-4f87-84c2-35430dd823d9\") "
Sep 10 05:04:15.341825 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:04:15.341561    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tlvqc\" (UniqueName: \"kubernetes.io/projected/d30b8fb8-1f34-4f87-84c2-35430dd823d9-kube-api-access-tlvqc\") pod \"d30b8fb8-1f34-4f87-84c2-35430dd823d9\" (UID: \"d30b8fb8-1f34-4f87-84c2-35430dd823d9\") "
Sep 10 05:04:15.341825 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:04:15.341611    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d30b8fb8-1f34-4f87-84c2-35430dd823d9-istio-token\") pod \"d30b8fb8-1f34-4f87-84c2-35430dd823d9\" (UID: \"d30b8fb8-1f34-4f87-84c2-35430dd823d9\") "
Sep 10 05:04:15.341825 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:04:15.341640    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d30b8fb8-1f34-4f87-84c2-35430dd823d9-workload-certs\") pod \"d30b8fb8-1f34-4f87-84c2-35430dd823d9\" (UID: \"d30b8fb8-1f34-4f87-84c2-35430dd823d9\") "
Sep 10 05:04:15.341825 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:04:15.341752    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d30b8fb8-1f34-4f87-84c2-35430dd823d9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d30b8fb8-1f34-4f87-84c2-35430dd823d9" (UID: "d30b8fb8-1f34-4f87-84c2-35430dd823d9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 05:04:15.341825 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:04:15.341787    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d30b8fb8-1f34-4f87-84c2-35430dd823d9-istio-envoy\") pod \"d30b8fb8-1f34-4f87-84c2-35430dd823d9\" (UID: \"d30b8fb8-1f34-4f87-84c2-35430dd823d9\") "
Sep 10 05:04:15.342116 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:04:15.341843    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d30b8fb8-1f34-4f87-84c2-35430dd823d9-workload-socket\") pod \"d30b8fb8-1f34-4f87-84c2-35430dd823d9\" (UID: \"d30b8fb8-1f34-4f87-84c2-35430dd823d9\") "
Sep 10 05:04:15.342116 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:04:15.341907    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d30b8fb8-1f34-4f87-84c2-35430dd823d9-istio-data" (OuterVolumeSpecName: "istio-data") pod "d30b8fb8-1f34-4f87-84c2-35430dd823d9" (UID: "d30b8fb8-1f34-4f87-84c2-35430dd823d9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 05:04:15.342116 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:04:15.341927    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d30b8fb8-1f34-4f87-84c2-35430dd823d9-istio-podinfo\") pod \"d30b8fb8-1f34-4f87-84c2-35430dd823d9\" (UID: \"d30b8fb8-1f34-4f87-84c2-35430dd823d9\") "
Sep 10 05:04:15.342116 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:04:15.341964    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d30b8fb8-1f34-4f87-84c2-35430dd823d9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d30b8fb8-1f34-4f87-84c2-35430dd823d9" (UID: "d30b8fb8-1f34-4f87-84c2-35430dd823d9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 05:04:15.342345 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:04:15.342321    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d30b8fb8-1f34-4f87-84c2-35430dd823d9-credential-socket\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:04:15.342345 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:04:15.342347    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d30b8fb8-1f34-4f87-84c2-35430dd823d9-istio-data\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:04:15.342614 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:04:15.342361    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d30b8fb8-1f34-4f87-84c2-35430dd823d9-workload-certs\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:04:15.342614 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:04:15.342474    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d30b8fb8-1f34-4f87-84c2-35430dd823d9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d30b8fb8-1f34-4f87-84c2-35430dd823d9" (UID: "d30b8fb8-1f34-4f87-84c2-35430dd823d9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 05:04:15.342614 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:04:15.342552    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d30b8fb8-1f34-4f87-84c2-35430dd823d9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d30b8fb8-1f34-4f87-84c2-35430dd823d9" (UID: "d30b8fb8-1f34-4f87-84c2-35430dd823d9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 05:04:15.344354 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:04:15.344316    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d30b8fb8-1f34-4f87-84c2-35430dd823d9-kube-api-access-tlvqc" (OuterVolumeSpecName: "kube-api-access-tlvqc") pod "d30b8fb8-1f34-4f87-84c2-35430dd823d9" (UID: "d30b8fb8-1f34-4f87-84c2-35430dd823d9"). InnerVolumeSpecName "kube-api-access-tlvqc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 05:04:15.344470 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:04:15.344378    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d30b8fb8-1f34-4f87-84c2-35430dd823d9-istio-token" (OuterVolumeSpecName: "istio-token") pod "d30b8fb8-1f34-4f87-84c2-35430dd823d9" (UID: "d30b8fb8-1f34-4f87-84c2-35430dd823d9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 05:04:15.344648 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:04:15.344626    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d30b8fb8-1f34-4f87-84c2-35430dd823d9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d30b8fb8-1f34-4f87-84c2-35430dd823d9" (UID: "d30b8fb8-1f34-4f87-84c2-35430dd823d9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 05:04:15.344840 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:04:15.344822    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d30b8fb8-1f34-4f87-84c2-35430dd823d9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d30b8fb8-1f34-4f87-84c2-35430dd823d9" (UID: "d30b8fb8-1f34-4f87-84c2-35430dd823d9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 05:04:15.443403 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:04:15.443357    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d30b8fb8-1f34-4f87-84c2-35430dd823d9-istiod-ca-cert\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:04:15.443403 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:04:15.443392    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tlvqc\" (UniqueName: \"kubernetes.io/projected/d30b8fb8-1f34-4f87-84c2-35430dd823d9-kube-api-access-tlvqc\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:04:15.443403 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:04:15.443408    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d30b8fb8-1f34-4f87-84c2-35430dd823d9-istio-token\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:04:15.443724 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:04:15.443419    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d30b8fb8-1f34-4f87-84c2-35430dd823d9-istio-envoy\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:04:15.443724 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:04:15.443428    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d30b8fb8-1f34-4f87-84c2-35430dd823d9-workload-socket\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:04:15.443724 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:04:15.443438    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d30b8fb8-1f34-4f87-84c2-35430dd823d9-istio-podinfo\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:04:15.855447 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:04:15.855413    2560 generic.go:356] "Generic (PLEG): container finished" podID="d30b8fb8-1f34-4f87-84c2-35430dd823d9" containerID="e59524850aa2b3ddca541b44c100b8a1c87841f467c9b6df9055ce5f064a1d99" exitCode=0
Sep 10 05:04:15.855602 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:04:15.855459    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn"
Sep 10 05:04:15.855602 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:04:15.855498    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn" event={"ID":"d30b8fb8-1f34-4f87-84c2-35430dd823d9","Type":"ContainerDied","Data":"e59524850aa2b3ddca541b44c100b8a1c87841f467c9b6df9055ce5f064a1d99"}
Sep 10 05:04:15.855602 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:04:15.855553    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn" event={"ID":"d30b8fb8-1f34-4f87-84c2-35430dd823d9","Type":"ContainerDied","Data":"c7c9dee185cd365a65ad2076ba0c5ddded7690193f8734b40b34f7b38fce8177"}
Sep 10 05:04:15.855602 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:04:15.855577    2560 scope.go:117] "RemoveContainer" containerID="e59524850aa2b3ddca541b44c100b8a1c87841f467c9b6df9055ce5f064a1d99"
Sep 10 05:04:15.867041 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:04:15.867017    2560 scope.go:117] "RemoveContainer" containerID="8bc6ea68f868ec7080bbda023a83cce669dca68e1a7400c5e5054d63d6611a35"
Sep 10 05:04:15.876422 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:04:15.876397    2560 scope.go:117] "RemoveContainer" containerID="e59524850aa2b3ddca541b44c100b8a1c87841f467c9b6df9055ce5f064a1d99"
Sep 10 05:04:15.876690 ip-10-0-138-27 kubenswrapper[2560]: E0910 05:04:15.876671    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e59524850aa2b3ddca541b44c100b8a1c87841f467c9b6df9055ce5f064a1d99\": container with ID starting with e59524850aa2b3ddca541b44c100b8a1c87841f467c9b6df9055ce5f064a1d99 not found: ID does not exist" containerID="e59524850aa2b3ddca541b44c100b8a1c87841f467c9b6df9055ce5f064a1d99"
Sep 10 05:04:15.876750 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:04:15.876699    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e59524850aa2b3ddca541b44c100b8a1c87841f467c9b6df9055ce5f064a1d99"} err="failed to get container status \"e59524850aa2b3ddca541b44c100b8a1c87841f467c9b6df9055ce5f064a1d99\": rpc error: code = NotFound desc = could not find container \"e59524850aa2b3ddca541b44c100b8a1c87841f467c9b6df9055ce5f064a1d99\": container with ID starting with e59524850aa2b3ddca541b44c100b8a1c87841f467c9b6df9055ce5f064a1d99 not found: ID does not exist"
Sep 10 05:04:15.876750 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:04:15.876717    2560 scope.go:117] "RemoveContainer" containerID="8bc6ea68f868ec7080bbda023a83cce669dca68e1a7400c5e5054d63d6611a35"
Sep 10 05:04:15.877036 ip-10-0-138-27 kubenswrapper[2560]: E0910 05:04:15.877015    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8bc6ea68f868ec7080bbda023a83cce669dca68e1a7400c5e5054d63d6611a35\": container with ID starting with 8bc6ea68f868ec7080bbda023a83cce669dca68e1a7400c5e5054d63d6611a35 not found: ID does not exist" containerID="8bc6ea68f868ec7080bbda023a83cce669dca68e1a7400c5e5054d63d6611a35"
Sep 10 05:04:15.877112 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:04:15.877046    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8bc6ea68f868ec7080bbda023a83cce669dca68e1a7400c5e5054d63d6611a35"} err="failed to get container status \"8bc6ea68f868ec7080bbda023a83cce669dca68e1a7400c5e5054d63d6611a35\": rpc error: code = NotFound desc = could not find container \"8bc6ea68f868ec7080bbda023a83cce669dca68e1a7400c5e5054d63d6611a35\": container with ID starting with 8bc6ea68f868ec7080bbda023a83cce669dca68e1a7400c5e5054d63d6611a35 not found: ID does not exist"
Sep 10 05:04:15.878217 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:04:15.878197    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn"]
Sep 10 05:04:15.881888 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:04:15.881869    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-8fcf3f8b-openshift-default-6549f5c64d-dmlhn"]
Sep 10 05:04:16.826022 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:04:16.825990    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d30b8fb8-1f34-4f87-84c2-35430dd823d9" path="/var/lib/kubelet/pods/d30b8fb8-1f34-4f87-84c2-35430dd823d9/volumes"
Sep 10 05:04:23.597934 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:04:23.597896    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 05:04:38.988799 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:04:38.988755    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 05:04:40.996920 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:04:40.996887    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7861-0c9547"]
Sep 10 05:04:40.997307 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:04:40.997294    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d30b8fb8-1f34-4f87-84c2-35430dd823d9" containerName="istio-proxy"
Sep 10 05:04:40.997307 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:04:40.997308    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="d30b8fb8-1f34-4f87-84c2-35430dd823d9" containerName="istio-proxy"
Sep 10 05:04:40.997396 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:04:40.997387    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="d30b8fb8-1f34-4f87-84c2-35430dd823d9" containerName="istio-proxy"
Sep 10 05:04:40.997432 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:04:40.997397    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="d30b8fb8-1f34-4f87-84c2-35430dd823d9" containerName="istio-proxy"
Sep 10 05:04:40.999490 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:04:40.999473    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7861-0c9547"
Sep 10 05:04:41.001448 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:04:41.001427    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-6n9j9\""
Sep 10 05:04:41.006765 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:04:41.006740    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7861-0c9547"]
Sep 10 05:04:41.065057 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:04:41.065029    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4km9h\" (UniqueName: \"kubernetes.io/projected/f376b89a-b0c4-4ea0-abbb-b4e4af6171aa-kube-api-access-4km9h\") pod \"test-curl-7861-0c9547\" (UID: \"f376b89a-b0c4-4ea0-abbb-b4e4af6171aa\") " pod="opendatahub/test-curl-7861-0c9547"
Sep 10 05:04:41.165883 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:04:41.165836    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4km9h\" (UniqueName: \"kubernetes.io/projected/f376b89a-b0c4-4ea0-abbb-b4e4af6171aa-kube-api-access-4km9h\") pod \"test-curl-7861-0c9547\" (UID: \"f376b89a-b0c4-4ea0-abbb-b4e4af6171aa\") " pod="opendatahub/test-curl-7861-0c9547"
Sep 10 05:04:41.173063 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:04:41.173041    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4km9h\" (UniqueName: \"kubernetes.io/projected/f376b89a-b0c4-4ea0-abbb-b4e4af6171aa-kube-api-access-4km9h\") pod \"test-curl-7861-0c9547\" (UID: \"f376b89a-b0c4-4ea0-abbb-b4e4af6171aa\") " pod="opendatahub/test-curl-7861-0c9547"
Sep 10 05:04:41.310691 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:04:41.310623    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7861-0c9547"
Sep 10 05:04:41.581396 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:04:41.581366    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7861-0c9547"]
Sep 10 05:04:41.582937 ip-10-0-138-27 kubenswrapper[2560]: W0910 05:04:41.582911    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf376b89a_b0c4_4ea0_abbb_b4e4af6171aa.slice/crio-fed448037b8c01c6048c985273b5dc8579e2cd8b17d16272b90a467f7aa18d64 WatchSource:0}: Error finding container fed448037b8c01c6048c985273b5dc8579e2cd8b17d16272b90a467f7aa18d64: Status 404 returned error can't find the container with id fed448037b8c01c6048c985273b5dc8579e2cd8b17d16272b90a467f7aa18d64
Sep 10 05:04:42.013385 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:04:42.013352    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7861-0c9547" event={"ID":"f376b89a-b0c4-4ea0-abbb-b4e4af6171aa","Type":"ContainerStarted","Data":"eb41c35b1e9e680e81166ba5341785e10ce2406a3ad53030b05e5c853daedb8e"}
Sep 10 05:04:42.013765 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:04:42.013393    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7861-0c9547" event={"ID":"f376b89a-b0c4-4ea0-abbb-b4e4af6171aa","Type":"ContainerStarted","Data":"fed448037b8c01c6048c985273b5dc8579e2cd8b17d16272b90a467f7aa18d64"}
Sep 10 05:04:42.027826 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:04:42.027775    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7861-0c9547" podStartSLOduration=2.027761615 podStartE2EDuration="2.027761615s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 05:04:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 05:04:42.025960325 +0000 UTC m=+1421.688418072" watchObservedRunningTime="2026-09-10 05:04:42.027761615 +0000 UTC m=+1421.690219361"
Sep 10 05:04:42.665950 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:04:42.665909    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7861-0c9547"]
Sep 10 05:04:42.672878 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:04:42.672821    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7861-0c9547"]
Sep 10 05:04:43.019923 ip-10-0-138-27 kubenswrapper[2560]: E0910 05:04:43.019892    2560 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7861-0c9547" container="test-curl-7861-0c9547"
Sep 10 05:04:44.027740 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:04:44.027676    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7861-0c9547" podUID="f376b89a-b0c4-4ea0-abbb-b4e4af6171aa" containerName="test-curl-7861-0c9547" containerID="cri-o://eb41c35b1e9e680e81166ba5341785e10ce2406a3ad53030b05e5c853daedb8e" gracePeriod=2
Sep 10 05:04:46.198942 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:04:46.198917    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7861-0c9547"
Sep 10 05:04:46.311764 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:04:46.311705    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4km9h\" (UniqueName: \"kubernetes.io/projected/f376b89a-b0c4-4ea0-abbb-b4e4af6171aa-kube-api-access-4km9h\") pod \"f376b89a-b0c4-4ea0-abbb-b4e4af6171aa\" (UID: \"f376b89a-b0c4-4ea0-abbb-b4e4af6171aa\") "
Sep 10 05:04:46.313645 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:04:46.313619    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f376b89a-b0c4-4ea0-abbb-b4e4af6171aa-kube-api-access-4km9h" (OuterVolumeSpecName: "kube-api-access-4km9h") pod "f376b89a-b0c4-4ea0-abbb-b4e4af6171aa" (UID: "f376b89a-b0c4-4ea0-abbb-b4e4af6171aa"). InnerVolumeSpecName "kube-api-access-4km9h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 05:04:46.413539 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:04:46.413513    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4km9h\" (UniqueName: \"kubernetes.io/projected/f376b89a-b0c4-4ea0-abbb-b4e4af6171aa-kube-api-access-4km9h\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:04:46.826041 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:04:46.826007    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f376b89a-b0c4-4ea0-abbb-b4e4af6171aa" path="/var/lib/kubelet/pods/f376b89a-b0c4-4ea0-abbb-b4e4af6171aa/volumes"
Sep 10 05:04:47.048114 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:04:47.048079    2560 generic.go:356] "Generic (PLEG): container finished" podID="f376b89a-b0c4-4ea0-abbb-b4e4af6171aa" containerID="eb41c35b1e9e680e81166ba5341785e10ce2406a3ad53030b05e5c853daedb8e" exitCode=137
Sep 10 05:04:47.048273 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:04:47.048116    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7861-0c9547"
Sep 10 05:04:47.048273 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:04:47.048175    2560 scope.go:117] "RemoveContainer" containerID="eb41c35b1e9e680e81166ba5341785e10ce2406a3ad53030b05e5c853daedb8e"
Sep 10 05:04:47.057249 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:04:47.057200    2560 scope.go:117] "RemoveContainer" containerID="eb41c35b1e9e680e81166ba5341785e10ce2406a3ad53030b05e5c853daedb8e"
Sep 10 05:04:47.057483 ip-10-0-138-27 kubenswrapper[2560]: E0910 05:04:47.057465    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb41c35b1e9e680e81166ba5341785e10ce2406a3ad53030b05e5c853daedb8e\": container with ID starting with eb41c35b1e9e680e81166ba5341785e10ce2406a3ad53030b05e5c853daedb8e not found: ID does not exist" containerID="eb41c35b1e9e680e81166ba5341785e10ce2406a3ad53030b05e5c853daedb8e"
Sep 10 05:04:47.057533 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:04:47.057492    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb41c35b1e9e680e81166ba5341785e10ce2406a3ad53030b05e5c853daedb8e"} err="failed to get container status \"eb41c35b1e9e680e81166ba5341785e10ce2406a3ad53030b05e5c853daedb8e\": rpc error: code = NotFound desc = could not find container \"eb41c35b1e9e680e81166ba5341785e10ce2406a3ad53030b05e5c853daedb8e\": container with ID starting with eb41c35b1e9e680e81166ba5341785e10ce2406a3ad53030b05e5c853daedb8e not found: ID does not exist"
Sep 10 05:04:50.092569 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:04:50.092535    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 05:05:00.591089 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:00.591005    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 05:05:04.194996 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:04.194964    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-c5e779-openshift-default-677496987b-fwhkt"]
Sep 10 05:05:04.195467 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:04.195450    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f376b89a-b0c4-4ea0-abbb-b4e4af6171aa" containerName="test-curl-7861-0c9547"
Sep 10 05:05:04.195513 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:04.195470    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f376b89a-b0c4-4ea0-abbb-b4e4af6171aa" containerName="test-curl-7861-0c9547"
Sep 10 05:05:04.195513 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:04.195483    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d30b8fb8-1f34-4f87-84c2-35430dd823d9" containerName="istio-proxy"
Sep 10 05:05:04.195513 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:04.195490    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="d30b8fb8-1f34-4f87-84c2-35430dd823d9" containerName="istio-proxy"
Sep 10 05:05:04.195616 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:04.195557    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f376b89a-b0c4-4ea0-abbb-b4e4af6171aa" containerName="test-curl-7861-0c9547"
Sep 10 05:05:04.198384 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:04.198368    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c5e779-openshift-default-677496987b-fwhkt"
Sep 10 05:05:04.200615 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:04.200592    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-c5e779-openshift-default-dockercfg-n6xpj\""
Sep 10 05:05:04.212309 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:04.212281    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-c5e779-openshift-default-677496987b-fwhkt"]
Sep 10 05:05:04.269670 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:04.269632    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0c4ca89-0a02-4d39-8dbd-11aebc6af20d-istio-token\") pod \"e2e-api-a-c5e779-openshift-default-677496987b-fwhkt\" (UID: \"e0c4ca89-0a02-4d39-8dbd-11aebc6af20d\") " pod="openshift-ingress/e2e-api-a-c5e779-openshift-default-677496987b-fwhkt"
Sep 10 05:05:04.269887 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:04.269677    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0c4ca89-0a02-4d39-8dbd-11aebc6af20d-credential-socket\") pod \"e2e-api-a-c5e779-openshift-default-677496987b-fwhkt\" (UID: \"e0c4ca89-0a02-4d39-8dbd-11aebc6af20d\") " pod="openshift-ingress/e2e-api-a-c5e779-openshift-default-677496987b-fwhkt"
Sep 10 05:05:04.269887 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:04.269716    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0c4ca89-0a02-4d39-8dbd-11aebc6af20d-workload-certs\") pod \"e2e-api-a-c5e779-openshift-default-677496987b-fwhkt\" (UID: \"e0c4ca89-0a02-4d39-8dbd-11aebc6af20d\") " pod="openshift-ingress/e2e-api-a-c5e779-openshift-default-677496987b-fwhkt"
Sep 10 05:05:04.269887 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:04.269762    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxswr\" (UniqueName: \"kubernetes.io/projected/e0c4ca89-0a02-4d39-8dbd-11aebc6af20d-kube-api-access-sxswr\") pod \"e2e-api-a-c5e779-openshift-default-677496987b-fwhkt\" (UID: \"e0c4ca89-0a02-4d39-8dbd-11aebc6af20d\") " pod="openshift-ingress/e2e-api-a-c5e779-openshift-default-677496987b-fwhkt"
Sep 10 05:05:04.269887 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:04.269800    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0c4ca89-0a02-4d39-8dbd-11aebc6af20d-workload-socket\") pod \"e2e-api-a-c5e779-openshift-default-677496987b-fwhkt\" (UID: \"e0c4ca89-0a02-4d39-8dbd-11aebc6af20d\") " pod="openshift-ingress/e2e-api-a-c5e779-openshift-default-677496987b-fwhkt"
Sep 10 05:05:04.269887 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:04.269822    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e0c4ca89-0a02-4d39-8dbd-11aebc6af20d-istio-envoy\") pod \"e2e-api-a-c5e779-openshift-default-677496987b-fwhkt\" (UID: \"e0c4ca89-0a02-4d39-8dbd-11aebc6af20d\") " pod="openshift-ingress/e2e-api-a-c5e779-openshift-default-677496987b-fwhkt"
Sep 10 05:05:04.270142 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:04.269907    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e0c4ca89-0a02-4d39-8dbd-11aebc6af20d-istio-data\") pod \"e2e-api-a-c5e779-openshift-default-677496987b-fwhkt\" (UID: \"e0c4ca89-0a02-4d39-8dbd-11aebc6af20d\") " pod="openshift-ingress/e2e-api-a-c5e779-openshift-default-677496987b-fwhkt"
Sep 10 05:05:04.270142 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:04.269930    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e0c4ca89-0a02-4d39-8dbd-11aebc6af20d-istiod-ca-cert\") pod \"e2e-api-a-c5e779-openshift-default-677496987b-fwhkt\" (UID: \"e0c4ca89-0a02-4d39-8dbd-11aebc6af20d\") " pod="openshift-ingress/e2e-api-a-c5e779-openshift-default-677496987b-fwhkt"
Sep 10 05:05:04.270142 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:04.269974    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e0c4ca89-0a02-4d39-8dbd-11aebc6af20d-istio-podinfo\") pod \"e2e-api-a-c5e779-openshift-default-677496987b-fwhkt\" (UID: \"e0c4ca89-0a02-4d39-8dbd-11aebc6af20d\") " pod="openshift-ingress/e2e-api-a-c5e779-openshift-default-677496987b-fwhkt"
Sep 10 05:05:04.371505 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:04.371471    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e0c4ca89-0a02-4d39-8dbd-11aebc6af20d-istio-data\") pod \"e2e-api-a-c5e779-openshift-default-677496987b-fwhkt\" (UID: \"e0c4ca89-0a02-4d39-8dbd-11aebc6af20d\") " pod="openshift-ingress/e2e-api-a-c5e779-openshift-default-677496987b-fwhkt"
Sep 10 05:05:04.371505 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:04.371506    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e0c4ca89-0a02-4d39-8dbd-11aebc6af20d-istiod-ca-cert\") pod \"e2e-api-a-c5e779-openshift-default-677496987b-fwhkt\" (UID: \"e0c4ca89-0a02-4d39-8dbd-11aebc6af20d\") " pod="openshift-ingress/e2e-api-a-c5e779-openshift-default-677496987b-fwhkt"
Sep 10 05:05:04.371716 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:04.371530    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e0c4ca89-0a02-4d39-8dbd-11aebc6af20d-istio-podinfo\") pod \"e2e-api-a-c5e779-openshift-default-677496987b-fwhkt\" (UID: \"e0c4ca89-0a02-4d39-8dbd-11aebc6af20d\") " pod="openshift-ingress/e2e-api-a-c5e779-openshift-default-677496987b-fwhkt"
Sep 10 05:05:04.371716 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:04.371575    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0c4ca89-0a02-4d39-8dbd-11aebc6af20d-istio-token\") pod \"e2e-api-a-c5e779-openshift-default-677496987b-fwhkt\" (UID: \"e0c4ca89-0a02-4d39-8dbd-11aebc6af20d\") " pod="openshift-ingress/e2e-api-a-c5e779-openshift-default-677496987b-fwhkt"
Sep 10 05:05:04.371716 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:04.371599    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0c4ca89-0a02-4d39-8dbd-11aebc6af20d-credential-socket\") pod \"e2e-api-a-c5e779-openshift-default-677496987b-fwhkt\" (UID: \"e0c4ca89-0a02-4d39-8dbd-11aebc6af20d\") " pod="openshift-ingress/e2e-api-a-c5e779-openshift-default-677496987b-fwhkt"
Sep 10 05:05:04.371716 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:04.371628    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0c4ca89-0a02-4d39-8dbd-11aebc6af20d-workload-certs\") pod \"e2e-api-a-c5e779-openshift-default-677496987b-fwhkt\" (UID: \"e0c4ca89-0a02-4d39-8dbd-11aebc6af20d\") " pod="openshift-ingress/e2e-api-a-c5e779-openshift-default-677496987b-fwhkt"
Sep 10 05:05:04.371716 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:04.371682    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxswr\" (UniqueName: \"kubernetes.io/projected/e0c4ca89-0a02-4d39-8dbd-11aebc6af20d-kube-api-access-sxswr\") pod \"e2e-api-a-c5e779-openshift-default-677496987b-fwhkt\" (UID: \"e0c4ca89-0a02-4d39-8dbd-11aebc6af20d\") " pod="openshift-ingress/e2e-api-a-c5e779-openshift-default-677496987b-fwhkt"
Sep 10 05:05:04.372018 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:04.371716    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0c4ca89-0a02-4d39-8dbd-11aebc6af20d-workload-socket\") pod \"e2e-api-a-c5e779-openshift-default-677496987b-fwhkt\" (UID: \"e0c4ca89-0a02-4d39-8dbd-11aebc6af20d\") " pod="openshift-ingress/e2e-api-a-c5e779-openshift-default-677496987b-fwhkt"
Sep 10 05:05:04.372018 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:04.371741    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e0c4ca89-0a02-4d39-8dbd-11aebc6af20d-istio-envoy\") pod \"e2e-api-a-c5e779-openshift-default-677496987b-fwhkt\" (UID: \"e0c4ca89-0a02-4d39-8dbd-11aebc6af20d\") " pod="openshift-ingress/e2e-api-a-c5e779-openshift-default-677496987b-fwhkt"
Sep 10 05:05:04.372135 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:04.372114    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0c4ca89-0a02-4d39-8dbd-11aebc6af20d-credential-socket\") pod \"e2e-api-a-c5e779-openshift-default-677496987b-fwhkt\" (UID: \"e0c4ca89-0a02-4d39-8dbd-11aebc6af20d\") " pod="openshift-ingress/e2e-api-a-c5e779-openshift-default-677496987b-fwhkt"
Sep 10 05:05:04.372197 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:04.372126    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0c4ca89-0a02-4d39-8dbd-11aebc6af20d-workload-certs\") pod \"e2e-api-a-c5e779-openshift-default-677496987b-fwhkt\" (UID: \"e0c4ca89-0a02-4d39-8dbd-11aebc6af20d\") " pod="openshift-ingress/e2e-api-a-c5e779-openshift-default-677496987b-fwhkt"
Sep 10 05:05:04.372253 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:04.372240    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0c4ca89-0a02-4d39-8dbd-11aebc6af20d-workload-socket\") pod \"e2e-api-a-c5e779-openshift-default-677496987b-fwhkt\" (UID: \"e0c4ca89-0a02-4d39-8dbd-11aebc6af20d\") " pod="openshift-ingress/e2e-api-a-c5e779-openshift-default-677496987b-fwhkt"
Sep 10 05:05:04.372331 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:04.372310    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e0c4ca89-0a02-4d39-8dbd-11aebc6af20d-istiod-ca-cert\") pod \"e2e-api-a-c5e779-openshift-default-677496987b-fwhkt\" (UID: \"e0c4ca89-0a02-4d39-8dbd-11aebc6af20d\") " pod="openshift-ingress/e2e-api-a-c5e779-openshift-default-677496987b-fwhkt"
Sep 10 05:05:04.372387 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:04.372329    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e0c4ca89-0a02-4d39-8dbd-11aebc6af20d-istio-data\") pod \"e2e-api-a-c5e779-openshift-default-677496987b-fwhkt\" (UID: \"e0c4ca89-0a02-4d39-8dbd-11aebc6af20d\") " pod="openshift-ingress/e2e-api-a-c5e779-openshift-default-677496987b-fwhkt"
Sep 10 05:05:04.373946 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:04.373929    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e0c4ca89-0a02-4d39-8dbd-11aebc6af20d-istio-envoy\") pod \"e2e-api-a-c5e779-openshift-default-677496987b-fwhkt\" (UID: \"e0c4ca89-0a02-4d39-8dbd-11aebc6af20d\") " pod="openshift-ingress/e2e-api-a-c5e779-openshift-default-677496987b-fwhkt"
Sep 10 05:05:04.374194 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:04.374173    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e0c4ca89-0a02-4d39-8dbd-11aebc6af20d-istio-podinfo\") pod \"e2e-api-a-c5e779-openshift-default-677496987b-fwhkt\" (UID: \"e0c4ca89-0a02-4d39-8dbd-11aebc6af20d\") " pod="openshift-ingress/e2e-api-a-c5e779-openshift-default-677496987b-fwhkt"
Sep 10 05:05:04.378733 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:04.378707    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0c4ca89-0a02-4d39-8dbd-11aebc6af20d-istio-token\") pod \"e2e-api-a-c5e779-openshift-default-677496987b-fwhkt\" (UID: \"e0c4ca89-0a02-4d39-8dbd-11aebc6af20d\") " pod="openshift-ingress/e2e-api-a-c5e779-openshift-default-677496987b-fwhkt"
Sep 10 05:05:04.379063 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:04.379042    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxswr\" (UniqueName: \"kubernetes.io/projected/e0c4ca89-0a02-4d39-8dbd-11aebc6af20d-kube-api-access-sxswr\") pod \"e2e-api-a-c5e779-openshift-default-677496987b-fwhkt\" (UID: \"e0c4ca89-0a02-4d39-8dbd-11aebc6af20d\") " pod="openshift-ingress/e2e-api-a-c5e779-openshift-default-677496987b-fwhkt"
Sep 10 05:05:04.511047 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:04.510958    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c5e779-openshift-default-677496987b-fwhkt"
Sep 10 05:05:04.792202 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:04.792176    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-c5e779-openshift-default-677496987b-fwhkt"]
Sep 10 05:05:04.793695 ip-10-0-138-27 kubenswrapper[2560]: W0910 05:05:04.793669    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0c4ca89_0a02_4d39_8dbd_11aebc6af20d.slice/crio-ce82bc27df8bdd1878db6dfc94644a361052aeaeec4afd51e358c41d71e1896e WatchSource:0}: Error finding container ce82bc27df8bdd1878db6dfc94644a361052aeaeec4afd51e358c41d71e1896e: Status 404 returned error can't find the container with id ce82bc27df8bdd1878db6dfc94644a361052aeaeec4afd51e358c41d71e1896e
Sep 10 05:05:04.795948 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:04.795918    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 05:05:04.796038 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:04.795980    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 05:05:04.796038 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:04.796009    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 05:05:05.162331 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:05.162300    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c5e779-openshift-default-677496987b-fwhkt" event={"ID":"e0c4ca89-0a02-4d39-8dbd-11aebc6af20d","Type":"ContainerStarted","Data":"d5b4a64b4f80c17340f90b714e567efa856525fdbf1bbd23d16da322db7a9ee8"}
Sep 10 05:05:05.162491 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:05.162350    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c5e779-openshift-default-677496987b-fwhkt" event={"ID":"e0c4ca89-0a02-4d39-8dbd-11aebc6af20d","Type":"ContainerStarted","Data":"ce82bc27df8bdd1878db6dfc94644a361052aeaeec4afd51e358c41d71e1896e"}
Sep 10 05:05:05.180312 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:05.180267    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-c5e779-openshift-default-677496987b-fwhkt" podStartSLOduration=1.18025252 podStartE2EDuration="1.18025252s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 05:05:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 05:05:05.179099848 +0000 UTC m=+1444.841557595" watchObservedRunningTime="2026-09-10 05:05:05.18025252 +0000 UTC m=+1444.842710270"
Sep 10 05:05:05.511918 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:05.511798    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-c5e779-openshift-default-677496987b-fwhkt"
Sep 10 05:05:05.517211 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:05.517184    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-c5e779-openshift-default-677496987b-fwhkt"
Sep 10 05:05:06.169465 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:06.169433    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-c5e779-openshift-default-677496987b-fwhkt"
Sep 10 05:05:06.170509 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:06.170486    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-c5e779-openshift-default-677496987b-fwhkt"
Sep 10 05:05:08.398215 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:08.398187    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-c5e779-d4b5b8b47-ftjnf"]
Sep 10 05:05:08.401122 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:08.401097    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c5e779-d4b5b8b47-ftjnf"
Sep 10 05:05:08.403432 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:08.403409    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-c5e779-serving-cert\""
Sep 10 05:05:08.412285 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:08.412262    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-c5e779-d4b5b8b47-ftjnf"]
Sep 10 05:05:08.511928 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:08.511885    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5cfb4ad6-b63c-4555-ad63-9da004852767-openshift-service-ca\") pod \"maas-api-e2e-api-a-c5e779-d4b5b8b47-ftjnf\" (UID: \"5cfb4ad6-b63c-4555-ad63-9da004852767\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c5e779-d4b5b8b47-ftjnf"
Sep 10 05:05:08.512270 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:08.512247    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5cfb4ad6-b63c-4555-ad63-9da004852767-metrics-certs\") pod \"maas-api-e2e-api-a-c5e779-d4b5b8b47-ftjnf\" (UID: \"5cfb4ad6-b63c-4555-ad63-9da004852767\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c5e779-d4b5b8b47-ftjnf"
Sep 10 05:05:08.512442 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:08.512423    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g55gx\" (UniqueName: \"kubernetes.io/projected/5cfb4ad6-b63c-4555-ad63-9da004852767-kube-api-access-g55gx\") pod \"maas-api-e2e-api-a-c5e779-d4b5b8b47-ftjnf\" (UID: \"5cfb4ad6-b63c-4555-ad63-9da004852767\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c5e779-d4b5b8b47-ftjnf"
Sep 10 05:05:08.512634 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:08.512620    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5cfb4ad6-b63c-4555-ad63-9da004852767-maas-api-tls\") pod \"maas-api-e2e-api-a-c5e779-d4b5b8b47-ftjnf\" (UID: \"5cfb4ad6-b63c-4555-ad63-9da004852767\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c5e779-d4b5b8b47-ftjnf"
Sep 10 05:05:08.613533 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:08.613503    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5cfb4ad6-b63c-4555-ad63-9da004852767-maas-api-tls\") pod \"maas-api-e2e-api-a-c5e779-d4b5b8b47-ftjnf\" (UID: \"5cfb4ad6-b63c-4555-ad63-9da004852767\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c5e779-d4b5b8b47-ftjnf"
Sep 10 05:05:08.613684 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:08.613565    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5cfb4ad6-b63c-4555-ad63-9da004852767-openshift-service-ca\") pod \"maas-api-e2e-api-a-c5e779-d4b5b8b47-ftjnf\" (UID: \"5cfb4ad6-b63c-4555-ad63-9da004852767\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c5e779-d4b5b8b47-ftjnf"
Sep 10 05:05:08.613684 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:08.613610    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5cfb4ad6-b63c-4555-ad63-9da004852767-metrics-certs\") pod \"maas-api-e2e-api-a-c5e779-d4b5b8b47-ftjnf\" (UID: \"5cfb4ad6-b63c-4555-ad63-9da004852767\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c5e779-d4b5b8b47-ftjnf"
Sep 10 05:05:08.613684 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:08.613636    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g55gx\" (UniqueName: \"kubernetes.io/projected/5cfb4ad6-b63c-4555-ad63-9da004852767-kube-api-access-g55gx\") pod \"maas-api-e2e-api-a-c5e779-d4b5b8b47-ftjnf\" (UID: \"5cfb4ad6-b63c-4555-ad63-9da004852767\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c5e779-d4b5b8b47-ftjnf"
Sep 10 05:05:08.614328 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:08.614306    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5cfb4ad6-b63c-4555-ad63-9da004852767-openshift-service-ca\") pod \"maas-api-e2e-api-a-c5e779-d4b5b8b47-ftjnf\" (UID: \"5cfb4ad6-b63c-4555-ad63-9da004852767\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c5e779-d4b5b8b47-ftjnf"
Sep 10 05:05:08.616031 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:08.616013    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5cfb4ad6-b63c-4555-ad63-9da004852767-maas-api-tls\") pod \"maas-api-e2e-api-a-c5e779-d4b5b8b47-ftjnf\" (UID: \"5cfb4ad6-b63c-4555-ad63-9da004852767\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c5e779-d4b5b8b47-ftjnf"
Sep 10 05:05:08.616124 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:08.616088    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5cfb4ad6-b63c-4555-ad63-9da004852767-metrics-certs\") pod \"maas-api-e2e-api-a-c5e779-d4b5b8b47-ftjnf\" (UID: \"5cfb4ad6-b63c-4555-ad63-9da004852767\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c5e779-d4b5b8b47-ftjnf"
Sep 10 05:05:08.620826 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:08.620802    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g55gx\" (UniqueName: \"kubernetes.io/projected/5cfb4ad6-b63c-4555-ad63-9da004852767-kube-api-access-g55gx\") pod \"maas-api-e2e-api-a-c5e779-d4b5b8b47-ftjnf\" (UID: \"5cfb4ad6-b63c-4555-ad63-9da004852767\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c5e779-d4b5b8b47-ftjnf"
Sep 10 05:05:08.715220 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:08.715159    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c5e779-d4b5b8b47-ftjnf"
Sep 10 05:05:08.992961 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:08.992884    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-c5e779-d4b5b8b47-ftjnf"]
Sep 10 05:05:08.995192 ip-10-0-138-27 kubenswrapper[2560]: W0910 05:05:08.995165    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cfb4ad6_b63c_4555_ad63_9da004852767.slice/crio-03a5863bb253c812fcd815705fcb63183a9adbb3d6dafb0deea27e8baebae998 WatchSource:0}: Error finding container 03a5863bb253c812fcd815705fcb63183a9adbb3d6dafb0deea27e8baebae998: Status 404 returned error can't find the container with id 03a5863bb253c812fcd815705fcb63183a9adbb3d6dafb0deea27e8baebae998
Sep 10 05:05:08.996679 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:08.996657    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 05:05:09.190268 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:09.190232    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c5e779-d4b5b8b47-ftjnf" event={"ID":"5cfb4ad6-b63c-4555-ad63-9da004852767","Type":"ContainerStarted","Data":"03a5863bb253c812fcd815705fcb63183a9adbb3d6dafb0deea27e8baebae998"}
Sep 10 05:05:10.206773 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:10.206735    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c5e779-d4b5b8b47-ftjnf" event={"ID":"5cfb4ad6-b63c-4555-ad63-9da004852767","Type":"ContainerStarted","Data":"de63f8dc6ef43767cd2b6a7edf9137ba5c786f25737ae095111ffb941aa47fcd"}
Sep 10 05:05:10.207350 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:10.206939    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c5e779-d4b5b8b47-ftjnf"
Sep 10 05:05:10.224878 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:10.224797    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c5e779-d4b5b8b47-ftjnf" podStartSLOduration=1.616497163 podStartE2EDuration="2.224783939s" totalImagesPullingTime="608.286776ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 05:05:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 05:05:10.221829581 +0000 UTC m=+1449.884287325" watchObservedRunningTime="2026-09-10 05:05:10.224783939 +0000 UTC m=+1449.887241743"
Sep 10 05:05:15.491572 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:15.491534    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 05:05:16.218543 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:16.218513    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c5e779-d4b5b8b47-ftjnf"
Sep 10 05:05:25.310441 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:25.310370    2560 generic.go:356] "Generic (PLEG): container finished" podID="e0c4ca89-0a02-4d39-8dbd-11aebc6af20d" containerID="d5b4a64b4f80c17340f90b714e567efa856525fdbf1bbd23d16da322db7a9ee8" exitCode=0
Sep 10 05:05:25.310811 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:25.310445    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c5e779-openshift-default-677496987b-fwhkt" event={"ID":"e0c4ca89-0a02-4d39-8dbd-11aebc6af20d","Type":"ContainerDied","Data":"d5b4a64b4f80c17340f90b714e567efa856525fdbf1bbd23d16da322db7a9ee8"}
Sep 10 05:05:25.310874 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:25.310836    2560 scope.go:117] "RemoveContainer" containerID="d5b4a64b4f80c17340f90b714e567efa856525fdbf1bbd23d16da322db7a9ee8"
Sep 10 05:05:25.311959 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:25.311934    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 05:05:25.312031 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:25.311999    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 05:05:25.312070 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:25.312036    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 05:05:26.318750 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:26.318715    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c5e779-openshift-default-677496987b-fwhkt" event={"ID":"e0c4ca89-0a02-4d39-8dbd-11aebc6af20d","Type":"ContainerStarted","Data":"38a3870097f5fb6951bfc8d9b2bf81ab3105be49c67b5cb54eed5ad4ef96a91d"}
Sep 10 05:05:26.511788 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:26.511755    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-c5e779-openshift-default-677496987b-fwhkt"
Sep 10 05:05:26.512005 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:26.511985    2560 patch_prober.go:28] interesting pod/e2e-api-a-c5e779-openshift-default-677496987b-fwhkt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Sep 10 05:05:26.512053 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:26.512032    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c5e779-openshift-default-677496987b-fwhkt" podUID="e0c4ca89-0a02-4d39-8dbd-11aebc6af20d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Sep 10 05:05:27.512106 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:27.512067    2560 patch_prober.go:28] interesting pod/e2e-api-a-c5e779-openshift-default-677496987b-fwhkt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Sep 10 05:05:27.512495 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:27.512122    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c5e779-openshift-default-677496987b-fwhkt" podUID="e0c4ca89-0a02-4d39-8dbd-11aebc6af20d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Sep 10 05:05:28.512151 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:28.512116    2560 patch_prober.go:28] interesting pod/e2e-api-a-c5e779-openshift-default-677496987b-fwhkt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Sep 10 05:05:28.512533 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:28.512194    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c5e779-openshift-default-677496987b-fwhkt" podUID="e0c4ca89-0a02-4d39-8dbd-11aebc6af20d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Sep 10 05:05:29.512306 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:29.512266    2560 patch_prober.go:28] interesting pod/e2e-api-a-c5e779-openshift-default-677496987b-fwhkt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Sep 10 05:05:29.512768 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:29.512331    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c5e779-openshift-default-677496987b-fwhkt" podUID="e0c4ca89-0a02-4d39-8dbd-11aebc6af20d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Sep 10 05:05:30.511677 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:30.511644    2560 patch_prober.go:28] interesting pod/e2e-api-a-c5e779-openshift-default-677496987b-fwhkt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Sep 10 05:05:30.511873 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:30.511699    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c5e779-openshift-default-677496987b-fwhkt" podUID="e0c4ca89-0a02-4d39-8dbd-11aebc6af20d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Sep 10 05:05:31.511767 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:31.511729    2560 patch_prober.go:28] interesting pod/e2e-api-a-c5e779-openshift-default-677496987b-fwhkt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Sep 10 05:05:31.512267 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:31.511792    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c5e779-openshift-default-677496987b-fwhkt" podUID="e0c4ca89-0a02-4d39-8dbd-11aebc6af20d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Sep 10 05:05:32.515430 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:32.515388    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-c5e779-openshift-default-677496987b-fwhkt"
Sep 10 05:05:32.515913 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:32.515783    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-c5e779-openshift-default-677496987b-fwhkt"
Sep 10 05:05:32.516533 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:32.516513    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-c5e779-openshift-default-677496987b-fwhkt"
Sep 10 05:05:37.224896 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:37.224842    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-25a681-7f4594cd45-5x74n"]
Sep 10 05:05:37.228302 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:37.228278    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-25a681-7f4594cd45-5x74n"
Sep 10 05:05:37.230261 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:37.230240    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-25a681-serving-cert\""
Sep 10 05:05:37.238493 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:37.238470    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-25a681-7f4594cd45-5x74n"]
Sep 10 05:05:37.278247 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:37.278216    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zt68\" (UniqueName: \"kubernetes.io/projected/964ba3d5-f090-44e2-aa4c-af5274b228cb-kube-api-access-5zt68\") pod \"maas-api-e2e-api-b-25a681-7f4594cd45-5x74n\" (UID: \"964ba3d5-f090-44e2-aa4c-af5274b228cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-25a681-7f4594cd45-5x74n"
Sep 10 05:05:37.278373 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:37.278351    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/964ba3d5-f090-44e2-aa4c-af5274b228cb-metrics-certs\") pod \"maas-api-e2e-api-b-25a681-7f4594cd45-5x74n\" (UID: \"964ba3d5-f090-44e2-aa4c-af5274b228cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-25a681-7f4594cd45-5x74n"
Sep 10 05:05:37.278422 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:37.278399    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/964ba3d5-f090-44e2-aa4c-af5274b228cb-maas-api-tls\") pod \"maas-api-e2e-api-b-25a681-7f4594cd45-5x74n\" (UID: \"964ba3d5-f090-44e2-aa4c-af5274b228cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-25a681-7f4594cd45-5x74n"
Sep 10 05:05:37.278466 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:37.278426    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/964ba3d5-f090-44e2-aa4c-af5274b228cb-openshift-service-ca\") pod \"maas-api-e2e-api-b-25a681-7f4594cd45-5x74n\" (UID: \"964ba3d5-f090-44e2-aa4c-af5274b228cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-25a681-7f4594cd45-5x74n"
Sep 10 05:05:37.379236 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:37.379206    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/964ba3d5-f090-44e2-aa4c-af5274b228cb-metrics-certs\") pod \"maas-api-e2e-api-b-25a681-7f4594cd45-5x74n\" (UID: \"964ba3d5-f090-44e2-aa4c-af5274b228cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-25a681-7f4594cd45-5x74n"
Sep 10 05:05:37.379388 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:37.379246    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/964ba3d5-f090-44e2-aa4c-af5274b228cb-maas-api-tls\") pod \"maas-api-e2e-api-b-25a681-7f4594cd45-5x74n\" (UID: \"964ba3d5-f090-44e2-aa4c-af5274b228cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-25a681-7f4594cd45-5x74n"
Sep 10 05:05:37.379388 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:37.379269    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/964ba3d5-f090-44e2-aa4c-af5274b228cb-openshift-service-ca\") pod \"maas-api-e2e-api-b-25a681-7f4594cd45-5x74n\" (UID: \"964ba3d5-f090-44e2-aa4c-af5274b228cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-25a681-7f4594cd45-5x74n"
Sep 10 05:05:37.379388 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:37.379333    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zt68\" (UniqueName: \"kubernetes.io/projected/964ba3d5-f090-44e2-aa4c-af5274b228cb-kube-api-access-5zt68\") pod \"maas-api-e2e-api-b-25a681-7f4594cd45-5x74n\" (UID: \"964ba3d5-f090-44e2-aa4c-af5274b228cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-25a681-7f4594cd45-5x74n"
Sep 10 05:05:37.379970 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:37.379949    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/964ba3d5-f090-44e2-aa4c-af5274b228cb-openshift-service-ca\") pod \"maas-api-e2e-api-b-25a681-7f4594cd45-5x74n\" (UID: \"964ba3d5-f090-44e2-aa4c-af5274b228cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-25a681-7f4594cd45-5x74n"
Sep 10 05:05:37.381651 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:37.381625    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/964ba3d5-f090-44e2-aa4c-af5274b228cb-maas-api-tls\") pod \"maas-api-e2e-api-b-25a681-7f4594cd45-5x74n\" (UID: \"964ba3d5-f090-44e2-aa4c-af5274b228cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-25a681-7f4594cd45-5x74n"
Sep 10 05:05:37.381651 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:37.381636    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/964ba3d5-f090-44e2-aa4c-af5274b228cb-metrics-certs\") pod \"maas-api-e2e-api-b-25a681-7f4594cd45-5x74n\" (UID: \"964ba3d5-f090-44e2-aa4c-af5274b228cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-25a681-7f4594cd45-5x74n"
Sep 10 05:05:37.386454 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:37.386432    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zt68\" (UniqueName: \"kubernetes.io/projected/964ba3d5-f090-44e2-aa4c-af5274b228cb-kube-api-access-5zt68\") pod \"maas-api-e2e-api-b-25a681-7f4594cd45-5x74n\" (UID: \"964ba3d5-f090-44e2-aa4c-af5274b228cb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-25a681-7f4594cd45-5x74n"
Sep 10 05:05:37.543364 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:37.543274    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-25a681-7f4594cd45-5x74n"
Sep 10 05:05:37.835664 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:37.835633    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-25a681-7f4594cd45-5x74n"]
Sep 10 05:05:37.836514 ip-10-0-138-27 kubenswrapper[2560]: W0910 05:05:37.836489    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod964ba3d5_f090_44e2_aa4c_af5274b228cb.slice/crio-ebcd58e4ad64cd898f506a73f12e214943dde1e8a9d8d5bc6b113d192b9c4723 WatchSource:0}: Error finding container ebcd58e4ad64cd898f506a73f12e214943dde1e8a9d8d5bc6b113d192b9c4723: Status 404 returned error can't find the container with id ebcd58e4ad64cd898f506a73f12e214943dde1e8a9d8d5bc6b113d192b9c4723
Sep 10 05:05:38.411813 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:38.411780    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-25a681-7f4594cd45-5x74n" event={"ID":"964ba3d5-f090-44e2-aa4c-af5274b228cb","Type":"ContainerStarted","Data":"2c8f86ab4dd6f192f13657180ebe5adc74df0e9609e1d876cf1cf5df8b75745c"}
Sep 10 05:05:38.412176 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:38.411874    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-25a681-7f4594cd45-5x74n" event={"ID":"964ba3d5-f090-44e2-aa4c-af5274b228cb","Type":"ContainerStarted","Data":"ebcd58e4ad64cd898f506a73f12e214943dde1e8a9d8d5bc6b113d192b9c4723"}
Sep 10 05:05:38.412176 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:38.411998    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-25a681-7f4594cd45-5x74n"
Sep 10 05:05:38.427187 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:38.427141    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-25a681-7f4594cd45-5x74n" podStartSLOduration=1.01979819 podStartE2EDuration="1.427127839s" totalImagesPullingTime="407.329649ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 05:05:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 05:05:38.425979737 +0000 UTC m=+1478.088437485" watchObservedRunningTime="2026-09-10 05:05:38.427127839 +0000 UTC m=+1478.089585590"
Sep 10 05:05:44.424423 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:44.424394    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-25a681-7f4594cd45-5x74n"
Sep 10 05:05:46.799464 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:05:46.799427    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 05:06:00.953008 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:00.952979    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-p5zjp_8b3ec8dc-1508-4537-8dc3-b9de1ff22d03/console-operator/1.log"
Sep 10 05:06:00.954538 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:00.954517    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-p5zjp_8b3ec8dc-1508-4537-8dc3-b9de1ff22d03/console-operator/1.log"
Sep 10 05:06:01.692783 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:01.692748    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 05:06:19.848612 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:19.848576    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-c5e779-d4b5b8b47-ftjnf"]
Sep 10 05:06:19.849547 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:19.849512    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c5e779-d4b5b8b47-ftjnf" podUID="5cfb4ad6-b63c-4555-ad63-9da004852767" containerName="maas-api" containerID="cri-o://de63f8dc6ef43767cd2b6a7edf9137ba5c786f25737ae095111ffb941aa47fcd" gracePeriod=30
Sep 10 05:06:20.096158 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:20.096131    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c5e779-d4b5b8b47-ftjnf"
Sep 10 05:06:20.184684 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:20.184647    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g55gx\" (UniqueName: \"kubernetes.io/projected/5cfb4ad6-b63c-4555-ad63-9da004852767-kube-api-access-g55gx\") pod \"5cfb4ad6-b63c-4555-ad63-9da004852767\" (UID: \"5cfb4ad6-b63c-4555-ad63-9da004852767\") "
Sep 10 05:06:20.184838 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:20.184702    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5cfb4ad6-b63c-4555-ad63-9da004852767-openshift-service-ca\") pod \"5cfb4ad6-b63c-4555-ad63-9da004852767\" (UID: \"5cfb4ad6-b63c-4555-ad63-9da004852767\") "
Sep 10 05:06:20.184838 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:20.184759    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5cfb4ad6-b63c-4555-ad63-9da004852767-metrics-certs\") pod \"5cfb4ad6-b63c-4555-ad63-9da004852767\" (UID: \"5cfb4ad6-b63c-4555-ad63-9da004852767\") "
Sep 10 05:06:20.184838 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:20.184783    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5cfb4ad6-b63c-4555-ad63-9da004852767-maas-api-tls\") pod \"5cfb4ad6-b63c-4555-ad63-9da004852767\" (UID: \"5cfb4ad6-b63c-4555-ad63-9da004852767\") "
Sep 10 05:06:20.185090 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:20.185058    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5cfb4ad6-b63c-4555-ad63-9da004852767-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5cfb4ad6-b63c-4555-ad63-9da004852767" (UID: "5cfb4ad6-b63c-4555-ad63-9da004852767"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 05:06:20.186939 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:20.186910    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5cfb4ad6-b63c-4555-ad63-9da004852767-kube-api-access-g55gx" (OuterVolumeSpecName: "kube-api-access-g55gx") pod "5cfb4ad6-b63c-4555-ad63-9da004852767" (UID: "5cfb4ad6-b63c-4555-ad63-9da004852767"). InnerVolumeSpecName "kube-api-access-g55gx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 05:06:20.186939 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:20.186919    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5cfb4ad6-b63c-4555-ad63-9da004852767-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "5cfb4ad6-b63c-4555-ad63-9da004852767" (UID: "5cfb4ad6-b63c-4555-ad63-9da004852767"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 05:06:20.187072 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:20.186938    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5cfb4ad6-b63c-4555-ad63-9da004852767-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5cfb4ad6-b63c-4555-ad63-9da004852767" (UID: "5cfb4ad6-b63c-4555-ad63-9da004852767"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 05:06:20.286556 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:20.286523    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5cfb4ad6-b63c-4555-ad63-9da004852767-metrics-certs\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:06:20.286556 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:20.286552    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5cfb4ad6-b63c-4555-ad63-9da004852767-maas-api-tls\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:06:20.286556 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:20.286561    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g55gx\" (UniqueName: \"kubernetes.io/projected/5cfb4ad6-b63c-4555-ad63-9da004852767-kube-api-access-g55gx\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:06:20.286783 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:20.286571    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5cfb4ad6-b63c-4555-ad63-9da004852767-openshift-service-ca\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:06:20.400209 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:20.400176    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 05:06:20.685026 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:20.684995    2560 generic.go:356] "Generic (PLEG): container finished" podID="5cfb4ad6-b63c-4555-ad63-9da004852767" containerID="de63f8dc6ef43767cd2b6a7edf9137ba5c786f25737ae095111ffb941aa47fcd" exitCode=0
Sep 10 05:06:20.685192 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:20.685039    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c5e779-d4b5b8b47-ftjnf"
Sep 10 05:06:20.685192 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:20.685078    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c5e779-d4b5b8b47-ftjnf" event={"ID":"5cfb4ad6-b63c-4555-ad63-9da004852767","Type":"ContainerDied","Data":"de63f8dc6ef43767cd2b6a7edf9137ba5c786f25737ae095111ffb941aa47fcd"}
Sep 10 05:06:20.685192 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:20.685135    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c5e779-d4b5b8b47-ftjnf" event={"ID":"5cfb4ad6-b63c-4555-ad63-9da004852767","Type":"ContainerDied","Data":"03a5863bb253c812fcd815705fcb63183a9adbb3d6dafb0deea27e8baebae998"}
Sep 10 05:06:20.685192 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:20.685163    2560 scope.go:117] "RemoveContainer" containerID="de63f8dc6ef43767cd2b6a7edf9137ba5c786f25737ae095111ffb941aa47fcd"
Sep 10 05:06:20.695966 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:20.695941    2560 scope.go:117] "RemoveContainer" containerID="de63f8dc6ef43767cd2b6a7edf9137ba5c786f25737ae095111ffb941aa47fcd"
Sep 10 05:06:20.696234 ip-10-0-138-27 kubenswrapper[2560]: E0910 05:06:20.696213    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de63f8dc6ef43767cd2b6a7edf9137ba5c786f25737ae095111ffb941aa47fcd\": container with ID starting with de63f8dc6ef43767cd2b6a7edf9137ba5c786f25737ae095111ffb941aa47fcd not found: ID does not exist" containerID="de63f8dc6ef43767cd2b6a7edf9137ba5c786f25737ae095111ffb941aa47fcd"
Sep 10 05:06:20.696307 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:20.696255    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de63f8dc6ef43767cd2b6a7edf9137ba5c786f25737ae095111ffb941aa47fcd"} err="failed to get container status \"de63f8dc6ef43767cd2b6a7edf9137ba5c786f25737ae095111ffb941aa47fcd\": rpc error: code = NotFound desc = could not find container \"de63f8dc6ef43767cd2b6a7edf9137ba5c786f25737ae095111ffb941aa47fcd\": container with ID starting with de63f8dc6ef43767cd2b6a7edf9137ba5c786f25737ae095111ffb941aa47fcd not found: ID does not exist"
Sep 10 05:06:20.706536 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:20.706517    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-c5e779-d4b5b8b47-ftjnf"]
Sep 10 05:06:20.713576 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:20.713556    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-c5e779-d4b5b8b47-ftjnf"]
Sep 10 05:06:20.826965 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:20.826942    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5cfb4ad6-b63c-4555-ad63-9da004852767" path="/var/lib/kubelet/pods/5cfb4ad6-b63c-4555-ad63-9da004852767/volumes"
Sep 10 05:06:26.676035 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:26.675958    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-c5e779-openshift-default-677496987b-fwhkt"]
Sep 10 05:06:26.676389 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:26.676229    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-c5e779-openshift-default-677496987b-fwhkt" podUID="e0c4ca89-0a02-4d39-8dbd-11aebc6af20d" containerName="istio-proxy" containerID="cri-o://38a3870097f5fb6951bfc8d9b2bf81ab3105be49c67b5cb54eed5ad4ef96a91d" gracePeriod=30
Sep 10 05:06:31.554494 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:31.554457    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7861-56e32f"]
Sep 10 05:06:31.554925 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:31.554911    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cfb4ad6-b63c-4555-ad63-9da004852767" containerName="maas-api"
Sep 10 05:06:31.554925 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:31.554926    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cfb4ad6-b63c-4555-ad63-9da004852767" containerName="maas-api"
Sep 10 05:06:31.555026 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:31.554996    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="5cfb4ad6-b63c-4555-ad63-9da004852767" containerName="maas-api"
Sep 10 05:06:31.558050 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:31.558032    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7861-56e32f"
Sep 10 05:06:31.560381 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:31.560362    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-6n9j9\""
Sep 10 05:06:31.564003 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:31.563981    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7861-56e32f"]
Sep 10 05:06:31.689634 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:31.689607    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npp6k\" (UniqueName: \"kubernetes.io/projected/d3f6ba33-769f-46b7-86cb-6afd885727ed-kube-api-access-npp6k\") pod \"test-curl-7861-56e32f\" (UID: \"d3f6ba33-769f-46b7-86cb-6afd885727ed\") " pod="opendatahub/test-curl-7861-56e32f"
Sep 10 05:06:31.790963 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:31.790936    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npp6k\" (UniqueName: \"kubernetes.io/projected/d3f6ba33-769f-46b7-86cb-6afd885727ed-kube-api-access-npp6k\") pod \"test-curl-7861-56e32f\" (UID: \"d3f6ba33-769f-46b7-86cb-6afd885727ed\") " pod="opendatahub/test-curl-7861-56e32f"
Sep 10 05:06:31.799107 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:31.799081    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-npp6k\" (UniqueName: \"kubernetes.io/projected/d3f6ba33-769f-46b7-86cb-6afd885727ed-kube-api-access-npp6k\") pod \"test-curl-7861-56e32f\" (UID: \"d3f6ba33-769f-46b7-86cb-6afd885727ed\") " pod="opendatahub/test-curl-7861-56e32f"
Sep 10 05:06:31.870956 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:31.870923    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7861-56e32f"
Sep 10 05:06:31.939062 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:31.937712    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c5e779-openshift-default-677496987b-fwhkt"
Sep 10 05:06:32.094526 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:32.094491    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0c4ca89-0a02-4d39-8dbd-11aebc6af20d-workload-certs\") pod \"e0c4ca89-0a02-4d39-8dbd-11aebc6af20d\" (UID: \"e0c4ca89-0a02-4d39-8dbd-11aebc6af20d\") "
Sep 10 05:06:32.094703 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:32.094575    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e0c4ca89-0a02-4d39-8dbd-11aebc6af20d-istio-data\") pod \"e0c4ca89-0a02-4d39-8dbd-11aebc6af20d\" (UID: \"e0c4ca89-0a02-4d39-8dbd-11aebc6af20d\") "
Sep 10 05:06:32.094703 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:32.094616    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0c4ca89-0a02-4d39-8dbd-11aebc6af20d-istio-token\") pod \"e0c4ca89-0a02-4d39-8dbd-11aebc6af20d\" (UID: \"e0c4ca89-0a02-4d39-8dbd-11aebc6af20d\") "
Sep 10 05:06:32.094703 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:32.094640    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e0c4ca89-0a02-4d39-8dbd-11aebc6af20d-istio-envoy\") pod \"e0c4ca89-0a02-4d39-8dbd-11aebc6af20d\" (UID: \"e0c4ca89-0a02-4d39-8dbd-11aebc6af20d\") "
Sep 10 05:06:32.094703 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:32.094663    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e0c4ca89-0a02-4d39-8dbd-11aebc6af20d-istiod-ca-cert\") pod \"e0c4ca89-0a02-4d39-8dbd-11aebc6af20d\" (UID: \"e0c4ca89-0a02-4d39-8dbd-11aebc6af20d\") "
Sep 10 05:06:32.094956 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:32.094709    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e0c4ca89-0a02-4d39-8dbd-11aebc6af20d-istio-podinfo\") pod \"e0c4ca89-0a02-4d39-8dbd-11aebc6af20d\" (UID: \"e0c4ca89-0a02-4d39-8dbd-11aebc6af20d\") "
Sep 10 05:06:32.094956 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:32.094748    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0c4ca89-0a02-4d39-8dbd-11aebc6af20d-credential-socket\") pod \"e0c4ca89-0a02-4d39-8dbd-11aebc6af20d\" (UID: \"e0c4ca89-0a02-4d39-8dbd-11aebc6af20d\") "
Sep 10 05:06:32.094956 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:32.094785    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0c4ca89-0a02-4d39-8dbd-11aebc6af20d-workload-socket\") pod \"e0c4ca89-0a02-4d39-8dbd-11aebc6af20d\" (UID: \"e0c4ca89-0a02-4d39-8dbd-11aebc6af20d\") "
Sep 10 05:06:32.094956 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:32.094790    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0c4ca89-0a02-4d39-8dbd-11aebc6af20d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e0c4ca89-0a02-4d39-8dbd-11aebc6af20d" (UID: "e0c4ca89-0a02-4d39-8dbd-11aebc6af20d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 05:06:32.094956 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:32.094906    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sxswr\" (UniqueName: \"kubernetes.io/projected/e0c4ca89-0a02-4d39-8dbd-11aebc6af20d-kube-api-access-sxswr\") pod \"e0c4ca89-0a02-4d39-8dbd-11aebc6af20d\" (UID: \"e0c4ca89-0a02-4d39-8dbd-11aebc6af20d\") "
Sep 10 05:06:32.095196 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:32.094904    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0c4ca89-0a02-4d39-8dbd-11aebc6af20d-istio-data" (OuterVolumeSpecName: "istio-data") pod "e0c4ca89-0a02-4d39-8dbd-11aebc6af20d" (UID: "e0c4ca89-0a02-4d39-8dbd-11aebc6af20d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 05:06:32.095196 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:32.095082    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0c4ca89-0a02-4d39-8dbd-11aebc6af20d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e0c4ca89-0a02-4d39-8dbd-11aebc6af20d" (UID: "e0c4ca89-0a02-4d39-8dbd-11aebc6af20d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 05:06:32.095196 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:32.095109    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0c4ca89-0a02-4d39-8dbd-11aebc6af20d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e0c4ca89-0a02-4d39-8dbd-11aebc6af20d" (UID: "e0c4ca89-0a02-4d39-8dbd-11aebc6af20d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 05:06:32.095344 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:32.095281    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0c4ca89-0a02-4d39-8dbd-11aebc6af20d-credential-socket\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:06:32.095344 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:32.095298    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0c4ca89-0a02-4d39-8dbd-11aebc6af20d-workload-socket\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:06:32.095344 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:32.095312    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0c4ca89-0a02-4d39-8dbd-11aebc6af20d-workload-certs\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:06:32.095344 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:32.095325    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e0c4ca89-0a02-4d39-8dbd-11aebc6af20d-istio-data\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:06:32.095512 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:32.095378    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0c4ca89-0a02-4d39-8dbd-11aebc6af20d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e0c4ca89-0a02-4d39-8dbd-11aebc6af20d" (UID: "e0c4ca89-0a02-4d39-8dbd-11aebc6af20d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 05:06:32.096954 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:32.096888    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e0c4ca89-0a02-4d39-8dbd-11aebc6af20d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e0c4ca89-0a02-4d39-8dbd-11aebc6af20d" (UID: "e0c4ca89-0a02-4d39-8dbd-11aebc6af20d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 05:06:32.096954 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:32.096922    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0c4ca89-0a02-4d39-8dbd-11aebc6af20d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e0c4ca89-0a02-4d39-8dbd-11aebc6af20d" (UID: "e0c4ca89-0a02-4d39-8dbd-11aebc6af20d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 05:06:32.097185 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:32.097167    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0c4ca89-0a02-4d39-8dbd-11aebc6af20d-istio-token" (OuterVolumeSpecName: "istio-token") pod "e0c4ca89-0a02-4d39-8dbd-11aebc6af20d" (UID: "e0c4ca89-0a02-4d39-8dbd-11aebc6af20d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 05:06:32.097233 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:32.097193    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0c4ca89-0a02-4d39-8dbd-11aebc6af20d-kube-api-access-sxswr" (OuterVolumeSpecName: "kube-api-access-sxswr") pod "e0c4ca89-0a02-4d39-8dbd-11aebc6af20d" (UID: "e0c4ca89-0a02-4d39-8dbd-11aebc6af20d"). InnerVolumeSpecName "kube-api-access-sxswr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 05:06:32.143903 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:32.143879    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7861-56e32f"]
Sep 10 05:06:32.145615 ip-10-0-138-27 kubenswrapper[2560]: W0910 05:06:32.145593    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd3f6ba33_769f_46b7_86cb_6afd885727ed.slice/crio-7ad199e9e036fd6b0eb0a03a3b34142cfcded86bd25612aa0f8a60aa361efb7c WatchSource:0}: Error finding container 7ad199e9e036fd6b0eb0a03a3b34142cfcded86bd25612aa0f8a60aa361efb7c: Status 404 returned error can't find the container with id 7ad199e9e036fd6b0eb0a03a3b34142cfcded86bd25612aa0f8a60aa361efb7c
Sep 10 05:06:32.196611 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:32.196587    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0c4ca89-0a02-4d39-8dbd-11aebc6af20d-istio-token\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:06:32.196611 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:32.196611    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e0c4ca89-0a02-4d39-8dbd-11aebc6af20d-istio-envoy\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:06:32.196748 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:32.196626    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e0c4ca89-0a02-4d39-8dbd-11aebc6af20d-istiod-ca-cert\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:06:32.196748 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:32.196637    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e0c4ca89-0a02-4d39-8dbd-11aebc6af20d-istio-podinfo\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:06:32.196748 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:32.196650    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sxswr\" (UniqueName: \"kubernetes.io/projected/e0c4ca89-0a02-4d39-8dbd-11aebc6af20d-kube-api-access-sxswr\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:06:32.770912 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:32.770840    2560 generic.go:356] "Generic (PLEG): container finished" podID="e0c4ca89-0a02-4d39-8dbd-11aebc6af20d" containerID="38a3870097f5fb6951bfc8d9b2bf81ab3105be49c67b5cb54eed5ad4ef96a91d" exitCode=0
Sep 10 05:06:32.770912 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:32.770898    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c5e779-openshift-default-677496987b-fwhkt"
Sep 10 05:06:32.770912 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:32.770908    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c5e779-openshift-default-677496987b-fwhkt" event={"ID":"e0c4ca89-0a02-4d39-8dbd-11aebc6af20d","Type":"ContainerDied","Data":"38a3870097f5fb6951bfc8d9b2bf81ab3105be49c67b5cb54eed5ad4ef96a91d"}
Sep 10 05:06:32.771479 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:32.770970    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c5e779-openshift-default-677496987b-fwhkt" event={"ID":"e0c4ca89-0a02-4d39-8dbd-11aebc6af20d","Type":"ContainerDied","Data":"ce82bc27df8bdd1878db6dfc94644a361052aeaeec4afd51e358c41d71e1896e"}
Sep 10 05:06:32.771479 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:32.771007    2560 scope.go:117] "RemoveContainer" containerID="38a3870097f5fb6951bfc8d9b2bf81ab3105be49c67b5cb54eed5ad4ef96a91d"
Sep 10 05:06:32.772905 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:32.772878    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7861-56e32f" event={"ID":"d3f6ba33-769f-46b7-86cb-6afd885727ed","Type":"ContainerStarted","Data":"184e0842e1ecc636cd1ff772f23407771387ba9ae06535744f149ac72cf1cb1f"}
Sep 10 05:06:32.773008 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:32.772919    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7861-56e32f" event={"ID":"d3f6ba33-769f-46b7-86cb-6afd885727ed","Type":"ContainerStarted","Data":"7ad199e9e036fd6b0eb0a03a3b34142cfcded86bd25612aa0f8a60aa361efb7c"}
Sep 10 05:06:32.780970 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:32.780953    2560 scope.go:117] "RemoveContainer" containerID="d5b4a64b4f80c17340f90b714e567efa856525fdbf1bbd23d16da322db7a9ee8"
Sep 10 05:06:32.789499 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:32.789478    2560 scope.go:117] "RemoveContainer" containerID="38a3870097f5fb6951bfc8d9b2bf81ab3105be49c67b5cb54eed5ad4ef96a91d"
Sep 10 05:06:32.789766 ip-10-0-138-27 kubenswrapper[2560]: E0910 05:06:32.789749    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38a3870097f5fb6951bfc8d9b2bf81ab3105be49c67b5cb54eed5ad4ef96a91d\": container with ID starting with 38a3870097f5fb6951bfc8d9b2bf81ab3105be49c67b5cb54eed5ad4ef96a91d not found: ID does not exist" containerID="38a3870097f5fb6951bfc8d9b2bf81ab3105be49c67b5cb54eed5ad4ef96a91d"
Sep 10 05:06:32.789806 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:32.789774    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38a3870097f5fb6951bfc8d9b2bf81ab3105be49c67b5cb54eed5ad4ef96a91d"} err="failed to get container status \"38a3870097f5fb6951bfc8d9b2bf81ab3105be49c67b5cb54eed5ad4ef96a91d\": rpc error: code = NotFound desc = could not find container \"38a3870097f5fb6951bfc8d9b2bf81ab3105be49c67b5cb54eed5ad4ef96a91d\": container with ID starting with 38a3870097f5fb6951bfc8d9b2bf81ab3105be49c67b5cb54eed5ad4ef96a91d not found: ID does not exist"
Sep 10 05:06:32.789806 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:32.789789    2560 scope.go:117] "RemoveContainer" containerID="d5b4a64b4f80c17340f90b714e567efa856525fdbf1bbd23d16da322db7a9ee8"
Sep 10 05:06:32.790104 ip-10-0-138-27 kubenswrapper[2560]: E0910 05:06:32.790084    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5b4a64b4f80c17340f90b714e567efa856525fdbf1bbd23d16da322db7a9ee8\": container with ID starting with d5b4a64b4f80c17340f90b714e567efa856525fdbf1bbd23d16da322db7a9ee8 not found: ID does not exist" containerID="d5b4a64b4f80c17340f90b714e567efa856525fdbf1bbd23d16da322db7a9ee8"
Sep 10 05:06:32.790174 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:32.790092    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7861-56e32f" podStartSLOduration=1.790076001 podStartE2EDuration="1.790076001s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 05:06:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 05:06:32.787155319 +0000 UTC m=+1532.449613067" watchObservedRunningTime="2026-09-10 05:06:32.790076001 +0000 UTC m=+1532.452533750"
Sep 10 05:06:32.790228 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:32.790113    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5b4a64b4f80c17340f90b714e567efa856525fdbf1bbd23d16da322db7a9ee8"} err="failed to get container status \"d5b4a64b4f80c17340f90b714e567efa856525fdbf1bbd23d16da322db7a9ee8\": rpc error: code = NotFound desc = could not find container \"d5b4a64b4f80c17340f90b714e567efa856525fdbf1bbd23d16da322db7a9ee8\": container with ID starting with d5b4a64b4f80c17340f90b714e567efa856525fdbf1bbd23d16da322db7a9ee8 not found: ID does not exist"
Sep 10 05:06:32.800954 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:32.800930    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-c5e779-openshift-default-677496987b-fwhkt"]
Sep 10 05:06:32.806697 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:32.806677    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-c5e779-openshift-default-677496987b-fwhkt"]
Sep 10 05:06:32.825562 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:32.825540    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0c4ca89-0a02-4d39-8dbd-11aebc6af20d" path="/var/lib/kubelet/pods/e0c4ca89-0a02-4d39-8dbd-11aebc6af20d/volumes"
Sep 10 05:06:33.394410 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:33.394379    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7861-56e32f"]
Sep 10 05:06:33.398351 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:33.398325    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7861-56e32f"]
Sep 10 05:06:33.522492 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:33.522463    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7861-e4cf8b"]
Sep 10 05:06:33.522919 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:33.522905    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0c4ca89-0a02-4d39-8dbd-11aebc6af20d" containerName="istio-proxy"
Sep 10 05:06:33.522968 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:33.522921    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0c4ca89-0a02-4d39-8dbd-11aebc6af20d" containerName="istio-proxy"
Sep 10 05:06:33.522968 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:33.522933    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0c4ca89-0a02-4d39-8dbd-11aebc6af20d" containerName="istio-proxy"
Sep 10 05:06:33.522968 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:33.522940    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0c4ca89-0a02-4d39-8dbd-11aebc6af20d" containerName="istio-proxy"
Sep 10 05:06:33.522968 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:33.522951    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3f6ba33-769f-46b7-86cb-6afd885727ed" containerName="test-curl-7861-56e32f"
Sep 10 05:06:33.522968 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:33.522957    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3f6ba33-769f-46b7-86cb-6afd885727ed" containerName="test-curl-7861-56e32f"
Sep 10 05:06:33.523154 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:33.523032    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3f6ba33-769f-46b7-86cb-6afd885727ed" containerName="test-curl-7861-56e32f"
Sep 10 05:06:33.523154 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:33.523042    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0c4ca89-0a02-4d39-8dbd-11aebc6af20d" containerName="istio-proxy"
Sep 10 05:06:33.523154 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:33.523049    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0c4ca89-0a02-4d39-8dbd-11aebc6af20d" containerName="istio-proxy"
Sep 10 05:06:33.527508 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:33.527483    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7861-e4cf8b"
Sep 10 05:06:33.529399 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:33.529376    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7861-e4cf8b"]
Sep 10 05:06:33.609396 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:33.609373    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6c6c2\" (UniqueName: \"kubernetes.io/projected/8ea183f0-0208-40c5-abe0-8f1b03b33c7a-kube-api-access-6c6c2\") pod \"test-curl-7861-e4cf8b\" (UID: \"8ea183f0-0208-40c5-abe0-8f1b03b33c7a\") " pod="opendatahub/test-curl-7861-e4cf8b"
Sep 10 05:06:33.710133 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:33.710052    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6c6c2\" (UniqueName: \"kubernetes.io/projected/8ea183f0-0208-40c5-abe0-8f1b03b33c7a-kube-api-access-6c6c2\") pod \"test-curl-7861-e4cf8b\" (UID: \"8ea183f0-0208-40c5-abe0-8f1b03b33c7a\") " pod="opendatahub/test-curl-7861-e4cf8b"
Sep 10 05:06:33.718031 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:33.718001    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6c6c2\" (UniqueName: \"kubernetes.io/projected/8ea183f0-0208-40c5-abe0-8f1b03b33c7a-kube-api-access-6c6c2\") pod \"test-curl-7861-e4cf8b\" (UID: \"8ea183f0-0208-40c5-abe0-8f1b03b33c7a\") " pod="opendatahub/test-curl-7861-e4cf8b"
Sep 10 05:06:33.781050 ip-10-0-138-27 kubenswrapper[2560]: E0910 05:06:33.781030    2560 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7861-56e32f" container="test-curl-7861-56e32f"
Sep 10 05:06:33.838147 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:33.838127    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7861-e4cf8b"
Sep 10 05:06:34.107019 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:34.106994    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7861-e4cf8b"]
Sep 10 05:06:34.108461 ip-10-0-138-27 kubenswrapper[2560]: W0910 05:06:34.108433    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8ea183f0_0208_40c5_abe0_8f1b03b33c7a.slice/crio-5e34165fd168e318accc73090384046408a3229cb97b8e49e800d66c921fad2f WatchSource:0}: Error finding container 5e34165fd168e318accc73090384046408a3229cb97b8e49e800d66c921fad2f: Status 404 returned error can't find the container with id 5e34165fd168e318accc73090384046408a3229cb97b8e49e800d66c921fad2f
Sep 10 05:06:34.791913 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:34.791869    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7861-e4cf8b" event={"ID":"8ea183f0-0208-40c5-abe0-8f1b03b33c7a","Type":"ContainerStarted","Data":"50465ed6b871a5f4658d446b6c97dd1556955e87107285632b816fd856c13bac"}
Sep 10 05:06:34.792302 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:34.791921    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7861-e4cf8b" event={"ID":"8ea183f0-0208-40c5-abe0-8f1b03b33c7a","Type":"ContainerStarted","Data":"5e34165fd168e318accc73090384046408a3229cb97b8e49e800d66c921fad2f"}
Sep 10 05:06:34.792302 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:34.792074    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7861-56e32f" podUID="d3f6ba33-769f-46b7-86cb-6afd885727ed" containerName="test-curl-7861-56e32f" containerID="cri-o://184e0842e1ecc636cd1ff772f23407771387ba9ae06535744f149ac72cf1cb1f" gracePeriod=2
Sep 10 05:06:34.806869 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:34.806804    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7861-e4cf8b" podStartSLOduration=1.806790001 podStartE2EDuration="1.806790001s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 05:06:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 05:06:34.805800952 +0000 UTC m=+1534.468258700" watchObservedRunningTime="2026-09-10 05:06:34.806790001 +0000 UTC m=+1534.469247747"
Sep 10 05:06:34.807987 ip-10-0-138-27 kubenswrapper[2560]: E0910 05:06:34.807954    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7861-56e32f\" is forbidden: User \"system:node:ip-10-0-138-27.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-27.ec2.internal' and this object" podUID="d3f6ba33-769f-46b7-86cb-6afd885727ed" pod="opendatahub/test-curl-7861-56e32f"
Sep 10 05:06:35.394861 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:35.394828    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7861-e4cf8b"]
Sep 10 05:06:35.398653 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:35.398627    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7861-e4cf8b"]
Sep 10 05:06:35.798324 ip-10-0-138-27 kubenswrapper[2560]: E0910 05:06:35.798292    2560 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7861-e4cf8b" container="test-curl-7861-e4cf8b"
Sep 10 05:06:36.804428 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:36.804392    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7861-e4cf8b" podUID="8ea183f0-0208-40c5-abe0-8f1b03b33c7a" containerName="test-curl-7861-e4cf8b" containerID="cri-o://50465ed6b871a5f4658d446b6c97dd1556955e87107285632b816fd856c13bac" gracePeriod=2
Sep 10 05:06:36.806671 ip-10-0-138-27 kubenswrapper[2560]: E0910 05:06:36.806639    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7861-e4cf8b\" is forbidden: User \"system:node:ip-10-0-138-27.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-27.ec2.internal' and this object" podUID="8ea183f0-0208-40c5-abe0-8f1b03b33c7a" pod="opendatahub/test-curl-7861-e4cf8b"
Sep 10 05:06:36.984565 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:36.984539    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7861-56e32f"
Sep 10 05:06:37.144066 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:37.144031    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-npp6k\" (UniqueName: \"kubernetes.io/projected/d3f6ba33-769f-46b7-86cb-6afd885727ed-kube-api-access-npp6k\") pod \"d3f6ba33-769f-46b7-86cb-6afd885727ed\" (UID: \"d3f6ba33-769f-46b7-86cb-6afd885727ed\") "
Sep 10 05:06:37.146085 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:37.146058    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3f6ba33-769f-46b7-86cb-6afd885727ed-kube-api-access-npp6k" (OuterVolumeSpecName: "kube-api-access-npp6k") pod "d3f6ba33-769f-46b7-86cb-6afd885727ed" (UID: "d3f6ba33-769f-46b7-86cb-6afd885727ed"). InnerVolumeSpecName "kube-api-access-npp6k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 05:06:37.244954 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:37.244923    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-npp6k\" (UniqueName: \"kubernetes.io/projected/d3f6ba33-769f-46b7-86cb-6afd885727ed-kube-api-access-npp6k\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:06:37.811613 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:37.811579    2560 generic.go:356] "Generic (PLEG): container finished" podID="d3f6ba33-769f-46b7-86cb-6afd885727ed" containerID="184e0842e1ecc636cd1ff772f23407771387ba9ae06535744f149ac72cf1cb1f" exitCode=137
Sep 10 05:06:37.812063 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:37.811629    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7861-56e32f"
Sep 10 05:06:37.812063 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:37.811674    2560 scope.go:117] "RemoveContainer" containerID="184e0842e1ecc636cd1ff772f23407771387ba9ae06535744f149ac72cf1cb1f"
Sep 10 05:06:37.821063 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:37.821044    2560 scope.go:117] "RemoveContainer" containerID="184e0842e1ecc636cd1ff772f23407771387ba9ae06535744f149ac72cf1cb1f"
Sep 10 05:06:37.821324 ip-10-0-138-27 kubenswrapper[2560]: E0910 05:06:37.821306    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"184e0842e1ecc636cd1ff772f23407771387ba9ae06535744f149ac72cf1cb1f\": container with ID starting with 184e0842e1ecc636cd1ff772f23407771387ba9ae06535744f149ac72cf1cb1f not found: ID does not exist" containerID="184e0842e1ecc636cd1ff772f23407771387ba9ae06535744f149ac72cf1cb1f"
Sep 10 05:06:37.821372 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:37.821333    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"184e0842e1ecc636cd1ff772f23407771387ba9ae06535744f149ac72cf1cb1f"} err="failed to get container status \"184e0842e1ecc636cd1ff772f23407771387ba9ae06535744f149ac72cf1cb1f\": rpc error: code = NotFound desc = could not find container \"184e0842e1ecc636cd1ff772f23407771387ba9ae06535744f149ac72cf1cb1f\": container with ID starting with 184e0842e1ecc636cd1ff772f23407771387ba9ae06535744f149ac72cf1cb1f not found: ID does not exist"
Sep 10 05:06:37.822087 ip-10-0-138-27 kubenswrapper[2560]: E0910 05:06:37.822067    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7861-56e32f\" is forbidden: User \"system:node:ip-10-0-138-27.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-27.ec2.internal' and this object" podUID="d3f6ba33-769f-46b7-86cb-6afd885727ed" pod="opendatahub/test-curl-7861-56e32f"
Sep 10 05:06:38.826717 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:38.826684    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3f6ba33-769f-46b7-86cb-6afd885727ed" path="/var/lib/kubelet/pods/d3f6ba33-769f-46b7-86cb-6afd885727ed/volumes"
Sep 10 05:06:38.960678 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:38.960653    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7861-e4cf8b"
Sep 10 05:06:39.062511 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:39.062452    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6c6c2\" (UniqueName: \"kubernetes.io/projected/8ea183f0-0208-40c5-abe0-8f1b03b33c7a-kube-api-access-6c6c2\") pod \"8ea183f0-0208-40c5-abe0-8f1b03b33c7a\" (UID: \"8ea183f0-0208-40c5-abe0-8f1b03b33c7a\") "
Sep 10 05:06:39.064270 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:39.064249    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ea183f0-0208-40c5-abe0-8f1b03b33c7a-kube-api-access-6c6c2" (OuterVolumeSpecName: "kube-api-access-6c6c2") pod "8ea183f0-0208-40c5-abe0-8f1b03b33c7a" (UID: "8ea183f0-0208-40c5-abe0-8f1b03b33c7a"). InnerVolumeSpecName "kube-api-access-6c6c2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 05:06:39.163445 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:39.163426    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6c6c2\" (UniqueName: \"kubernetes.io/projected/8ea183f0-0208-40c5-abe0-8f1b03b33c7a-kube-api-access-6c6c2\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:06:39.827262 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:39.827227    2560 generic.go:356] "Generic (PLEG): container finished" podID="8ea183f0-0208-40c5-abe0-8f1b03b33c7a" containerID="50465ed6b871a5f4658d446b6c97dd1556955e87107285632b816fd856c13bac" exitCode=137
Sep 10 05:06:39.827689 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:39.827270    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7861-e4cf8b"
Sep 10 05:06:39.827689 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:39.827319    2560 scope.go:117] "RemoveContainer" containerID="50465ed6b871a5f4658d446b6c97dd1556955e87107285632b816fd856c13bac"
Sep 10 05:06:39.836948 ip-10-0-138-27 kubenswrapper[2560]: E0910 05:06:39.836915    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7861-e4cf8b\" is forbidden: User \"system:node:ip-10-0-138-27.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-27.ec2.internal' and this object" podUID="8ea183f0-0208-40c5-abe0-8f1b03b33c7a" pod="opendatahub/test-curl-7861-e4cf8b"
Sep 10 05:06:39.837155 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:39.837078    2560 scope.go:117] "RemoveContainer" containerID="50465ed6b871a5f4658d446b6c97dd1556955e87107285632b816fd856c13bac"
Sep 10 05:06:39.837341 ip-10-0-138-27 kubenswrapper[2560]: E0910 05:06:39.837320    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50465ed6b871a5f4658d446b6c97dd1556955e87107285632b816fd856c13bac\": container with ID starting with 50465ed6b871a5f4658d446b6c97dd1556955e87107285632b816fd856c13bac not found: ID does not exist" containerID="50465ed6b871a5f4658d446b6c97dd1556955e87107285632b816fd856c13bac"
Sep 10 05:06:39.837403 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:39.837350    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50465ed6b871a5f4658d446b6c97dd1556955e87107285632b816fd856c13bac"} err="failed to get container status \"50465ed6b871a5f4658d446b6c97dd1556955e87107285632b816fd856c13bac\": rpc error: code = NotFound desc = could not find container \"50465ed6b871a5f4658d446b6c97dd1556955e87107285632b816fd856c13bac\": container with ID starting with 50465ed6b871a5f4658d446b6c97dd1556955e87107285632b816fd856c13bac not found: ID does not exist"
Sep 10 05:06:40.294949 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:40.294916    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 05:06:40.824070 ip-10-0-138-27 kubenswrapper[2560]: E0910 05:06:40.824016    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7861-e4cf8b\" is forbidden: User \"system:node:ip-10-0-138-27.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-27.ec2.internal' and this object" podUID="8ea183f0-0208-40c5-abe0-8f1b03b33c7a" pod="opendatahub/test-curl-7861-e4cf8b"
Sep 10 05:06:40.825877 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:40.825838    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ea183f0-0208-40c5-abe0-8f1b03b33c7a" path="/var/lib/kubelet/pods/8ea183f0-0208-40c5-abe0-8f1b03b33c7a/volumes"
Sep 10 05:06:42.613484 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:42.613451    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-25a681-7f4594cd45-5x74n"]
Sep 10 05:06:42.613967 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:42.613688    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-25a681-7f4594cd45-5x74n" podUID="964ba3d5-f090-44e2-aa4c-af5274b228cb" containerName="maas-api" containerID="cri-o://2c8f86ab4dd6f192f13657180ebe5adc74df0e9609e1d876cf1cf5df8b75745c" gracePeriod=30
Sep 10 05:06:42.850379 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:42.850348    2560 generic.go:356] "Generic (PLEG): container finished" podID="964ba3d5-f090-44e2-aa4c-af5274b228cb" containerID="2c8f86ab4dd6f192f13657180ebe5adc74df0e9609e1d876cf1cf5df8b75745c" exitCode=0
Sep 10 05:06:42.850525 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:42.850422    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-25a681-7f4594cd45-5x74n" event={"ID":"964ba3d5-f090-44e2-aa4c-af5274b228cb","Type":"ContainerDied","Data":"2c8f86ab4dd6f192f13657180ebe5adc74df0e9609e1d876cf1cf5df8b75745c"}
Sep 10 05:06:42.877244 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:42.877225    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-25a681-7f4594cd45-5x74n"
Sep 10 05:06:42.998556 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:42.998527    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/964ba3d5-f090-44e2-aa4c-af5274b228cb-metrics-certs\") pod \"964ba3d5-f090-44e2-aa4c-af5274b228cb\" (UID: \"964ba3d5-f090-44e2-aa4c-af5274b228cb\") "
Sep 10 05:06:42.998700 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:42.998582    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5zt68\" (UniqueName: \"kubernetes.io/projected/964ba3d5-f090-44e2-aa4c-af5274b228cb-kube-api-access-5zt68\") pod \"964ba3d5-f090-44e2-aa4c-af5274b228cb\" (UID: \"964ba3d5-f090-44e2-aa4c-af5274b228cb\") "
Sep 10 05:06:42.998700 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:42.998628    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/964ba3d5-f090-44e2-aa4c-af5274b228cb-openshift-service-ca\") pod \"964ba3d5-f090-44e2-aa4c-af5274b228cb\" (UID: \"964ba3d5-f090-44e2-aa4c-af5274b228cb\") "
Sep 10 05:06:42.998772 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:42.998700    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/964ba3d5-f090-44e2-aa4c-af5274b228cb-maas-api-tls\") pod \"964ba3d5-f090-44e2-aa4c-af5274b228cb\" (UID: \"964ba3d5-f090-44e2-aa4c-af5274b228cb\") "
Sep 10 05:06:42.999131 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:42.999105    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/964ba3d5-f090-44e2-aa4c-af5274b228cb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "964ba3d5-f090-44e2-aa4c-af5274b228cb" (UID: "964ba3d5-f090-44e2-aa4c-af5274b228cb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 05:06:43.000656 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:43.000632    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/964ba3d5-f090-44e2-aa4c-af5274b228cb-kube-api-access-5zt68" (OuterVolumeSpecName: "kube-api-access-5zt68") pod "964ba3d5-f090-44e2-aa4c-af5274b228cb" (UID: "964ba3d5-f090-44e2-aa4c-af5274b228cb"). InnerVolumeSpecName "kube-api-access-5zt68". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 05:06:43.001126 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:43.001106    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/964ba3d5-f090-44e2-aa4c-af5274b228cb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "964ba3d5-f090-44e2-aa4c-af5274b228cb" (UID: "964ba3d5-f090-44e2-aa4c-af5274b228cb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 05:06:43.001205 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:43.001124    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/964ba3d5-f090-44e2-aa4c-af5274b228cb-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "964ba3d5-f090-44e2-aa4c-af5274b228cb" (UID: "964ba3d5-f090-44e2-aa4c-af5274b228cb"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 05:06:43.100261 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:43.100231    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/964ba3d5-f090-44e2-aa4c-af5274b228cb-maas-api-tls\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:06:43.100261 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:43.100258    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/964ba3d5-f090-44e2-aa4c-af5274b228cb-metrics-certs\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:06:43.100261 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:43.100268    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5zt68\" (UniqueName: \"kubernetes.io/projected/964ba3d5-f090-44e2-aa4c-af5274b228cb-kube-api-access-5zt68\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:06:43.100481 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:43.100277    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/964ba3d5-f090-44e2-aa4c-af5274b228cb-openshift-service-ca\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:06:43.857663 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:43.857637    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-25a681-7f4594cd45-5x74n"
Sep 10 05:06:43.858072 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:43.857635    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-25a681-7f4594cd45-5x74n" event={"ID":"964ba3d5-f090-44e2-aa4c-af5274b228cb","Type":"ContainerDied","Data":"ebcd58e4ad64cd898f506a73f12e214943dde1e8a9d8d5bc6b113d192b9c4723"}
Sep 10 05:06:43.858072 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:43.857763    2560 scope.go:117] "RemoveContainer" containerID="2c8f86ab4dd6f192f13657180ebe5adc74df0e9609e1d876cf1cf5df8b75745c"
Sep 10 05:06:43.885181 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:43.885155    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-25a681-7f4594cd45-5x74n"]
Sep 10 05:06:43.891104 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:43.891084    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-25a681-7f4594cd45-5x74n"]
Sep 10 05:06:44.825901 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:44.825842    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="964ba3d5-f090-44e2-aa4c-af5274b228cb" path="/var/lib/kubelet/pods/964ba3d5-f090-44e2-aa4c-af5274b228cb/volumes"
Sep 10 05:06:59.396762 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:06:59.396717    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 05:07:01.114097 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:01.114067    2560 scope.go:117] "RemoveContainer" containerID="105b4c822f86fc59a47cf56714089c174b2cc8d0067a6f952944c71dca644383"
Sep 10 05:07:01.123084 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:01.123063    2560 scope.go:117] "RemoveContainer" containerID="1b446ab24b0d0e8b3ec1c7a4fcd663c906743c09ab8ab011bebaea803bed28c0"
Sep 10 05:07:07.315631 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:07.315598    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4"]
Sep 10 05:07:07.316065 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:07.315867    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4" podUID="deb10655-be47-4f62-97f8-82ddddf7d3a7" containerName="istio-proxy" containerID="cri-o://029ee704f8ad3dc74e86b681a23c45ea3a47bb19fff0e83932cd57afa2218aff" gracePeriod=30
Sep 10 05:07:12.577452 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:12.577390    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4"
Sep 10 05:07:12.662695 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:12.662665    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/deb10655-be47-4f62-97f8-82ddddf7d3a7-istio-podinfo\") pod \"deb10655-be47-4f62-97f8-82ddddf7d3a7\" (UID: \"deb10655-be47-4f62-97f8-82ddddf7d3a7\") "
Sep 10 05:07:12.662829 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:12.662717    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/deb10655-be47-4f62-97f8-82ddddf7d3a7-workload-certs\") pod \"deb10655-be47-4f62-97f8-82ddddf7d3a7\" (UID: \"deb10655-be47-4f62-97f8-82ddddf7d3a7\") "
Sep 10 05:07:12.662829 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:12.662750    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/deb10655-be47-4f62-97f8-82ddddf7d3a7-istio-data\") pod \"deb10655-be47-4f62-97f8-82ddddf7d3a7\" (UID: \"deb10655-be47-4f62-97f8-82ddddf7d3a7\") "
Sep 10 05:07:12.662829 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:12.662770    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/deb10655-be47-4f62-97f8-82ddddf7d3a7-istio-envoy\") pod \"deb10655-be47-4f62-97f8-82ddddf7d3a7\" (UID: \"deb10655-be47-4f62-97f8-82ddddf7d3a7\") "
Sep 10 05:07:12.662829 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:12.662786    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/deb10655-be47-4f62-97f8-82ddddf7d3a7-istio-token\") pod \"deb10655-be47-4f62-97f8-82ddddf7d3a7\" (UID: \"deb10655-be47-4f62-97f8-82ddddf7d3a7\") "
Sep 10 05:07:12.662829 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:12.662805    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/deb10655-be47-4f62-97f8-82ddddf7d3a7-workload-socket\") pod \"deb10655-be47-4f62-97f8-82ddddf7d3a7\" (UID: \"deb10655-be47-4f62-97f8-82ddddf7d3a7\") "
Sep 10 05:07:12.663127 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:12.662842    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8bpns\" (UniqueName: \"kubernetes.io/projected/deb10655-be47-4f62-97f8-82ddddf7d3a7-kube-api-access-8bpns\") pod \"deb10655-be47-4f62-97f8-82ddddf7d3a7\" (UID: \"deb10655-be47-4f62-97f8-82ddddf7d3a7\") "
Sep 10 05:07:12.663127 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:12.662898    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/deb10655-be47-4f62-97f8-82ddddf7d3a7-credential-socket\") pod \"deb10655-be47-4f62-97f8-82ddddf7d3a7\" (UID: \"deb10655-be47-4f62-97f8-82ddddf7d3a7\") "
Sep 10 05:07:12.663127 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:12.662940    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/deb10655-be47-4f62-97f8-82ddddf7d3a7-istiod-ca-cert\") pod \"deb10655-be47-4f62-97f8-82ddddf7d3a7\" (UID: \"deb10655-be47-4f62-97f8-82ddddf7d3a7\") "
Sep 10 05:07:12.663127 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:12.663053    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/deb10655-be47-4f62-97f8-82ddddf7d3a7-istio-data" (OuterVolumeSpecName: "istio-data") pod "deb10655-be47-4f62-97f8-82ddddf7d3a7" (UID: "deb10655-be47-4f62-97f8-82ddddf7d3a7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 05:07:12.663332 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:12.663170    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/deb10655-be47-4f62-97f8-82ddddf7d3a7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "deb10655-be47-4f62-97f8-82ddddf7d3a7" (UID: "deb10655-be47-4f62-97f8-82ddddf7d3a7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 05:07:12.663332 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:12.663217    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/deb10655-be47-4f62-97f8-82ddddf7d3a7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "deb10655-be47-4f62-97f8-82ddddf7d3a7" (UID: "deb10655-be47-4f62-97f8-82ddddf7d3a7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 05:07:12.663332 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:12.663308    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/deb10655-be47-4f62-97f8-82ddddf7d3a7-workload-certs\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:07:12.663483 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:12.663356    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/deb10655-be47-4f62-97f8-82ddddf7d3a7-istio-data\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:07:12.663483 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:12.663370    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/deb10655-be47-4f62-97f8-82ddddf7d3a7-workload-socket\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:07:12.663483 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:12.663378    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/deb10655-be47-4f62-97f8-82ddddf7d3a7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "deb10655-be47-4f62-97f8-82ddddf7d3a7" (UID: "deb10655-be47-4f62-97f8-82ddddf7d3a7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 05:07:12.663635 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:12.663562    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/deb10655-be47-4f62-97f8-82ddddf7d3a7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "deb10655-be47-4f62-97f8-82ddddf7d3a7" (UID: "deb10655-be47-4f62-97f8-82ddddf7d3a7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 05:07:12.664891 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:12.664864    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/deb10655-be47-4f62-97f8-82ddddf7d3a7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "deb10655-be47-4f62-97f8-82ddddf7d3a7" (UID: "deb10655-be47-4f62-97f8-82ddddf7d3a7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 05:07:12.665018 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:12.664968    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/deb10655-be47-4f62-97f8-82ddddf7d3a7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "deb10655-be47-4f62-97f8-82ddddf7d3a7" (UID: "deb10655-be47-4f62-97f8-82ddddf7d3a7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 05:07:12.665174 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:12.665151    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/deb10655-be47-4f62-97f8-82ddddf7d3a7-kube-api-access-8bpns" (OuterVolumeSpecName: "kube-api-access-8bpns") pod "deb10655-be47-4f62-97f8-82ddddf7d3a7" (UID: "deb10655-be47-4f62-97f8-82ddddf7d3a7"). InnerVolumeSpecName "kube-api-access-8bpns". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 05:07:12.665277 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:12.665258    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/deb10655-be47-4f62-97f8-82ddddf7d3a7-istio-token" (OuterVolumeSpecName: "istio-token") pod "deb10655-be47-4f62-97f8-82ddddf7d3a7" (UID: "deb10655-be47-4f62-97f8-82ddddf7d3a7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 05:07:12.764390 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:12.764363    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/deb10655-be47-4f62-97f8-82ddddf7d3a7-istio-podinfo\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:07:12.764390 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:12.764387    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/deb10655-be47-4f62-97f8-82ddddf7d3a7-istio-envoy\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:07:12.764390 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:12.764396    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/deb10655-be47-4f62-97f8-82ddddf7d3a7-istio-token\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:07:12.764570 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:12.764403    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8bpns\" (UniqueName: \"kubernetes.io/projected/deb10655-be47-4f62-97f8-82ddddf7d3a7-kube-api-access-8bpns\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:07:12.764570 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:12.764412    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/deb10655-be47-4f62-97f8-82ddddf7d3a7-credential-socket\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:07:12.764570 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:12.764420    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/deb10655-be47-4f62-97f8-82ddddf7d3a7-istiod-ca-cert\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:07:13.052553 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:13.052510    2560 generic.go:356] "Generic (PLEG): container finished" podID="deb10655-be47-4f62-97f8-82ddddf7d3a7" containerID="029ee704f8ad3dc74e86b681a23c45ea3a47bb19fff0e83932cd57afa2218aff" exitCode=0
Sep 10 05:07:13.052715 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:13.052564    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4"
Sep 10 05:07:13.052715 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:13.052565    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4" event={"ID":"deb10655-be47-4f62-97f8-82ddddf7d3a7","Type":"ContainerDied","Data":"029ee704f8ad3dc74e86b681a23c45ea3a47bb19fff0e83932cd57afa2218aff"}
Sep 10 05:07:13.052715 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:13.052625    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4" event={"ID":"deb10655-be47-4f62-97f8-82ddddf7d3a7","Type":"ContainerDied","Data":"9484cf94f2302f2ee49a2ce74f3cd782bd32cdf0a21571b49780e1416e860f77"}
Sep 10 05:07:13.052715 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:13.052652    2560 scope.go:117] "RemoveContainer" containerID="029ee704f8ad3dc74e86b681a23c45ea3a47bb19fff0e83932cd57afa2218aff"
Sep 10 05:07:13.066685 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:13.066663    2560 scope.go:117] "RemoveContainer" containerID="915fbef53dd9b7a0c0522d7d86d567ab60e5bdf1e0a1d3e96f2106280dfc7587"
Sep 10 05:07:13.076026 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:13.075960    2560 scope.go:117] "RemoveContainer" containerID="029ee704f8ad3dc74e86b681a23c45ea3a47bb19fff0e83932cd57afa2218aff"
Sep 10 05:07:13.076312 ip-10-0-138-27 kubenswrapper[2560]: E0910 05:07:13.076288    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"029ee704f8ad3dc74e86b681a23c45ea3a47bb19fff0e83932cd57afa2218aff\": container with ID starting with 029ee704f8ad3dc74e86b681a23c45ea3a47bb19fff0e83932cd57afa2218aff not found: ID does not exist" containerID="029ee704f8ad3dc74e86b681a23c45ea3a47bb19fff0e83932cd57afa2218aff"
Sep 10 05:07:13.076436 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:13.076320    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"029ee704f8ad3dc74e86b681a23c45ea3a47bb19fff0e83932cd57afa2218aff"} err="failed to get container status \"029ee704f8ad3dc74e86b681a23c45ea3a47bb19fff0e83932cd57afa2218aff\": rpc error: code = NotFound desc = could not find container \"029ee704f8ad3dc74e86b681a23c45ea3a47bb19fff0e83932cd57afa2218aff\": container with ID starting with 029ee704f8ad3dc74e86b681a23c45ea3a47bb19fff0e83932cd57afa2218aff not found: ID does not exist"
Sep 10 05:07:13.076436 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:13.076345    2560 scope.go:117] "RemoveContainer" containerID="915fbef53dd9b7a0c0522d7d86d567ab60e5bdf1e0a1d3e96f2106280dfc7587"
Sep 10 05:07:13.076697 ip-10-0-138-27 kubenswrapper[2560]: E0910 05:07:13.076674    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"915fbef53dd9b7a0c0522d7d86d567ab60e5bdf1e0a1d3e96f2106280dfc7587\": container with ID starting with 915fbef53dd9b7a0c0522d7d86d567ab60e5bdf1e0a1d3e96f2106280dfc7587 not found: ID does not exist" containerID="915fbef53dd9b7a0c0522d7d86d567ab60e5bdf1e0a1d3e96f2106280dfc7587"
Sep 10 05:07:13.076812 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:13.076699    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"915fbef53dd9b7a0c0522d7d86d567ab60e5bdf1e0a1d3e96f2106280dfc7587"} err="failed to get container status \"915fbef53dd9b7a0c0522d7d86d567ab60e5bdf1e0a1d3e96f2106280dfc7587\": rpc error: code = NotFound desc = could not find container \"915fbef53dd9b7a0c0522d7d86d567ab60e5bdf1e0a1d3e96f2106280dfc7587\": container with ID starting with 915fbef53dd9b7a0c0522d7d86d567ab60e5bdf1e0a1d3e96f2106280dfc7587 not found: ID does not exist"
Sep 10 05:07:13.078999 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:13.078920    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4"]
Sep 10 05:07:13.089160 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:13.089113    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-25bd47-openshift-default-6bd4fb5ff4-pdmg4"]
Sep 10 05:07:13.499722 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:13.499689    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 05:07:14.826866 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:14.826810    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="deb10655-be47-4f62-97f8-82ddddf7d3a7" path="/var/lib/kubelet/pods/deb10655-be47-4f62-97f8-82ddddf7d3a7/volumes"
Sep 10 05:07:18.383623 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:18.383584    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-97ffde-6845fd6ff6-l86v9"]
Sep 10 05:07:18.384109 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:18.383864    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-97ffde-6845fd6ff6-l86v9" podUID="e7487ffa-b740-459e-9023-1aaf7437bbe8" containerName="maas-api" containerID="cri-o://4d76755a25ee59df3140ff580ff35a137a9f0b8dda100125acedc95978d7bd2b" gracePeriod=30
Sep 10 05:07:18.643058 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:18.643003    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-97ffde-6845fd6ff6-l86v9"
Sep 10 05:07:18.717211 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:18.717185    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e7487ffa-b740-459e-9023-1aaf7437bbe8-maas-api-tls\") pod \"e7487ffa-b740-459e-9023-1aaf7437bbe8\" (UID: \"e7487ffa-b740-459e-9023-1aaf7437bbe8\") "
Sep 10 05:07:18.717370 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:18.717239    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gf9qr\" (UniqueName: \"kubernetes.io/projected/e7487ffa-b740-459e-9023-1aaf7437bbe8-kube-api-access-gf9qr\") pod \"e7487ffa-b740-459e-9023-1aaf7437bbe8\" (UID: \"e7487ffa-b740-459e-9023-1aaf7437bbe8\") "
Sep 10 05:07:18.717370 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:18.717278    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7487ffa-b740-459e-9023-1aaf7437bbe8-metrics-certs\") pod \"e7487ffa-b740-459e-9023-1aaf7437bbe8\" (UID: \"e7487ffa-b740-459e-9023-1aaf7437bbe8\") "
Sep 10 05:07:18.717370 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:18.717310    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7487ffa-b740-459e-9023-1aaf7437bbe8-openshift-service-ca\") pod \"e7487ffa-b740-459e-9023-1aaf7437bbe8\" (UID: \"e7487ffa-b740-459e-9023-1aaf7437bbe8\") "
Sep 10 05:07:18.717822 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:18.717790    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7487ffa-b740-459e-9023-1aaf7437bbe8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e7487ffa-b740-459e-9023-1aaf7437bbe8" (UID: "e7487ffa-b740-459e-9023-1aaf7437bbe8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 05:07:18.719600 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:18.719572    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7487ffa-b740-459e-9023-1aaf7437bbe8-kube-api-access-gf9qr" (OuterVolumeSpecName: "kube-api-access-gf9qr") pod "e7487ffa-b740-459e-9023-1aaf7437bbe8" (UID: "e7487ffa-b740-459e-9023-1aaf7437bbe8"). InnerVolumeSpecName "kube-api-access-gf9qr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 05:07:18.719737 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:18.719718    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7487ffa-b740-459e-9023-1aaf7437bbe8-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "e7487ffa-b740-459e-9023-1aaf7437bbe8" (UID: "e7487ffa-b740-459e-9023-1aaf7437bbe8"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 05:07:18.719874 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:18.719828    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7487ffa-b740-459e-9023-1aaf7437bbe8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e7487ffa-b740-459e-9023-1aaf7437bbe8" (UID: "e7487ffa-b740-459e-9023-1aaf7437bbe8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 05:07:18.818864 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:18.818816    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7487ffa-b740-459e-9023-1aaf7437bbe8-openshift-service-ca\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:07:18.818864 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:18.818868    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e7487ffa-b740-459e-9023-1aaf7437bbe8-maas-api-tls\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:07:18.819066 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:18.818884    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gf9qr\" (UniqueName: \"kubernetes.io/projected/e7487ffa-b740-459e-9023-1aaf7437bbe8-kube-api-access-gf9qr\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:07:18.819066 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:18.818897    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7487ffa-b740-459e-9023-1aaf7437bbe8-metrics-certs\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:07:19.092895 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:19.092785    2560 generic.go:356] "Generic (PLEG): container finished" podID="e7487ffa-b740-459e-9023-1aaf7437bbe8" containerID="4d76755a25ee59df3140ff580ff35a137a9f0b8dda100125acedc95978d7bd2b" exitCode=0
Sep 10 05:07:19.092895 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:19.092830    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-97ffde-6845fd6ff6-l86v9"
Sep 10 05:07:19.092895 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:19.092886    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-97ffde-6845fd6ff6-l86v9" event={"ID":"e7487ffa-b740-459e-9023-1aaf7437bbe8","Type":"ContainerDied","Data":"4d76755a25ee59df3140ff580ff35a137a9f0b8dda100125acedc95978d7bd2b"}
Sep 10 05:07:19.093106 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:19.092943    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-97ffde-6845fd6ff6-l86v9" event={"ID":"e7487ffa-b740-459e-9023-1aaf7437bbe8","Type":"ContainerDied","Data":"db81ec102aeee6b8adad31d7098d50d290479b2d54ee1afd7faa561e5a2aa452"}
Sep 10 05:07:19.093106 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:19.092968    2560 scope.go:117] "RemoveContainer" containerID="4d76755a25ee59df3140ff580ff35a137a9f0b8dda100125acedc95978d7bd2b"
Sep 10 05:07:19.102089 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:19.102067    2560 scope.go:117] "RemoveContainer" containerID="4d76755a25ee59df3140ff580ff35a137a9f0b8dda100125acedc95978d7bd2b"
Sep 10 05:07:19.102349 ip-10-0-138-27 kubenswrapper[2560]: E0910 05:07:19.102329    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d76755a25ee59df3140ff580ff35a137a9f0b8dda100125acedc95978d7bd2b\": container with ID starting with 4d76755a25ee59df3140ff580ff35a137a9f0b8dda100125acedc95978d7bd2b not found: ID does not exist" containerID="4d76755a25ee59df3140ff580ff35a137a9f0b8dda100125acedc95978d7bd2b"
Sep 10 05:07:19.102423 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:19.102364    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d76755a25ee59df3140ff580ff35a137a9f0b8dda100125acedc95978d7bd2b"} err="failed to get container status \"4d76755a25ee59df3140ff580ff35a137a9f0b8dda100125acedc95978d7bd2b\": rpc error: code = NotFound desc = could not find container \"4d76755a25ee59df3140ff580ff35a137a9f0b8dda100125acedc95978d7bd2b\": container with ID starting with 4d76755a25ee59df3140ff580ff35a137a9f0b8dda100125acedc95978d7bd2b not found: ID does not exist"
Sep 10 05:07:19.110937 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:19.110918    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-97ffde-6845fd6ff6-l86v9"]
Sep 10 05:07:19.115341 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:19.115320    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-97ffde-6845fd6ff6-l86v9"]
Sep 10 05:07:20.825964 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:20.825930    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7487ffa-b740-459e-9023-1aaf7437bbe8" path="/var/lib/kubelet/pods/e7487ffa-b740-459e-9023-1aaf7437bbe8/volumes"
Sep 10 05:07:25.008023 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:25.007992    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr"]
Sep 10 05:07:25.008434 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:25.008218    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr" podUID="231145e0-7b08-4465-ae64-2da3aaee4529" containerName="istio-proxy" containerID="cri-o://b912022b57203a07600d819bd9cf4ec587f54ffac2ee8618013e0a47bc6fc004" gracePeriod=30
Sep 10 05:07:29.011831 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:29.011782    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 05:07:30.162375 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:30.162345    2560 generic.go:356] "Generic (PLEG): container finished" podID="231145e0-7b08-4465-ae64-2da3aaee4529" containerID="b912022b57203a07600d819bd9cf4ec587f54ffac2ee8618013e0a47bc6fc004" exitCode=0
Sep 10 05:07:30.162772 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:30.162419    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr" event={"ID":"231145e0-7b08-4465-ae64-2da3aaee4529","Type":"ContainerDied","Data":"b912022b57203a07600d819bd9cf4ec587f54ffac2ee8618013e0a47bc6fc004"}
Sep 10 05:07:30.162772 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:30.162485    2560 scope.go:117] "RemoveContainer" containerID="7c410bc117d2fb9f339cee0d1f55f372444911f1da5b5964dafef9edead2db3c"
Sep 10 05:07:30.272699 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:30.272646    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr"
Sep 10 05:07:30.428039 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:30.428013    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/231145e0-7b08-4465-ae64-2da3aaee4529-istio-token\") pod \"231145e0-7b08-4465-ae64-2da3aaee4529\" (UID: \"231145e0-7b08-4465-ae64-2da3aaee4529\") "
Sep 10 05:07:30.428210 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:30.428046    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wjlx4\" (UniqueName: \"kubernetes.io/projected/231145e0-7b08-4465-ae64-2da3aaee4529-kube-api-access-wjlx4\") pod \"231145e0-7b08-4465-ae64-2da3aaee4529\" (UID: \"231145e0-7b08-4465-ae64-2da3aaee4529\") "
Sep 10 05:07:30.428210 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:30.428079    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/231145e0-7b08-4465-ae64-2da3aaee4529-istio-envoy\") pod \"231145e0-7b08-4465-ae64-2da3aaee4529\" (UID: \"231145e0-7b08-4465-ae64-2da3aaee4529\") "
Sep 10 05:07:30.428210 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:30.428113    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/231145e0-7b08-4465-ae64-2da3aaee4529-workload-socket\") pod \"231145e0-7b08-4465-ae64-2da3aaee4529\" (UID: \"231145e0-7b08-4465-ae64-2da3aaee4529\") "
Sep 10 05:07:30.428210 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:30.428160    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/231145e0-7b08-4465-ae64-2da3aaee4529-istio-data\") pod \"231145e0-7b08-4465-ae64-2da3aaee4529\" (UID: \"231145e0-7b08-4465-ae64-2da3aaee4529\") "
Sep 10 05:07:30.428210 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:30.428179    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/231145e0-7b08-4465-ae64-2da3aaee4529-istiod-ca-cert\") pod \"231145e0-7b08-4465-ae64-2da3aaee4529\" (UID: \"231145e0-7b08-4465-ae64-2da3aaee4529\") "
Sep 10 05:07:30.428497 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:30.428215    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/231145e0-7b08-4465-ae64-2da3aaee4529-istio-podinfo\") pod \"231145e0-7b08-4465-ae64-2da3aaee4529\" (UID: \"231145e0-7b08-4465-ae64-2da3aaee4529\") "
Sep 10 05:07:30.428497 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:30.428239    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/231145e0-7b08-4465-ae64-2da3aaee4529-workload-certs\") pod \"231145e0-7b08-4465-ae64-2da3aaee4529\" (UID: \"231145e0-7b08-4465-ae64-2da3aaee4529\") "
Sep 10 05:07:30.428497 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:30.428261    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/231145e0-7b08-4465-ae64-2da3aaee4529-credential-socket\") pod \"231145e0-7b08-4465-ae64-2da3aaee4529\" (UID: \"231145e0-7b08-4465-ae64-2da3aaee4529\") "
Sep 10 05:07:30.428497 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:30.428442    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/231145e0-7b08-4465-ae64-2da3aaee4529-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "231145e0-7b08-4465-ae64-2da3aaee4529" (UID: "231145e0-7b08-4465-ae64-2da3aaee4529"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 05:07:30.428716 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:30.428561    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/231145e0-7b08-4465-ae64-2da3aaee4529-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "231145e0-7b08-4465-ae64-2da3aaee4529" (UID: "231145e0-7b08-4465-ae64-2da3aaee4529"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 05:07:30.428716 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:30.428637    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/231145e0-7b08-4465-ae64-2da3aaee4529-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "231145e0-7b08-4465-ae64-2da3aaee4529" (UID: "231145e0-7b08-4465-ae64-2da3aaee4529"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 05:07:30.428826 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:30.428721    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/231145e0-7b08-4465-ae64-2da3aaee4529-workload-socket\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:07:30.428826 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:30.428737    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/231145e0-7b08-4465-ae64-2da3aaee4529-istiod-ca-cert\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:07:30.428826 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:30.428743    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/231145e0-7b08-4465-ae64-2da3aaee4529-istio-data" (OuterVolumeSpecName: "istio-data") pod "231145e0-7b08-4465-ae64-2da3aaee4529" (UID: "231145e0-7b08-4465-ae64-2da3aaee4529"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 05:07:30.428826 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:30.428782    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/231145e0-7b08-4465-ae64-2da3aaee4529-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "231145e0-7b08-4465-ae64-2da3aaee4529" (UID: "231145e0-7b08-4465-ae64-2da3aaee4529"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 05:07:30.430320 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:30.430293    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/231145e0-7b08-4465-ae64-2da3aaee4529-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "231145e0-7b08-4465-ae64-2da3aaee4529" (UID: "231145e0-7b08-4465-ae64-2da3aaee4529"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 05:07:30.430423 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:30.430345    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/231145e0-7b08-4465-ae64-2da3aaee4529-kube-api-access-wjlx4" (OuterVolumeSpecName: "kube-api-access-wjlx4") pod "231145e0-7b08-4465-ae64-2da3aaee4529" (UID: "231145e0-7b08-4465-ae64-2da3aaee4529"). InnerVolumeSpecName "kube-api-access-wjlx4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 05:07:30.430423 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:30.430391    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/231145e0-7b08-4465-ae64-2da3aaee4529-istio-token" (OuterVolumeSpecName: "istio-token") pod "231145e0-7b08-4465-ae64-2da3aaee4529" (UID: "231145e0-7b08-4465-ae64-2da3aaee4529"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 05:07:30.430504 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:30.430434    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/231145e0-7b08-4465-ae64-2da3aaee4529-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "231145e0-7b08-4465-ae64-2da3aaee4529" (UID: "231145e0-7b08-4465-ae64-2da3aaee4529"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 05:07:30.530249 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:30.530178    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/231145e0-7b08-4465-ae64-2da3aaee4529-istio-data\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:07:30.530249 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:30.530202    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/231145e0-7b08-4465-ae64-2da3aaee4529-istio-podinfo\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:07:30.530249 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:30.530210    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/231145e0-7b08-4465-ae64-2da3aaee4529-workload-certs\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:07:30.530249 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:30.530220    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/231145e0-7b08-4465-ae64-2da3aaee4529-credential-socket\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:07:30.530249 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:30.530228    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/231145e0-7b08-4465-ae64-2da3aaee4529-istio-token\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:07:30.530249 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:30.530237    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wjlx4\" (UniqueName: \"kubernetes.io/projected/231145e0-7b08-4465-ae64-2da3aaee4529-kube-api-access-wjlx4\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:07:30.530249 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:30.530245    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/231145e0-7b08-4465-ae64-2da3aaee4529-istio-envoy\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:07:31.169638 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:31.169609    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr" event={"ID":"231145e0-7b08-4465-ae64-2da3aaee4529","Type":"ContainerDied","Data":"e002540d53aee91d954ae63179097890e6c71a44d3523e415afce66ea80081e1"}
Sep 10 05:07:31.170039 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:31.169659    2560 scope.go:117] "RemoveContainer" containerID="b912022b57203a07600d819bd9cf4ec587f54ffac2ee8618013e0a47bc6fc004"
Sep 10 05:07:31.170039 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:31.169616    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr"
Sep 10 05:07:31.187071 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:31.187049    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr"]
Sep 10 05:07:31.191029 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:31.191008    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-97ffde-openshift-default-764cc6cbd6-qkmkr"]
Sep 10 05:07:32.825388 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:32.825355    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="231145e0-7b08-4465-ae64-2da3aaee4529" path="/var/lib/kubelet/pods/231145e0-7b08-4465-ae64-2da3aaee4529/volumes"
Sep 10 05:07:40.800094 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:40.800052    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 05:07:48.198705 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:48.198671    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 05:07:55.218316 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:55.218215    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6"]
Sep 10 05:07:55.218769 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:55.218677    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ea183f0-0208-40c5-abe0-8f1b03b33c7a" containerName="test-curl-7861-e4cf8b"
Sep 10 05:07:55.218769 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:55.218692    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ea183f0-0208-40c5-abe0-8f1b03b33c7a" containerName="test-curl-7861-e4cf8b"
Sep 10 05:07:55.218769 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:55.218703    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="964ba3d5-f090-44e2-aa4c-af5274b228cb" containerName="maas-api"
Sep 10 05:07:55.218769 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:55.218709    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="964ba3d5-f090-44e2-aa4c-af5274b228cb" containerName="maas-api"
Sep 10 05:07:55.218769 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:55.218719    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="deb10655-be47-4f62-97f8-82ddddf7d3a7" containerName="istio-proxy"
Sep 10 05:07:55.218769 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:55.218724    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="deb10655-be47-4f62-97f8-82ddddf7d3a7" containerName="istio-proxy"
Sep 10 05:07:55.218769 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:55.218735    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7487ffa-b740-459e-9023-1aaf7437bbe8" containerName="maas-api"
Sep 10 05:07:55.218769 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:55.218744    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7487ffa-b740-459e-9023-1aaf7437bbe8" containerName="maas-api"
Sep 10 05:07:55.218769 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:55.218751    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="231145e0-7b08-4465-ae64-2da3aaee4529" containerName="istio-proxy"
Sep 10 05:07:55.218769 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:55.218756    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="231145e0-7b08-4465-ae64-2da3aaee4529" containerName="istio-proxy"
Sep 10 05:07:55.218769 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:55.218770    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="deb10655-be47-4f62-97f8-82ddddf7d3a7" containerName="istio-proxy"
Sep 10 05:07:55.218769 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:55.218775    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="deb10655-be47-4f62-97f8-82ddddf7d3a7" containerName="istio-proxy"
Sep 10 05:07:55.219416 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:55.218889    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="231145e0-7b08-4465-ae64-2da3aaee4529" containerName="istio-proxy"
Sep 10 05:07:55.219416 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:55.218898    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="deb10655-be47-4f62-97f8-82ddddf7d3a7" containerName="istio-proxy"
Sep 10 05:07:55.219416 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:55.218905    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="deb10655-be47-4f62-97f8-82ddddf7d3a7" containerName="istio-proxy"
Sep 10 05:07:55.219416 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:55.218911    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="964ba3d5-f090-44e2-aa4c-af5274b228cb" containerName="maas-api"
Sep 10 05:07:55.219416 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:55.218917    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ea183f0-0208-40c5-abe0-8f1b03b33c7a" containerName="test-curl-7861-e4cf8b"
Sep 10 05:07:55.219416 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:55.218923    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7487ffa-b740-459e-9023-1aaf7437bbe8" containerName="maas-api"
Sep 10 05:07:55.219416 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:55.218936    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="231145e0-7b08-4465-ae64-2da3aaee4529" containerName="istio-proxy"
Sep 10 05:07:55.222318 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:55.222295    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6"
Sep 10 05:07:55.225320 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:55.225301    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-95427a-openshift-default-dockercfg-q4scn\""
Sep 10 05:07:55.234003 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:55.233981    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6"]
Sep 10 05:07:55.334296 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:55.334266    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93d40d75-2f34-4930-8c40-cf6428c096bb-workload-certs\") pod \"e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6\" (UID: \"93d40d75-2f34-4930-8c40-cf6428c096bb\") " pod="openshift-ingress/e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6"
Sep 10 05:07:55.334296 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:55.334300    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93d40d75-2f34-4930-8c40-cf6428c096bb-istio-podinfo\") pod \"e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6\" (UID: \"93d40d75-2f34-4930-8c40-cf6428c096bb\") " pod="openshift-ingress/e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6"
Sep 10 05:07:55.334543 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:55.334327    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93d40d75-2f34-4930-8c40-cf6428c096bb-istio-token\") pod \"e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6\" (UID: \"93d40d75-2f34-4930-8c40-cf6428c096bb\") " pod="openshift-ingress/e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6"
Sep 10 05:07:55.334543 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:55.334350    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93d40d75-2f34-4930-8c40-cf6428c096bb-istio-envoy\") pod \"e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6\" (UID: \"93d40d75-2f34-4930-8c40-cf6428c096bb\") " pod="openshift-ingress/e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6"
Sep 10 05:07:55.334543 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:55.334424    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93d40d75-2f34-4930-8c40-cf6428c096bb-workload-socket\") pod \"e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6\" (UID: \"93d40d75-2f34-4930-8c40-cf6428c096bb\") " pod="openshift-ingress/e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6"
Sep 10 05:07:55.334543 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:55.334487    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93d40d75-2f34-4930-8c40-cf6428c096bb-credential-socket\") pod \"e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6\" (UID: \"93d40d75-2f34-4930-8c40-cf6428c096bb\") " pod="openshift-ingress/e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6"
Sep 10 05:07:55.334543 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:55.334534    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93d40d75-2f34-4930-8c40-cf6428c096bb-istiod-ca-cert\") pod \"e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6\" (UID: \"93d40d75-2f34-4930-8c40-cf6428c096bb\") " pod="openshift-ingress/e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6"
Sep 10 05:07:55.334742 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:55.334591    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxrpc\" (UniqueName: \"kubernetes.io/projected/93d40d75-2f34-4930-8c40-cf6428c096bb-kube-api-access-bxrpc\") pod \"e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6\" (UID: \"93d40d75-2f34-4930-8c40-cf6428c096bb\") " pod="openshift-ingress/e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6"
Sep 10 05:07:55.334742 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:55.334624    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93d40d75-2f34-4930-8c40-cf6428c096bb-istio-data\") pod \"e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6\" (UID: \"93d40d75-2f34-4930-8c40-cf6428c096bb\") " pod="openshift-ingress/e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6"
Sep 10 05:07:55.435772 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:55.435744    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93d40d75-2f34-4930-8c40-cf6428c096bb-istio-data\") pod \"e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6\" (UID: \"93d40d75-2f34-4930-8c40-cf6428c096bb\") " pod="openshift-ingress/e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6"
Sep 10 05:07:55.435967 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:55.435801    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93d40d75-2f34-4930-8c40-cf6428c096bb-workload-certs\") pod \"e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6\" (UID: \"93d40d75-2f34-4930-8c40-cf6428c096bb\") " pod="openshift-ingress/e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6"
Sep 10 05:07:55.435967 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:55.435834    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93d40d75-2f34-4930-8c40-cf6428c096bb-istio-podinfo\") pod \"e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6\" (UID: \"93d40d75-2f34-4930-8c40-cf6428c096bb\") " pod="openshift-ingress/e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6"
Sep 10 05:07:55.435967 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:55.435896    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93d40d75-2f34-4930-8c40-cf6428c096bb-istio-token\") pod \"e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6\" (UID: \"93d40d75-2f34-4930-8c40-cf6428c096bb\") " pod="openshift-ingress/e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6"
Sep 10 05:07:55.435967 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:55.435925    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93d40d75-2f34-4930-8c40-cf6428c096bb-istio-envoy\") pod \"e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6\" (UID: \"93d40d75-2f34-4930-8c40-cf6428c096bb\") " pod="openshift-ingress/e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6"
Sep 10 05:07:55.435967 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:55.435955    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93d40d75-2f34-4930-8c40-cf6428c096bb-workload-socket\") pod \"e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6\" (UID: \"93d40d75-2f34-4930-8c40-cf6428c096bb\") " pod="openshift-ingress/e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6"
Sep 10 05:07:55.436237 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:55.436005    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93d40d75-2f34-4930-8c40-cf6428c096bb-credential-socket\") pod \"e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6\" (UID: \"93d40d75-2f34-4930-8c40-cf6428c096bb\") " pod="openshift-ingress/e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6"
Sep 10 05:07:55.436237 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:55.436036    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93d40d75-2f34-4930-8c40-cf6428c096bb-istiod-ca-cert\") pod \"e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6\" (UID: \"93d40d75-2f34-4930-8c40-cf6428c096bb\") " pod="openshift-ingress/e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6"
Sep 10 05:07:55.436237 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:55.436085    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxrpc\" (UniqueName: \"kubernetes.io/projected/93d40d75-2f34-4930-8c40-cf6428c096bb-kube-api-access-bxrpc\") pod \"e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6\" (UID: \"93d40d75-2f34-4930-8c40-cf6428c096bb\") " pod="openshift-ingress/e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6"
Sep 10 05:07:55.436392 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:55.436230    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93d40d75-2f34-4930-8c40-cf6428c096bb-workload-certs\") pod \"e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6\" (UID: \"93d40d75-2f34-4930-8c40-cf6428c096bb\") " pod="openshift-ingress/e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6"
Sep 10 05:07:55.436392 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:55.436344    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93d40d75-2f34-4930-8c40-cf6428c096bb-workload-socket\") pod \"e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6\" (UID: \"93d40d75-2f34-4930-8c40-cf6428c096bb\") " pod="openshift-ingress/e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6"
Sep 10 05:07:55.436485 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:55.436426    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93d40d75-2f34-4930-8c40-cf6428c096bb-credential-socket\") pod \"e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6\" (UID: \"93d40d75-2f34-4930-8c40-cf6428c096bb\") " pod="openshift-ingress/e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6"
Sep 10 05:07:55.436532 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:55.436485    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93d40d75-2f34-4930-8c40-cf6428c096bb-istio-data\") pod \"e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6\" (UID: \"93d40d75-2f34-4930-8c40-cf6428c096bb\") " pod="openshift-ingress/e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6"
Sep 10 05:07:55.436957 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:55.436933    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93d40d75-2f34-4930-8c40-cf6428c096bb-istiod-ca-cert\") pod \"e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6\" (UID: \"93d40d75-2f34-4930-8c40-cf6428c096bb\") " pod="openshift-ingress/e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6"
Sep 10 05:07:55.438205 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:55.438177    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93d40d75-2f34-4930-8c40-cf6428c096bb-istio-envoy\") pod \"e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6\" (UID: \"93d40d75-2f34-4930-8c40-cf6428c096bb\") " pod="openshift-ingress/e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6"
Sep 10 05:07:55.438389 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:55.438373    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93d40d75-2f34-4930-8c40-cf6428c096bb-istio-podinfo\") pod \"e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6\" (UID: \"93d40d75-2f34-4930-8c40-cf6428c096bb\") " pod="openshift-ingress/e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6"
Sep 10 05:07:55.443221 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:55.443199    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93d40d75-2f34-4930-8c40-cf6428c096bb-istio-token\") pod \"e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6\" (UID: \"93d40d75-2f34-4930-8c40-cf6428c096bb\") " pod="openshift-ingress/e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6"
Sep 10 05:07:55.443402 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:55.443384    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxrpc\" (UniqueName: \"kubernetes.io/projected/93d40d75-2f34-4930-8c40-cf6428c096bb-kube-api-access-bxrpc\") pod \"e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6\" (UID: \"93d40d75-2f34-4930-8c40-cf6428c096bb\") " pod="openshift-ingress/e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6"
Sep 10 05:07:55.533507 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:55.533450    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6"
Sep 10 05:07:55.809952 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:55.809929    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6"]
Sep 10 05:07:55.812063 ip-10-0-138-27 kubenswrapper[2560]: W0910 05:07:55.812034    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93d40d75_2f34_4930_8c40_cf6428c096bb.slice/crio-9be50386fcd19291c7c7d2b4efd4de5394abe9a5dcfbc5c5d41329373a28810b WatchSource:0}: Error finding container 9be50386fcd19291c7c7d2b4efd4de5394abe9a5dcfbc5c5d41329373a28810b: Status 404 returned error can't find the container with id 9be50386fcd19291c7c7d2b4efd4de5394abe9a5dcfbc5c5d41329373a28810b
Sep 10 05:07:55.814284 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:55.814252    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 05:07:55.814386 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:55.814328    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 05:07:55.814386 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:55.814374    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 05:07:56.320396 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:56.320354    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6" event={"ID":"93d40d75-2f34-4930-8c40-cf6428c096bb","Type":"ContainerStarted","Data":"33926d46f0e61c116ff1e541a408f2744ad865cabcc8805c33eb5ba261c5a4f3"}
Sep 10 05:07:56.320812 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:56.320416    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6" event={"ID":"93d40d75-2f34-4930-8c40-cf6428c096bb","Type":"ContainerStarted","Data":"9be50386fcd19291c7c7d2b4efd4de5394abe9a5dcfbc5c5d41329373a28810b"}
Sep 10 05:07:56.341493 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:56.341448    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6" podStartSLOduration=1.3414336869999999 podStartE2EDuration="1.341433687s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 05:07:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 05:07:56.338989612 +0000 UTC m=+1616.001447359" watchObservedRunningTime="2026-09-10 05:07:56.341433687 +0000 UTC m=+1616.003891431"
Sep 10 05:07:56.533676 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:56.533646    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6"
Sep 10 05:07:56.539088 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:56.539058    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6"
Sep 10 05:07:57.326615 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:57.326588    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6"
Sep 10 05:07:57.327551 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:57.327530    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6"
Sep 10 05:07:58.704899 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:07:58.704866    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 05:08:10.111668 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:10.111632    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 05:08:13.368018 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:13.367978    2560 patch_prober.go:28] interesting pod/e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 05:08:13.368362 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:13.368043    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6" podUID="93d40d75-2f34-4930-8c40-cf6428c096bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 05:08:15.438398 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:15.438364    2560 generic.go:356] "Generic (PLEG): container finished" podID="93d40d75-2f34-4930-8c40-cf6428c096bb" containerID="33926d46f0e61c116ff1e541a408f2744ad865cabcc8805c33eb5ba261c5a4f3" exitCode=0
Sep 10 05:08:15.438811 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:15.438441    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6" event={"ID":"93d40d75-2f34-4930-8c40-cf6428c096bb","Type":"ContainerDied","Data":"33926d46f0e61c116ff1e541a408f2744ad865cabcc8805c33eb5ba261c5a4f3"}
Sep 10 05:08:15.438932 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:15.438912    2560 scope.go:117] "RemoveContainer" containerID="33926d46f0e61c116ff1e541a408f2744ad865cabcc8805c33eb5ba261c5a4f3"
Sep 10 05:08:15.440085 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:15.440056    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 05:08:15.440200 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:15.440139    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 05:08:15.440200 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:15.440191    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 05:08:16.460224 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:16.460180    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6" event={"ID":"93d40d75-2f34-4930-8c40-cf6428c096bb","Type":"ContainerStarted","Data":"841a84ecadcb498dd85c6485138a894bbeed0e13c680b3fe8def9f3f449c2bf4"}
Sep 10 05:08:16.534385 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:16.534355    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6"
Sep 10 05:08:16.534624 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:16.534603    2560 patch_prober.go:28] interesting pod/e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Sep 10 05:08:16.534679 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:16.534649    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6" podUID="93d40d75-2f34-4930-8c40-cf6428c096bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Sep 10 05:08:17.534728 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:17.534692    2560 patch_prober.go:28] interesting pod/e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Sep 10 05:08:17.535144 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:17.534748    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6" podUID="93d40d75-2f34-4930-8c40-cf6428c096bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Sep 10 05:08:18.534452 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:18.534419    2560 patch_prober.go:28] interesting pod/e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Sep 10 05:08:18.534627 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:18.534469    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6" podUID="93d40d75-2f34-4930-8c40-cf6428c096bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Sep 10 05:08:19.534859 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:19.534811    2560 patch_prober.go:28] interesting pod/e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Sep 10 05:08:19.535326 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:19.534893    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6" podUID="93d40d75-2f34-4930-8c40-cf6428c096bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Sep 10 05:08:20.534505 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:20.534468    2560 patch_prober.go:28] interesting pod/e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Sep 10 05:08:20.534686 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:20.534524    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6" podUID="93d40d75-2f34-4930-8c40-cf6428c096bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Sep 10 05:08:21.538207 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:21.538174    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6"
Sep 10 05:08:21.538591 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:21.538539    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6"
Sep 10 05:08:21.539338 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:21.539316    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6"
Sep 10 05:08:24.461676 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:24.461641    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2"]
Sep 10 05:08:24.462307 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:24.462282    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="231145e0-7b08-4465-ae64-2da3aaee4529" containerName="istio-proxy"
Sep 10 05:08:24.462307 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:24.462307    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="231145e0-7b08-4465-ae64-2da3aaee4529" containerName="istio-proxy"
Sep 10 05:08:24.464634 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:24.464612    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2"
Sep 10 05:08:24.466960 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:24.466938    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-1c7644-openshift-default-dockercfg-xkr2c\""
Sep 10 05:08:24.478667 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:24.478643    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2"]
Sep 10 05:08:24.525656 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:24.525628    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/83fd3371-9570-44c9-bf1c-ce31b54583e3-istiod-ca-cert\") pod \"e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2\" (UID: \"83fd3371-9570-44c9-bf1c-ce31b54583e3\") " pod="openshift-ingress/e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2"
Sep 10 05:08:24.525776 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:24.525688    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/83fd3371-9570-44c9-bf1c-ce31b54583e3-istio-envoy\") pod \"e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2\" (UID: \"83fd3371-9570-44c9-bf1c-ce31b54583e3\") " pod="openshift-ingress/e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2"
Sep 10 05:08:24.525776 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:24.525757    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/83fd3371-9570-44c9-bf1c-ce31b54583e3-istio-token\") pod \"e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2\" (UID: \"83fd3371-9570-44c9-bf1c-ce31b54583e3\") " pod="openshift-ingress/e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2"
Sep 10 05:08:24.525939 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:24.525806    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7sz7\" (UniqueName: \"kubernetes.io/projected/83fd3371-9570-44c9-bf1c-ce31b54583e3-kube-api-access-d7sz7\") pod \"e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2\" (UID: \"83fd3371-9570-44c9-bf1c-ce31b54583e3\") " pod="openshift-ingress/e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2"
Sep 10 05:08:24.525939 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:24.525880    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/83fd3371-9570-44c9-bf1c-ce31b54583e3-istio-data\") pod \"e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2\" (UID: \"83fd3371-9570-44c9-bf1c-ce31b54583e3\") " pod="openshift-ingress/e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2"
Sep 10 05:08:24.525939 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:24.525919    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/83fd3371-9570-44c9-bf1c-ce31b54583e3-istio-podinfo\") pod \"e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2\" (UID: \"83fd3371-9570-44c9-bf1c-ce31b54583e3\") " pod="openshift-ingress/e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2"
Sep 10 05:08:24.526096 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:24.525946    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/83fd3371-9570-44c9-bf1c-ce31b54583e3-credential-socket\") pod \"e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2\" (UID: \"83fd3371-9570-44c9-bf1c-ce31b54583e3\") " pod="openshift-ingress/e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2"
Sep 10 05:08:24.526096 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:24.525983    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/83fd3371-9570-44c9-bf1c-ce31b54583e3-workload-certs\") pod \"e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2\" (UID: \"83fd3371-9570-44c9-bf1c-ce31b54583e3\") " pod="openshift-ingress/e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2"
Sep 10 05:08:24.526096 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:24.526073    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/83fd3371-9570-44c9-bf1c-ce31b54583e3-workload-socket\") pod \"e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2\" (UID: \"83fd3371-9570-44c9-bf1c-ce31b54583e3\") " pod="openshift-ingress/e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2"
Sep 10 05:08:24.627283 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:24.627253    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/83fd3371-9570-44c9-bf1c-ce31b54583e3-istio-podinfo\") pod \"e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2\" (UID: \"83fd3371-9570-44c9-bf1c-ce31b54583e3\") " pod="openshift-ingress/e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2"
Sep 10 05:08:24.627283 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:24.627288    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/83fd3371-9570-44c9-bf1c-ce31b54583e3-credential-socket\") pod \"e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2\" (UID: \"83fd3371-9570-44c9-bf1c-ce31b54583e3\") " pod="openshift-ingress/e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2"
Sep 10 05:08:24.627504 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:24.627311    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/83fd3371-9570-44c9-bf1c-ce31b54583e3-workload-certs\") pod \"e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2\" (UID: \"83fd3371-9570-44c9-bf1c-ce31b54583e3\") " pod="openshift-ingress/e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2"
Sep 10 05:08:24.627504 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:24.627352    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/83fd3371-9570-44c9-bf1c-ce31b54583e3-workload-socket\") pod \"e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2\" (UID: \"83fd3371-9570-44c9-bf1c-ce31b54583e3\") " pod="openshift-ingress/e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2"
Sep 10 05:08:24.627504 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:24.627387    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/83fd3371-9570-44c9-bf1c-ce31b54583e3-istiod-ca-cert\") pod \"e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2\" (UID: \"83fd3371-9570-44c9-bf1c-ce31b54583e3\") " pod="openshift-ingress/e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2"
Sep 10 05:08:24.627504 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:24.627436    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/83fd3371-9570-44c9-bf1c-ce31b54583e3-istio-envoy\") pod \"e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2\" (UID: \"83fd3371-9570-44c9-bf1c-ce31b54583e3\") " pod="openshift-ingress/e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2"
Sep 10 05:08:24.627504 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:24.627475    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/83fd3371-9570-44c9-bf1c-ce31b54583e3-istio-token\") pod \"e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2\" (UID: \"83fd3371-9570-44c9-bf1c-ce31b54583e3\") " pod="openshift-ingress/e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2"
Sep 10 05:08:24.627827 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:24.627506    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7sz7\" (UniqueName: \"kubernetes.io/projected/83fd3371-9570-44c9-bf1c-ce31b54583e3-kube-api-access-d7sz7\") pod \"e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2\" (UID: \"83fd3371-9570-44c9-bf1c-ce31b54583e3\") " pod="openshift-ingress/e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2"
Sep 10 05:08:24.627827 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:24.627539    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/83fd3371-9570-44c9-bf1c-ce31b54583e3-istio-data\") pod \"e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2\" (UID: \"83fd3371-9570-44c9-bf1c-ce31b54583e3\") " pod="openshift-ingress/e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2"
Sep 10 05:08:24.627827 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:24.627679    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/83fd3371-9570-44c9-bf1c-ce31b54583e3-credential-socket\") pod \"e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2\" (UID: \"83fd3371-9570-44c9-bf1c-ce31b54583e3\") " pod="openshift-ingress/e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2"
Sep 10 05:08:24.627827 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:24.627741    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/83fd3371-9570-44c9-bf1c-ce31b54583e3-workload-certs\") pod \"e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2\" (UID: \"83fd3371-9570-44c9-bf1c-ce31b54583e3\") " pod="openshift-ingress/e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2"
Sep 10 05:08:24.627827 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:24.627791    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/83fd3371-9570-44c9-bf1c-ce31b54583e3-workload-socket\") pod \"e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2\" (UID: \"83fd3371-9570-44c9-bf1c-ce31b54583e3\") " pod="openshift-ingress/e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2"
Sep 10 05:08:24.628207 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:24.627876    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/83fd3371-9570-44c9-bf1c-ce31b54583e3-istio-data\") pod \"e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2\" (UID: \"83fd3371-9570-44c9-bf1c-ce31b54583e3\") " pod="openshift-ingress/e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2"
Sep 10 05:08:24.628340 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:24.628319    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/83fd3371-9570-44c9-bf1c-ce31b54583e3-istiod-ca-cert\") pod \"e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2\" (UID: \"83fd3371-9570-44c9-bf1c-ce31b54583e3\") " pod="openshift-ingress/e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2"
Sep 10 05:08:24.629739 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:24.629714    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/83fd3371-9570-44c9-bf1c-ce31b54583e3-istio-envoy\") pod \"e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2\" (UID: \"83fd3371-9570-44c9-bf1c-ce31b54583e3\") " pod="openshift-ingress/e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2"
Sep 10 05:08:24.629952 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:24.629936    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/83fd3371-9570-44c9-bf1c-ce31b54583e3-istio-podinfo\") pod \"e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2\" (UID: \"83fd3371-9570-44c9-bf1c-ce31b54583e3\") " pod="openshift-ingress/e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2"
Sep 10 05:08:24.634873 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:24.634820    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/83fd3371-9570-44c9-bf1c-ce31b54583e3-istio-token\") pod \"e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2\" (UID: \"83fd3371-9570-44c9-bf1c-ce31b54583e3\") " pod="openshift-ingress/e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2"
Sep 10 05:08:24.635386 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:24.635368    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7sz7\" (UniqueName: \"kubernetes.io/projected/83fd3371-9570-44c9-bf1c-ce31b54583e3-kube-api-access-d7sz7\") pod \"e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2\" (UID: \"83fd3371-9570-44c9-bf1c-ce31b54583e3\") " pod="openshift-ingress/e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2"
Sep 10 05:08:24.775480 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:24.775408    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2"
Sep 10 05:08:25.050801 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:25.050779    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2"]
Sep 10 05:08:25.053383 ip-10-0-138-27 kubenswrapper[2560]: W0910 05:08:25.053352    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83fd3371_9570_44c9_bf1c_ce31b54583e3.slice/crio-7882ec590e110e9d5d9e1541667579b675cb13387967973ed0eb097f66514e3b WatchSource:0}: Error finding container 7882ec590e110e9d5d9e1541667579b675cb13387967973ed0eb097f66514e3b: Status 404 returned error can't find the container with id 7882ec590e110e9d5d9e1541667579b675cb13387967973ed0eb097f66514e3b
Sep 10 05:08:25.055898 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:25.055832    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 05:08:25.056014 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:25.055945    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 05:08:25.056014 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:25.055990    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 05:08:25.515409 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:25.515371    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2" event={"ID":"83fd3371-9570-44c9-bf1c-ce31b54583e3","Type":"ContainerStarted","Data":"011d93135eccb03a73b1ca1d0bd55637334960d022d9b6ad64c5def9cf528869"}
Sep 10 05:08:25.515780 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:25.515435    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2" event={"ID":"83fd3371-9570-44c9-bf1c-ce31b54583e3","Type":"ContainerStarted","Data":"7882ec590e110e9d5d9e1541667579b675cb13387967973ed0eb097f66514e3b"}
Sep 10 05:08:25.547511 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:25.547461    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2" podStartSLOduration=1.547445333 podStartE2EDuration="1.547445333s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 05:08:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 05:08:25.544827399 +0000 UTC m=+1645.207285146" watchObservedRunningTime="2026-09-10 05:08:25.547445333 +0000 UTC m=+1645.209903143"
Sep 10 05:08:25.776404 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:25.776327    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2"
Sep 10 05:08:26.780900 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:26.780866    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2"
Sep 10 05:08:27.527105 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:27.527076    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2"
Sep 10 05:08:27.528013 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:27.527990    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2"
Sep 10 05:08:28.606753 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:28.606715    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-1c7644-655579c6bb-4rlsf"]
Sep 10 05:08:28.610148 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:28.610128    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-1c7644-655579c6bb-4rlsf"
Sep 10 05:08:28.613423 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:28.613401    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-1c7644-serving-cert\""
Sep 10 05:08:28.622483 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:28.622460    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-1c7644-655579c6bb-4rlsf"]
Sep 10 05:08:28.666964 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:28.666937    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6fb5984-1198-40e4-bd16-d7f8fcafe1ee-metrics-certs\") pod \"maas-api-e2e-ipp-b-1c7644-655579c6bb-4rlsf\" (UID: \"e6fb5984-1198-40e4-bd16-d7f8fcafe1ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-1c7644-655579c6bb-4rlsf"
Sep 10 05:08:28.667131 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:28.666968    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlxrg\" (UniqueName: \"kubernetes.io/projected/e6fb5984-1198-40e4-bd16-d7f8fcafe1ee-kube-api-access-qlxrg\") pod \"maas-api-e2e-ipp-b-1c7644-655579c6bb-4rlsf\" (UID: \"e6fb5984-1198-40e4-bd16-d7f8fcafe1ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-1c7644-655579c6bb-4rlsf"
Sep 10 05:08:28.667211 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:28.667157    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6fb5984-1198-40e4-bd16-d7f8fcafe1ee-maas-api-tls\") pod \"maas-api-e2e-ipp-b-1c7644-655579c6bb-4rlsf\" (UID: \"e6fb5984-1198-40e4-bd16-d7f8fcafe1ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-1c7644-655579c6bb-4rlsf"
Sep 10 05:08:28.667278 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:28.667227    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6fb5984-1198-40e4-bd16-d7f8fcafe1ee-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-1c7644-655579c6bb-4rlsf\" (UID: \"e6fb5984-1198-40e4-bd16-d7f8fcafe1ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-1c7644-655579c6bb-4rlsf"
Sep 10 05:08:28.767940 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:28.767906    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6fb5984-1198-40e4-bd16-d7f8fcafe1ee-maas-api-tls\") pod \"maas-api-e2e-ipp-b-1c7644-655579c6bb-4rlsf\" (UID: \"e6fb5984-1198-40e4-bd16-d7f8fcafe1ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-1c7644-655579c6bb-4rlsf"
Sep 10 05:08:28.768121 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:28.767957    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6fb5984-1198-40e4-bd16-d7f8fcafe1ee-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-1c7644-655579c6bb-4rlsf\" (UID: \"e6fb5984-1198-40e4-bd16-d7f8fcafe1ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-1c7644-655579c6bb-4rlsf"
Sep 10 05:08:28.768121 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:28.767978    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6fb5984-1198-40e4-bd16-d7f8fcafe1ee-metrics-certs\") pod \"maas-api-e2e-ipp-b-1c7644-655579c6bb-4rlsf\" (UID: \"e6fb5984-1198-40e4-bd16-d7f8fcafe1ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-1c7644-655579c6bb-4rlsf"
Sep 10 05:08:28.768121 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:28.767997    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlxrg\" (UniqueName: \"kubernetes.io/projected/e6fb5984-1198-40e4-bd16-d7f8fcafe1ee-kube-api-access-qlxrg\") pod \"maas-api-e2e-ipp-b-1c7644-655579c6bb-4rlsf\" (UID: \"e6fb5984-1198-40e4-bd16-d7f8fcafe1ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-1c7644-655579c6bb-4rlsf"
Sep 10 05:08:28.768121 ip-10-0-138-27 kubenswrapper[2560]: E0910 05:08:28.768007    2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-b-1c7644-serving-cert: secret "maas-api-e2e-ipp-b-1c7644-serving-cert" not found
Sep 10 05:08:28.768121 ip-10-0-138-27 kubenswrapper[2560]: E0910 05:08:28.768086    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6fb5984-1198-40e4-bd16-d7f8fcafe1ee-maas-api-tls podName:e6fb5984-1198-40e4-bd16-d7f8fcafe1ee nodeName:}" failed. No retries permitted until 2026-09-10 05:08:29.268066052 +0000 UTC m=+1648.930523801 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e6fb5984-1198-40e4-bd16-d7f8fcafe1ee-maas-api-tls") pod "maas-api-e2e-ipp-b-1c7644-655579c6bb-4rlsf" (UID: "e6fb5984-1198-40e4-bd16-d7f8fcafe1ee") : secret "maas-api-e2e-ipp-b-1c7644-serving-cert" not found
Sep 10 05:08:28.768757 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:28.768735    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6fb5984-1198-40e4-bd16-d7f8fcafe1ee-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-1c7644-655579c6bb-4rlsf\" (UID: \"e6fb5984-1198-40e4-bd16-d7f8fcafe1ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-1c7644-655579c6bb-4rlsf"
Sep 10 05:08:28.770542 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:28.770519    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6fb5984-1198-40e4-bd16-d7f8fcafe1ee-metrics-certs\") pod \"maas-api-e2e-ipp-b-1c7644-655579c6bb-4rlsf\" (UID: \"e6fb5984-1198-40e4-bd16-d7f8fcafe1ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-1c7644-655579c6bb-4rlsf"
Sep 10 05:08:28.776584 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:28.776562    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlxrg\" (UniqueName: \"kubernetes.io/projected/e6fb5984-1198-40e4-bd16-d7f8fcafe1ee-kube-api-access-qlxrg\") pod \"maas-api-e2e-ipp-b-1c7644-655579c6bb-4rlsf\" (UID: \"e6fb5984-1198-40e4-bd16-d7f8fcafe1ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-1c7644-655579c6bb-4rlsf"
Sep 10 05:08:29.272725 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:29.272682    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6fb5984-1198-40e4-bd16-d7f8fcafe1ee-maas-api-tls\") pod \"maas-api-e2e-ipp-b-1c7644-655579c6bb-4rlsf\" (UID: \"e6fb5984-1198-40e4-bd16-d7f8fcafe1ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-1c7644-655579c6bb-4rlsf"
Sep 10 05:08:29.275198 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:29.275168    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6fb5984-1198-40e4-bd16-d7f8fcafe1ee-maas-api-tls\") pod \"maas-api-e2e-ipp-b-1c7644-655579c6bb-4rlsf\" (UID: \"e6fb5984-1198-40e4-bd16-d7f8fcafe1ee\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-1c7644-655579c6bb-4rlsf"
Sep 10 05:08:29.522591 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:29.522557    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-1c7644-655579c6bb-4rlsf"
Sep 10 05:08:29.796985 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:29.796951    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-1c7644-655579c6bb-4rlsf"]
Sep 10 05:08:30.550512 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:30.550395    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-1c7644-655579c6bb-4rlsf" event={"ID":"e6fb5984-1198-40e4-bd16-d7f8fcafe1ee","Type":"ContainerStarted","Data":"b27123b3d84d84a608567bb40c6e80be4451dddf0d5e4e2a395d82bd2bb10e63"}
Sep 10 05:08:30.550512 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:30.550469    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-1c7644-655579c6bb-4rlsf"
Sep 10 05:08:30.550512 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:30.550495    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-1c7644-655579c6bb-4rlsf" event={"ID":"e6fb5984-1198-40e4-bd16-d7f8fcafe1ee","Type":"ContainerStarted","Data":"a2f762f8347c2018e8658c8e9b54ae0247761f4aef9ab371c3dbfa14239562ff"}
Sep 10 05:08:30.569182 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:30.569128    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-1c7644-655579c6bb-4rlsf" podStartSLOduration=2.142359746 podStartE2EDuration="2.569112544s" totalImagesPullingTime="426.752798ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 05:08:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 05:08:30.566121959 +0000 UTC m=+1650.228579706" watchObservedRunningTime="2026-09-10 05:08:30.569112544 +0000 UTC m=+1650.231570316"
Sep 10 05:08:34.502322 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:34.502285    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 05:08:36.567109 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:36.567076    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-1c7644-655579c6bb-4rlsf"
Sep 10 05:08:43.568047 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:43.568001    2560 patch_prober.go:28] interesting pod/e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 05:08:43.568492 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:43.568094    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2" podUID="83fd3371-9570-44c9-bf1c-ce31b54583e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 05:08:44.642471 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:44.642440    2560 generic.go:356] "Generic (PLEG): container finished" podID="83fd3371-9570-44c9-bf1c-ce31b54583e3" containerID="011d93135eccb03a73b1ca1d0bd55637334960d022d9b6ad64c5def9cf528869" exitCode=0
Sep 10 05:08:44.642913 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:44.642508    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2" event={"ID":"83fd3371-9570-44c9-bf1c-ce31b54583e3","Type":"ContainerDied","Data":"011d93135eccb03a73b1ca1d0bd55637334960d022d9b6ad64c5def9cf528869"}
Sep 10 05:08:44.642913 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:44.642875    2560 scope.go:117] "RemoveContainer" containerID="011d93135eccb03a73b1ca1d0bd55637334960d022d9b6ad64c5def9cf528869"
Sep 10 05:08:44.643986 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:44.643953    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 05:08:44.644072 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:44.644023    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 05:08:44.644072 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:44.644057    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 05:08:45.654705 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:45.654651    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2" event={"ID":"83fd3371-9570-44c9-bf1c-ce31b54583e3","Type":"ContainerStarted","Data":"dc5e03ecf86661eee3f64f14ec41a89b8adc433201caa475a0d4336eadc8bbef"}
Sep 10 05:08:45.776096 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:45.776064    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2"
Sep 10 05:08:45.776310 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:45.776287    2560 patch_prober.go:28] interesting pod/e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Sep 10 05:08:45.776383 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:45.776337    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2" podUID="83fd3371-9570-44c9-bf1c-ce31b54583e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Sep 10 05:08:46.776269 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:46.776234    2560 patch_prober.go:28] interesting pod/e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Sep 10 05:08:46.776647 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:46.776290    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2" podUID="83fd3371-9570-44c9-bf1c-ce31b54583e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Sep 10 05:08:47.775922 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:47.775887    2560 patch_prober.go:28] interesting pod/e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Sep 10 05:08:47.776103 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:47.775940    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2" podUID="83fd3371-9570-44c9-bf1c-ce31b54583e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Sep 10 05:08:48.775967 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:48.775927    2560 patch_prober.go:28] interesting pod/e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Sep 10 05:08:48.776348 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:48.775984    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2" podUID="83fd3371-9570-44c9-bf1c-ce31b54583e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Sep 10 05:08:49.775750 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:49.775714    2560 patch_prober.go:28] interesting pod/e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Sep 10 05:08:49.775963 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:49.775775    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2" podUID="83fd3371-9570-44c9-bf1c-ce31b54583e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Sep 10 05:08:50.847106 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:50.847074    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2"
Sep 10 05:08:50.847737 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:50.847454    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2"
Sep 10 05:08:50.848379 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:08:50.848363    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2"
Sep 10 05:09:09.505259 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:09:09.505216    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 05:09:32.843079 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:09:32.843043    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 05:09:43.705289 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:09:43.705252    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-56fdcd-5566898457-qmqsr"]
Sep 10 05:09:43.709167 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:09:43.709144    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-56fdcd-5566898457-qmqsr"
Sep 10 05:09:43.711120 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:09:43.711095    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-56fdcd-serving-cert\""
Sep 10 05:09:43.720164 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:09:43.720138    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-56fdcd-5566898457-qmqsr"]
Sep 10 05:09:43.751335 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:09:43.751303    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snslm\" (UniqueName: \"kubernetes.io/projected/421178db-d7ea-4419-a278-e18511112721-kube-api-access-snslm\") pod \"maas-api-e2e-ipp-cleanup-56fdcd-5566898457-qmqsr\" (UID: \"421178db-d7ea-4419-a278-e18511112721\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-56fdcd-5566898457-qmqsr"
Sep 10 05:09:43.751467 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:09:43.751357    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/421178db-d7ea-4419-a278-e18511112721-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-56fdcd-5566898457-qmqsr\" (UID: \"421178db-d7ea-4419-a278-e18511112721\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-56fdcd-5566898457-qmqsr"
Sep 10 05:09:43.751467 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:09:43.751429    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/421178db-d7ea-4419-a278-e18511112721-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-56fdcd-5566898457-qmqsr\" (UID: \"421178db-d7ea-4419-a278-e18511112721\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-56fdcd-5566898457-qmqsr"
Sep 10 05:09:43.751587 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:09:43.751508    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/421178db-d7ea-4419-a278-e18511112721-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-56fdcd-5566898457-qmqsr\" (UID: \"421178db-d7ea-4419-a278-e18511112721\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-56fdcd-5566898457-qmqsr"
Sep 10 05:09:43.852451 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:09:43.852423    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/421178db-d7ea-4419-a278-e18511112721-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-56fdcd-5566898457-qmqsr\" (UID: \"421178db-d7ea-4419-a278-e18511112721\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-56fdcd-5566898457-qmqsr"
Sep 10 05:09:43.852617 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:09:43.852481    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snslm\" (UniqueName: \"kubernetes.io/projected/421178db-d7ea-4419-a278-e18511112721-kube-api-access-snslm\") pod \"maas-api-e2e-ipp-cleanup-56fdcd-5566898457-qmqsr\" (UID: \"421178db-d7ea-4419-a278-e18511112721\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-56fdcd-5566898457-qmqsr"
Sep 10 05:09:43.852617 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:09:43.852505    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/421178db-d7ea-4419-a278-e18511112721-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-56fdcd-5566898457-qmqsr\" (UID: \"421178db-d7ea-4419-a278-e18511112721\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-56fdcd-5566898457-qmqsr"
Sep 10 05:09:43.852617 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:09:43.852542    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/421178db-d7ea-4419-a278-e18511112721-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-56fdcd-5566898457-qmqsr\" (UID: \"421178db-d7ea-4419-a278-e18511112721\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-56fdcd-5566898457-qmqsr"
Sep 10 05:09:43.852749 ip-10-0-138-27 kubenswrapper[2560]: E0910 05:09:43.852660    2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-56fdcd-serving-cert: secret "maas-api-e2e-ipp-cleanup-56fdcd-serving-cert" not found
Sep 10 05:09:43.852749 ip-10-0-138-27 kubenswrapper[2560]: E0910 05:09:43.852713    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/421178db-d7ea-4419-a278-e18511112721-maas-api-tls podName:421178db-d7ea-4419-a278-e18511112721 nodeName:}" failed. No retries permitted until 2026-09-10 05:09:44.352699031 +0000 UTC m=+1724.015156756 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/421178db-d7ea-4419-a278-e18511112721-maas-api-tls") pod "maas-api-e2e-ipp-cleanup-56fdcd-5566898457-qmqsr" (UID: "421178db-d7ea-4419-a278-e18511112721") : secret "maas-api-e2e-ipp-cleanup-56fdcd-serving-cert" not found
Sep 10 05:09:43.853187 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:09:43.853162    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/421178db-d7ea-4419-a278-e18511112721-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-56fdcd-5566898457-qmqsr\" (UID: \"421178db-d7ea-4419-a278-e18511112721\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-56fdcd-5566898457-qmqsr"
Sep 10 05:09:43.854977 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:09:43.854946    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/421178db-d7ea-4419-a278-e18511112721-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-56fdcd-5566898457-qmqsr\" (UID: \"421178db-d7ea-4419-a278-e18511112721\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-56fdcd-5566898457-qmqsr"
Sep 10 05:09:43.862406 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:09:43.862385    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-snslm\" (UniqueName: \"kubernetes.io/projected/421178db-d7ea-4419-a278-e18511112721-kube-api-access-snslm\") pod \"maas-api-e2e-ipp-cleanup-56fdcd-5566898457-qmqsr\" (UID: \"421178db-d7ea-4419-a278-e18511112721\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-56fdcd-5566898457-qmqsr"
Sep 10 05:09:44.356680 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:09:44.356648    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/421178db-d7ea-4419-a278-e18511112721-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-56fdcd-5566898457-qmqsr\" (UID: \"421178db-d7ea-4419-a278-e18511112721\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-56fdcd-5566898457-qmqsr"
Sep 10 05:09:44.359163 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:09:44.359137    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/421178db-d7ea-4419-a278-e18511112721-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-56fdcd-5566898457-qmqsr\" (UID: \"421178db-d7ea-4419-a278-e18511112721\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-56fdcd-5566898457-qmqsr"
Sep 10 05:09:44.620339 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:09:44.620310    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-56fdcd-5566898457-qmqsr"
Sep 10 05:09:44.901032 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:09:44.901007    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-56fdcd-5566898457-qmqsr"]
Sep 10 05:09:44.902647 ip-10-0-138-27 kubenswrapper[2560]: W0910 05:09:44.902617    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod421178db_d7ea_4419_a278_e18511112721.slice/crio-ce638ecc92e51da2ab34d7ebfa0380bdecdcd5fd0c0d6c64d6e0c58be976c905 WatchSource:0}: Error finding container ce638ecc92e51da2ab34d7ebfa0380bdecdcd5fd0c0d6c64d6e0c58be976c905: Status 404 returned error can't find the container with id ce638ecc92e51da2ab34d7ebfa0380bdecdcd5fd0c0d6c64d6e0c58be976c905
Sep 10 05:09:45.005229 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:09:45.005196    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-56fdcd-5566898457-qmqsr" event={"ID":"421178db-d7ea-4419-a278-e18511112721","Type":"ContainerStarted","Data":"ce638ecc92e51da2ab34d7ebfa0380bdecdcd5fd0c0d6c64d6e0c58be976c905"}
Sep 10 05:09:46.012917 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:09:46.012879    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-56fdcd-5566898457-qmqsr" event={"ID":"421178db-d7ea-4419-a278-e18511112721","Type":"ContainerStarted","Data":"27e321e5776d0e769535d6011ca7c43736f1eddad75563e936e663e250f0f5c7"}
Sep 10 05:09:46.013340 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:09:46.013002    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-56fdcd-5566898457-qmqsr"
Sep 10 05:09:46.030824 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:09:46.030772    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-56fdcd-5566898457-qmqsr" podStartSLOduration=2.624736161 podStartE2EDuration="3.030758651s" totalImagesPullingTime="406.02249ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 05:09:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 05:09:46.028219697 +0000 UTC m=+1725.690677444" watchObservedRunningTime="2026-09-10 05:09:46.030758651 +0000 UTC m=+1725.693216399"
Sep 10 05:09:51.800558 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:09:51.800521    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 05:09:52.024589 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:09:52.024559    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-56fdcd-5566898457-qmqsr"
Sep 10 05:10:14.369790 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:10:14.369756    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-56fdcd-5566898457-qmqsr"]
Sep 10 05:10:14.370391 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:10:14.370079    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-56fdcd-5566898457-qmqsr" podUID="421178db-d7ea-4419-a278-e18511112721" containerName="maas-api" containerID="cri-o://27e321e5776d0e769535d6011ca7c43736f1eddad75563e936e663e250f0f5c7" gracePeriod=30
Sep 10 05:10:14.621474 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:10:14.621454    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-56fdcd-5566898457-qmqsr"
Sep 10 05:10:14.736174 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:10:14.736144    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/421178db-d7ea-4419-a278-e18511112721-openshift-service-ca\") pod \"421178db-d7ea-4419-a278-e18511112721\" (UID: \"421178db-d7ea-4419-a278-e18511112721\") "
Sep 10 05:10:14.736318 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:10:14.736202    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-snslm\" (UniqueName: \"kubernetes.io/projected/421178db-d7ea-4419-a278-e18511112721-kube-api-access-snslm\") pod \"421178db-d7ea-4419-a278-e18511112721\" (UID: \"421178db-d7ea-4419-a278-e18511112721\") "
Sep 10 05:10:14.736392 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:10:14.736325    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/421178db-d7ea-4419-a278-e18511112721-metrics-certs\") pod \"421178db-d7ea-4419-a278-e18511112721\" (UID: \"421178db-d7ea-4419-a278-e18511112721\") "
Sep 10 05:10:14.736392 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:10:14.736357    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/421178db-d7ea-4419-a278-e18511112721-maas-api-tls\") pod \"421178db-d7ea-4419-a278-e18511112721\" (UID: \"421178db-d7ea-4419-a278-e18511112721\") "
Sep 10 05:10:14.736554 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:10:14.736527    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/421178db-d7ea-4419-a278-e18511112721-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "421178db-d7ea-4419-a278-e18511112721" (UID: "421178db-d7ea-4419-a278-e18511112721"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 05:10:14.736759 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:10:14.736738    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/421178db-d7ea-4419-a278-e18511112721-openshift-service-ca\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:10:14.738523 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:10:14.738495    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/421178db-d7ea-4419-a278-e18511112721-kube-api-access-snslm" (OuterVolumeSpecName: "kube-api-access-snslm") pod "421178db-d7ea-4419-a278-e18511112721" (UID: "421178db-d7ea-4419-a278-e18511112721"). InnerVolumeSpecName "kube-api-access-snslm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 05:10:14.738743 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:10:14.738716    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/421178db-d7ea-4419-a278-e18511112721-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "421178db-d7ea-4419-a278-e18511112721" (UID: "421178db-d7ea-4419-a278-e18511112721"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 05:10:14.738940 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:10:14.738919    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/421178db-d7ea-4419-a278-e18511112721-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "421178db-d7ea-4419-a278-e18511112721" (UID: "421178db-d7ea-4419-a278-e18511112721"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 05:10:14.837632 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:10:14.837601    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-snslm\" (UniqueName: \"kubernetes.io/projected/421178db-d7ea-4419-a278-e18511112721-kube-api-access-snslm\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:10:14.837632 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:10:14.837634    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/421178db-d7ea-4419-a278-e18511112721-metrics-certs\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:10:14.837837 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:10:14.837648    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/421178db-d7ea-4419-a278-e18511112721-maas-api-tls\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:10:15.194121 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:10:15.194088    2560 generic.go:356] "Generic (PLEG): container finished" podID="421178db-d7ea-4419-a278-e18511112721" containerID="27e321e5776d0e769535d6011ca7c43736f1eddad75563e936e663e250f0f5c7" exitCode=0
Sep 10 05:10:15.194283 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:10:15.194130    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-56fdcd-5566898457-qmqsr"
Sep 10 05:10:15.194283 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:10:15.194170    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-56fdcd-5566898457-qmqsr" event={"ID":"421178db-d7ea-4419-a278-e18511112721","Type":"ContainerDied","Data":"27e321e5776d0e769535d6011ca7c43736f1eddad75563e936e663e250f0f5c7"}
Sep 10 05:10:15.194283 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:10:15.194225    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-56fdcd-5566898457-qmqsr" event={"ID":"421178db-d7ea-4419-a278-e18511112721","Type":"ContainerDied","Data":"ce638ecc92e51da2ab34d7ebfa0380bdecdcd5fd0c0d6c64d6e0c58be976c905"}
Sep 10 05:10:15.194283 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:10:15.194248    2560 scope.go:117] "RemoveContainer" containerID="27e321e5776d0e769535d6011ca7c43736f1eddad75563e936e663e250f0f5c7"
Sep 10 05:10:15.203661 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:10:15.203645    2560 scope.go:117] "RemoveContainer" containerID="27e321e5776d0e769535d6011ca7c43736f1eddad75563e936e663e250f0f5c7"
Sep 10 05:10:15.203954 ip-10-0-138-27 kubenswrapper[2560]: E0910 05:10:15.203937    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27e321e5776d0e769535d6011ca7c43736f1eddad75563e936e663e250f0f5c7\": container with ID starting with 27e321e5776d0e769535d6011ca7c43736f1eddad75563e936e663e250f0f5c7 not found: ID does not exist" containerID="27e321e5776d0e769535d6011ca7c43736f1eddad75563e936e663e250f0f5c7"
Sep 10 05:10:15.204006 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:10:15.203963    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27e321e5776d0e769535d6011ca7c43736f1eddad75563e936e663e250f0f5c7"} err="failed to get container status \"27e321e5776d0e769535d6011ca7c43736f1eddad75563e936e663e250f0f5c7\": rpc error: code = NotFound desc = could not find container \"27e321e5776d0e769535d6011ca7c43736f1eddad75563e936e663e250f0f5c7\": container with ID starting with 27e321e5776d0e769535d6011ca7c43736f1eddad75563e936e663e250f0f5c7 not found: ID does not exist"
Sep 10 05:10:15.210945 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:10:15.210924    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-56fdcd-5566898457-qmqsr"]
Sep 10 05:10:15.215242 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:10:15.215223    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-56fdcd-5566898457-qmqsr"]
Sep 10 05:10:16.825633 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:10:16.825599    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="421178db-d7ea-4419-a278-e18511112721" path="/var/lib/kubelet/pods/421178db-d7ea-4419-a278-e18511112721/volumes"
Sep 10 05:10:18.999772 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:10:18.999743    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 05:10:38.288381 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:10:38.288346    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 05:10:50.994891 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:10:50.994844    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 05:11:00.999348 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:00.999319    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-p5zjp_8b3ec8dc-1508-4537-8dc3-b9de1ff22d03/console-operator/1.log"
Sep 10 05:11:01.004599 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:01.004578    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-p5zjp_8b3ec8dc-1508-4537-8dc3-b9de1ff22d03/console-operator/1.log"
Sep 10 05:11:28.725005 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:28.724969    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6"]
Sep 10 05:11:28.725601 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:28.725262    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6" podUID="93d40d75-2f34-4930-8c40-cf6428c096bb" containerName="istio-proxy" containerID="cri-o://841a84ecadcb498dd85c6485138a894bbeed0e13c680b3fe8def9f3f449c2bf4" gracePeriod=30
Sep 10 05:11:33.977343 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:33.977320    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6"
Sep 10 05:11:34.055413 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:34.055343    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93d40d75-2f34-4930-8c40-cf6428c096bb-istio-token\") pod \"93d40d75-2f34-4930-8c40-cf6428c096bb\" (UID: \"93d40d75-2f34-4930-8c40-cf6428c096bb\") "
Sep 10 05:11:34.055413 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:34.055391    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93d40d75-2f34-4930-8c40-cf6428c096bb-istio-podinfo\") pod \"93d40d75-2f34-4930-8c40-cf6428c096bb\" (UID: \"93d40d75-2f34-4930-8c40-cf6428c096bb\") "
Sep 10 05:11:34.055597 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:34.055415    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93d40d75-2f34-4930-8c40-cf6428c096bb-istiod-ca-cert\") pod \"93d40d75-2f34-4930-8c40-cf6428c096bb\" (UID: \"93d40d75-2f34-4930-8c40-cf6428c096bb\") "
Sep 10 05:11:34.055597 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:34.055454    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93d40d75-2f34-4930-8c40-cf6428c096bb-istio-envoy\") pod \"93d40d75-2f34-4930-8c40-cf6428c096bb\" (UID: \"93d40d75-2f34-4930-8c40-cf6428c096bb\") "
Sep 10 05:11:34.055597 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:34.055471    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93d40d75-2f34-4930-8c40-cf6428c096bb-credential-socket\") pod \"93d40d75-2f34-4930-8c40-cf6428c096bb\" (UID: \"93d40d75-2f34-4930-8c40-cf6428c096bb\") "
Sep 10 05:11:34.055597 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:34.055539    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93d40d75-2f34-4930-8c40-cf6428c096bb-workload-socket\") pod \"93d40d75-2f34-4930-8c40-cf6428c096bb\" (UID: \"93d40d75-2f34-4930-8c40-cf6428c096bb\") "
Sep 10 05:11:34.055597 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:34.055573    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93d40d75-2f34-4930-8c40-cf6428c096bb-workload-certs\") pod \"93d40d75-2f34-4930-8c40-cf6428c096bb\" (UID: \"93d40d75-2f34-4930-8c40-cf6428c096bb\") "
Sep 10 05:11:34.055898 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:34.055603    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bxrpc\" (UniqueName: \"kubernetes.io/projected/93d40d75-2f34-4930-8c40-cf6428c096bb-kube-api-access-bxrpc\") pod \"93d40d75-2f34-4930-8c40-cf6428c096bb\" (UID: \"93d40d75-2f34-4930-8c40-cf6428c096bb\") "
Sep 10 05:11:34.055898 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:34.055691    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93d40d75-2f34-4930-8c40-cf6428c096bb-istio-data\") pod \"93d40d75-2f34-4930-8c40-cf6428c096bb\" (UID: \"93d40d75-2f34-4930-8c40-cf6428c096bb\") "
Sep 10 05:11:34.055898 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:34.055790    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93d40d75-2f34-4930-8c40-cf6428c096bb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "93d40d75-2f34-4930-8c40-cf6428c096bb" (UID: "93d40d75-2f34-4930-8c40-cf6428c096bb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 05:11:34.055898 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:34.055807    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93d40d75-2f34-4930-8c40-cf6428c096bb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "93d40d75-2f34-4930-8c40-cf6428c096bb" (UID: "93d40d75-2f34-4930-8c40-cf6428c096bb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 05:11:34.056109 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:34.055942    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93d40d75-2f34-4930-8c40-cf6428c096bb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "93d40d75-2f34-4930-8c40-cf6428c096bb" (UID: "93d40d75-2f34-4930-8c40-cf6428c096bb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 05:11:34.056109 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:34.056050    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93d40d75-2f34-4930-8c40-cf6428c096bb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "93d40d75-2f34-4930-8c40-cf6428c096bb" (UID: "93d40d75-2f34-4930-8c40-cf6428c096bb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 05:11:34.056202 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:34.056151    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93d40d75-2f34-4930-8c40-cf6428c096bb-istiod-ca-cert\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:11:34.056202 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:34.056158    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93d40d75-2f34-4930-8c40-cf6428c096bb-istio-data" (OuterVolumeSpecName: "istio-data") pod "93d40d75-2f34-4930-8c40-cf6428c096bb" (UID: "93d40d75-2f34-4930-8c40-cf6428c096bb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 05:11:34.056202 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:34.056169    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93d40d75-2f34-4930-8c40-cf6428c096bb-credential-socket\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:11:34.056202 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:34.056186    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93d40d75-2f34-4930-8c40-cf6428c096bb-workload-socket\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:11:34.056202 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:34.056200    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93d40d75-2f34-4930-8c40-cf6428c096bb-workload-certs\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:11:34.057773 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:34.057748    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93d40d75-2f34-4930-8c40-cf6428c096bb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "93d40d75-2f34-4930-8c40-cf6428c096bb" (UID: "93d40d75-2f34-4930-8c40-cf6428c096bb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 05:11:34.057904 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:34.057784    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93d40d75-2f34-4930-8c40-cf6428c096bb-istio-token" (OuterVolumeSpecName: "istio-token") pod "93d40d75-2f34-4930-8c40-cf6428c096bb" (UID: "93d40d75-2f34-4930-8c40-cf6428c096bb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 05:11:34.057994 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:34.057978    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/93d40d75-2f34-4930-8c40-cf6428c096bb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "93d40d75-2f34-4930-8c40-cf6428c096bb" (UID: "93d40d75-2f34-4930-8c40-cf6428c096bb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 05:11:34.058076 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:34.058056    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93d40d75-2f34-4930-8c40-cf6428c096bb-kube-api-access-bxrpc" (OuterVolumeSpecName: "kube-api-access-bxrpc") pod "93d40d75-2f34-4930-8c40-cf6428c096bb" (UID: "93d40d75-2f34-4930-8c40-cf6428c096bb"). InnerVolumeSpecName "kube-api-access-bxrpc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 05:11:34.157014 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:34.156986    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bxrpc\" (UniqueName: \"kubernetes.io/projected/93d40d75-2f34-4930-8c40-cf6428c096bb-kube-api-access-bxrpc\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:11:34.157014 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:34.157012    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93d40d75-2f34-4930-8c40-cf6428c096bb-istio-data\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:11:34.157182 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:34.157022    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93d40d75-2f34-4930-8c40-cf6428c096bb-istio-token\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:11:34.157182 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:34.157030    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93d40d75-2f34-4930-8c40-cf6428c096bb-istio-podinfo\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:11:34.157182 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:34.157038    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93d40d75-2f34-4930-8c40-cf6428c096bb-istio-envoy\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:11:34.665599 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:34.665560    2560 generic.go:356] "Generic (PLEG): container finished" podID="93d40d75-2f34-4930-8c40-cf6428c096bb" containerID="841a84ecadcb498dd85c6485138a894bbeed0e13c680b3fe8def9f3f449c2bf4" exitCode=0
Sep 10 05:11:34.665793 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:34.665626    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6"
Sep 10 05:11:34.665793 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:34.665653    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6" event={"ID":"93d40d75-2f34-4930-8c40-cf6428c096bb","Type":"ContainerDied","Data":"841a84ecadcb498dd85c6485138a894bbeed0e13c680b3fe8def9f3f449c2bf4"}
Sep 10 05:11:34.665793 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:34.665750    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6" event={"ID":"93d40d75-2f34-4930-8c40-cf6428c096bb","Type":"ContainerDied","Data":"9be50386fcd19291c7c7d2b4efd4de5394abe9a5dcfbc5c5d41329373a28810b"}
Sep 10 05:11:34.665793 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:34.665781    2560 scope.go:117] "RemoveContainer" containerID="841a84ecadcb498dd85c6485138a894bbeed0e13c680b3fe8def9f3f449c2bf4"
Sep 10 05:11:34.678919 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:34.678896    2560 scope.go:117] "RemoveContainer" containerID="33926d46f0e61c116ff1e541a408f2744ad865cabcc8805c33eb5ba261c5a4f3"
Sep 10 05:11:34.687559 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:34.687541    2560 scope.go:117] "RemoveContainer" containerID="841a84ecadcb498dd85c6485138a894bbeed0e13c680b3fe8def9f3f449c2bf4"
Sep 10 05:11:34.687866 ip-10-0-138-27 kubenswrapper[2560]: E0910 05:11:34.687824    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"841a84ecadcb498dd85c6485138a894bbeed0e13c680b3fe8def9f3f449c2bf4\": container with ID starting with 841a84ecadcb498dd85c6485138a894bbeed0e13c680b3fe8def9f3f449c2bf4 not found: ID does not exist" containerID="841a84ecadcb498dd85c6485138a894bbeed0e13c680b3fe8def9f3f449c2bf4"
Sep 10 05:11:34.687923 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:34.687885    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"841a84ecadcb498dd85c6485138a894bbeed0e13c680b3fe8def9f3f449c2bf4"} err="failed to get container status \"841a84ecadcb498dd85c6485138a894bbeed0e13c680b3fe8def9f3f449c2bf4\": rpc error: code = NotFound desc = could not find container \"841a84ecadcb498dd85c6485138a894bbeed0e13c680b3fe8def9f3f449c2bf4\": container with ID starting with 841a84ecadcb498dd85c6485138a894bbeed0e13c680b3fe8def9f3f449c2bf4 not found: ID does not exist"
Sep 10 05:11:34.687923 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:34.687908    2560 scope.go:117] "RemoveContainer" containerID="33926d46f0e61c116ff1e541a408f2744ad865cabcc8805c33eb5ba261c5a4f3"
Sep 10 05:11:34.688171 ip-10-0-138-27 kubenswrapper[2560]: E0910 05:11:34.688154    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33926d46f0e61c116ff1e541a408f2744ad865cabcc8805c33eb5ba261c5a4f3\": container with ID starting with 33926d46f0e61c116ff1e541a408f2744ad865cabcc8805c33eb5ba261c5a4f3 not found: ID does not exist" containerID="33926d46f0e61c116ff1e541a408f2744ad865cabcc8805c33eb5ba261c5a4f3"
Sep 10 05:11:34.688213 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:34.688178    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33926d46f0e61c116ff1e541a408f2744ad865cabcc8805c33eb5ba261c5a4f3"} err="failed to get container status \"33926d46f0e61c116ff1e541a408f2744ad865cabcc8805c33eb5ba261c5a4f3\": rpc error: code = NotFound desc = could not find container \"33926d46f0e61c116ff1e541a408f2744ad865cabcc8805c33eb5ba261c5a4f3\": container with ID starting with 33926d46f0e61c116ff1e541a408f2744ad865cabcc8805c33eb5ba261c5a4f3 not found: ID does not exist"
Sep 10 05:11:34.689423 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:34.689406    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6"]
Sep 10 05:11:34.693208 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:34.693189    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-95427a-openshift-default-5df7c968f4-cr8k6"]
Sep 10 05:11:34.825076 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:34.825048    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93d40d75-2f34-4930-8c40-cf6428c096bb" path="/var/lib/kubelet/pods/93d40d75-2f34-4930-8c40-cf6428c096bb/volumes"
Sep 10 05:11:39.633162 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:39.633131    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-1c7644-655579c6bb-4rlsf"]
Sep 10 05:11:39.633569 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:39.633359    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-1c7644-655579c6bb-4rlsf" podUID="e6fb5984-1198-40e4-bd16-d7f8fcafe1ee" containerName="maas-api" containerID="cri-o://b27123b3d84d84a608567bb40c6e80be4451dddf0d5e4e2a395d82bd2bb10e63" gracePeriod=30
Sep 10 05:11:39.893271 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:39.893214    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-1c7644-655579c6bb-4rlsf"
Sep 10 05:11:40.011691 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:40.011657    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6fb5984-1198-40e4-bd16-d7f8fcafe1ee-maas-api-tls\") pod \"e6fb5984-1198-40e4-bd16-d7f8fcafe1ee\" (UID: \"e6fb5984-1198-40e4-bd16-d7f8fcafe1ee\") "
Sep 10 05:11:40.011894 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:40.011736    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qlxrg\" (UniqueName: \"kubernetes.io/projected/e6fb5984-1198-40e4-bd16-d7f8fcafe1ee-kube-api-access-qlxrg\") pod \"e6fb5984-1198-40e4-bd16-d7f8fcafe1ee\" (UID: \"e6fb5984-1198-40e4-bd16-d7f8fcafe1ee\") "
Sep 10 05:11:40.011894 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:40.011791    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6fb5984-1198-40e4-bd16-d7f8fcafe1ee-openshift-service-ca\") pod \"e6fb5984-1198-40e4-bd16-d7f8fcafe1ee\" (UID: \"e6fb5984-1198-40e4-bd16-d7f8fcafe1ee\") "
Sep 10 05:11:40.011894 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:40.011844    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6fb5984-1198-40e4-bd16-d7f8fcafe1ee-metrics-certs\") pod \"e6fb5984-1198-40e4-bd16-d7f8fcafe1ee\" (UID: \"e6fb5984-1198-40e4-bd16-d7f8fcafe1ee\") "
Sep 10 05:11:40.012221 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:40.012181    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6fb5984-1198-40e4-bd16-d7f8fcafe1ee-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e6fb5984-1198-40e4-bd16-d7f8fcafe1ee" (UID: "e6fb5984-1198-40e4-bd16-d7f8fcafe1ee"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 05:11:40.014010 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:40.013977    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6fb5984-1198-40e4-bd16-d7f8fcafe1ee-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "e6fb5984-1198-40e4-bd16-d7f8fcafe1ee" (UID: "e6fb5984-1198-40e4-bd16-d7f8fcafe1ee"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 05:11:40.014108 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:40.014058    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6fb5984-1198-40e4-bd16-d7f8fcafe1ee-kube-api-access-qlxrg" (OuterVolumeSpecName: "kube-api-access-qlxrg") pod "e6fb5984-1198-40e4-bd16-d7f8fcafe1ee" (UID: "e6fb5984-1198-40e4-bd16-d7f8fcafe1ee"). InnerVolumeSpecName "kube-api-access-qlxrg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 05:11:40.014108 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:40.014080    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6fb5984-1198-40e4-bd16-d7f8fcafe1ee-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e6fb5984-1198-40e4-bd16-d7f8fcafe1ee" (UID: "e6fb5984-1198-40e4-bd16-d7f8fcafe1ee"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 05:11:40.113281 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:40.113254    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6fb5984-1198-40e4-bd16-d7f8fcafe1ee-metrics-certs\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:11:40.113281 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:40.113279    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6fb5984-1198-40e4-bd16-d7f8fcafe1ee-maas-api-tls\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:11:40.113432 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:40.113288    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qlxrg\" (UniqueName: \"kubernetes.io/projected/e6fb5984-1198-40e4-bd16-d7f8fcafe1ee-kube-api-access-qlxrg\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:11:40.113432 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:40.113299    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6fb5984-1198-40e4-bd16-d7f8fcafe1ee-openshift-service-ca\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:11:40.704187 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:40.704150    2560 generic.go:356] "Generic (PLEG): container finished" podID="e6fb5984-1198-40e4-bd16-d7f8fcafe1ee" containerID="b27123b3d84d84a608567bb40c6e80be4451dddf0d5e4e2a395d82bd2bb10e63" exitCode=0
Sep 10 05:11:40.704551 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:40.704199    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-1c7644-655579c6bb-4rlsf"
Sep 10 05:11:40.704551 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:40.704232    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-1c7644-655579c6bb-4rlsf" event={"ID":"e6fb5984-1198-40e4-bd16-d7f8fcafe1ee","Type":"ContainerDied","Data":"b27123b3d84d84a608567bb40c6e80be4451dddf0d5e4e2a395d82bd2bb10e63"}
Sep 10 05:11:40.704551 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:40.704294    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-1c7644-655579c6bb-4rlsf" event={"ID":"e6fb5984-1198-40e4-bd16-d7f8fcafe1ee","Type":"ContainerDied","Data":"a2f762f8347c2018e8658c8e9b54ae0247761f4aef9ab371c3dbfa14239562ff"}
Sep 10 05:11:40.704551 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:40.704318    2560 scope.go:117] "RemoveContainer" containerID="b27123b3d84d84a608567bb40c6e80be4451dddf0d5e4e2a395d82bd2bb10e63"
Sep 10 05:11:40.714325 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:40.714308    2560 scope.go:117] "RemoveContainer" containerID="b27123b3d84d84a608567bb40c6e80be4451dddf0d5e4e2a395d82bd2bb10e63"
Sep 10 05:11:40.714555 ip-10-0-138-27 kubenswrapper[2560]: E0910 05:11:40.714538    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b27123b3d84d84a608567bb40c6e80be4451dddf0d5e4e2a395d82bd2bb10e63\": container with ID starting with b27123b3d84d84a608567bb40c6e80be4451dddf0d5e4e2a395d82bd2bb10e63 not found: ID does not exist" containerID="b27123b3d84d84a608567bb40c6e80be4451dddf0d5e4e2a395d82bd2bb10e63"
Sep 10 05:11:40.714608 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:40.714565    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b27123b3d84d84a608567bb40c6e80be4451dddf0d5e4e2a395d82bd2bb10e63"} err="failed to get container status \"b27123b3d84d84a608567bb40c6e80be4451dddf0d5e4e2a395d82bd2bb10e63\": rpc error: code = NotFound desc = could not find container \"b27123b3d84d84a608567bb40c6e80be4451dddf0d5e4e2a395d82bd2bb10e63\": container with ID starting with b27123b3d84d84a608567bb40c6e80be4451dddf0d5e4e2a395d82bd2bb10e63 not found: ID does not exist"
Sep 10 05:11:40.728089 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:40.728066    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-1c7644-655579c6bb-4rlsf"]
Sep 10 05:11:40.731507 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:40.731488    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-1c7644-655579c6bb-4rlsf"]
Sep 10 05:11:40.825315 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:40.825288    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6fb5984-1198-40e4-bd16-d7f8fcafe1ee" path="/var/lib/kubelet/pods/e6fb5984-1198-40e4-bd16-d7f8fcafe1ee/volumes"
Sep 10 05:11:42.899044 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:42.899007    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 05:11:46.144627 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:46.144593    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2"]
Sep 10 05:11:46.145061 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:46.144885    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2" podUID="83fd3371-9570-44c9-bf1c-ce31b54583e3" containerName="istio-proxy" containerID="cri-o://dc5e03ecf86661eee3f64f14ec41a89b8adc433201caa475a0d4336eadc8bbef" gracePeriod=30
Sep 10 05:11:50.850174 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:50.850137    2560 patch_prober.go:28] interesting pod/e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 05:11:50.850526 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:50.850194    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2" podUID="83fd3371-9570-44c9-bf1c-ce31b54583e3" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 05:11:51.398991 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:51.398969    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2"
Sep 10 05:11:51.516980 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:51.516911    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/83fd3371-9570-44c9-bf1c-ce31b54583e3-istiod-ca-cert\") pod \"83fd3371-9570-44c9-bf1c-ce31b54583e3\" (UID: \"83fd3371-9570-44c9-bf1c-ce31b54583e3\") "
Sep 10 05:11:51.516980 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:51.516962    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/83fd3371-9570-44c9-bf1c-ce31b54583e3-workload-socket\") pod \"83fd3371-9570-44c9-bf1c-ce31b54583e3\" (UID: \"83fd3371-9570-44c9-bf1c-ce31b54583e3\") "
Sep 10 05:11:51.517181 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:51.516989    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/83fd3371-9570-44c9-bf1c-ce31b54583e3-istio-podinfo\") pod \"83fd3371-9570-44c9-bf1c-ce31b54583e3\" (UID: \"83fd3371-9570-44c9-bf1c-ce31b54583e3\") "
Sep 10 05:11:51.517181 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:51.517038    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/83fd3371-9570-44c9-bf1c-ce31b54583e3-workload-certs\") pod \"83fd3371-9570-44c9-bf1c-ce31b54583e3\" (UID: \"83fd3371-9570-44c9-bf1c-ce31b54583e3\") "
Sep 10 05:11:51.517181 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:51.517077    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/83fd3371-9570-44c9-bf1c-ce31b54583e3-istio-envoy\") pod \"83fd3371-9570-44c9-bf1c-ce31b54583e3\" (UID: \"83fd3371-9570-44c9-bf1c-ce31b54583e3\") "
Sep 10 05:11:51.517181 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:51.517122    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/83fd3371-9570-44c9-bf1c-ce31b54583e3-credential-socket\") pod \"83fd3371-9570-44c9-bf1c-ce31b54583e3\" (UID: \"83fd3371-9570-44c9-bf1c-ce31b54583e3\") "
Sep 10 05:11:51.517181 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:51.517165    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d7sz7\" (UniqueName: \"kubernetes.io/projected/83fd3371-9570-44c9-bf1c-ce31b54583e3-kube-api-access-d7sz7\") pod \"83fd3371-9570-44c9-bf1c-ce31b54583e3\" (UID: \"83fd3371-9570-44c9-bf1c-ce31b54583e3\") "
Sep 10 05:11:51.517370 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:51.517206    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/83fd3371-9570-44c9-bf1c-ce31b54583e3-istio-token\") pod \"83fd3371-9570-44c9-bf1c-ce31b54583e3\" (UID: \"83fd3371-9570-44c9-bf1c-ce31b54583e3\") "
Sep 10 05:11:51.517370 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:51.517230    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/83fd3371-9570-44c9-bf1c-ce31b54583e3-istio-data\") pod \"83fd3371-9570-44c9-bf1c-ce31b54583e3\" (UID: \"83fd3371-9570-44c9-bf1c-ce31b54583e3\") "
Sep 10 05:11:51.517370 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:51.517214    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83fd3371-9570-44c9-bf1c-ce31b54583e3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "83fd3371-9570-44c9-bf1c-ce31b54583e3" (UID: "83fd3371-9570-44c9-bf1c-ce31b54583e3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 05:11:51.517477 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:51.517386    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83fd3371-9570-44c9-bf1c-ce31b54583e3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "83fd3371-9570-44c9-bf1c-ce31b54583e3" (UID: "83fd3371-9570-44c9-bf1c-ce31b54583e3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 05:11:51.517477 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:51.517399    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83fd3371-9570-44c9-bf1c-ce31b54583e3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "83fd3371-9570-44c9-bf1c-ce31b54583e3" (UID: "83fd3371-9570-44c9-bf1c-ce31b54583e3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 05:11:51.517477 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:51.517412    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83fd3371-9570-44c9-bf1c-ce31b54583e3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "83fd3371-9570-44c9-bf1c-ce31b54583e3" (UID: "83fd3371-9570-44c9-bf1c-ce31b54583e3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 05:11:51.517611 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:51.517570    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/83fd3371-9570-44c9-bf1c-ce31b54583e3-workload-certs\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:11:51.517611 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:51.517577    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83fd3371-9570-44c9-bf1c-ce31b54583e3-istio-data" (OuterVolumeSpecName: "istio-data") pod "83fd3371-9570-44c9-bf1c-ce31b54583e3" (UID: "83fd3371-9570-44c9-bf1c-ce31b54583e3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 05:11:51.517611 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:51.517592    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/83fd3371-9570-44c9-bf1c-ce31b54583e3-credential-socket\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:11:51.517611 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:51.517608    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/83fd3371-9570-44c9-bf1c-ce31b54583e3-istiod-ca-cert\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:11:51.517774 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:51.517623    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/83fd3371-9570-44c9-bf1c-ce31b54583e3-workload-socket\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:11:51.519268 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:51.519245    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83fd3371-9570-44c9-bf1c-ce31b54583e3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "83fd3371-9570-44c9-bf1c-ce31b54583e3" (UID: "83fd3371-9570-44c9-bf1c-ce31b54583e3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 05:11:51.519490 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:51.519463    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/83fd3371-9570-44c9-bf1c-ce31b54583e3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "83fd3371-9570-44c9-bf1c-ce31b54583e3" (UID: "83fd3371-9570-44c9-bf1c-ce31b54583e3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 05:11:51.519751 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:51.519727    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83fd3371-9570-44c9-bf1c-ce31b54583e3-istio-token" (OuterVolumeSpecName: "istio-token") pod "83fd3371-9570-44c9-bf1c-ce31b54583e3" (UID: "83fd3371-9570-44c9-bf1c-ce31b54583e3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 05:11:51.519875 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:51.519799    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83fd3371-9570-44c9-bf1c-ce31b54583e3-kube-api-access-d7sz7" (OuterVolumeSpecName: "kube-api-access-d7sz7") pod "83fd3371-9570-44c9-bf1c-ce31b54583e3" (UID: "83fd3371-9570-44c9-bf1c-ce31b54583e3"). InnerVolumeSpecName "kube-api-access-d7sz7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 05:11:51.619010 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:51.618985    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/83fd3371-9570-44c9-bf1c-ce31b54583e3-istio-podinfo\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:11:51.619010 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:51.619008    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/83fd3371-9570-44c9-bf1c-ce31b54583e3-istio-envoy\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:11:51.619156 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:51.619020    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d7sz7\" (UniqueName: \"kubernetes.io/projected/83fd3371-9570-44c9-bf1c-ce31b54583e3-kube-api-access-d7sz7\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:11:51.619156 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:51.619032    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/83fd3371-9570-44c9-bf1c-ce31b54583e3-istio-token\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:11:51.619156 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:51.619043    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/83fd3371-9570-44c9-bf1c-ce31b54583e3-istio-data\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:11:51.769902 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:51.769824    2560 generic.go:356] "Generic (PLEG): container finished" podID="83fd3371-9570-44c9-bf1c-ce31b54583e3" containerID="dc5e03ecf86661eee3f64f14ec41a89b8adc433201caa475a0d4336eadc8bbef" exitCode=0
Sep 10 05:11:51.770010 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:51.769905    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2"
Sep 10 05:11:51.770010 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:51.769906    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2" event={"ID":"83fd3371-9570-44c9-bf1c-ce31b54583e3","Type":"ContainerDied","Data":"dc5e03ecf86661eee3f64f14ec41a89b8adc433201caa475a0d4336eadc8bbef"}
Sep 10 05:11:51.770010 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:51.769984    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2" event={"ID":"83fd3371-9570-44c9-bf1c-ce31b54583e3","Type":"ContainerDied","Data":"7882ec590e110e9d5d9e1541667579b675cb13387967973ed0eb097f66514e3b"}
Sep 10 05:11:51.770010 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:51.770007    2560 scope.go:117] "RemoveContainer" containerID="dc5e03ecf86661eee3f64f14ec41a89b8adc433201caa475a0d4336eadc8bbef"
Sep 10 05:11:51.779659 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:51.779642    2560 scope.go:117] "RemoveContainer" containerID="011d93135eccb03a73b1ca1d0bd55637334960d022d9b6ad64c5def9cf528869"
Sep 10 05:11:51.788058 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:51.788039    2560 scope.go:117] "RemoveContainer" containerID="dc5e03ecf86661eee3f64f14ec41a89b8adc433201caa475a0d4336eadc8bbef"
Sep 10 05:11:51.788390 ip-10-0-138-27 kubenswrapper[2560]: E0910 05:11:51.788358    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc5e03ecf86661eee3f64f14ec41a89b8adc433201caa475a0d4336eadc8bbef\": container with ID starting with dc5e03ecf86661eee3f64f14ec41a89b8adc433201caa475a0d4336eadc8bbef not found: ID does not exist" containerID="dc5e03ecf86661eee3f64f14ec41a89b8adc433201caa475a0d4336eadc8bbef"
Sep 10 05:11:51.788476 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:51.788387    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc5e03ecf86661eee3f64f14ec41a89b8adc433201caa475a0d4336eadc8bbef"} err="failed to get container status \"dc5e03ecf86661eee3f64f14ec41a89b8adc433201caa475a0d4336eadc8bbef\": rpc error: code = NotFound desc = could not find container \"dc5e03ecf86661eee3f64f14ec41a89b8adc433201caa475a0d4336eadc8bbef\": container with ID starting with dc5e03ecf86661eee3f64f14ec41a89b8adc433201caa475a0d4336eadc8bbef not found: ID does not exist"
Sep 10 05:11:51.788476 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:51.788408    2560 scope.go:117] "RemoveContainer" containerID="011d93135eccb03a73b1ca1d0bd55637334960d022d9b6ad64c5def9cf528869"
Sep 10 05:11:51.788700 ip-10-0-138-27 kubenswrapper[2560]: E0910 05:11:51.788674    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"011d93135eccb03a73b1ca1d0bd55637334960d022d9b6ad64c5def9cf528869\": container with ID starting with 011d93135eccb03a73b1ca1d0bd55637334960d022d9b6ad64c5def9cf528869 not found: ID does not exist" containerID="011d93135eccb03a73b1ca1d0bd55637334960d022d9b6ad64c5def9cf528869"
Sep 10 05:11:51.788752 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:51.788698    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"011d93135eccb03a73b1ca1d0bd55637334960d022d9b6ad64c5def9cf528869"} err="failed to get container status \"011d93135eccb03a73b1ca1d0bd55637334960d022d9b6ad64c5def9cf528869\": rpc error: code = NotFound desc = could not find container \"011d93135eccb03a73b1ca1d0bd55637334960d022d9b6ad64c5def9cf528869\": container with ID starting with 011d93135eccb03a73b1ca1d0bd55637334960d022d9b6ad64c5def9cf528869 not found: ID does not exist"
Sep 10 05:11:51.790982 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:51.790964    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2"]
Sep 10 05:11:51.794158 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:51.794139    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-1c7644-openshift-default-fb44f75f4-kknr2"]
Sep 10 05:11:52.824749 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:52.824718    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83fd3371-9570-44c9-bf1c-ce31b54583e3" path="/var/lib/kubelet/pods/83fd3371-9570-44c9-bf1c-ce31b54583e3/volumes"
Sep 10 05:11:59.901942 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:11:59.901905    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 05:12:03.679710 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:03.679675    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s"]
Sep 10 05:12:03.680190 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:03.679964    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s" podUID="c9d58812-4328-4d41-b9ee-99a876f5f6e4" containerName="istio-proxy" containerID="cri-o://4e856dc94f039f124159f44439a16b93d63643f9bee9f3583e4d6f513469bd0d" gracePeriod=30
Sep 10 05:12:05.374082 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:05.374048    2560 patch_prober.go:28] interesting pod/e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 05:12:05.374443 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:05.374118    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s" podUID="c9d58812-4328-4d41-b9ee-99a876f5f6e4" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 05:12:08.872991 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:08.872961    2560 generic.go:356] "Generic (PLEG): container finished" podID="c9d58812-4328-4d41-b9ee-99a876f5f6e4" containerID="4e856dc94f039f124159f44439a16b93d63643f9bee9f3583e4d6f513469bd0d" exitCode=0
Sep 10 05:12:08.873325 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:08.873046    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s" event={"ID":"c9d58812-4328-4d41-b9ee-99a876f5f6e4","Type":"ContainerDied","Data":"4e856dc94f039f124159f44439a16b93d63643f9bee9f3583e4d6f513469bd0d"}
Sep 10 05:12:08.873325 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:08.873130    2560 scope.go:117] "RemoveContainer" containerID="815f84a3a5ec166e5e18fa3762f7cd9d2406f2ef9ea201a0986fa82bb4283dd1"
Sep 10 05:12:08.930562 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:08.930543    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s"
Sep 10 05:12:08.966953 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:08.966895    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gjrtx\" (UniqueName: \"kubernetes.io/projected/c9d58812-4328-4d41-b9ee-99a876f5f6e4-kube-api-access-gjrtx\") pod \"c9d58812-4328-4d41-b9ee-99a876f5f6e4\" (UID: \"c9d58812-4328-4d41-b9ee-99a876f5f6e4\") "
Sep 10 05:12:08.966953 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:08.966939    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9d58812-4328-4d41-b9ee-99a876f5f6e4-workload-socket\") pod \"c9d58812-4328-4d41-b9ee-99a876f5f6e4\" (UID: \"c9d58812-4328-4d41-b9ee-99a876f5f6e4\") "
Sep 10 05:12:08.967112 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:08.966970    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9d58812-4328-4d41-b9ee-99a876f5f6e4-istiod-ca-cert\") pod \"c9d58812-4328-4d41-b9ee-99a876f5f6e4\" (UID: \"c9d58812-4328-4d41-b9ee-99a876f5f6e4\") "
Sep 10 05:12:08.967112 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:08.967000    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9d58812-4328-4d41-b9ee-99a876f5f6e4-workload-certs\") pod \"c9d58812-4328-4d41-b9ee-99a876f5f6e4\" (UID: \"c9d58812-4328-4d41-b9ee-99a876f5f6e4\") "
Sep 10 05:12:08.967112 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:08.967031    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9d58812-4328-4d41-b9ee-99a876f5f6e4-istio-envoy\") pod \"c9d58812-4328-4d41-b9ee-99a876f5f6e4\" (UID: \"c9d58812-4328-4d41-b9ee-99a876f5f6e4\") "
Sep 10 05:12:08.967112 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:08.967098    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9d58812-4328-4d41-b9ee-99a876f5f6e4-istio-token\") pod \"c9d58812-4328-4d41-b9ee-99a876f5f6e4\" (UID: \"c9d58812-4328-4d41-b9ee-99a876f5f6e4\") "
Sep 10 05:12:08.967328 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:08.967139    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9d58812-4328-4d41-b9ee-99a876f5f6e4-istio-data\") pod \"c9d58812-4328-4d41-b9ee-99a876f5f6e4\" (UID: \"c9d58812-4328-4d41-b9ee-99a876f5f6e4\") "
Sep 10 05:12:08.967328 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:08.967186    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9d58812-4328-4d41-b9ee-99a876f5f6e4-istio-podinfo\") pod \"c9d58812-4328-4d41-b9ee-99a876f5f6e4\" (UID: \"c9d58812-4328-4d41-b9ee-99a876f5f6e4\") "
Sep 10 05:12:08.967328 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:08.967219    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9d58812-4328-4d41-b9ee-99a876f5f6e4-credential-socket\") pod \"c9d58812-4328-4d41-b9ee-99a876f5f6e4\" (UID: \"c9d58812-4328-4d41-b9ee-99a876f5f6e4\") "
Sep 10 05:12:08.967490 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:08.967345    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9d58812-4328-4d41-b9ee-99a876f5f6e4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c9d58812-4328-4d41-b9ee-99a876f5f6e4" (UID: "c9d58812-4328-4d41-b9ee-99a876f5f6e4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 05:12:08.967548 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:08.967505    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9d58812-4328-4d41-b9ee-99a876f5f6e4-istio-data" (OuterVolumeSpecName: "istio-data") pod "c9d58812-4328-4d41-b9ee-99a876f5f6e4" (UID: "c9d58812-4328-4d41-b9ee-99a876f5f6e4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 05:12:08.967606 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:08.967554    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9d58812-4328-4d41-b9ee-99a876f5f6e4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c9d58812-4328-4d41-b9ee-99a876f5f6e4" (UID: "c9d58812-4328-4d41-b9ee-99a876f5f6e4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 05:12:08.968030 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:08.967737    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9d58812-4328-4d41-b9ee-99a876f5f6e4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c9d58812-4328-4d41-b9ee-99a876f5f6e4" (UID: "c9d58812-4328-4d41-b9ee-99a876f5f6e4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 05:12:08.968030 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:08.967895    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9d58812-4328-4d41-b9ee-99a876f5f6e4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c9d58812-4328-4d41-b9ee-99a876f5f6e4" (UID: "c9d58812-4328-4d41-b9ee-99a876f5f6e4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 05:12:08.968030 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:08.967962    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9d58812-4328-4d41-b9ee-99a876f5f6e4-istio-data\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:12:08.968030 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:08.967982    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9d58812-4328-4d41-b9ee-99a876f5f6e4-credential-socket\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:12:08.968030 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:08.967997    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9d58812-4328-4d41-b9ee-99a876f5f6e4-workload-socket\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:12:08.968030 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:08.968011    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9d58812-4328-4d41-b9ee-99a876f5f6e4-workload-certs\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:12:08.969817 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:08.969786    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9d58812-4328-4d41-b9ee-99a876f5f6e4-kube-api-access-gjrtx" (OuterVolumeSpecName: "kube-api-access-gjrtx") pod "c9d58812-4328-4d41-b9ee-99a876f5f6e4" (UID: "c9d58812-4328-4d41-b9ee-99a876f5f6e4"). InnerVolumeSpecName "kube-api-access-gjrtx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 05:12:08.969940 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:08.969810    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9d58812-4328-4d41-b9ee-99a876f5f6e4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c9d58812-4328-4d41-b9ee-99a876f5f6e4" (UID: "c9d58812-4328-4d41-b9ee-99a876f5f6e4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 05:12:08.970007 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:08.969958    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c9d58812-4328-4d41-b9ee-99a876f5f6e4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c9d58812-4328-4d41-b9ee-99a876f5f6e4" (UID: "c9d58812-4328-4d41-b9ee-99a876f5f6e4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 05:12:08.970007 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:08.969984    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9d58812-4328-4d41-b9ee-99a876f5f6e4-istio-token" (OuterVolumeSpecName: "istio-token") pod "c9d58812-4328-4d41-b9ee-99a876f5f6e4" (UID: "c9d58812-4328-4d41-b9ee-99a876f5f6e4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 05:12:09.069302 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:09.069281    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9d58812-4328-4d41-b9ee-99a876f5f6e4-istio-token\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:12:09.069302 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:09.069301    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9d58812-4328-4d41-b9ee-99a876f5f6e4-istio-podinfo\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:12:09.069423 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:09.069310    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gjrtx\" (UniqueName: \"kubernetes.io/projected/c9d58812-4328-4d41-b9ee-99a876f5f6e4-kube-api-access-gjrtx\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:12:09.069423 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:09.069319    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9d58812-4328-4d41-b9ee-99a876f5f6e4-istiod-ca-cert\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:12:09.069423 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:09.069329    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9d58812-4328-4d41-b9ee-99a876f5f6e4-istio-envoy\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:12:09.880771 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:09.880740    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s"
Sep 10 05:12:09.881186 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:09.880750    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s" event={"ID":"c9d58812-4328-4d41-b9ee-99a876f5f6e4","Type":"ContainerDied","Data":"b5b15c00d9e3c9a1edaabb5afaf2234ba637958b701e481765bd507d41e617c9"}
Sep 10 05:12:09.881186 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:09.880893    2560 scope.go:117] "RemoveContainer" containerID="4e856dc94f039f124159f44439a16b93d63643f9bee9f3583e4d6f513469bd0d"
Sep 10 05:12:09.904988 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:09.904819    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s"]
Sep 10 05:12:09.910412 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:09.910381    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-4bfef6-openshift-default-7c6f74c7d6-lrm8s"]
Sep 10 05:12:10.825456 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:10.825421    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9d58812-4328-4d41-b9ee-99a876f5f6e4" path="/var/lib/kubelet/pods/c9d58812-4328-4d41-b9ee-99a876f5f6e4/volumes"
Sep 10 05:12:14.605315 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:14.605278    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3b702d-7bc8469c7d-lkbvp"]
Sep 10 05:12:14.605737 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:14.605508    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3b702d-7bc8469c7d-lkbvp" podUID="f41e86ac-ee6c-469e-a002-c7cd15a3bf7d" containerName="maas-api" containerID="cri-o://d44b9c7ecb47edc5bc858b864964286b85039d0d8211dcf8d5b1433dacbcef6c" gracePeriod=30
Sep 10 05:12:14.858118 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:14.858062    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3b702d-7bc8469c7d-lkbvp"
Sep 10 05:12:14.909743 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:14.909708    2560 generic.go:356] "Generic (PLEG): container finished" podID="f41e86ac-ee6c-469e-a002-c7cd15a3bf7d" containerID="d44b9c7ecb47edc5bc858b864964286b85039d0d8211dcf8d5b1433dacbcef6c" exitCode=0
Sep 10 05:12:14.909881 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:14.909746    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3b702d-7bc8469c7d-lkbvp"
Sep 10 05:12:14.909881 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:14.909752    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3b702d-7bc8469c7d-lkbvp" event={"ID":"f41e86ac-ee6c-469e-a002-c7cd15a3bf7d","Type":"ContainerDied","Data":"d44b9c7ecb47edc5bc858b864964286b85039d0d8211dcf8d5b1433dacbcef6c"}
Sep 10 05:12:14.909881 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:14.909805    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3b702d-7bc8469c7d-lkbvp" event={"ID":"f41e86ac-ee6c-469e-a002-c7cd15a3bf7d","Type":"ContainerDied","Data":"d5f5966b9b889aa1d4530b1bc33f5c01890cb2dabdd7fb2968b10fb6f53a9b28"}
Sep 10 05:12:14.909881 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:14.909828    2560 scope.go:117] "RemoveContainer" containerID="d44b9c7ecb47edc5bc858b864964286b85039d0d8211dcf8d5b1433dacbcef6c"
Sep 10 05:12:14.917583 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:14.917562    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f41e86ac-ee6c-469e-a002-c7cd15a3bf7d-metrics-certs\") pod \"f41e86ac-ee6c-469e-a002-c7cd15a3bf7d\" (UID: \"f41e86ac-ee6c-469e-a002-c7cd15a3bf7d\") "
Sep 10 05:12:14.917724 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:14.917648    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f41e86ac-ee6c-469e-a002-c7cd15a3bf7d-maas-api-tls\") pod \"f41e86ac-ee6c-469e-a002-c7cd15a3bf7d\" (UID: \"f41e86ac-ee6c-469e-a002-c7cd15a3bf7d\") "
Sep 10 05:12:14.917724 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:14.917703    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f41e86ac-ee6c-469e-a002-c7cd15a3bf7d-openshift-service-ca\") pod \"f41e86ac-ee6c-469e-a002-c7cd15a3bf7d\" (UID: \"f41e86ac-ee6c-469e-a002-c7cd15a3bf7d\") "
Sep 10 05:12:14.918006 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:14.917796    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9db96\" (UniqueName: \"kubernetes.io/projected/f41e86ac-ee6c-469e-a002-c7cd15a3bf7d-kube-api-access-9db96\") pod \"f41e86ac-ee6c-469e-a002-c7cd15a3bf7d\" (UID: \"f41e86ac-ee6c-469e-a002-c7cd15a3bf7d\") "
Sep 10 05:12:14.918090 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:14.918057    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f41e86ac-ee6c-469e-a002-c7cd15a3bf7d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f41e86ac-ee6c-469e-a002-c7cd15a3bf7d" (UID: "f41e86ac-ee6c-469e-a002-c7cd15a3bf7d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 05:12:14.918937 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:14.918921    2560 scope.go:117] "RemoveContainer" containerID="d44b9c7ecb47edc5bc858b864964286b85039d0d8211dcf8d5b1433dacbcef6c"
Sep 10 05:12:14.919224 ip-10-0-138-27 kubenswrapper[2560]: E0910 05:12:14.919207    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d44b9c7ecb47edc5bc858b864964286b85039d0d8211dcf8d5b1433dacbcef6c\": container with ID starting with d44b9c7ecb47edc5bc858b864964286b85039d0d8211dcf8d5b1433dacbcef6c not found: ID does not exist" containerID="d44b9c7ecb47edc5bc858b864964286b85039d0d8211dcf8d5b1433dacbcef6c"
Sep 10 05:12:14.919284 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:14.919232    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d44b9c7ecb47edc5bc858b864964286b85039d0d8211dcf8d5b1433dacbcef6c"} err="failed to get container status \"d44b9c7ecb47edc5bc858b864964286b85039d0d8211dcf8d5b1433dacbcef6c\": rpc error: code = NotFound desc = could not find container \"d44b9c7ecb47edc5bc858b864964286b85039d0d8211dcf8d5b1433dacbcef6c\": container with ID starting with d44b9c7ecb47edc5bc858b864964286b85039d0d8211dcf8d5b1433dacbcef6c not found: ID does not exist"
Sep 10 05:12:14.919987 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:14.919959    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f41e86ac-ee6c-469e-a002-c7cd15a3bf7d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f41e86ac-ee6c-469e-a002-c7cd15a3bf7d" (UID: "f41e86ac-ee6c-469e-a002-c7cd15a3bf7d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 05:12:14.920105 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:14.920068    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f41e86ac-ee6c-469e-a002-c7cd15a3bf7d-kube-api-access-9db96" (OuterVolumeSpecName: "kube-api-access-9db96") pod "f41e86ac-ee6c-469e-a002-c7cd15a3bf7d" (UID: "f41e86ac-ee6c-469e-a002-c7cd15a3bf7d"). InnerVolumeSpecName "kube-api-access-9db96". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 05:12:14.920171 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:14.920101    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f41e86ac-ee6c-469e-a002-c7cd15a3bf7d-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f41e86ac-ee6c-469e-a002-c7cd15a3bf7d" (UID: "f41e86ac-ee6c-469e-a002-c7cd15a3bf7d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 05:12:15.019334 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:15.019310    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f41e86ac-ee6c-469e-a002-c7cd15a3bf7d-metrics-certs\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:12:15.019334 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:15.019333    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f41e86ac-ee6c-469e-a002-c7cd15a3bf7d-maas-api-tls\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:12:15.019519 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:15.019342    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f41e86ac-ee6c-469e-a002-c7cd15a3bf7d-openshift-service-ca\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:12:15.019519 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:15.019352    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9db96\" (UniqueName: \"kubernetes.io/projected/f41e86ac-ee6c-469e-a002-c7cd15a3bf7d-kube-api-access-9db96\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:12:15.231465 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:15.231437    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3b702d-7bc8469c7d-lkbvp"]
Sep 10 05:12:15.234585 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:15.234562    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-3b702d-7bc8469c7d-lkbvp"]
Sep 10 05:12:16.825437 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:16.825397    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f41e86ac-ee6c-469e-a002-c7cd15a3bf7d" path="/var/lib/kubelet/pods/f41e86ac-ee6c-469e-a002-c7cd15a3bf7d/volumes"
Sep 10 05:12:17.303675 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:17.303641    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 05:12:24.081487 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:24.081411    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7597cb784c-845nm"]
Sep 10 05:12:24.081893 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:24.081669    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7597cb784c-845nm" podUID="f3aaedd5-d3e1-497a-88bb-1214e7dc512b" containerName="manager" containerID="cri-o://1d05d749dec13e9265d220dd4f5ed28370afd2ac39f638a7ca489a11ede5b6c2" gracePeriod=30
Sep 10 05:12:24.332415 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:24.332358    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7597cb784c-845nm"
Sep 10 05:12:24.405729 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:24.405701    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q7jbh\" (UniqueName: \"kubernetes.io/projected/f3aaedd5-d3e1-497a-88bb-1214e7dc512b-kube-api-access-q7jbh\") pod \"f3aaedd5-d3e1-497a-88bb-1214e7dc512b\" (UID: \"f3aaedd5-d3e1-497a-88bb-1214e7dc512b\") "
Sep 10 05:12:24.405913 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:24.405799    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3aaedd5-d3e1-497a-88bb-1214e7dc512b-metrics-certs\") pod \"f3aaedd5-d3e1-497a-88bb-1214e7dc512b\" (UID: \"f3aaedd5-d3e1-497a-88bb-1214e7dc512b\") "
Sep 10 05:12:24.405913 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:24.405823    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f3aaedd5-d3e1-497a-88bb-1214e7dc512b-webhook-cert\") pod \"f3aaedd5-d3e1-497a-88bb-1214e7dc512b\" (UID: \"f3aaedd5-d3e1-497a-88bb-1214e7dc512b\") "
Sep 10 05:12:24.407649 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:24.407614    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3aaedd5-d3e1-497a-88bb-1214e7dc512b-kube-api-access-q7jbh" (OuterVolumeSpecName: "kube-api-access-q7jbh") pod "f3aaedd5-d3e1-497a-88bb-1214e7dc512b" (UID: "f3aaedd5-d3e1-497a-88bb-1214e7dc512b"). InnerVolumeSpecName "kube-api-access-q7jbh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 05:12:24.407762 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:24.407718    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3aaedd5-d3e1-497a-88bb-1214e7dc512b-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f3aaedd5-d3e1-497a-88bb-1214e7dc512b" (UID: "f3aaedd5-d3e1-497a-88bb-1214e7dc512b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 05:12:24.407802 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:24.407755    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3aaedd5-d3e1-497a-88bb-1214e7dc512b-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "f3aaedd5-d3e1-497a-88bb-1214e7dc512b" (UID: "f3aaedd5-d3e1-497a-88bb-1214e7dc512b"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 05:12:24.507410 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:24.507375    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3aaedd5-d3e1-497a-88bb-1214e7dc512b-metrics-certs\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:12:24.507410 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:24.507406    2560 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f3aaedd5-d3e1-497a-88bb-1214e7dc512b-webhook-cert\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:12:24.507410 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:24.507415    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q7jbh\" (UniqueName: \"kubernetes.io/projected/f3aaedd5-d3e1-497a-88bb-1214e7dc512b-kube-api-access-q7jbh\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:12:24.971401 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:24.971372    2560 generic.go:356] "Generic (PLEG): container finished" podID="f3aaedd5-d3e1-497a-88bb-1214e7dc512b" containerID="1d05d749dec13e9265d220dd4f5ed28370afd2ac39f638a7ca489a11ede5b6c2" exitCode=0
Sep 10 05:12:24.971551 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:24.971416    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7597cb784c-845nm"
Sep 10 05:12:24.971551 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:24.971462    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7597cb784c-845nm" event={"ID":"f3aaedd5-d3e1-497a-88bb-1214e7dc512b","Type":"ContainerDied","Data":"1d05d749dec13e9265d220dd4f5ed28370afd2ac39f638a7ca489a11ede5b6c2"}
Sep 10 05:12:24.971551 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:24.971516    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7597cb784c-845nm" event={"ID":"f3aaedd5-d3e1-497a-88bb-1214e7dc512b","Type":"ContainerDied","Data":"72a74f9b0f82bd66f0abc321f52d7d40e4d97af663a29fb2671e629cc93f06f1"}
Sep 10 05:12:24.971551 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:24.971546    2560 scope.go:117] "RemoveContainer" containerID="1d05d749dec13e9265d220dd4f5ed28370afd2ac39f638a7ca489a11ede5b6c2"
Sep 10 05:12:24.980777 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:24.980759    2560 scope.go:117] "RemoveContainer" containerID="1d05d749dec13e9265d220dd4f5ed28370afd2ac39f638a7ca489a11ede5b6c2"
Sep 10 05:12:24.981069 ip-10-0-138-27 kubenswrapper[2560]: E0910 05:12:24.981048    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d05d749dec13e9265d220dd4f5ed28370afd2ac39f638a7ca489a11ede5b6c2\": container with ID starting with 1d05d749dec13e9265d220dd4f5ed28370afd2ac39f638a7ca489a11ede5b6c2 not found: ID does not exist" containerID="1d05d749dec13e9265d220dd4f5ed28370afd2ac39f638a7ca489a11ede5b6c2"
Sep 10 05:12:24.981129 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:24.981075    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d05d749dec13e9265d220dd4f5ed28370afd2ac39f638a7ca489a11ede5b6c2"} err="failed to get container status \"1d05d749dec13e9265d220dd4f5ed28370afd2ac39f638a7ca489a11ede5b6c2\": rpc error: code = NotFound desc = could not find container \"1d05d749dec13e9265d220dd4f5ed28370afd2ac39f638a7ca489a11ede5b6c2\": container with ID starting with 1d05d749dec13e9265d220dd4f5ed28370afd2ac39f638a7ca489a11ede5b6c2 not found: ID does not exist"
Sep 10 05:12:24.986796 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:24.986775    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7597cb784c-845nm"]
Sep 10 05:12:24.990252 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:24.990231    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7597cb784c-845nm"]
Sep 10 05:12:26.091803 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:26.091764    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 05:12:26.825455 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:12:26.825414    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3aaedd5-d3e1-497a-88bb-1214e7dc512b" path="/var/lib/kubelet/pods/f3aaedd5-d3e1-497a-88bb-1214e7dc512b/volumes"
Sep 10 05:13:46.795368 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:13:46.795326    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 05:14:13.093741 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:14:13.093664    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 05:14:21.086173 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:14:21.086134    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 05:14:27.087764 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:14:27.087727    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 05:14:34.097069 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:14:34.097034    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 05:14:52.096476 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:14:52.096443    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 05:14:58.590996 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:14:58.590963    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 05:15:00.131740 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:15:00.131705    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29816955-8trl5"]
Sep 10 05:15:00.132136 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:15:00.132083    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83fd3371-9570-44c9-bf1c-ce31b54583e3" containerName="istio-proxy"
Sep 10 05:15:00.132136 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:15:00.132095    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="83fd3371-9570-44c9-bf1c-ce31b54583e3" containerName="istio-proxy"
Sep 10 05:15:00.132136 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:15:00.132111    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3aaedd5-d3e1-497a-88bb-1214e7dc512b" containerName="manager"
Sep 10 05:15:00.132136 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:15:00.132117    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3aaedd5-d3e1-497a-88bb-1214e7dc512b" containerName="manager"
Sep 10 05:15:00.132136 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:15:00.132124    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93d40d75-2f34-4930-8c40-cf6428c096bb" containerName="istio-proxy"
Sep 10 05:15:00.132136 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:15:00.132130    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="93d40d75-2f34-4930-8c40-cf6428c096bb" containerName="istio-proxy"
Sep 10 05:15:00.132136 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:15:00.132138    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9d58812-4328-4d41-b9ee-99a876f5f6e4" containerName="istio-proxy"
Sep 10 05:15:00.132361 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:15:00.132144    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9d58812-4328-4d41-b9ee-99a876f5f6e4" containerName="istio-proxy"
Sep 10 05:15:00.132361 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:15:00.132156    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f41e86ac-ee6c-469e-a002-c7cd15a3bf7d" containerName="maas-api"
Sep 10 05:15:00.132361 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:15:00.132162    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f41e86ac-ee6c-469e-a002-c7cd15a3bf7d" containerName="maas-api"
Sep 10 05:15:00.132361 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:15:00.132168    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83fd3371-9570-44c9-bf1c-ce31b54583e3" containerName="istio-proxy"
Sep 10 05:15:00.132361 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:15:00.132173    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="83fd3371-9570-44c9-bf1c-ce31b54583e3" containerName="istio-proxy"
Sep 10 05:15:00.132361 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:15:00.132181    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6fb5984-1198-40e4-bd16-d7f8fcafe1ee" containerName="maas-api"
Sep 10 05:15:00.132361 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:15:00.132185    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6fb5984-1198-40e4-bd16-d7f8fcafe1ee" containerName="maas-api"
Sep 10 05:15:00.132361 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:15:00.132193    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="421178db-d7ea-4419-a278-e18511112721" containerName="maas-api"
Sep 10 05:15:00.132361 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:15:00.132198    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="421178db-d7ea-4419-a278-e18511112721" containerName="maas-api"
Sep 10 05:15:00.132361 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:15:00.132248    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="83fd3371-9570-44c9-bf1c-ce31b54583e3" containerName="istio-proxy"
Sep 10 05:15:00.132361 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:15:00.132256    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="421178db-d7ea-4419-a278-e18511112721" containerName="maas-api"
Sep 10 05:15:00.132361 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:15:00.132263    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="83fd3371-9570-44c9-bf1c-ce31b54583e3" containerName="istio-proxy"
Sep 10 05:15:00.132361 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:15:00.132269    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="93d40d75-2f34-4930-8c40-cf6428c096bb" containerName="istio-proxy"
Sep 10 05:15:00.132361 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:15:00.132274    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f41e86ac-ee6c-469e-a002-c7cd15a3bf7d" containerName="maas-api"
Sep 10 05:15:00.132361 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:15:00.132280    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3aaedd5-d3e1-497a-88bb-1214e7dc512b" containerName="manager"
Sep 10 05:15:00.132361 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:15:00.132285    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9d58812-4328-4d41-b9ee-99a876f5f6e4" containerName="istio-proxy"
Sep 10 05:15:00.132361 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:15:00.132289    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6fb5984-1198-40e4-bd16-d7f8fcafe1ee" containerName="maas-api"
Sep 10 05:15:00.132361 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:15:00.132295    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9d58812-4328-4d41-b9ee-99a876f5f6e4" containerName="istio-proxy"
Sep 10 05:15:00.134330 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:15:00.134313    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816955-8trl5"
Sep 10 05:15:00.137479 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:15:00.137457    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-dkf6w\""
Sep 10 05:15:00.145492 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:15:00.145468    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29816955-8trl5"]
Sep 10 05:15:00.146336 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:15:00.146317    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816955-8trl5"
Sep 10 05:15:00.153964 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:15:00.153943    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xv7fs"]
Sep 10 05:15:00.154125 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:15:00.154105    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xv7fs" podUID="70785dd7-57c4-4902-a64d-94051bf12e6c" containerName="manager" containerID="cri-o://e248af7e192e851578ea64f8fc6396fea2812a38634d980928fb760985a2d55e" gracePeriod=10
Sep 10 05:15:00.420687 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:15:00.420663    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29816955-8trl5"]
Sep 10 05:15:00.422017 ip-10-0-138-27 kubenswrapper[2560]: W0910 05:15:00.421991    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97fe7146_7ec5_45f7_9570_db4ac1a6c1a1.slice/crio-731578a145fa940eddbb1082edfd1844ae13aadf11aeb8781a5b3312acb69032 WatchSource:0}: Error finding container 731578a145fa940eddbb1082edfd1844ae13aadf11aeb8781a5b3312acb69032: Status 404 returned error can't find the container with id 731578a145fa940eddbb1082edfd1844ae13aadf11aeb8781a5b3312acb69032
Sep 10 05:15:00.845591 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:15:00.845555    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816955-8trl5" event={"ID":"97fe7146-7ec5-45f7-9570-db4ac1a6c1a1","Type":"ContainerStarted","Data":"e4e95880ea0fc8323a5b3ea7f7aff911d3ba66474d4ee4f5c23119b1dfa7a1a8"}
Sep 10 05:15:00.845735 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:15:00.845610    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816955-8trl5" event={"ID":"97fe7146-7ec5-45f7-9570-db4ac1a6c1a1","Type":"ContainerStarted","Data":"731578a145fa940eddbb1082edfd1844ae13aadf11aeb8781a5b3312acb69032"}
Sep 10 05:15:00.860278 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:15:00.860227    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816955-8trl5" podStartSLOduration=0.860213185 podStartE2EDuration="860.213185ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 05:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 05:15:00.857509003 +0000 UTC m=+2040.519966750" watchObservedRunningTime="2026-09-10 05:15:00.860213185 +0000 UTC m=+2040.522670980"
Sep 10 05:15:01.852581 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:15:01.852550    2560 generic.go:356] "Generic (PLEG): container finished" podID="97fe7146-7ec5-45f7-9570-db4ac1a6c1a1" containerID="e4e95880ea0fc8323a5b3ea7f7aff911d3ba66474d4ee4f5c23119b1dfa7a1a8" exitCode=0
Sep 10 05:15:01.852982 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:15:01.852601    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816955-8trl5" event={"ID":"97fe7146-7ec5-45f7-9570-db4ac1a6c1a1","Type":"ContainerDied","Data":"e4e95880ea0fc8323a5b3ea7f7aff911d3ba66474d4ee4f5c23119b1dfa7a1a8"}
Sep 10 05:15:02.303803 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:15:02.303771    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xv7fs"
Sep 10 05:15:02.435811 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:15:02.435730    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m8zfp\" (UniqueName: \"kubernetes.io/projected/70785dd7-57c4-4902-a64d-94051bf12e6c-kube-api-access-m8zfp\") pod \"70785dd7-57c4-4902-a64d-94051bf12e6c\" (UID: \"70785dd7-57c4-4902-a64d-94051bf12e6c\") "
Sep 10 05:15:02.435811 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:15:02.435769    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/70785dd7-57c4-4902-a64d-94051bf12e6c-extensions-socket-volume\") pod \"70785dd7-57c4-4902-a64d-94051bf12e6c\" (UID: \"70785dd7-57c4-4902-a64d-94051bf12e6c\") "
Sep 10 05:15:02.436161 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:15:02.436132    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70785dd7-57c4-4902-a64d-94051bf12e6c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "70785dd7-57c4-4902-a64d-94051bf12e6c" (UID: "70785dd7-57c4-4902-a64d-94051bf12e6c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 05:15:02.437836 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:15:02.437809    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70785dd7-57c4-4902-a64d-94051bf12e6c-kube-api-access-m8zfp" (OuterVolumeSpecName: "kube-api-access-m8zfp") pod "70785dd7-57c4-4902-a64d-94051bf12e6c" (UID: "70785dd7-57c4-4902-a64d-94051bf12e6c"). InnerVolumeSpecName "kube-api-access-m8zfp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 05:15:02.536362 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:15:02.536328    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m8zfp\" (UniqueName: \"kubernetes.io/projected/70785dd7-57c4-4902-a64d-94051bf12e6c-kube-api-access-m8zfp\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:15:02.536362 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:15:02.536357    2560 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/70785dd7-57c4-4902-a64d-94051bf12e6c-extensions-socket-volume\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:15:02.859289 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:15:02.859257    2560 generic.go:356] "Generic (PLEG): container finished" podID="70785dd7-57c4-4902-a64d-94051bf12e6c" containerID="e248af7e192e851578ea64f8fc6396fea2812a38634d980928fb760985a2d55e" exitCode=0
Sep 10 05:15:02.859623 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:15:02.859297    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xv7fs"
Sep 10 05:15:02.859623 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:15:02.859339    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xv7fs" event={"ID":"70785dd7-57c4-4902-a64d-94051bf12e6c","Type":"ContainerDied","Data":"e248af7e192e851578ea64f8fc6396fea2812a38634d980928fb760985a2d55e"}
Sep 10 05:15:02.859623 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:15:02.859392    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xv7fs" event={"ID":"70785dd7-57c4-4902-a64d-94051bf12e6c","Type":"ContainerDied","Data":"3a86e599a4c74b9455d81a89c5350eb272b88811829c7a6d9e5007806861affe"}
Sep 10 05:15:02.859623 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:15:02.859416    2560 scope.go:117] "RemoveContainer" containerID="e248af7e192e851578ea64f8fc6396fea2812a38634d980928fb760985a2d55e"
Sep 10 05:15:02.869605 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:15:02.869588    2560 scope.go:117] "RemoveContainer" containerID="e248af7e192e851578ea64f8fc6396fea2812a38634d980928fb760985a2d55e"
Sep 10 05:15:02.869938 ip-10-0-138-27 kubenswrapper[2560]: E0910 05:15:02.869917    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e248af7e192e851578ea64f8fc6396fea2812a38634d980928fb760985a2d55e\": container with ID starting with e248af7e192e851578ea64f8fc6396fea2812a38634d980928fb760985a2d55e not found: ID does not exist" containerID="e248af7e192e851578ea64f8fc6396fea2812a38634d980928fb760985a2d55e"
Sep 10 05:15:02.870038 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:15:02.869947    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e248af7e192e851578ea64f8fc6396fea2812a38634d980928fb760985a2d55e"} err="failed to get container status \"e248af7e192e851578ea64f8fc6396fea2812a38634d980928fb760985a2d55e\": rpc error: code = NotFound desc = could not find container \"e248af7e192e851578ea64f8fc6396fea2812a38634d980928fb760985a2d55e\": container with ID starting with e248af7e192e851578ea64f8fc6396fea2812a38634d980928fb760985a2d55e not found: ID does not exist"
Sep 10 05:15:02.878529 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:15:02.878505    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xv7fs"]
Sep 10 05:15:02.885590 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:15:02.885565    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xv7fs"]
Sep 10 05:15:02.993160 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:15:02.993139    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816955-8trl5"
Sep 10 05:15:03.866023 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:15:03.865994    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816955-8trl5"
Sep 10 05:15:03.866493 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:15:03.865995    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816955-8trl5" event={"ID":"97fe7146-7ec5-45f7-9570-db4ac1a6c1a1","Type":"ContainerDied","Data":"731578a145fa940eddbb1082edfd1844ae13aadf11aeb8781a5b3312acb69032"}
Sep 10 05:15:03.866493 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:15:03.866135    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="731578a145fa940eddbb1082edfd1844ae13aadf11aeb8781a5b3312acb69032"
Sep 10 05:15:04.825516 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:15:04.825480    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70785dd7-57c4-4902-a64d-94051bf12e6c" path="/var/lib/kubelet/pods/70785dd7-57c4-4902-a64d-94051bf12e6c/volumes"
Sep 10 05:16:00.850569 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:16:00.850534    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-mtbp2"]
Sep 10 05:16:00.850974 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:16:00.850914    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97fe7146-7ec5-45f7-9570-db4ac1a6c1a1" containerName="cleanup"
Sep 10 05:16:00.850974 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:16:00.850928    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="97fe7146-7ec5-45f7-9570-db4ac1a6c1a1" containerName="cleanup"
Sep 10 05:16:00.850974 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:16:00.850953    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70785dd7-57c4-4902-a64d-94051bf12e6c" containerName="manager"
Sep 10 05:16:00.850974 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:16:00.850958    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="70785dd7-57c4-4902-a64d-94051bf12e6c" containerName="manager"
Sep 10 05:16:00.850974 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:16:00.850969    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93d40d75-2f34-4930-8c40-cf6428c096bb" containerName="istio-proxy"
Sep 10 05:16:00.850974 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:16:00.850975    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="93d40d75-2f34-4930-8c40-cf6428c096bb" containerName="istio-proxy"
Sep 10 05:16:00.851174 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:16:00.850983    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9d58812-4328-4d41-b9ee-99a876f5f6e4" containerName="istio-proxy"
Sep 10 05:16:00.851174 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:16:00.850989    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9d58812-4328-4d41-b9ee-99a876f5f6e4" containerName="istio-proxy"
Sep 10 05:16:00.851174 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:16:00.851042    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="93d40d75-2f34-4930-8c40-cf6428c096bb" containerName="istio-proxy"
Sep 10 05:16:00.851174 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:16:00.851050    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="97fe7146-7ec5-45f7-9570-db4ac1a6c1a1" containerName="cleanup"
Sep 10 05:16:00.851174 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:16:00.851058    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="70785dd7-57c4-4902-a64d-94051bf12e6c" containerName="manager"
Sep 10 05:16:00.854118 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:16:00.854100    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-mtbp2"
Sep 10 05:16:00.856281 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:16:00.856260    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-4cwpk\""
Sep 10 05:16:00.865335 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:16:00.865314    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-mtbp2"]
Sep 10 05:16:00.979134 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:16:00.979109    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xz85v\" (UniqueName: \"kubernetes.io/projected/0db0f63f-07b9-4cdd-a058-2752cff48a46-kube-api-access-xz85v\") pod \"kuadrant-operator-controller-manager-5769f99d9f-mtbp2\" (UID: \"0db0f63f-07b9-4cdd-a058-2752cff48a46\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-mtbp2"
Sep 10 05:16:00.979270 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:16:00.979145    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0db0f63f-07b9-4cdd-a058-2752cff48a46-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-mtbp2\" (UID: \"0db0f63f-07b9-4cdd-a058-2752cff48a46\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-mtbp2"
Sep 10 05:16:01.036180 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:16:01.036156    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-p5zjp_8b3ec8dc-1508-4537-8dc3-b9de1ff22d03/console-operator/1.log"
Sep 10 05:16:01.042904 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:16:01.042884    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-p5zjp_8b3ec8dc-1508-4537-8dc3-b9de1ff22d03/console-operator/1.log"
Sep 10 05:16:01.080171 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:16:01.080150    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xz85v\" (UniqueName: \"kubernetes.io/projected/0db0f63f-07b9-4cdd-a058-2752cff48a46-kube-api-access-xz85v\") pod \"kuadrant-operator-controller-manager-5769f99d9f-mtbp2\" (UID: \"0db0f63f-07b9-4cdd-a058-2752cff48a46\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-mtbp2"
Sep 10 05:16:01.080279 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:16:01.080184    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0db0f63f-07b9-4cdd-a058-2752cff48a46-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-mtbp2\" (UID: \"0db0f63f-07b9-4cdd-a058-2752cff48a46\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-mtbp2"
Sep 10 05:16:01.080643 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:16:01.080625    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0db0f63f-07b9-4cdd-a058-2752cff48a46-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-mtbp2\" (UID: \"0db0f63f-07b9-4cdd-a058-2752cff48a46\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-mtbp2"
Sep 10 05:16:01.087422 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:16:01.087401    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xz85v\" (UniqueName: \"kubernetes.io/projected/0db0f63f-07b9-4cdd-a058-2752cff48a46-kube-api-access-xz85v\") pod \"kuadrant-operator-controller-manager-5769f99d9f-mtbp2\" (UID: \"0db0f63f-07b9-4cdd-a058-2752cff48a46\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-mtbp2"
Sep 10 05:16:01.164689 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:16:01.164665    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-mtbp2"
Sep 10 05:16:01.441407 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:16:01.441381    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-mtbp2"]
Sep 10 05:16:01.442330 ip-10-0-138-27 kubenswrapper[2560]: W0910 05:16:01.442302    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0db0f63f_07b9_4cdd_a058_2752cff48a46.slice/crio-dc933bdb3a4a9c4c2404e1bd200a31a70413751ed17c254ce4513c1d408f1eff WatchSource:0}: Error finding container dc933bdb3a4a9c4c2404e1bd200a31a70413751ed17c254ce4513c1d408f1eff: Status 404 returned error can't find the container with id dc933bdb3a4a9c4c2404e1bd200a31a70413751ed17c254ce4513c1d408f1eff
Sep 10 05:16:02.186553 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:16:02.186515    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-mtbp2" event={"ID":"0db0f63f-07b9-4cdd-a058-2752cff48a46","Type":"ContainerStarted","Data":"3ede9ab52bca959ba40780d4506f82db888a8784094b1e3df543108be2d7ed89"}
Sep 10 05:16:02.186964 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:16:02.186573    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-mtbp2" event={"ID":"0db0f63f-07b9-4cdd-a058-2752cff48a46","Type":"ContainerStarted","Data":"dc933bdb3a4a9c4c2404e1bd200a31a70413751ed17c254ce4513c1d408f1eff"}
Sep 10 05:16:02.186964 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:16:02.186598    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-mtbp2"
Sep 10 05:16:02.210700 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:16:02.210658    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-mtbp2" podStartSLOduration=2.210643686 podStartE2EDuration="2.210643686s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 05:16:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 05:16:02.208833234 +0000 UTC m=+2101.871290981" watchObservedRunningTime="2026-09-10 05:16:02.210643686 +0000 UTC m=+2101.873101429"
Sep 10 05:16:13.194513 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:16:13.194480    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-mtbp2"
Sep 10 05:16:24.596360 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:16:24.596322    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 05:16:32.397932 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:16:32.397902    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 05:16:40.690292 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:16:40.690252    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 05:17:09.391045 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:17:09.390962    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 05:17:47.588915 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:17:47.588881    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 05:17:56.496084 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:17:56.496050    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 05:18:03.688309 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:03.688278    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 05:18:09.595216 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:09.595182    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 05:18:10.016004 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:10.015972    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7ff5bf8f9d-2qhh8"]
Sep 10 05:18:10.019521 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:10.019500    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7ff5bf8f9d-2qhh8"
Sep 10 05:18:10.021571 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:10.021551    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 10 05:18:10.022319 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:10.022296    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 10 05:18:10.022431 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:10.022368    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-ksvhk\""
Sep 10 05:18:10.029763 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:10.029741    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7ff5bf8f9d-2qhh8"]
Sep 10 05:18:10.112782 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:10.112749    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5f249ab-6ea7-4c45-8aa0-12a8c5db530d-metrics-certs\") pod \"maas-api-7ff5bf8f9d-2qhh8\" (UID: \"b5f249ab-6ea7-4c45-8aa0-12a8c5db530d\") " pod="odh-ai-gateway-infra/maas-api-7ff5bf8f9d-2qhh8"
Sep 10 05:18:10.112782 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:10.112783    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5f249ab-6ea7-4c45-8aa0-12a8c5db530d-openshift-service-ca\") pod \"maas-api-7ff5bf8f9d-2qhh8\" (UID: \"b5f249ab-6ea7-4c45-8aa0-12a8c5db530d\") " pod="odh-ai-gateway-infra/maas-api-7ff5bf8f9d-2qhh8"
Sep 10 05:18:10.113068 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:10.112804    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b5f249ab-6ea7-4c45-8aa0-12a8c5db530d-maas-api-tls\") pod \"maas-api-7ff5bf8f9d-2qhh8\" (UID: \"b5f249ab-6ea7-4c45-8aa0-12a8c5db530d\") " pod="odh-ai-gateway-infra/maas-api-7ff5bf8f9d-2qhh8"
Sep 10 05:18:10.113068 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:10.112878    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqkgt\" (UniqueName: \"kubernetes.io/projected/b5f249ab-6ea7-4c45-8aa0-12a8c5db530d-kube-api-access-rqkgt\") pod \"maas-api-7ff5bf8f9d-2qhh8\" (UID: \"b5f249ab-6ea7-4c45-8aa0-12a8c5db530d\") " pod="odh-ai-gateway-infra/maas-api-7ff5bf8f9d-2qhh8"
Sep 10 05:18:10.214078 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:10.214048    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5f249ab-6ea7-4c45-8aa0-12a8c5db530d-metrics-certs\") pod \"maas-api-7ff5bf8f9d-2qhh8\" (UID: \"b5f249ab-6ea7-4c45-8aa0-12a8c5db530d\") " pod="odh-ai-gateway-infra/maas-api-7ff5bf8f9d-2qhh8"
Sep 10 05:18:10.214237 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:10.214086    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5f249ab-6ea7-4c45-8aa0-12a8c5db530d-openshift-service-ca\") pod \"maas-api-7ff5bf8f9d-2qhh8\" (UID: \"b5f249ab-6ea7-4c45-8aa0-12a8c5db530d\") " pod="odh-ai-gateway-infra/maas-api-7ff5bf8f9d-2qhh8"
Sep 10 05:18:10.214237 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:10.214107    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b5f249ab-6ea7-4c45-8aa0-12a8c5db530d-maas-api-tls\") pod \"maas-api-7ff5bf8f9d-2qhh8\" (UID: \"b5f249ab-6ea7-4c45-8aa0-12a8c5db530d\") " pod="odh-ai-gateway-infra/maas-api-7ff5bf8f9d-2qhh8"
Sep 10 05:18:10.214237 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:10.214222    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqkgt\" (UniqueName: \"kubernetes.io/projected/b5f249ab-6ea7-4c45-8aa0-12a8c5db530d-kube-api-access-rqkgt\") pod \"maas-api-7ff5bf8f9d-2qhh8\" (UID: \"b5f249ab-6ea7-4c45-8aa0-12a8c5db530d\") " pod="odh-ai-gateway-infra/maas-api-7ff5bf8f9d-2qhh8"
Sep 10 05:18:10.214783 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:10.214757    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5f249ab-6ea7-4c45-8aa0-12a8c5db530d-openshift-service-ca\") pod \"maas-api-7ff5bf8f9d-2qhh8\" (UID: \"b5f249ab-6ea7-4c45-8aa0-12a8c5db530d\") " pod="odh-ai-gateway-infra/maas-api-7ff5bf8f9d-2qhh8"
Sep 10 05:18:10.216658 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:10.216632    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5f249ab-6ea7-4c45-8aa0-12a8c5db530d-metrics-certs\") pod \"maas-api-7ff5bf8f9d-2qhh8\" (UID: \"b5f249ab-6ea7-4c45-8aa0-12a8c5db530d\") " pod="odh-ai-gateway-infra/maas-api-7ff5bf8f9d-2qhh8"
Sep 10 05:18:10.216777 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:10.216639    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b5f249ab-6ea7-4c45-8aa0-12a8c5db530d-maas-api-tls\") pod \"maas-api-7ff5bf8f9d-2qhh8\" (UID: \"b5f249ab-6ea7-4c45-8aa0-12a8c5db530d\") " pod="odh-ai-gateway-infra/maas-api-7ff5bf8f9d-2qhh8"
Sep 10 05:18:10.221427 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:10.221404    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqkgt\" (UniqueName: \"kubernetes.io/projected/b5f249ab-6ea7-4c45-8aa0-12a8c5db530d-kube-api-access-rqkgt\") pod \"maas-api-7ff5bf8f9d-2qhh8\" (UID: \"b5f249ab-6ea7-4c45-8aa0-12a8c5db530d\") " pod="odh-ai-gateway-infra/maas-api-7ff5bf8f9d-2qhh8"
Sep 10 05:18:10.331484 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:10.331420    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7ff5bf8f9d-2qhh8"
Sep 10 05:18:10.602816 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:10.602777    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7ff5bf8f9d-2qhh8"]
Sep 10 05:18:10.603938 ip-10-0-138-27 kubenswrapper[2560]: W0910 05:18:10.603908    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5f249ab_6ea7_4c45_8aa0_12a8c5db530d.slice/crio-0e3616415646e0f4c6a9d9faad699399912bc348193ccb348228eb6d4dd4ecaa WatchSource:0}: Error finding container 0e3616415646e0f4c6a9d9faad699399912bc348193ccb348228eb6d4dd4ecaa: Status 404 returned error can't find the container with id 0e3616415646e0f4c6a9d9faad699399912bc348193ccb348228eb6d4dd4ecaa
Sep 10 05:18:10.605284 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:10.605265    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 05:18:10.910174 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:10.910138    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7ff5bf8f9d-2qhh8" event={"ID":"b5f249ab-6ea7-4c45-8aa0-12a8c5db530d","Type":"ContainerStarted","Data":"0e3616415646e0f4c6a9d9faad699399912bc348193ccb348228eb6d4dd4ecaa"}
Sep 10 05:18:11.916992 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:11.916955    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7ff5bf8f9d-2qhh8" event={"ID":"b5f249ab-6ea7-4c45-8aa0-12a8c5db530d","Type":"ContainerStarted","Data":"35ab739761239b46c17c6b30dda5e81147f8095d3c88fc3df5bf8f1f76fba1d1"}
Sep 10 05:18:11.917393 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:11.917040    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7ff5bf8f9d-2qhh8"
Sep 10 05:18:11.932704 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:11.932660    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7ff5bf8f9d-2qhh8" podStartSLOduration=2.512206758 podStartE2EDuration="2.93264459s" totalImagesPullingTime="420.437832ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 05:18:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 05:18:11.932033444 +0000 UTC m=+2231.594491227" watchObservedRunningTime="2026-09-10 05:18:11.93264459 +0000 UTC m=+2231.595102336"
Sep 10 05:18:17.317251 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:17.317218    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-7ff5bf8f9d-2qhh8"]
Sep 10 05:18:17.317652 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:17.317447    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-7ff5bf8f9d-2qhh8" podUID="b5f249ab-6ea7-4c45-8aa0-12a8c5db530d" containerName="maas-api" containerID="cri-o://35ab739761239b46c17c6b30dda5e81147f8095d3c88fc3df5bf8f1f76fba1d1" gracePeriod=30
Sep 10 05:18:17.323331 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:17.323309    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7ff5bf8f9d-2qhh8"
Sep 10 05:18:17.351887 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:17.349884    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-84bff48b9d-qcc49"]
Sep 10 05:18:17.355435 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:17.355250    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-84bff48b9d-qcc49"
Sep 10 05:18:17.360581 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:17.360557    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-84bff48b9d-qcc49"]
Sep 10 05:18:17.475609 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:17.475577    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/992135be-b6ae-4dd8-9674-06c016f0b402-openshift-service-ca\") pod \"maas-api-84bff48b9d-qcc49\" (UID: \"992135be-b6ae-4dd8-9674-06c016f0b402\") " pod="odh-ai-gateway-infra/maas-api-84bff48b9d-qcc49"
Sep 10 05:18:17.475609 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:17.475622    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/992135be-b6ae-4dd8-9674-06c016f0b402-metrics-certs\") pod \"maas-api-84bff48b9d-qcc49\" (UID: \"992135be-b6ae-4dd8-9674-06c016f0b402\") " pod="odh-ai-gateway-infra/maas-api-84bff48b9d-qcc49"
Sep 10 05:18:17.475825 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:17.475649    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/992135be-b6ae-4dd8-9674-06c016f0b402-maas-api-tls\") pod \"maas-api-84bff48b9d-qcc49\" (UID: \"992135be-b6ae-4dd8-9674-06c016f0b402\") " pod="odh-ai-gateway-infra/maas-api-84bff48b9d-qcc49"
Sep 10 05:18:17.475825 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:17.475766    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7csb4\" (UniqueName: \"kubernetes.io/projected/992135be-b6ae-4dd8-9674-06c016f0b402-kube-api-access-7csb4\") pod \"maas-api-84bff48b9d-qcc49\" (UID: \"992135be-b6ae-4dd8-9674-06c016f0b402\") " pod="odh-ai-gateway-infra/maas-api-84bff48b9d-qcc49"
Sep 10 05:18:17.494360 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:17.494330    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 05:18:17.567179 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:17.567151    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7ff5bf8f9d-2qhh8"
Sep 10 05:18:17.576647 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:17.576588    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/992135be-b6ae-4dd8-9674-06c016f0b402-openshift-service-ca\") pod \"maas-api-84bff48b9d-qcc49\" (UID: \"992135be-b6ae-4dd8-9674-06c016f0b402\") " pod="odh-ai-gateway-infra/maas-api-84bff48b9d-qcc49"
Sep 10 05:18:17.576647 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:17.576622    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/992135be-b6ae-4dd8-9674-06c016f0b402-metrics-certs\") pod \"maas-api-84bff48b9d-qcc49\" (UID: \"992135be-b6ae-4dd8-9674-06c016f0b402\") " pod="odh-ai-gateway-infra/maas-api-84bff48b9d-qcc49"
Sep 10 05:18:17.576647 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:17.576646    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/992135be-b6ae-4dd8-9674-06c016f0b402-maas-api-tls\") pod \"maas-api-84bff48b9d-qcc49\" (UID: \"992135be-b6ae-4dd8-9674-06c016f0b402\") " pod="odh-ai-gateway-infra/maas-api-84bff48b9d-qcc49"
Sep 10 05:18:17.576907 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:17.576683    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7csb4\" (UniqueName: \"kubernetes.io/projected/992135be-b6ae-4dd8-9674-06c016f0b402-kube-api-access-7csb4\") pod \"maas-api-84bff48b9d-qcc49\" (UID: \"992135be-b6ae-4dd8-9674-06c016f0b402\") " pod="odh-ai-gateway-infra/maas-api-84bff48b9d-qcc49"
Sep 10 05:18:17.577349 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:17.577323    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/992135be-b6ae-4dd8-9674-06c016f0b402-openshift-service-ca\") pod \"maas-api-84bff48b9d-qcc49\" (UID: \"992135be-b6ae-4dd8-9674-06c016f0b402\") " pod="odh-ai-gateway-infra/maas-api-84bff48b9d-qcc49"
Sep 10 05:18:17.579182 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:17.579155    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/992135be-b6ae-4dd8-9674-06c016f0b402-metrics-certs\") pod \"maas-api-84bff48b9d-qcc49\" (UID: \"992135be-b6ae-4dd8-9674-06c016f0b402\") " pod="odh-ai-gateway-infra/maas-api-84bff48b9d-qcc49"
Sep 10 05:18:17.579389 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:17.579370    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/992135be-b6ae-4dd8-9674-06c016f0b402-maas-api-tls\") pod \"maas-api-84bff48b9d-qcc49\" (UID: \"992135be-b6ae-4dd8-9674-06c016f0b402\") " pod="odh-ai-gateway-infra/maas-api-84bff48b9d-qcc49"
Sep 10 05:18:17.587332 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:17.586666    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7csb4\" (UniqueName: \"kubernetes.io/projected/992135be-b6ae-4dd8-9674-06c016f0b402-kube-api-access-7csb4\") pod \"maas-api-84bff48b9d-qcc49\" (UID: \"992135be-b6ae-4dd8-9674-06c016f0b402\") " pod="odh-ai-gateway-infra/maas-api-84bff48b9d-qcc49"
Sep 10 05:18:17.677263 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:17.677231    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b5f249ab-6ea7-4c45-8aa0-12a8c5db530d-maas-api-tls\") pod \"b5f249ab-6ea7-4c45-8aa0-12a8c5db530d\" (UID: \"b5f249ab-6ea7-4c45-8aa0-12a8c5db530d\") "
Sep 10 05:18:17.677263 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:17.677266    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5f249ab-6ea7-4c45-8aa0-12a8c5db530d-metrics-certs\") pod \"b5f249ab-6ea7-4c45-8aa0-12a8c5db530d\" (UID: \"b5f249ab-6ea7-4c45-8aa0-12a8c5db530d\") "
Sep 10 05:18:17.677457 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:17.677314    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rqkgt\" (UniqueName: \"kubernetes.io/projected/b5f249ab-6ea7-4c45-8aa0-12a8c5db530d-kube-api-access-rqkgt\") pod \"b5f249ab-6ea7-4c45-8aa0-12a8c5db530d\" (UID: \"b5f249ab-6ea7-4c45-8aa0-12a8c5db530d\") "
Sep 10 05:18:17.677457 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:17.677429    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5f249ab-6ea7-4c45-8aa0-12a8c5db530d-openshift-service-ca\") pod \"b5f249ab-6ea7-4c45-8aa0-12a8c5db530d\" (UID: \"b5f249ab-6ea7-4c45-8aa0-12a8c5db530d\") "
Sep 10 05:18:17.677761 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:17.677732    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5f249ab-6ea7-4c45-8aa0-12a8c5db530d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b5f249ab-6ea7-4c45-8aa0-12a8c5db530d" (UID: "b5f249ab-6ea7-4c45-8aa0-12a8c5db530d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 05:18:17.679301 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:17.679281    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5f249ab-6ea7-4c45-8aa0-12a8c5db530d-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "b5f249ab-6ea7-4c45-8aa0-12a8c5db530d" (UID: "b5f249ab-6ea7-4c45-8aa0-12a8c5db530d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 05:18:17.679385 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:17.679345    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5f249ab-6ea7-4c45-8aa0-12a8c5db530d-kube-api-access-rqkgt" (OuterVolumeSpecName: "kube-api-access-rqkgt") pod "b5f249ab-6ea7-4c45-8aa0-12a8c5db530d" (UID: "b5f249ab-6ea7-4c45-8aa0-12a8c5db530d"). InnerVolumeSpecName "kube-api-access-rqkgt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 05:18:17.679422 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:17.679394    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5f249ab-6ea7-4c45-8aa0-12a8c5db530d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b5f249ab-6ea7-4c45-8aa0-12a8c5db530d" (UID: "b5f249ab-6ea7-4c45-8aa0-12a8c5db530d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 05:18:17.694713 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:17.694683    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-84bff48b9d-qcc49"
Sep 10 05:18:17.778784 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:17.778749    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5f249ab-6ea7-4c45-8aa0-12a8c5db530d-openshift-service-ca\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:18:17.778914 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:17.778786    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b5f249ab-6ea7-4c45-8aa0-12a8c5db530d-maas-api-tls\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:18:17.778914 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:17.778801    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5f249ab-6ea7-4c45-8aa0-12a8c5db530d-metrics-certs\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:18:17.778914 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:17.778814    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rqkgt\" (UniqueName: \"kubernetes.io/projected/b5f249ab-6ea7-4c45-8aa0-12a8c5db530d-kube-api-access-rqkgt\") on node \"ip-10-0-138-27.ec2.internal\" DevicePath \"\""
Sep 10 05:18:17.950893 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:17.950840    2560 generic.go:356] "Generic (PLEG): container finished" podID="b5f249ab-6ea7-4c45-8aa0-12a8c5db530d" containerID="35ab739761239b46c17c6b30dda5e81147f8095d3c88fc3df5bf8f1f76fba1d1" exitCode=0
Sep 10 05:18:17.951032 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:17.950892    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7ff5bf8f9d-2qhh8" event={"ID":"b5f249ab-6ea7-4c45-8aa0-12a8c5db530d","Type":"ContainerDied","Data":"35ab739761239b46c17c6b30dda5e81147f8095d3c88fc3df5bf8f1f76fba1d1"}
Sep 10 05:18:17.951032 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:17.950918    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7ff5bf8f9d-2qhh8"
Sep 10 05:18:17.951032 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:17.950943    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7ff5bf8f9d-2qhh8" event={"ID":"b5f249ab-6ea7-4c45-8aa0-12a8c5db530d","Type":"ContainerDied","Data":"0e3616415646e0f4c6a9d9faad699399912bc348193ccb348228eb6d4dd4ecaa"}
Sep 10 05:18:17.951032 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:17.950966    2560 scope.go:117] "RemoveContainer" containerID="35ab739761239b46c17c6b30dda5e81147f8095d3c88fc3df5bf8f1f76fba1d1"
Sep 10 05:18:17.961410 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:17.961391    2560 scope.go:117] "RemoveContainer" containerID="35ab739761239b46c17c6b30dda5e81147f8095d3c88fc3df5bf8f1f76fba1d1"
Sep 10 05:18:17.961714 ip-10-0-138-27 kubenswrapper[2560]: E0910 05:18:17.961694    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35ab739761239b46c17c6b30dda5e81147f8095d3c88fc3df5bf8f1f76fba1d1\": container with ID starting with 35ab739761239b46c17c6b30dda5e81147f8095d3c88fc3df5bf8f1f76fba1d1 not found: ID does not exist" containerID="35ab739761239b46c17c6b30dda5e81147f8095d3c88fc3df5bf8f1f76fba1d1"
Sep 10 05:18:17.961794 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:17.961725    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35ab739761239b46c17c6b30dda5e81147f8095d3c88fc3df5bf8f1f76fba1d1"} err="failed to get container status \"35ab739761239b46c17c6b30dda5e81147f8095d3c88fc3df5bf8f1f76fba1d1\": rpc error: code = NotFound desc = could not find container \"35ab739761239b46c17c6b30dda5e81147f8095d3c88fc3df5bf8f1f76fba1d1\": container with ID starting with 35ab739761239b46c17c6b30dda5e81147f8095d3c88fc3df5bf8f1f76fba1d1 not found: ID does not exist"
Sep 10 05:18:17.969524 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:17.969503    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-84bff48b9d-qcc49"]
Sep 10 05:18:17.969746 ip-10-0-138-27 kubenswrapper[2560]: W0910 05:18:17.969725    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod992135be_b6ae_4dd8_9674_06c016f0b402.slice/crio-13c781d64bd65f70e8a4a8d77d4aa88368ec72181e6c4d0d948270bc7970fe22 WatchSource:0}: Error finding container 13c781d64bd65f70e8a4a8d77d4aa88368ec72181e6c4d0d948270bc7970fe22: Status 404 returned error can't find the container with id 13c781d64bd65f70e8a4a8d77d4aa88368ec72181e6c4d0d948270bc7970fe22
Sep 10 05:18:17.974073 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:17.974053    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-7ff5bf8f9d-2qhh8"]
Sep 10 05:18:17.977799 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:17.977779    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-7ff5bf8f9d-2qhh8"]
Sep 10 05:18:18.825488 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:18.825455    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5f249ab-6ea7-4c45-8aa0-12a8c5db530d" path="/var/lib/kubelet/pods/b5f249ab-6ea7-4c45-8aa0-12a8c5db530d/volumes"
Sep 10 05:18:18.958667 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:18.958633    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-84bff48b9d-qcc49" event={"ID":"992135be-b6ae-4dd8-9674-06c016f0b402","Type":"ContainerStarted","Data":"468d00969841fa5309ac9b2c83c4c69460e635044233ad5f8d3eb3ac05d310d8"}
Sep 10 05:18:18.958832 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:18.958690    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-84bff48b9d-qcc49" event={"ID":"992135be-b6ae-4dd8-9674-06c016f0b402","Type":"ContainerStarted","Data":"13c781d64bd65f70e8a4a8d77d4aa88368ec72181e6c4d0d948270bc7970fe22"}
Sep 10 05:18:18.958832 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:18.958741    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-84bff48b9d-qcc49"
Sep 10 05:18:18.975044 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:18.975003    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-84bff48b9d-qcc49" podStartSLOduration=1.622223198 podStartE2EDuration="1.97498933s" totalImagesPullingTime="352.766132ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 05:18:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 05:18:18.97298649 +0000 UTC m=+2238.635444237" watchObservedRunningTime="2026-09-10 05:18:18.97498933 +0000 UTC m=+2238.637447116"
Sep 10 05:18:24.897984 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:24.897910    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 05:18:24.970100 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:24.970071    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-84bff48b9d-qcc49"
Sep 10 05:18:32.496747 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:32.496711    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 05:18:37.890243 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:37.890209    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5xnsh"]
Sep 10 05:18:46.123693 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:46.123662    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-dkq9k_74acb377-c278-43a1-bcd6-f480b6f2ac7d/manager/0.log"
Sep 10 05:18:46.238950 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:46.238921    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-6gtvq_dfccac4b-ddde-448b-b213-d807b7c99177/manager/0.log"
Sep 10 05:18:46.850525 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:46.850421    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c57f4866c-hl9rp_ebd0eaa2-806f-4597-b997-4d96be4cca53/copy-manifests/0.log"
Sep 10 05:18:46.856448 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:46.856425    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c57f4866c-hl9rp_ebd0eaa2-806f-4597-b997-4d96be4cca53/manager/0.log"
Sep 10 05:18:47.463687 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:47.463657    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-84bff48b9d-qcc49_992135be-b6ae-4dd8-9674-06c016f0b402/maas-api/0.log"
Sep 10 05:18:47.699366 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:47.699342    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29816955-8trl5_97fe7146-7ec5-45f7-9570-db4ac1a6c1a1/cleanup/0.log"
Sep 10 05:18:47.816591 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:47.816517    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-l85dx_0dc1823b-e1c9-4283-972f-b1f242f7171a/postgres/0.log"
Sep 10 05:18:48.706378 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:48.706347    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-7ngfc_1c878856-9baa-43f0-b4b1-41d7a6a94c0f/manager/0.log"
Sep 10 05:18:48.816632 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:48.816608    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-fpjhq_211d18a3-f851-4561-9ffa-3a66d5ec0c01/manager/0.log"
Sep 10 05:18:48.924577 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:48.924556    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-dq6l2_468710e9-c46c-4cd7-9cd5-edca50b0e5c7/kuadrant-console-plugin/0.log"
Sep 10 05:18:49.043986 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:49.043923    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-mtbp2_0db0f63f-07b9-4cdd-a058-2752cff48a46/manager/0.log"
Sep 10 05:18:49.159437 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:49.159410    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-5xnsh_e07d792c-848b-45b3-bfa2-4bf3b39663b8/limitador/0.log"
Sep 10 05:18:49.277691 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:49.277669    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-jtp8g_e0dc06ae-7d96-49cb-bd11-043e343c59f9/manager/0.log"
Sep 10 05:18:49.857718 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:49.857691    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b5848dcdb-bjbmm_81258c1b-f1e0-41e3-bc6d-1f76ae3e3a93/kube-auth-proxy/0.log"
Sep 10 05:18:50.451744 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:50.451715    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7bff86c86-9d7sj_107242dc-160c-4fff-b4d5-ac1b059ff6e1/router/0.log"
Sep 10 05:18:51.026315 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:51.026285    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-7w7x9_c782af71-9da6-4795-b73f-1186db77ffee/main/0.log"
Sep 10 05:18:51.138277 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:51.138253    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-74gbq_dfbce4ad-006d-4e46-85c8-cdc8c94711c1/main/0.log"
Sep 10 05:18:56.997816 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:56.997783    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-x7vl4/must-gather-2wbl2"]
Sep 10 05:18:56.998193 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:56.998155    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5f249ab-6ea7-4c45-8aa0-12a8c5db530d" containerName="maas-api"
Sep 10 05:18:56.998193 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:56.998166    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5f249ab-6ea7-4c45-8aa0-12a8c5db530d" containerName="maas-api"
Sep 10 05:18:56.998266 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:56.998242    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5f249ab-6ea7-4c45-8aa0-12a8c5db530d" containerName="maas-api"
Sep 10 05:18:57.001680 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:57.001657    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-x7vl4/must-gather-2wbl2"
Sep 10 05:18:57.003893 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:57.003869    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-x7vl4\"/\"default-dockercfg-b6tnh\""
Sep 10 05:18:57.004027 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:57.004009    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-x7vl4\"/\"openshift-service-ca.crt\""
Sep 10 05:18:57.004522 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:57.004503    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-x7vl4\"/\"kube-root-ca.crt\""
Sep 10 05:18:57.008459 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:57.008440    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-x7vl4/must-gather-2wbl2"]
Sep 10 05:18:57.100051 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:57.100023    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2vjt\" (UniqueName: \"kubernetes.io/projected/f6c66d5d-5f29-4725-bdb0-fadca11a9252-kube-api-access-w2vjt\") pod \"must-gather-2wbl2\" (UID: \"f6c66d5d-5f29-4725-bdb0-fadca11a9252\") " pod="openshift-must-gather-x7vl4/must-gather-2wbl2"
Sep 10 05:18:57.100167 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:57.100069    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f6c66d5d-5f29-4725-bdb0-fadca11a9252-must-gather-output\") pod \"must-gather-2wbl2\" (UID: \"f6c66d5d-5f29-4725-bdb0-fadca11a9252\") " pod="openshift-must-gather-x7vl4/must-gather-2wbl2"
Sep 10 05:18:57.200658 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:57.200632    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2vjt\" (UniqueName: \"kubernetes.io/projected/f6c66d5d-5f29-4725-bdb0-fadca11a9252-kube-api-access-w2vjt\") pod \"must-gather-2wbl2\" (UID: \"f6c66d5d-5f29-4725-bdb0-fadca11a9252\") " pod="openshift-must-gather-x7vl4/must-gather-2wbl2"
Sep 10 05:18:57.200809 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:57.200671    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f6c66d5d-5f29-4725-bdb0-fadca11a9252-must-gather-output\") pod \"must-gather-2wbl2\" (UID: \"f6c66d5d-5f29-4725-bdb0-fadca11a9252\") " pod="openshift-must-gather-x7vl4/must-gather-2wbl2"
Sep 10 05:18:57.200997 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:57.200971    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f6c66d5d-5f29-4725-bdb0-fadca11a9252-must-gather-output\") pod \"must-gather-2wbl2\" (UID: \"f6c66d5d-5f29-4725-bdb0-fadca11a9252\") " pod="openshift-must-gather-x7vl4/must-gather-2wbl2"
Sep 10 05:18:57.208566 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:57.208544    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2vjt\" (UniqueName: \"kubernetes.io/projected/f6c66d5d-5f29-4725-bdb0-fadca11a9252-kube-api-access-w2vjt\") pod \"must-gather-2wbl2\" (UID: \"f6c66d5d-5f29-4725-bdb0-fadca11a9252\") " pod="openshift-must-gather-x7vl4/must-gather-2wbl2"
Sep 10 05:18:57.311568 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:57.311509    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-x7vl4/must-gather-2wbl2"
Sep 10 05:18:57.583959 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:57.583933    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-x7vl4/must-gather-2wbl2"]
Sep 10 05:18:57.584925 ip-10-0-138-27 kubenswrapper[2560]: W0910 05:18:57.584902    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf6c66d5d_5f29_4725_bdb0_fadca11a9252.slice/crio-b7be5c11d0844354fe2490575a438f4dab29df7f8ae2e6ebba7b67b9f3f33ebb WatchSource:0}: Error finding container b7be5c11d0844354fe2490575a438f4dab29df7f8ae2e6ebba7b67b9f3f33ebb: Status 404 returned error can't find the container with id b7be5c11d0844354fe2490575a438f4dab29df7f8ae2e6ebba7b67b9f3f33ebb
Sep 10 05:18:58.183645 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:58.183602    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-x7vl4/must-gather-2wbl2" event={"ID":"f6c66d5d-5f29-4725-bdb0-fadca11a9252","Type":"ContainerStarted","Data":"b7be5c11d0844354fe2490575a438f4dab29df7f8ae2e6ebba7b67b9f3f33ebb"}
Sep 10 05:18:59.195006 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:59.194952    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-x7vl4/must-gather-2wbl2" event={"ID":"f6c66d5d-5f29-4725-bdb0-fadca11a9252","Type":"ContainerStarted","Data":"d9529f2bb5fa3cc817d15dadae5e1dade623ae7c81cc4f63d6289b5b65b5d529"}
Sep 10 05:18:59.195502 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:59.195031    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-x7vl4/must-gather-2wbl2" event={"ID":"f6c66d5d-5f29-4725-bdb0-fadca11a9252","Type":"ContainerStarted","Data":"531cc5446b366ddfc2ead6a389bc66dc0792fc7a562fd4c87ca1664a2b2bbd0f"}
Sep 10 05:18:59.212315 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:59.212252    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-x7vl4/must-gather-2wbl2" podStartSLOduration=2.445830364 podStartE2EDuration="3.212230495s" totalImagesPullingTime="766.400131ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 05:18:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 05:18:59.209436411 +0000 UTC m=+2278.871894160" watchObservedRunningTime="2026-09-10 05:18:59.212230495 +0000 UTC m=+2278.874688244"
Sep 10 05:18:59.938933 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:18:59.938872    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-77cd4_5e472a47-9b1d-4f3e-be2f-36ac4b0ebc7f/global-pull-secret-syncer/0.log"
Sep 10 05:19:04.806643 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:19:04.806603    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-7ngfc_1c878856-9baa-43f0-b4b1-41d7a6a94c0f/manager/0.log"
Sep 10 05:19:04.832063 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:19:04.832035    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-fpjhq_211d18a3-f851-4561-9ffa-3a66d5ec0c01/manager/0.log"
Sep 10 05:19:04.855736 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:19:04.855707    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-dq6l2_468710e9-c46c-4cd7-9cd5-edca50b0e5c7/kuadrant-console-plugin/0.log"
Sep 10 05:19:04.906281 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:19:04.906250    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-mtbp2_0db0f63f-07b9-4cdd-a058-2752cff48a46/manager/0.log"
Sep 10 05:19:04.937882 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:19:04.937837    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-5xnsh_e07d792c-848b-45b3-bfa2-4bf3b39663b8/limitador/0.log"
Sep 10 05:19:05.006392 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:19:05.006364    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-jtp8g_e0dc06ae-7d96-49cb-bd11-043e343c59f9/manager/0.log"
Sep 10 05:19:08.879563 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:19:08.879528    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-x7vl4/perf-node-gather-daemonset-xmxtr"]
Sep 10 05:19:08.888417 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:19:08.888386    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-x7vl4/perf-node-gather-daemonset-xmxtr"
Sep 10 05:19:08.918084 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:19:08.918051    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfh2x\" (UniqueName: \"kubernetes.io/projected/36086bdb-c32c-4296-a06f-231c31318508-kube-api-access-dfh2x\") pod \"perf-node-gather-daemonset-xmxtr\" (UID: \"36086bdb-c32c-4296-a06f-231c31318508\") " pod="openshift-must-gather-x7vl4/perf-node-gather-daemonset-xmxtr"
Sep 10 05:19:08.918255 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:19:08.918178    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/36086bdb-c32c-4296-a06f-231c31318508-podres\") pod \"perf-node-gather-daemonset-xmxtr\" (UID: \"36086bdb-c32c-4296-a06f-231c31318508\") " pod="openshift-must-gather-x7vl4/perf-node-gather-daemonset-xmxtr"
Sep 10 05:19:08.918255 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:19:08.918219    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/36086bdb-c32c-4296-a06f-231c31318508-lib-modules\") pod \"perf-node-gather-daemonset-xmxtr\" (UID: \"36086bdb-c32c-4296-a06f-231c31318508\") " pod="openshift-must-gather-x7vl4/perf-node-gather-daemonset-xmxtr"
Sep 10 05:19:08.918386 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:19:08.918254    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/36086bdb-c32c-4296-a06f-231c31318508-proc\") pod \"perf-node-gather-daemonset-xmxtr\" (UID: \"36086bdb-c32c-4296-a06f-231c31318508\") " pod="openshift-must-gather-x7vl4/perf-node-gather-daemonset-xmxtr"
Sep 10 05:19:08.918386 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:19:08.918298    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/36086bdb-c32c-4296-a06f-231c31318508-sys\") pod \"perf-node-gather-daemonset-xmxtr\" (UID: \"36086bdb-c32c-4296-a06f-231c31318508\") " pod="openshift-must-gather-x7vl4/perf-node-gather-daemonset-xmxtr"
Sep 10 05:19:09.019868 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:19:09.019822    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfh2x\" (UniqueName: \"kubernetes.io/projected/36086bdb-c32c-4296-a06f-231c31318508-kube-api-access-dfh2x\") pod \"perf-node-gather-daemonset-xmxtr\" (UID: \"36086bdb-c32c-4296-a06f-231c31318508\") " pod="openshift-must-gather-x7vl4/perf-node-gather-daemonset-xmxtr"
Sep 10 05:19:09.020055 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:19:09.019992    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/36086bdb-c32c-4296-a06f-231c31318508-podres\") pod \"perf-node-gather-daemonset-xmxtr\" (UID: \"36086bdb-c32c-4296-a06f-231c31318508\") " pod="openshift-must-gather-x7vl4/perf-node-gather-daemonset-xmxtr"
Sep 10 05:19:09.020140 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:19:09.020059    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/36086bdb-c32c-4296-a06f-231c31318508-lib-modules\") pod \"perf-node-gather-daemonset-xmxtr\" (UID: \"36086bdb-c32c-4296-a06f-231c31318508\") " pod="openshift-must-gather-x7vl4/perf-node-gather-daemonset-xmxtr"
Sep 10 05:19:09.020140 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:19:09.020128    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/36086bdb-c32c-4296-a06f-231c31318508-proc\") pod \"perf-node-gather-daemonset-xmxtr\" (UID: \"36086bdb-c32c-4296-a06f-231c31318508\") " pod="openshift-must-gather-x7vl4/perf-node-gather-daemonset-xmxtr"
Sep 10 05:19:09.020253 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:19:09.020175    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/36086bdb-c32c-4296-a06f-231c31318508-sys\") pod \"perf-node-gather-daemonset-xmxtr\" (UID: \"36086bdb-c32c-4296-a06f-231c31318508\") " pod="openshift-must-gather-x7vl4/perf-node-gather-daemonset-xmxtr"
Sep 10 05:19:09.020253 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:19:09.020204    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/36086bdb-c32c-4296-a06f-231c31318508-podres\") pod \"perf-node-gather-daemonset-xmxtr\" (UID: \"36086bdb-c32c-4296-a06f-231c31318508\") " pod="openshift-must-gather-x7vl4/perf-node-gather-daemonset-xmxtr"
Sep 10 05:19:09.020253 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:19:09.020241    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/36086bdb-c32c-4296-a06f-231c31318508-lib-modules\") pod \"perf-node-gather-daemonset-xmxtr\" (UID: \"36086bdb-c32c-4296-a06f-231c31318508\") " pod="openshift-must-gather-x7vl4/perf-node-gather-daemonset-xmxtr"
Sep 10 05:19:09.020399 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:19:09.020248    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/36086bdb-c32c-4296-a06f-231c31318508-proc\") pod \"perf-node-gather-daemonset-xmxtr\" (UID: \"36086bdb-c32c-4296-a06f-231c31318508\") " pod="openshift-must-gather-x7vl4/perf-node-gather-daemonset-xmxtr"
Sep 10 05:19:09.020399 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:19:09.020318    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/36086bdb-c32c-4296-a06f-231c31318508-sys\") pod \"perf-node-gather-daemonset-xmxtr\" (UID: \"36086bdb-c32c-4296-a06f-231c31318508\") " pod="openshift-must-gather-x7vl4/perf-node-gather-daemonset-xmxtr"
Sep 10 05:19:09.027504 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:19:09.027477    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfh2x\" (UniqueName: \"kubernetes.io/projected/36086bdb-c32c-4296-a06f-231c31318508-kube-api-access-dfh2x\") pod \"perf-node-gather-daemonset-xmxtr\" (UID: \"36086bdb-c32c-4296-a06f-231c31318508\") " pod="openshift-must-gather-x7vl4/perf-node-gather-daemonset-xmxtr"
Sep 10 05:19:09.202863 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:19:09.202748    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-x7vl4/perf-node-gather-daemonset-xmxtr"
Sep 10 05:19:17.903391 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:19:17.903360    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b5848dcdb-bjbmm_81258c1b-f1e0-41e3-bc6d-1f76ae3e3a93/kube-auth-proxy/0.log"
Sep 10 05:19:18.011633 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:19:18.011601    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7bff86c86-9d7sj_107242dc-160c-4fff-b4d5-ac1b059ff6e1/router/0.log"
Sep 10 05:19:19.677213 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:19:19.677177    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b5848dcdb-bjbmm_81258c1b-f1e0-41e3-bc6d-1f76ae3e3a93/kube-auth-proxy/0.log"
Sep 10 05:19:19.788887 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:19:19.788861    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7bff86c86-9d7sj_107242dc-160c-4fff-b4d5-ac1b059ff6e1/router/0.log"
Sep 10 05:19:42.525835 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:19:42.525799    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-jrddm_e547a905-b80c-4247-b45b-71da7aeaf4e1/konnectivity-agent/0.log"
Sep 10 05:19:42.620057 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:19:42.620031    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cdcc96965-mpw59_92e0e646-b15f-45be-8797-fcac67a89fd1/cluster-monitoring-operator/0.log"
Sep 10 05:19:42.652380 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:19:42.652337    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-27.ec2.internal_08157110d78d292dae4b05db5b9fb1a8/haproxy/0.log"
Sep 10 05:19:42.859923 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:19:42.859833    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-89hdm_39614aa5-4368-42f8-891e-79124c9686ce/node-exporter/0.log"
Sep 10 05:19:42.883499 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:19:42.883478    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-89hdm_39614aa5-4368-42f8-891e-79124c9686ce/kube-rbac-proxy/0.log"
Sep 10 05:19:42.907834 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:19:42.907809    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-89hdm_39614aa5-4368-42f8-891e-79124c9686ce/init-textfile/0.log"
Sep 10 05:19:43.377079 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:19:43.377052    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-84c69d5fb8-hbv7m_e086bb59-3491-4c1a-badf-35db6ab31614/telemeter-client/0.log"
Sep 10 05:19:43.434820 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:19:43.434784    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-84c69d5fb8-hbv7m_e086bb59-3491-4c1a-badf-35db6ab31614/reload/0.log"
Sep 10 05:19:43.485960 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:19:43.485932    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-84c69d5fb8-hbv7m_e086bb59-3491-4c1a-badf-35db6ab31614/kube-rbac-proxy/0.log"
Sep 10 05:19:44.029937 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:19:44.029898    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-x7vl4/perf-node-gather-daemonset-xmxtr"]
Sep 10 05:19:44.437530 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:19:44.437496    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-x7vl4/perf-node-gather-daemonset-xmxtr"]
Sep 10 05:19:44.529761 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:19:44.529734    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-x7vl4/perf-node-gather-daemonset-xmxtr" event={"ID":"36086bdb-c32c-4296-a06f-231c31318508","Type":"ContainerStarted","Data":"5ea620df400688aa4c2182e909ffc3dd4c8779c0c009ff8165a6f4896307efe4"}
Sep 10 05:19:45.182550 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:19:45.182514    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-p5zjp_8b3ec8dc-1508-4537-8dc3-b9de1ff22d03/console-operator/1.log"
Sep 10 05:19:45.187453 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:19:45.187430    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-p5zjp_8b3ec8dc-1508-4537-8dc3-b9de1ff22d03/console-operator/2.log"
Sep 10 05:19:45.540993 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:19:45.540889    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-x7vl4/perf-node-gather-daemonset-xmxtr" event={"ID":"36086bdb-c32c-4296-a06f-231c31318508","Type":"ContainerStarted","Data":"f76a96f3887b2b8f2133e7019afacaea31d11612c0343471b4da334b86bc390f"}
Sep 10 05:19:45.541162 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:19:45.540996    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-x7vl4/perf-node-gather-daemonset-xmxtr"
Sep 10 05:19:45.768018 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:19:45.767986    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7b55df5c64-xd5z8_aa152cea-7dd8-415c-844e-996635f2e428/console/0.log"
Sep 10 05:19:46.478442 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:19:46.478411    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-695c895bd6-6r6cl_61306ba6-2958-4dfb-84b4-e35336f7ec3d/volume-data-source-validator/0.log"
Sep 10 05:19:47.640255 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:19:47.640220    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tkl9f_345fe3ae-0c3e-4924-af34-bf06acf51ac4/dns/0.log"
Sep 10 05:19:47.659460 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:19:47.659440    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tkl9f_345fe3ae-0c3e-4924-af34-bf06acf51ac4/kube-rbac-proxy/0.log"
Sep 10 05:19:47.756944 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:19:47.756907    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6c6hs_70619315-7b0a-40c0-82cf-a3f283ada09f/dns-node-resolver/0.log"
Sep 10 05:19:48.429905 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:19:48.429878    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-h7swz_1e129b32-2387-4f9c-91b8-940841cb77cc/node-ca/0.log"
Sep 10 05:19:49.866775 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:19:49.866740    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b5848dcdb-bjbmm_81258c1b-f1e0-41e3-bc6d-1f76ae3e3a93/kube-auth-proxy/0.log"
Sep 10 05:19:50.025269 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:19:50.025237    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7bff86c86-9d7sj_107242dc-160c-4fff-b4d5-ac1b059ff6e1/router/0.log"
Sep 10 05:19:50.984812 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:19:50.984783    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vjxjf_beaaafd1-47c4-4a3a-a985-bed140f007e6/serve-healthcheck-canary/0.log"
Sep 10 05:19:51.523972 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:19:51.523939    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-x8kmb_b0f33b82-87c0-4c48-a093-a91e3317cf73/insights-operator/0.log"
Sep 10 05:19:51.524494 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:19:51.524463    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-x8kmb_b0f33b82-87c0-4c48-a093-a91e3317cf73/insights-operator/1.log"
Sep 10 05:19:51.550640 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:19:51.550621    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6v2kg_c11fc765-df6d-4277-84d0-8767a3d38372/kube-rbac-proxy/0.log"
Sep 10 05:19:51.559424 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:19:51.559404    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-x7vl4/perf-node-gather-daemonset-xmxtr"
Sep 10 05:19:51.592427 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:19:51.592381    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-x7vl4/perf-node-gather-daemonset-xmxtr" podStartSLOduration=43.592361796 podStartE2EDuration="43.592361796s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 05:19:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 05:19:45.586508417 +0000 UTC m=+2325.248966164" watchObservedRunningTime="2026-09-10 05:19:51.592361796 +0000 UTC m=+2331.254819546"
Sep 10 05:19:51.626271 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:19:51.626244    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6v2kg_c11fc765-df6d-4277-84d0-8767a3d38372/exporter/0.log"
Sep 10 05:19:51.696040 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:19:51.696016    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6v2kg_c11fc765-df6d-4277-84d0-8767a3d38372/extractor/0.log"
Sep 10 05:19:54.363391 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:19:54.363318    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-dkq9k_74acb377-c278-43a1-bcd6-f480b6f2ac7d/manager/0.log"
Sep 10 05:19:54.579492 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:19:54.579460    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-6gtvq_dfccac4b-ddde-448b-b213-d807b7c99177/manager/0.log"
Sep 10 05:19:54.879422 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:19:54.879392    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c57f4866c-hl9rp_ebd0eaa2-806f-4597-b997-4d96be4cca53/manager/0.log"
Sep 10 05:19:54.898050 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:19:54.898024    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c57f4866c-hl9rp_ebd0eaa2-806f-4597-b997-4d96be4cca53/copy-manifests/0.log"
Sep 10 05:20:00.973109 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:20:00.973074    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-tgcbl_ef57e894-f8b4-464e-b814-3ceada543c28/kube-storage-version-migrator-operator/0.log"
Sep 10 05:20:00.973818 ip-10-0-138-27 kubenswrapper[2560]: I0910 05:20:00.973791    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-tgcbl_ef57e894-f8b4-464e-b814-3ceada543c28/kube-storage-version-migrator-operator/1.log"